-- Logs begin at Tue 2022-07-19 18:48:23 UTC, end at Tue 2022-07-19 21:43:26 UTC. -- Jul 19 19:34:55.265443 n-d-843861-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 19:34:55.272743 n-d-843861-3 devstack@n-api.service[110691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 19:34:55 2022] *** Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: nodename: n-d-843861-3 Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: machine: x86_64 Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: clock source: unix Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: pcre jit disabled Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: detected number of CPU cores: 4 Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: current working directory: / Jul 19 19:34:55.275436 n-d-843861-3 devstack@n-api.service[110691]: detected binary path: /usr/bin/uwsgi-core Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: your processes number limit is 47680 Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: your memory page size is 4096 bytes Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: detected max file descriptor number: 2048 Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: lock engine: pthread robust mutexes Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: thunder lock: enabled Jul 19 19:34:55.276168 n-d-843861-3 devstack@n-api.service[110691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 19:34:55.276934 n-d-843861-3 devstack@n-api.service[110691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 19:34:55.319433 n-d-843861-3 devstack@n-api.service[110691]: Python main interpreter initialized at 0x5555a16eb9c0 Jul 19 19:34:55.319433 n-d-843861-3 devstack@n-api.service[110691]: python threads support enabled Jul 19 19:34:55.319433 n-d-843861-3 devstack@n-api.service[110691]: your server socket listen backlog is limited to 100 connections Jul 19 19:34:55.319433 n-d-843861-3 devstack@n-api.service[110691]: your mercy for graceful operations on workers is 90 seconds Jul 19 19:34:55.319834 n-d-843861-3 devstack@n-api.service[110691]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 19:34:55.319918 n-d-843861-3 devstack@n-api.service[110691]: *** Operational MODE: preforking *** Jul 19 19:34:55.320166 n-d-843861-3 devstack@n-api.service[110691]: *** uWSGI is running in multiple interpreter mode *** Jul 19 19:34:55.320166 n-d-843861-3 devstack@n-api.service[110691]: spawned uWSGI master process (pid: 110691) Jul 19 19:34:55.320359 n-d-843861-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 19:34:55.322471 n-d-843861-3 devstack@n-api.service[110691]: spawned uWSGI worker 1 (pid: 110692, cores: 1) Jul 19 19:34:55.322471 n-d-843861-3 devstack@n-api.service[110691]: spawned uWSGI worker 2 (pid: 110693, cores: 1) Jul 19 19:34:55.322471 n-d-843861-3 devstack@n-api.service[110691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 19:34:55.979018 n-d-843861-3 devstack@n-api.service[110693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:34:55.980271 n-d-843861-3 devstack@n-api.service[110692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:34:57.092657 n-d-843861-3 devstack@n-api.service[110692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:34:57.092657 n-d-843861-3 devstack@n-api.service[110692]: from cryptography.utils import int_from_bytes Jul 19 19:34:57.093383 n-d-843861-3 devstack@n-api.service[110692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:34:57.093383 n-d-843861-3 devstack@n-api.service[110692]: from cryptography.utils import int_from_bytes Jul 19 19:34:57.094127 n-d-843861-3 devstack@n-api.service[110693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:34:57.094127 n-d-843861-3 devstack@n-api.service[110693]: from cryptography.utils import int_from_bytes Jul 19 19:34:57.094556 n-d-843861-3 devstack@n-api.service[110693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:34:57.094556 n-d-843861-3 devstack@n-api.service[110693]: from cryptography.utils import int_from_bytes Jul 19 19:34:59.551068 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:34:59.551620 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:34:59.551751 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:34:59.552129 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:34:59.552227 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:34:59.552609 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:34:59.552696 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:34:59.552791 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.552962 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:34:59.553057 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.553326 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:34:59.553432 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.553583 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:34:59.553673 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.553965 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554053 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554267 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554369 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554580 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554666 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554892 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.554978 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555215 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555323 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555493 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555581 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555819 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.555908 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556153 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843861-3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556248 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556468 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556554 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556756 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.556842 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557062 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557154 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557377 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557463 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843861-3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557677 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557781 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.557986 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558072 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558282 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558372 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558608 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558775 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.558914 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.559223 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.559333 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.559529 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.559627 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.559852 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560062 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560171 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560375 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560488 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560692 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560795 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.560994 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561087 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561329 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561422 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561642 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561729 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.561953 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562040 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562274 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562389 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843861-3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562587 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562683 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562910 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.562993 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.563219 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.563320 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.563616 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843861-3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.563727 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.563948 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564036 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564256 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564388 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564573 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564675 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564888 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.564983 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565208 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565307 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565517 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565621 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565847 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.565944 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566144 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566315 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566459 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566546 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566756 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.566842 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567058 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567154 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567359 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567446 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567672 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567772 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.567998 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568089 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568298 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568392 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568543 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568630 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568846 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.568934 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569160 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569256 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569474 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569562 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569736 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.569829 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570024 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570132 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570271 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570408 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570581 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570700 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.570896 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.571499 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.571731 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.571853 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572018 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572118 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572337 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572431 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572656 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572753 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.572967 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573053 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573265 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573352 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573567 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573702 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573870 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.573955 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574175 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574281 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574483 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574581 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574784 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.574871 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575084 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575178 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575400 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575499 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575709 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.575796 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576056 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576190 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576365 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576529 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576684 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.576835 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577077 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577197 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577328 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577446 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577634 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577761 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.577972 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578066 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578288 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578375 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578596 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578696 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.578918 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579014 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579237 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579330 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579546 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579646 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579867 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.579958 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580117 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580213 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580415 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580503 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580715 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.580813 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581030 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581117 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581314 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581406 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581618 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581712 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.581917 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582011 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582213 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582311 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582513 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582610 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582813 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.582901 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583114 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583209 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583412 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583504 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583714 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.583826 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584038 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584141 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584340 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584428 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584641 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584762 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.584937 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585037 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585238 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585329 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585547 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585646 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585847 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.585939 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.586150 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.586236 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.586451 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.586546 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.587321 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.587430 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.587626 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.587718 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.587954 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588044 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588261 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588349 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588568 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588661 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588869 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.588955 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589171 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589266 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589478 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589563 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589780 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.589871 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590085 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590174 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590387 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590473 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590684 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590773 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.590985 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591074 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591291 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591383 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591591 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591683 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.591919 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592019 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592220 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592313 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592520 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592606 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592818 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.592906 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593119 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593205 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593417 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593582 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593719 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.593816 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594012 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594097 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594314 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594410 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594617 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594769 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.594920 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595008 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595219 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595319 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595536 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595660 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595854 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.595943 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.596164 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.596261 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.596472 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.596567 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.596778 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.596864 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.597098 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:34:59.597186 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.597435 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.597521 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.597761 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.597847 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598076 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598164 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598385 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598473 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598697 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.598784 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599019 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599113 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599329 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599423 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599636 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599732 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.599966 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600066 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600282 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600376 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600594 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600739 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600909 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.600996 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601218 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601324 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601532 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601620 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601848 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.601935 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602153 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602240 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602500 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602595 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602816 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.602903 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603132 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603216 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603438 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603534 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603756 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.603861 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604113 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604201 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604425 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604522 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604734 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.604858 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605053 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605138 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605360 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605455 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605666 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605797 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.605972 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606059 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606290 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606378 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606616 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606709 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.606925 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607018 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607234 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607321 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607540 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607625 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607868 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.607960 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608178 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608268 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608485 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608579 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608791 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.608886 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609113 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609200 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609425 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609511 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609737 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.609832 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610050 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610150 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610386 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610473 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610703 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.610846 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611019 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611108 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611329 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611415 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611636 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611730 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.611958 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612058 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612262 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612357 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612568 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612666 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612866 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.612953 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613170 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613255 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613475 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613578 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613783 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.613870 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614087 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614180 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614398 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614485 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614704 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.614791 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615010 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615097 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615316 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615405 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615619 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615704 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.615951 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616106 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616322 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616459 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616590 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616721 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616852 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.616984 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617142 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617276 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617442 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617576 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617745 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.617895 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618074 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618220 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618407 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618556 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618690 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618834 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.618973 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619104 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619247 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619386 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619552 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619693 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.619906 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620040 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620192 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620325 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620501 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620635 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620809 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.620943 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621117 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621203 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621442 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621530 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621739 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.621826 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622055 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622139 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622373 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622460 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622685 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622771 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.622986 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623080 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623293 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623382 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623594 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623683 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.623926 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624018 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624231 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624319 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624536 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624622 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624839 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.624933 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625143 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625262 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625442 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625532 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625740 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.625840 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626041 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626138 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626344 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626432 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626646 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626746 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.626944 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627030 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627244 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627338 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627542 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627638 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627882 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.627974 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628189 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628276 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628494 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628585 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628798 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.628892 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629144 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629232 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629451 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629540 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629759 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.629852 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630073 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630161 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630381 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630471 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630692 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.630779 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631004 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631105 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631310 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631400 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631619 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631705 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.631951 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632054 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632263 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632351 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632568 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632654 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632883 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.632978 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.633188 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.633274 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634012 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634125 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634332 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634472 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634654 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634796 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.634965 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635098 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635286 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635435 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635577 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635705 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.635914 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636128 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636290 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636428 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636564 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636698 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.636857 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637002 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637149 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637282 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637459 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637593 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637767 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.637906 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638075 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638220 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638379 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638514 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638686 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638828 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.638974 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.639107 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.639541 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.639676 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.639864 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.639998 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640182 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640320 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640465 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640606 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640777 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.640922 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641100 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641233 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641428 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641562 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641737 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.641877 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642047 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642189 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642361 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642513 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642657 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642805 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.642963 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643100 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643270 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643401 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643572 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643713 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.643900 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644035 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644214 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644362 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644522 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644657 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644818 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.644950 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645122 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645264 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645480 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645619 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645756 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.645891 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646028 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646181 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646331 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646486 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646618 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646709 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646875 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.646963 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647192 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647280 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647494 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647579 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647800 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.647923 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648132 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648220 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648432 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648518 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648732 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.648829 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.649050 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.649137 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.649925 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650021 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650228 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650324 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650529 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650616 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650830 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.650917 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651145 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651239 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651450 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651538 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651749 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.651927 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652079 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652167 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652393 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652478 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652698 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.652793 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653010 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653098 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653313 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653399 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653618 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653705 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.653930 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654023 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654241 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654326 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654546 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654632 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654854 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.654941 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655159 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655254 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655466 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655562 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655772 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.655891 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656107 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656194 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656411 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656559 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656709 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.656843 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657011 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657143 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657311 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657461 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657604 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657746 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.657918 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658050 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658227 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658483 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658621 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658812 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.658957 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.659124 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.659265 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.659440 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.659681 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.659853 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660042 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660176 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660363 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660509 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660682 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.660829 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661003 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661140 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661293 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661443 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661599 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661738 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.661899 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662044 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662200 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662342 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662493 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662639 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662794 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.662927 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663080 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663222 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663371 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663522 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663655 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663785 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.663987 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664131 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664276 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664409 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664544 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664634 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.664862 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665006 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665172 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665310 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665473 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665608 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665780 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.665925 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666067 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666203 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666381 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666513 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666684 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666831 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.666974 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667106 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667269 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667402 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667566 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667708 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.667905 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668050 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668194 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668331 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668501 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668652 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668792 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.668928 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669139 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669273 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669490 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669627 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669759 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.669904 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670079 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670213 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670410 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670552 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670710 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.670856 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671010 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671142 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671311 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671462 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671607 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671741 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.671921 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672059 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672202 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672337 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672489 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672623 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672795 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.672942 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673081 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673214 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673384 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673520 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673685 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673834 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.673969 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674105 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674282 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674417 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674583 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674679 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674882 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.674972 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675180 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675266 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675485 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675585 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675787 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.675941 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676104 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676193 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676408 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676531 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676702 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.676788 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677010 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677095 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677307 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677395 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677606 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677693 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677904 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.677989 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678206 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678294 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678505 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678590 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678802 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.678887 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679107 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679193 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679409 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679495 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679709 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.679834 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680030 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680118 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680337 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680456 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680659 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680755 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.680959 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681044 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681261 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681349 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681567 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681662 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681871 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.681966 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682163 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682256 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682468 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682574 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682766 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.682853 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683066 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683152 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683363 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683459 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683666 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683753 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.683991 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684079 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684289 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684378 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684584 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684671 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684881 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.684970 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685178 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685266 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685479 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685565 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685783 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.685870 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686077 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686164 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686375 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686469 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686671 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686771 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.686991 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687084 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687295 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687381 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687604 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687718 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.687932 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688024 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688253 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688349 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688566 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688662 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688869 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.688955 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689176 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689264 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689484 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689579 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689784 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.689871 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690093 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690179 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690398 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690495 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690704 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.690793 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691002 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691090 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691301 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691389 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691609 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691693 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.691934 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692023 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692239 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692327 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692543 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692637 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692857 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.692950 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693167 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693254 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693465 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693557 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693770 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.693856 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694078 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694167 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694382 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694471 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694687 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694782 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.694991 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695085 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695295 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695381 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695600 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695694 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.695931 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.696539 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.696774 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.696863 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697081 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697176 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697383 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697470 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697689 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697775 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.697996 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698161 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698296 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698384 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698600 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698692 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698909 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.698996 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699210 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699297 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699513 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699599 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699851 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.699942 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700139 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700226 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700439 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700525 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700749 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.700857 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701056 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701154 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701369 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701456 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701674 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.701770 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702037 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702124 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702345 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702441 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702655 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702749 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.702964 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703051 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703265 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703364 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703575 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703660 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.703911 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704065 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704226 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704376 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704531 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704689 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.704944 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705030 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705258 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705354 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705568 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705656 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705880 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.705965 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706177 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706265 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706478 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706564 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706777 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.706911 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707094 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707183 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707395 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707487 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707699 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.707786 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708026 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708143 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708348 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708461 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708651 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708739 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.708976 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.709105 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.709390 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.709477 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.709703 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.709798 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710006 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710098 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710325 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710409 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710717 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.710811 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.711023 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.711115 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.711338 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.711425 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.711671 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.712322 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.712540 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.712638 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.712847 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.712933 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713156 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713242 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713464 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713559 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713763 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.713850 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714082 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714177 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714396 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714491 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714708 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.714795 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715012 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715105 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715334 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715426 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715655 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715749 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.715993 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716084 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716318 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716408 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716662 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716759 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.716967 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717055 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717269 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717364 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717576 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717663 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717878 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.717964 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718180 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718268 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718498 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718591 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718800 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.718896 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719107 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719195 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719413 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719498 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719716 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.719838 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720040 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720128 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720343 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720438 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720650 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720745 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.720949 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721035 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721249 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721334 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721551 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721651 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721867 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.721954 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722166 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722252 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722470 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722564 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722787 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.722872 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723089 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723174 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723388 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723477 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723688 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.723776 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724012 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724101 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724326 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724422 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724630 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724725 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.724934 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725021 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725236 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725370 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725574 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725661 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725875 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.725980 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726194 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726281 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726512 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726598 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726826 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.726922 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727135 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727232 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727475 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727571 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727777 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.727943 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728099 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728187 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728407 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728501 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728710 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.728807 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729012 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729107 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729314 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729408 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729622 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729718 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.729921 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730008 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730219 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730306 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730521 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730615 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730828 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.730922 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731124 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731210 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731424 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731511 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731726 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.731852 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732046 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732133 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732349 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732439 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732649 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732740 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.732959 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733056 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733262 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733350 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733566 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733653 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733868 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.733969 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734191 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734277 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734497 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734582 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734817 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.734913 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735130 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735216 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735441 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735548 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735752 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.735875 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736089 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736184 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736412 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736509 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736728 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.736817 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737042 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737167 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737352 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737438 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737661 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737753 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.737973 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738069 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738282 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738369 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738595 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738683 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.738905 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739108 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739223 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739438 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739535 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739753 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.739859 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.740089 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.740380 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.740481 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.740704 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.740792 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741019 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741104 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741327 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741422 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741639 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741726 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.741948 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742034 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742258 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742359 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742570 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742699 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742904 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.742997 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.743228 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.743397 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.743559 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.743718 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.743899 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.744077 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.744218 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.744404 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.744793 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.744882 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.745113 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.745465 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.745855 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.746182 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.746509 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.746603 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.746924 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.747035 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.747473 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.747799 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.748218 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.748718 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.748816 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.749107 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.749298 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.749450 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.749786 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.749872 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.750117 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.750358 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.750693 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.751026 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.751358 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.751514 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.751684 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.751878 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752037 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752213 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752363 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752538 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752690 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.752862 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753023 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753192 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753364 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753517 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753694 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.753852 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754016 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754193 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754337 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754520 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754658 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.754841 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.755165 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.755252 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.755486 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.755582 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.755976 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756092 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756178 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756351 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756490 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756688 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.756778 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757017 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757107 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757439 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757536 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757793 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.757879 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.758113 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.758200 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.758443 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759062 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759276 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759364 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759582 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759676 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.759920 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760025 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760233 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760322 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760540 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760627 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760864 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.760953 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.761178 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.761266 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.761484 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.761712 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.761807 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762071 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762166 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762394 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762617 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762726 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.762967 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763065 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763287 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763376 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763612 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763699 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.763963 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.764056 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.764538 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.764634 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.764848 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.764943 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765168 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765255 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765476 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765564 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765781 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.765876 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766092 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766190 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766399 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766492 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766704 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.766809 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767007 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767095 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767315 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767402 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767620 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767728 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.767943 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768044 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768252 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768347 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768554 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768643 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768868 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.768962 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769169 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769256 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769474 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769563 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769775 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.769862 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770082 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770168 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770382 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770469 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770684 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770783 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.770987 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771074 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771287 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771376 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771591 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771678 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.771912 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772016 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772221 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772308 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772521 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772615 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772828 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.772924 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773130 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773276 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773439 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773580 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773769 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.773913 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.774089 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.774267 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.774947 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775038 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775248 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775344 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775566 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775654 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775897 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.775988 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.776223 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.776313 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.776534 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.776621 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.776844 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.777068 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.777212 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.777408 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.777549 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.777733 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778004 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778139 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778338 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778473 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778659 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778793 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.778971 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779111 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779279 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779420 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779596 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779742 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.779938 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780084 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780228 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780364 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780506 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780643 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780820 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.780962 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781128 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781268 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781437 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781576 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781728 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.781876 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782041 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782173 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782363 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782528 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782654 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782744 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.782960 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783092 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783265 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783353 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783572 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783660 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783906 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.783997 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784216 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784304 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784524 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784614 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784832 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.784919 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785156 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785251 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785473 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785560 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785783 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.785870 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786095 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786198 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786400 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786488 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786703 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.786835 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787009 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787106 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787314 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787403 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787702 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787829 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.787953 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788044 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788281 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788372 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788591 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788679 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788892 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.788981 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.789282 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.789369 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.789599 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.789686 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.790434 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.790530 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.790753 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.790849 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791061 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791161 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791378 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791477 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791687 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.791774 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792018 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792120 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792335 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792423 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792641 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792736 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.792968 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793064 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793277 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793415 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793583 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793723 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.793890 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794031 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794200 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794338 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794499 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794630 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794800 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.794939 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795104 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795235 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795407 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795540 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795711 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.795881 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796034 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796167 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796332 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796474 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796619 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796756 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.796928 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797049 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797224 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797334 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797524 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797621 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797821 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.797909 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798119 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798216 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798413 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798501 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798709 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.798799 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799006 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799104 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799304 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799392 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799602 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799692 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.799924 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800032 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800230 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800319 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800529 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800619 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800829 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.800927 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801168 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801263 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801420 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801512 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801719 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.801816 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802043 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802132 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802368 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802458 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802677 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802771 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.802988 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803076 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803297 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803395 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803611 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803702 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.803941 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804046 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804250 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804347 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804565 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804653 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804875 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.804963 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.805180 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.805282 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806038 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806183 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806354 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806453 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806662 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806798 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.806969 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807059 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807276 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807365 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807580 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807679 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.807918 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808013 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808245 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808335 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808564 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808655 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808865 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.808959 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809188 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809277 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809503 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809599 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809819 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.809907 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810132 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810221 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810442 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810530 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810754 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.810849 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811061 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811157 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811371 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811459 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811687 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.811774 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812024 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812127 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812338 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812427 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812654 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812741 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.812968 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813066 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813279 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813383 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813596 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813693 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.813905 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814001 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814225 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814320 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814548 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814637 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814856 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.814947 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815180 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815275 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815501 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815598 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815857 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.815974 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816193 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816291 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816487 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816607 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816794 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.816885 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.817043 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:34:59.817159 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.817418 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.817721 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:34:59.817962 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:34:59.878722 n-d-843861-3 devstack@n-api.service[110693]: INFO dbcounter [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Registered counter for database nova_api Jul 19 19:34:59.879128 n-d-843861-3 devstack@n-api.service[110692]: INFO dbcounter [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Registered counter for database nova_api Jul 19 19:34:59.990780 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_db.sqlalchemy.engines [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:34:59.992486 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_db.sqlalchemy.engines [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:34:59.997316 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writer thread running {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:34:59.998761 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writer thread running {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.052775 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.context [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=110693) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:35:00.054046 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.context [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=110692) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:35:00.056663 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:35:00.057956 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_concurrency.lockutils [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:35:00.058264 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:35:00.059057 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:35:00.059796 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_concurrency.lockutils [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:35:00.060615 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_concurrency.lockutils [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:35:00.061485 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:35:00.062698 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_concurrency.lockutils [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:35:00.063431 n-d-843861-3 devstack@n-api.service[110693]: INFO dbcounter [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Registered counter for database nova_cell0 Jul 19 19:35:00.064667 n-d-843861-3 devstack@n-api.service[110692]: INFO dbcounter [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Registered counter for database nova_cell0 Jul 19 19:35:00.067208 n-d-843861-3 devstack@n-api.service[110693]: INFO dbcounter [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Registered counter for database nova_cell1 Jul 19 19:35:00.068378 n-d-843861-3 devstack@n-api.service[110692]: INFO dbcounter [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Registered counter for database nova_cell1 Jul 19 19:35:00.075314 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_db.sqlalchemy.engines [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.076768 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_db.sqlalchemy.engines [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.078901 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_db.sqlalchemy.engines [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.079920 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_db.sqlalchemy.engines [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.083681 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writer thread running {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.084972 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writer thread running {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.086254 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writer thread running {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.091798 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writer thread running {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.229032 n-d-843861-3 devstack@n-api.service[110693]: INFO dbcounter [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Registered counter for database nova_cell0 Jul 19 19:35:00.232403 n-d-843861-3 devstack@n-api.service[110692]: INFO dbcounter [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Registered counter for database nova_cell0 Jul 19 19:35:00.235734 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_db.sqlalchemy.engines [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.240168 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writer thread running {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.240971 n-d-843861-3 devstack@n-api.service[110692]: DEBUG oslo_db.sqlalchemy.engines [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:35:00.245713 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writer thread running {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:35:00.578825 n-d-843861-3 devstack@n-api.service[110693]: WARNING keystonemiddleware.auth_token [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:35:00.586135 n-d-843861-3 devstack@n-api.service[110693]: WARNING keystonemiddleware.auth_token [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:35:00.587996 n-d-843861-3 devstack@n-api.service[110692]: WARNING keystonemiddleware.auth_token [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:35:00.595289 n-d-843861-3 devstack@n-api.service[110692]: WARNING keystonemiddleware.auth_token [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:35:00.932838 n-d-843861-3 devstack@n-api.service[110693]: WARNING keystonemiddleware.auth_token [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:35:00.938684 n-d-843861-3 devstack@n-api.service[110693]: WARNING keystonemiddleware.auth_token [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:35:00.943921 n-d-843861-3 devstack@n-api.service[110693]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555a16eb9c0 pid: 110693 (default app) Jul 19 19:35:00.945978 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:35:00.947194 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 19 19:35:00.947940 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Tue Jul 19 19:35:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:35:00.956659 n-d-843861-3 devstack@n-api.service[110692]: WARNING keystonemiddleware.auth_token [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:35:00.963085 n-d-843861-3 devstack@n-api.service[110692]: WARNING keystonemiddleware.auth_token [None req-97418f5f-d190-4ee1-b09b-619a94dbe014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:35:00.968308 n-d-843861-3 devstack@n-api.service[110692]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555a16eb9c0 pid: 110692 (default app) Jul 19 19:36:17.021048 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:17.022068 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 19 19:36:17.022473 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:17.034657 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_api:SELECT=3 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:17.036062 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_cell0:SELECT=3 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:17.036771 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_cell1:SELECT=3 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:17.037672 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:17.911822 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-d27ff545-c079-4b5c-8bc8-74969417bb64 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:17.942511 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-d27ff545-c079-4b5c-8bc8-74969417bb64 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912908 Jul 19 19:36:17.943406 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:36:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:20.185101 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:20.186284 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-281c16ec-cff0-441f-b135-89a10c07cc4c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Jul 19 19:36:20.187033 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:20.661332 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-8cd6e7f4-b3a7-480d-9349-537cdcfa83bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:20.679500 n-d-843861-3 devstack@n-api.service[110692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:36:20.679500 n-d-843861-3 devstack@n-api.service[110692]: warnings.warn(msg) Jul 19 19:36:20.707361 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-8cd6e7f4-b3a7-480d-9349-537cdcfa83bb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513167 Jul 19 19:36:20.708064 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:20.722361 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_api:SELECT=3 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:20.723316 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_cell0:SELECT=3 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:20.724592 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_cell1:SELECT=3 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:20.725426 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:20.932138 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-4e4cc23d-d707-4c7e-b35f-f8812c10cc37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:20.934486 n-d-843861-3 devstack@n-api.service[110693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:36:20.934486 n-d-843861-3 devstack@n-api.service[110693]: warnings.warn(msg) Jul 19 19:36:21.000634 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-4e4cc23d-d707-4c7e-b35f-f8812c10cc37 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283568 Jul 19 19:36:21.001221 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 19 19:36:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:23.304725 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-8cd6e7f4-b3a7-480d-9349-537cdcfa83bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:23.305738 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-8cd6e7f4-b3a7-480d-9349-537cdcfa83bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 19 19:36:23.306333 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:36:24.076185 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-7dcfbe47-19ee-427b-b02d-81ca440a11cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:24.094884 n-d-843861-3 devstack@n-api.service[110693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:36:24.094884 n-d-843861-3 devstack@n-api.service[110693]: warnings.warn(msg) Jul 19 19:36:24.114208 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-7dcfbe47-19ee-427b-b02d-81ca440a11cc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.801290 Jul 19 19:36:24.114856 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:24.127112 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-128b4af3-86b7-4b80-b27b-aaa7afad4ea8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:24.128621 n-d-843861-3 devstack@n-api.service[110692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:36:24.128621 n-d-843861-3 devstack@n-api.service[110692]: warnings.warn(msg) Jul 19 19:36:24.163533 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-128b4af3-86b7-4b80-b27b-aaa7afad4ea8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039979 Jul 19 19:36:24.175893 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 19 19:36:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:26.641362 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-7dcfbe47-19ee-427b-b02d-81ca440a11cc admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:26.642419 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-7dcfbe47-19ee-427b-b02d-81ca440a11cc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 19 19:36:26.642741 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:27.169710 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-8aba8d46-891c-4029-838a-d94300ab2ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:27.190941 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-8aba8d46-891c-4029-838a-d94300ab2ef5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541677 Jul 19 19:36:27.192156 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:27.204641 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-e93096e8-3eda-4d34-80d1-123f61aace31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:27.232903 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-e93096e8-3eda-4d34-80d1-123f61aace31 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031951 Jul 19 19:36:27.240357 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 19 19:36:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:29.611269 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-8aba8d46-891c-4029-838a-d94300ab2ef5 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:29.612336 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-8aba8d46-891c-4029-838a-d94300ab2ef5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 19 19:36:29.612991 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:29.985479 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-96f64ef4-f4d2-4f7f-84c4-547bbafc343a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:30.004984 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-96f64ef4-f4d2-4f7f-84c4-547bbafc343a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.386397 Jul 19 19:36:30.005705 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:30.017736 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-54ab60da-363b-47bb-8456-ece4cbd12996 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:30.040823 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-54ab60da-363b-47bb-8456-ece4cbd12996 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026698 Jul 19 19:36:30.042033 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 19 19:36:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:32.354472 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-96f64ef4-f4d2-4f7f-84c4-547bbafc343a admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:32.355404 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-96f64ef4-f4d2-4f7f-84c4-547bbafc343a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 19 19:36:32.356153 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:32.841079 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "name": "ds4G", "disk": 20, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:32.858066 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496209 Jul 19 19:36:32.858552 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:32.870400 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-ee5598fd-732d-4ff5-a3e3-3aab019a13c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:32.892848 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-ee5598fd-732d-4ff5-a3e3-3aab019a13c3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026078 Jul 19 19:36:32.893414 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 19 19:36:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:35.201666 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:35.203321 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Jul 19 19:36:35.204152 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:35.706660 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-336acbb1-7dbe-45be-bb08-610b47993c8d admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:35.732309 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-336acbb1-7dbe-45be-bb08-610b47993c8d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.521869 Jul 19 19:36:35.748488 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:36:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:36:38.055610 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:38.056681 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-7c06e05b-65af-47b7-9a57-eaba6a6eb1cb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 19 19:36:38.058013 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:38.494620 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-d1a2eb67-0cae-49b2-a821-ac381ef26ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:38.512484 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-d1a2eb67-0cae-49b2-a821-ac381ef26ef5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.448139 Jul 19 19:36:38.513065 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:36:38.525604 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-cda419f3-1e7b-4e62-9634-236ef5659c84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:38.553978 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-cda419f3-1e7b-4e62-9634-236ef5659c84 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031963 Jul 19 19:36:38.554725 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 19 19:36:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:36:40.808923 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-d1a2eb67-0cae-49b2-a821-ac381ef26ef5 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:40.810248 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-d1a2eb67-0cae-49b2-a821-ac381ef26ef5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002600 Jul 19 19:36:40.810718 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:41.256123 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-a18a627c-2387-4f08-97e8-c091ba001efa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:41.276358 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-a18a627c-2387-4f08-97e8-c091ba001efa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457110 Jul 19 19:36:41.276813 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:36:41.288487 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-a0d8d2ba-91af-409f-9c74-308a83386acf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:41.311651 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-a0d8d2ba-91af-409f-9c74-308a83386acf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026744 Jul 19 19:36:41.312258 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 19 19:36:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:43.949710 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-a18a627c-2387-4f08-97e8-c091ba001efa admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:43.950775 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-a18a627c-2387-4f08-97e8-c091ba001efa admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 19 19:36:43.951177 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:44.345397 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-ec84f6af-4986-4b84-8bb2-d5f68b5a2293 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:44.364096 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-ec84f6af-4986-4b84-8bb2-d5f68b5a2293 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407001 Jul 19 19:36:44.364782 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:44.378253 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-04c23f92-0472-4ee5-ae75-b69d46f960f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:44.401166 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-04c23f92-0472-4ee5-ae75-b69d46f960f6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027058 Jul 19 19:36:44.401721 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 19 19:36:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:36:46.601035 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-ec84f6af-4986-4b84-8bb2-d5f68b5a2293 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:46.602192 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-ec84f6af-4986-4b84-8bb2-d5f68b5a2293 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jul 19 19:36:46.602920 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:47.030576 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-1f29a185-1b7a-440c-8d9f-502d100d0449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "id": "4", "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:47.048600 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-1f29a185-1b7a-440c-8d9f-502d100d0449 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439244 Jul 19 19:36:47.049151 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:47.061551 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-3350626a-90b0-44b2-b285-7c9551b123cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:47.084895 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-3350626a-90b0-44b2-b285-7c9551b123cf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027582 Jul 19 19:36:47.085471 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 19 19:36:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:36:49.366994 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-1f29a185-1b7a-440c-8d9f-502d100d0449 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:36:49.368095 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-1f29a185-1b7a-440c-8d9f-502d100d0449 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 19 19:36:49.370639 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:36:49.865967 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:49.883896 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509074 Jul 19 19:36:49.892106 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 19 19:36:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:36:49.897780 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-f23660cc-642b-4752-aa67-fddea0eaaf60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:36:49.901710 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:36:49.931891 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-f23660cc-642b-4752-aa67-fddea0eaaf60 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038637 Jul 19 19:36:49.933202 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 19 19:36:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:37:14.074941 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:14.075991 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 19 19:37:14.076385 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:14.086506 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:37:14.460205 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-1164bb17-4e01-4a6b-bfe4-fdd85cce5b81 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:14.477333 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-1164bb17-4e01-4a6b-bfe4-fdd85cce5b81 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395209 Jul 19 19:37:14.477808 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:37:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:15.535608 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:15.536661 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-e91ffc21-3e06-40cc-abd8-4105193070d4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 19 19:37:15.537062 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:16.076897 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-618a26f2-f0c6-45e4-819f-ca2bae0294f7 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:16.082661 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.wsgi [None req-618a26f2-f0c6-45e4-819f-ca2bae0294f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-618a26f2-f0c6-45e4-819f-ca2bae0294f7 admin admin] Request method failure captured: Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Accept: application/json Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Accept-Encoding: gzip, deflate Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Connection: keep-alive Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Content-Length: 0 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Host: 10.222.0.33 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: Openstack-System-Scope: None Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: User-Agent: python-novaclient Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Auth-Token: gAAAAABi1wfrbEO0IX-YEmxK1rLsmNZ6uvVnZ-y_xKIagarTjGilbTtseabVbcK3VA91_kkfXaidngItCg7-kTvoaNkuaGsxFMMll_DRpAoqPp0msqDERH9B_Qr3Ne14AMLSCKTx19HKqEWENKG0D8f3b5VTQskq3qOHW25nIf1ildhyVZ8hx18 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Id: None Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Name: None Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Identity-Status: Confirmed Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Is-Admin-Project: True Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Id: default Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Name: Default Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Name: admin Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Role: reader,member,admin Jul 19 19:37:16.085974 n-d-843861-3 devstack@n-api.service[110692]: X-Roles: reader,member,admin Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant: admin Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Name: admin Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-User: admin Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Id: default Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Name: Default Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: X-User-Name: admin Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: method: > Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: exception: Flavor 42 could not be found. Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: action_args: {'id': '42'} Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:16.087719 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:16.088809 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.090694 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-618a26f2-f0c6-45e4-819f-ca2bae0294f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:16.091750 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-618a26f2-f0c6-45e4-819f-ca2bae0294f7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394669 Jul 19 19:37:16.091750 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:37:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:16.097641 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-1d2a3ecf-b23d-4dc6-83b2-845b83c1c03a admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:16.100605 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:37:16.119868 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-1d2a3ecf-b23d-4dc6-83b2-845b83c1c03a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025784 Jul 19 19:37:16.120399 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:16.152702 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-83b695d3-e550-4ed6-a627-bd556251d076 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:16.173708 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-83b695d3-e550-4ed6-a627-bd556251d076 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025197 Jul 19 19:37:16.174234 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:16.184135 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-18aa74ad-4fad-4d70-a27e-119b13450466 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:16.190653 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.wsgi [None req-18aa74ad-4fad-4d70-a27e-119b13450466 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-18aa74ad-4fad-4d70-a27e-119b13450466 admin admin] Request method failure captured: Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Accept: application/json Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Accept-Encoding: gzip, deflate Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Connection: keep-alive Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Content-Length: 0 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Host: 10.222.0.33 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: Openstack-System-Scope: None Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: User-Agent: python-novaclient Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Auth-Token: gAAAAABi1wfrbEO0IX-YEmxK1rLsmNZ6uvVnZ-y_xKIagarTjGilbTtseabVbcK3VA91_kkfXaidngItCg7-kTvoaNkuaGsxFMMll_DRpAoqPp0msqDERH9B_Qr3Ne14AMLSCKTx19HKqEWENKG0D8f3b5VTQskq3qOHW25nIf1ildhyVZ8hx18 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Id: None Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Name: None Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Identity-Status: Confirmed Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Is-Admin-Project: True Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Id: default Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Name: Default Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Name: admin Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Role: reader,member,admin Jul 19 19:37:16.193878 n-d-843861-3 devstack@n-api.service[110693]: X-Roles: reader,member,admin Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant: admin Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Name: admin Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-User: admin Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Id: default Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Name: Default Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: X-User-Name: admin Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: method: > Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: exception: Flavor 42 could not be found. Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: action_args: {'id': '42'} Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:16.195392 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:16.196494 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:16.197882 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-18aa74ad-4fad-4d70-a27e-119b13450466 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:16.199602 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-18aa74ad-4fad-4d70-a27e-119b13450466 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015493 Jul 19 19:37:16.199602 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:37:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:17.164383 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-83b695d3-e550-4ed6-a627-bd556251d076 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:17.165400 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-83b695d3-e550-4ed6-a627-bd556251d076 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 19 19:37:17.165799 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:17.685529 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-11a95c4f-86f3-47e9-a454-474a1e7f6684 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:17.692186 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.wsgi [None req-11a95c4f-86f3-47e9-a454-474a1e7f6684 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-11a95c4f-86f3-47e9-a454-474a1e7f6684 admin admin] Request method failure captured: Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Accept: application/json Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Accept-Encoding: gzip, deflate Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Connection: keep-alive Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Content-Length: 0 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Host: 10.222.0.33 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: Openstack-System-Scope: None Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: User-Agent: python-novaclient Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Auth-Token: gAAAAABi1wftVD-pNd5X_whhn0P3eLjlO0hryP-l_9BB6y-JJZuEAxYrH57ILI8xqLIaS8oMBHEI6hMPxul4q3RgPvSQufxZ9liujltPLqQQYK-i-VM6XgF9R0LjXYEG67JvnALoZh1UiasXtSmWJ_MIzsBbqffZZEeLjEb5VZ3FFinCEwjQCAs Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Id: None Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Name: None Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Identity-Status: Confirmed Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Is-Admin-Project: True Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Id: default Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Name: Default Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Name: admin Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Role: reader,member,admin Jul 19 19:37:17.693744 n-d-843861-3 devstack@n-api.service[110693]: X-Roles: reader,member,admin Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant: admin Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Name: admin Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-User: admin Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Id: default Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Name: Default Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: X-User-Name: admin Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: method: > Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: exception: Flavor 84 could not be found. Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: action_args: {'id': '84'} Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:17.695249 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:17.696106 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.697158 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-11a95c4f-86f3-47e9-a454-474a1e7f6684 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:17.698758 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-11a95c4f-86f3-47e9-a454-474a1e7f6684 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393137 Jul 19 19:37:17.698758 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:37:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:17.704871 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-e03b1253-0e20-490d-8911-586df3cb76c0 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:17.718221 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-e03b1253-0e20-490d-8911-586df3cb76c0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016949 Jul 19 19:37:17.718766 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:17.727880 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-99ba0509-ea51-4922-93ec-8111cb2817a0 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:17.741875 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-99ba0509-ea51-4922-93ec-8111cb2817a0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017530 Jul 19 19:37:17.742396 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:17.752255 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-2029e436-f080-4c4c-9683-6499076abb76 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:17.757521 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.wsgi [None req-2029e436-f080-4c4c-9683-6499076abb76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-2029e436-f080-4c4c-9683-6499076abb76 admin admin] Request method failure captured: Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Accept: application/json Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Accept-Encoding: gzip, deflate Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Connection: keep-alive Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Content-Length: 0 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Host: 10.222.0.33 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: Openstack-System-Scope: None Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: User-Agent: python-novaclient Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Auth-Token: gAAAAABi1wftVD-pNd5X_whhn0P3eLjlO0hryP-l_9BB6y-JJZuEAxYrH57ILI8xqLIaS8oMBHEI6hMPxul4q3RgPvSQufxZ9liujltPLqQQYK-i-VM6XgF9R0LjXYEG67JvnALoZh1UiasXtSmWJ_MIzsBbqffZZEeLjEb5VZ3FFinCEwjQCAs Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Id: None Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Name: None Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Identity-Status: Confirmed Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Is-Admin-Project: True Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Id: default Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Name: Default Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Name: admin Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Role: reader,member,admin Jul 19 19:37:17.759056 n-d-843861-3 devstack@n-api.service[110692]: X-Roles: reader,member,admin Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant: admin Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Name: admin Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-User: admin Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Id: default Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Name: Default Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: X-User-Name: admin Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: method: > Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: exception: Flavor 84 could not be found. Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: action_args: {'id': '84'} Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:17.760601 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:17.761396 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:17.762524 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-2029e436-f080-4c4c-9683-6499076abb76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:17.763617 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-2029e436-f080-4c4c-9683-6499076abb76 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011629 Jul 19 19:37:17.763617 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:37:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:18.743296 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-99ba0509-ea51-4922-93ec-8111cb2817a0 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:18.744550 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-99ba0509-ea51-4922-93ec-8111cb2817a0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Jul 19 19:37:18.744944 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:19.273444 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-c6430876-a8e4-4c9c-9316-069c2f8dbe2e admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:19.279206 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.wsgi [None req-c6430876-a8e4-4c9c-9316-069c2f8dbe2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-c6430876-a8e4-4c9c-9316-069c2f8dbe2e admin admin] Request method failure captured: Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Accept: application/json Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Accept-Encoding: gzip, deflate Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Connection: keep-alive Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Content-Length: 0 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Host: 10.222.0.33 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: Openstack-System-Scope: None Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: User-Agent: python-novaclient Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Auth-Token: gAAAAABi1wfucKWucPRZyFPM_q6WhvqEERNMCJKkwvOqoM_yGS9ofrzS0Cb5v8bDgNFYQvrHsugGf_Rwf_j-ndiR3jJsoD3ynEH15RTDoCaHH1GupjAw3bt3vgQqJeXo51vIpJXomkI35N947cEbLUaSSBwiC0LJ6qlsnvchNQoAPwR4n4jl4uA Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Id: None Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Domain-Name: None Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Identity-Status: Confirmed Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Is-Admin-Project: True Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Id: default Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Domain-Name: Default Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Project-Name: admin Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Role: reader,member,admin Jul 19 19:37:19.280758 n-d-843861-3 devstack@n-api.service[110692]: X-Roles: reader,member,admin Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant: admin Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-Tenant-Name: admin Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-User: admin Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Id: default Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-User-Domain-Name: Default Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: X-User-Name: admin Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: method: > Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: exception: Flavor 451 could not be found. Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: action_args: {'id': '451'} Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:19.282319 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:19.283302 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.284641 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-c6430876-a8e4-4c9c-9316-069c2f8dbe2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:19.285876 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-c6430876-a8e4-4c9c-9316-069c2f8dbe2e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392794 Jul 19 19:37:19.285876 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:37:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:19.291766 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-12ff1b0e-a953-40de-9208-10eb7dddec02 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:19.306027 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-12ff1b0e-a953-40de-9208-10eb7dddec02 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017853 Jul 19 19:37:19.306552 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:19.316459 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:19.331099 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018143 Jul 19 19:37:19.331622 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:37:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:37:19.340642 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-2fbe46ce-8e16-4c4e-b8fa-96eeeade7865 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:19.345922 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.wsgi [None req-2fbe46ce-8e16-4c4e-b8fa-96eeeade7865 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-2fbe46ce-8e16-4c4e-b8fa-96eeeade7865 admin admin] Request method failure captured: Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Accept: application/json Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Accept-Encoding: gzip, deflate Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Connection: keep-alive Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Content-Length: 0 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Host: 10.222.0.33 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Openstack-Api-Version: compute 2.90 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: Openstack-System-Scope: None Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: User-Agent: python-novaclient Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Auth-Token: gAAAAABi1wfucKWucPRZyFPM_q6WhvqEERNMCJKkwvOqoM_yGS9ofrzS0Cb5v8bDgNFYQvrHsugGf_Rwf_j-ndiR3jJsoD3ynEH15RTDoCaHH1GupjAw3bt3vgQqJeXo51vIpJXomkI35N947cEbLUaSSBwiC0LJ6qlsnvchNQoAPwR4n4jl4uA Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Id: None Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Domain-Name: None Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Identity-Status: Confirmed Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Is-Admin-Project: True Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Id: default Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Domain-Name: Default Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Project-Name: admin Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Role: reader,member,admin Jul 19 19:37:19.347411 n-d-843861-3 devstack@n-api.service[110693]: X-Roles: reader,member,admin Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_558f994e313e4d9fa769d01810e1c1c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant: admin Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Id: 558f994e313e4d9fa769d01810e1c1c9 Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-Tenant-Name: admin Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-User: admin Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Id: default Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-User-Domain-Name: Default Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-User-Id: b218914217af4646a4f93f11fe14c3e7 Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: X-User-Name: admin Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: method: > Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: exception: Flavor 451 could not be found. Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: action_args: {'id': '451'} Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:37:19.349047 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:19.350198 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: ERROR nova.api.openstack.wsgi Jul 19 19:37:19.351463 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-2fbe46ce-8e16-4c4e-b8fa-96eeeade7865 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:37:19.352789 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-2fbe46ce-8e16-4c4e-b8fa-96eeeade7865 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011673 Jul 19 19:37:19.352789 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:37:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:37:20.318534 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:20.319564 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 19 19:37:20.319981 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:20.852247 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-195e1e78-a57b-4bda-bb07-f8fea43cd1ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:37:20.870694 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-195e1e78-a57b-4bda-bb07-f8fea43cd1ac admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414204 Jul 19 19:37:20.871231 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 19 19:37:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:37:21.827392 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:21.828506 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 19 19:37:21.828906 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:22.355299 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-8881df33-72d7-4427-bd95-1a5891f877d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:37:22.372664 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-8881df33-72d7-4427-bd95-1a5891f877d3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408783 Jul 19 19:37:22.373207 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 19 19:37:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:37:23.343822 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:23.344826 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 19 19:37:23.345217 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:23.864057 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-894fa3ac-55d9-4890-978d-6bde44101fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:37:23.880574 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-894fa3ac-55d9-4890-978d-6bde44101fda admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398687 Jul 19 19:37:23.881124 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 19 19:37:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:37:24.841851 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:24.842856 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jul 19 19:37:24.843294 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:25.481529 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-d159a24e-9a6a-4e1b-b766-9e1fd0a926f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:37:25.500420 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-d159a24e-9a6a-4e1b-b766-9e1fd0a926f7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.518684 Jul 19 19:37:25.500957 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 19 19:37:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:37:26.459264 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:26.460298 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 19 19:37:26.460689 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:26.995673 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-87785f42-3f35-4c40-b06b-7c82ed46af99 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:27.014627 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-87785f42-3f35-4c40-b06b-7c82ed46af99 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.418578 Jul 19 19:37:27.015153 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Jul 19 19:37:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:38:18.772861 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:18.773867 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-135262b6-8aac-4d48-b70b-34a5bf4d77bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 19 19:38:18.774263 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 19 19:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:38:18.784442 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:38:19.161730 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-1040c9f9-2819-4b8e-8eca-015332a355e7 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:19.180346 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-1040c9f9-2819-4b8e-8eca-015332a355e7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400374 Jul 19 19:38:19.180886 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:38:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:38:19.203754 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-14bfae2b-968e-4652-948b-4a1fe3c8dde6 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:19.207687 n-d-843861-3 devstack@n-api.service[110692]: DEBUG dbcounter [-] [110692] Writing DB stats nova_api:SELECT=14 {{(pid=110692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:38:19.213189 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-14bfae2b-968e-4652-948b-4a1fe3c8dde6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013066 Jul 19 19:38:19.213710 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Tue Jul 19 19:38:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:38:19.225335 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-ea94e775-bfa1-4abe-a8ff-a977ba80790a admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:19.232995 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-ea94e775-bfa1-4abe-a8ff-a977ba80790a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011331 Jul 19 19:38:19.233511 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Tue Jul 19 19:38:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:38:19.245200 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:19.252861 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011540 Jul 19 19:38:19.253526 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Tue Jul 19 19:38:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:38:19.264888 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-0174a264-cc1d-4a97-8157-bbac3f5224b4 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:38:19.273370 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-0174a264-cc1d-4a97-8157-bbac3f5224b4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011916 Jul 19 19:38:19.273884 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Tue Jul 19 19:38:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:48.609275 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:48.610271 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 19 19:43:48.610659 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:43:48.751883 n-d-843861-3 devstack@n-api.service[110693]: DEBUG dbcounter [-] [110693] Writing DB stats nova_api:SELECT=6 {{(pid=110693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:48.894664 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:48.895890 n-d-843861-3 devstack@n-api.service[110693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:43:48.895890 n-d-843861-3 devstack@n-api.service[110693]: warnings.warn(msg) Jul 19 19:43:48.897097 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.897541 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.898331 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.898762 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.939715 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-124e505e-e6fa-4d19-a292-f16d0d7c89e8 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.189270 Jul 19 19:43:48.940340 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:43:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:49.761337 n-d-843861-3 devstack@n-api.service[110692]: DEBUG nova.api.openstack.wsgi [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] Calling method '>' {{(pid=110692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:49.762333 n-d-843861-3 devstack@n-api.service[110692]: INFO nova.api.openstack.requestlog [None req-acb7c9c3-1b80-432a-88c9-81ceda12f039 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 19 19:43:49.762722 n-d-843861-3 devstack@n-api.service[110692]: [pid: 110692|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 19 19:43:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:49.956317 n-d-843861-3 devstack@n-api.service[110693]: DEBUG nova.api.openstack.wsgi [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] Calling method '>' {{(pid=110693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:49.957559 n-d-843861-3 devstack@n-api.service[110693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:43:49.957559 n-d-843861-3 devstack@n-api.service[110693]: warnings.warn(msg) Jul 19 19:43:49.958775 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.959213 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.960028 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.960457 n-d-843861-3 devstack@n-api.service[110693]: DEBUG oslo_concurrency.lockutils [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.983453 n-d-843861-3 devstack@n-api.service[110693]: INFO nova.api.openstack.requestlog [None req-e9d38ea3-05ce-4df7-8907-647cb7614ded admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.079608 Jul 19 19:43:49.983966 n-d-843861-3 devstack@n-api.service[110693]: [pid: 110693|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:43:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:33.793730 n-d-843861-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 19:44:33.794268 n-d-843861-3 devstack@n-api.service[110691]: Tue Jul 19 19:44:33 2022 - graceful shutdown triggered... Jul 19 19:44:33.794733 n-d-843861-3 devstack@n-api.service[110692]: Gracefully killing worker 1 (pid: 110692)... Jul 19 19:44:33.795122 n-d-843861-3 devstack@n-api.service[110693]: Gracefully killing worker 2 (pid: 110693)... Jul 19 19:44:34.795185 n-d-843861-3 devstack@n-api.service[110691]: worker 1 buried after 1 seconds Jul 19 19:44:34.795185 n-d-843861-3 devstack@n-api.service[110691]: worker 2 buried after 1 seconds Jul 19 19:44:34.795185 n-d-843861-3 devstack@n-api.service[110691]: goodbye to uWSGI. Jul 19 19:44:34.796824 n-d-843861-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 19 19:44:34.797401 n-d-843861-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 19:44:34.800144 n-d-843861-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 19:44:34.819473 n-d-843861-3 devstack@n-api.service[125997]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 19:44:34 2022] *** Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: nodename: n-d-843861-3 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: machine: x86_64 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: clock source: unix Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: pcre jit disabled Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: detected number of CPU cores: 4 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: current working directory: / Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: detected binary path: /usr/bin/uwsgi-core Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: your processes number limit is 47680 Jul 19 19:44:34.840259 n-d-843861-3 devstack@n-api.service[125997]: your memory page size is 4096 bytes Jul 19 19:44:34.841170 n-d-843861-3 devstack@n-api.service[125997]: detected max file descriptor number: 2048 Jul 19 19:44:34.841170 n-d-843861-3 devstack@n-api.service[125997]: lock engine: pthread robust mutexes Jul 19 19:44:34.841170 n-d-843861-3 devstack@n-api.service[125997]: thunder lock: enabled Jul 19 19:44:34.841170 n-d-843861-3 devstack@n-api.service[125997]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 19:44:34.841170 n-d-843861-3 devstack@n-api.service[125997]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 19:44:34.887091 n-d-843861-3 devstack@n-api.service[125997]: Python main interpreter initialized at 0x55d4089a99c0 Jul 19 19:44:34.887091 n-d-843861-3 devstack@n-api.service[125997]: python threads support enabled Jul 19 19:44:34.887091 n-d-843861-3 devstack@n-api.service[125997]: your server socket listen backlog is limited to 100 connections Jul 19 19:44:34.887091 n-d-843861-3 devstack@n-api.service[125997]: your mercy for graceful operations on workers is 90 seconds Jul 19 19:44:34.887770 n-d-843861-3 devstack@n-api.service[125997]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 19:44:34.887889 n-d-843861-3 devstack@n-api.service[125997]: *** Operational MODE: preforking *** Jul 19 19:44:34.888182 n-d-843861-3 devstack@n-api.service[125997]: *** uWSGI is running in multiple interpreter mode *** Jul 19 19:44:34.888182 n-d-843861-3 devstack@n-api.service[125997]: spawned uWSGI master process (pid: 125997) Jul 19 19:44:34.888387 n-d-843861-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 19:44:34.890602 n-d-843861-3 devstack@n-api.service[125997]: spawned uWSGI worker 1 (pid: 126007, cores: 1) Jul 19 19:44:34.890602 n-d-843861-3 devstack@n-api.service[125997]: spawned uWSGI worker 2 (pid: 126008, cores: 1) Jul 19 19:44:34.890602 n-d-843861-3 devstack@n-api.service[125997]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 19:44:35.565838 n-d-843861-3 devstack@n-api.service[126008]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:44:35.607410 n-d-843861-3 devstack@n-api.service[126007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:44:36.758890 n-d-843861-3 devstack@n-api.service[126008]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:44:36.758890 n-d-843861-3 devstack@n-api.service[126008]: from cryptography.utils import int_from_bytes Jul 19 19:44:36.759544 n-d-843861-3 devstack@n-api.service[126008]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:44:36.759544 n-d-843861-3 devstack@n-api.service[126008]: from cryptography.utils import int_from_bytes Jul 19 19:44:36.817195 n-d-843861-3 devstack@n-api.service[126007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:44:36.817195 n-d-843861-3 devstack@n-api.service[126007]: from cryptography.utils import int_from_bytes Jul 19 19:44:36.817772 n-d-843861-3 devstack@n-api.service[126007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:44:36.817772 n-d-843861-3 devstack@n-api.service[126007]: from cryptography.utils import int_from_bytes Jul 19 19:44:39.061479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:44:39.062031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:44:39.062286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:44:39.062615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:44:39.062867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:44:39.063290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.063667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.063899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.064218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.064541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.064847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.065161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.065474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.065798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.066054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.066363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.066681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843861-3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.067000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.067302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.067608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.067946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.068257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.068577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.068881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.069381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.070646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.070646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.070646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.070942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.071082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.071389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.071723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.072054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.072376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.072685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.073076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843861-3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.073392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.073701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.074026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.074422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.074744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.075034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.075348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.075666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.076003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.076341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.076657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.076971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.077287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.077584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.077886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.078196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.078510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.078809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.079106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.079352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.079654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.079998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.080314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.080631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.080878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.081124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.081440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.081759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.082063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.082358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.082662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.082966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.083268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.083566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.083891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.084197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.084515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.084825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.085141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.085442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.085757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.086672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.086923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.087234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.087567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.087906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.088215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.088530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.088855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.089159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.089461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.089765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.090080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.090408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.090711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.090958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.091254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.091556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.091902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.092209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.092511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.092815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.093111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.093413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.093715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.094015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.094317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.094622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.094918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.095221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.095520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.095827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.096160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.096478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.096782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.097084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.097387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.097690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.098005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.098308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.098616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.098935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.099236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.099536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.099876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.100182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.100487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.100801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.101097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.101399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.101870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.102683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.102983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.103285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.103587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.103913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.104216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.104516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.104817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.105108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.105423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.105742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.106046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.106349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.106649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.106965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.107300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.107632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.107995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.108308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.108639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.108973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.109287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.109596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.109907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.110230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.110539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.110847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.111153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.111470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.111783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.112137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.112448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.112761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.113076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.113381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.113694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.114018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.114336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.114639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.114975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.115316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.115624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.115968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.116288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.116595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.116903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.117206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.117553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.117879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.118188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.118504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.118817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.119126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.119430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.119738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.120073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.120455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.120719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.121028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.121336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.121664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.121954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.122266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.122568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.122873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.123173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.123473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.123778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.124108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.124425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.124752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.125058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.125389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.125692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.126000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.126309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.126616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.126918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.127227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.127539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.127859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.128184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.128493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.128801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.129119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.129422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.129724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.130033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.130340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.130649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.130957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.131518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.131859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.132193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.132485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.132821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.133173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.133473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.133794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.134115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.134427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.134726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.135072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.135330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.135630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.136002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.136311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.136612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.136913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.137214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.137514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.137814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.138134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.138441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.138750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.139051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.139352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.139692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.140018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.140357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.140693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.141011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.141335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.141646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.141959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.142269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.142577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.142886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.143194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.143515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.143835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.144158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.144463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.144785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.145092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.145409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.145712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.146023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.146359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.146691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.147003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.147323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.147634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.147977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.148287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.149108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.149425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.149737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.150054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.150362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.150678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.150983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.151303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.151610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.151954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.152258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.152569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.152891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.153222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.153533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.153844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.154163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.154473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.154779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.155087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.155392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.155690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.156021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.156335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.156644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.156952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.157254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.157564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.157874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.158172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.158472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.158782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.159101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.159417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.159737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.160082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.160385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.160685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.161007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.161314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.161616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.161915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.162217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.162555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.162865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.163165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.163478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.163796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.164131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.164986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.165295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.165601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.165920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.166228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.166534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.166842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.167149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.167455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.167762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.168109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.168415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.168722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.169030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.169596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.169730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.169928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.170496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.170824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.171136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.171449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.171767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.172110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.172440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.172767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.173109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.173412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.173792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.174019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.174361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.174628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.174935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.175235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.175536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.175859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.176163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.176462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.176760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.177060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.177370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.177670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.177977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.178278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.178596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.178901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.179206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.179505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.179824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.180201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.180500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.180836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.181165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.181503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.181805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.182108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.182428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.182731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.183033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.183332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.183639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.183971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.184271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.184581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.184887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.185193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.185502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.185667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:44:39.186105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.186196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:44:39.186280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.186377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.186471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:44:39.186673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.186769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:44:39.186975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.187069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:44:39.187275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.187379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.187574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.187679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.187903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.188000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.188212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.188366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.188513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.188615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.188819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.188933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.189118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.189212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.189437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.189538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.189737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.189844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.190037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.190139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.190336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.190437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.190643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.190737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843861-3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.190949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.191042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.191250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.191349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.191558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.191652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.191955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.192062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.192258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.192350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.192559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.192660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.192865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.192958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.193166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.193365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.193486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.193671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.193819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.193983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.194150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.194317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.194461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.194610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.194758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.194900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.195039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.195218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.195361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.195512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.195645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.195801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.196099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.196257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.196404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.196559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.196700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.196700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.196980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843861-3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.197127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.197280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.197421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.197569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.197723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.197871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.198014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.198162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.198328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.198478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.198583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.198671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.198755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.198942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.199037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.199260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.199362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.199561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.199656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.199919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.200019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.200235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.200347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.200549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.200643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.200863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.200963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.201159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.201262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.201461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.201560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.201762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.201862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.202059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.202153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.202358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.202451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.202654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.202747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.202900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.203002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.203207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.203382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.203534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.203684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.203850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.203996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.204215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.204358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.204499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.204649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.204805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.204948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.205089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.205231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.205383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.205524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.205684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.205821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.205919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.206005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.206144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.206277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.206367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.206524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.206619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.206831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.206938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.207139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.207240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.207445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.207546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.207756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.207917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.208092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.208194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.208403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.208556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.208704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.208798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.209003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.209095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.209318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.209421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.209623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.209717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.209921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.210012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.210240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.210332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.210546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.210642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.210844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.210935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.211677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.211782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.212016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.212146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.212320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.212447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.212621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.212756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.212924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.213134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.213261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.213373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.213555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.213686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.213862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.213982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.214102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.214685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.214806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.214928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.215041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.215152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.215277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.215390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.215500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.215621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.215753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.215893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.216017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.216127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.216259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.216420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.216583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.216727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.216855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.217026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.217155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.217328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.217448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.217635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.217778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.217958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.218189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.218309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.218513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.218639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.218827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.218947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.219140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.219261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.221242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.221560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.221713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.221962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.221962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.222241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.222383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.222515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.222617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.222705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.222790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.222882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.222977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.223062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.223163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.223256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.223342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.223439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.223525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.223615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.223700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.223791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.223906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.224006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.224092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.224183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.224275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.224366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.224458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.224552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.224657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.224880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.225150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.225345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.225529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.225713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.225909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.225994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.226086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.226172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.226255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.226360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.226517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.226643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.227384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.227529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.227690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.227861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.228013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.228183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.228331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.228504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.228650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.228807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.228957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.229108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.229261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.229421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.229563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.229724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.229880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:44:39.230026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.230981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.231236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.231328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.231543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.231648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.231862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.232946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.233797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.234948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.235992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.236925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.237863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.238826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.239975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.240987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.241871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.242971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.243917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.244937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.245848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.246959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.247923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.248949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.249866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.250936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.251954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.252876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.253816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.254956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.255918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.256016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.256484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.256593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.256802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.256907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.257813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.258953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.259980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.260875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.261991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.262927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.263938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.264875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.265987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.266891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.267195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.267348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.267514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.267743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.267921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.268969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.269282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.269473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.269621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.269804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.269949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.270995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.271937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.272810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.273004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.273252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.273406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.274921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.275973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.276941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.277871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.278985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.279931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.280935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.281850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.282847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.283937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.284127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.284252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.284568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.284835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.284942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.285886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.286808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.287972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.288988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.289222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.289840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.290984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.291922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.292930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.293201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.293374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.293488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.293639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.293778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.294954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.295921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.296977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.297876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.298990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.299922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.300927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.301844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.302962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.303958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.304912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.305917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.306956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.307956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.308964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.309871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.310984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.311920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.312933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.313884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.314780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.315977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.316920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.317946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.318845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.319752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.320961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.321902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.322884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.323129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.323236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.323427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.323578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.323675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:44:39.323790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.324118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.324431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.324757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.325057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.325368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.325675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.325976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.326290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.326597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.326906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.327208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.327506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.327848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.328165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.328475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.328795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.329117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.329438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.329739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.330049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.330355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.330660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.331123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.331393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.331704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.332042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.332358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.332669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.332980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.333289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.333598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.334004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.334315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.334531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.334840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.335138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.335435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.335739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.336610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.336918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.337373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.337687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.337999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.338305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.338618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.338930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.339246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.339567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.339908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.340315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.340630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.340938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.341247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.341551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.341857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.342163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.342484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.342787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.343089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.343394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.344655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.344655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.344655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.345016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.345140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.345361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.345779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.346090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.346399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.346735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.347041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.347362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.347662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.348000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.348310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.348633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.348955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.349267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.349579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.349881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.350200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.350521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.350830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.351159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.351579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.352569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.352884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.353207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.353530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.353834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.354134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.354448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.354760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.355156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.355539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.355903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.356374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.356721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.357036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.357434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.357895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.358254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.358565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.358893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.359214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.359542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.359893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.360206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.360532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.360844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.361151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.361454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.361758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.362105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.362409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.362731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.363062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.363390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.363698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.364057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.364386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.364720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.365036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.365359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.365663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.365965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.366273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.366578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.366880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.367181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.367535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.367856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.368159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.368458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.368783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.369090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.369410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.369719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.370023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.370324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.370624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.370969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.371271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.371605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.371950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.372272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.372601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.372908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.373232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.373550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.373943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.374171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.374490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.374834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.375128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.375447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.375756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.376102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.376417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.376734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.377321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.377650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.377966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.378279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.378590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.378904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.379217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.379529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.379859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.380174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.380485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.380818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.381140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.381738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.382076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.382410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.382706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.383578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.383917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.384282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.384596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.384908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.385233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.385541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.385851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.386163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.386472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.386781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.387090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.387398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.387705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.388050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.388359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.388685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.389021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.389341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.389653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.389964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.390277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.390848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.391162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.391497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.391857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.392165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.392478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.392793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.393120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.393424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.393728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.394037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.394345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.394648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.394973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.395400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.395597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.395939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.396249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.396836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.397183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.397505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.397831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.398154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.398469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.399347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.399672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.400001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.400308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.400622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.400932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.401235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.401607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.401984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.402398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.402705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.403018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.403325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.403650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.403977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.404336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.404681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.405064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.405390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.405699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.406007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.406365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.406683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.406987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.437347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.438135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.440427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.442569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.443619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.445417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.447536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.448979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.449806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.450786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.451678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.452878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.453875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.454257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.454645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.455057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.455471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.455720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.456089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.456415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.457015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.457333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.457655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.457984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.458306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.458622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.458938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.459258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.459577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.459932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.460264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.460577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.460906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.461787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.462141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.462459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.462805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.463139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.463455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.463769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.464097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:44:39.464343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:44:39.494476 n-d-843861-3 devstack@n-api.service[126008]: INFO dbcounter [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Registered counter for database nova_api Jul 19 19:44:39.516350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_db.sqlalchemy.engines [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.524525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writer thread running {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.581961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.context [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126008) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:44:39.587040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.588861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.589863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.592069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.594269 n-d-843861-3 devstack@n-api.service[126008]: INFO dbcounter [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Registered counter for database nova_cell0 Jul 19 19:44:39.598861 n-d-843861-3 devstack@n-api.service[126008]: INFO dbcounter [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Registered counter for database nova_cell1 Jul 19 19:44:39.608551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_db.sqlalchemy.engines [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.609791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_db.sqlalchemy.engines [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.616762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writer thread running {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.617961 n-d-843861-3 devstack@n-api.service[126007]: INFO dbcounter [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Registered counter for database nova_api Jul 19 19:44:39.618229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writer thread running {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.638277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_db.sqlalchemy.engines [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.645782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writer thread running {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.703043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.context [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126007) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:44:39.707130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.708734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.709536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.712101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.714087 n-d-843861-3 devstack@n-api.service[126007]: INFO dbcounter [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Registered counter for database nova_cell0 Jul 19 19:44:39.718207 n-d-843861-3 devstack@n-api.service[126007]: INFO dbcounter [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Registered counter for database nova_cell1 Jul 19 19:44:39.725360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_db.sqlalchemy.engines [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.727251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_db.sqlalchemy.engines [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.734067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writer thread running {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.736331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writer thread running {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.767716 n-d-843861-3 devstack@n-api.service[126008]: INFO dbcounter [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Registered counter for database nova_cell0 Jul 19 19:44:39.775007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_db.sqlalchemy.engines [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.779397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writer thread running {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:39.886862 n-d-843861-3 devstack@n-api.service[126007]: INFO dbcounter [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Registered counter for database nova_cell0 Jul 19 19:44:39.896878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_db.sqlalchemy.engines [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:44:39.901392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writer thread running {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:44:40.110677 n-d-843861-3 devstack@n-api.service[126008]: WARNING keystonemiddleware.auth_token [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:44:40.118745 n-d-843861-3 devstack@n-api.service[126008]: WARNING keystonemiddleware.auth_token [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:44:40.226184 n-d-843861-3 devstack@n-api.service[126007]: WARNING keystonemiddleware.auth_token [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:44:40.234056 n-d-843861-3 devstack@n-api.service[126007]: WARNING keystonemiddleware.auth_token [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:44:40.471222 n-d-843861-3 devstack@n-api.service[126008]: WARNING keystonemiddleware.auth_token [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:44:40.477524 n-d-843861-3 devstack@n-api.service[126008]: WARNING keystonemiddleware.auth_token [None req-74f86f24-9f75-4e2c-bcb8-6024e0a13f6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:44:40.483969 n-d-843861-3 devstack@n-api.service[126008]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4089a99c0 pid: 126008 (default app) Jul 19 19:44:40.578767 n-d-843861-3 devstack@n-api.service[126007]: WARNING keystonemiddleware.auth_token [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:44:40.584863 n-d-843861-3 devstack@n-api.service[126007]: WARNING keystonemiddleware.auth_token [None req-f82150c4-adf8-423a-a1fa-12f0101f0c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:44:40.591043 n-d-843861-3 devstack@n-api.service[126007]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4089a99c0 pid: 126007 (default app) Jul 19 19:45:25.541785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.542890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.543779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.544527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.801006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.802810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.803831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:25.804961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:26.656264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87e59692-86d2-45f4-b32c-dbe2d2eb9c82 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-819654694", "ram": 512, "vcpus": 1, "disk": 10, "id": 1868978849, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:26.674550 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:26.674550 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:26.706464 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87e59692-86d2-45f4-b32c-dbe2d2eb9c82 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.174560 Jul 19 19:45:26.714311 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:26.719565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-446763a5-a8e8-4967-86d7-057990746d8c tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:26.721099 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:26.721099 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:26.761940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-446763a5-a8e8-4967-86d7-057990746d8c tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046096 Jul 19 19:45:26.767002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1223 bytes} [Tue Jul 19 19:45:26 2022] POST /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:27.031488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '.version_select at 0x7fb8908b4c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.033050 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.033050 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:27.039328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126007) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 19:45:27.040255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.040691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.066466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.066911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.080557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.080979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.087688 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2b68b51-3167-4c2e-906d-76af3f42224d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.293517 Jul 19 19:45:27.088351 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:45:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:27.209181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c74d59c7-afed-4b4d-a68e-ca21e583ac9f tempest-FlavorsExtraSpecsTestJSON-1708160035 tempest-FlavorsExtraSpecsTestJSON-1708160035-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.235171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c74d59c7-afed-4b4d-a68e-ca21e583ac9f tempest-FlavorsExtraSpecsTestJSON-1708160035 tempest-FlavorsExtraSpecsTestJSON-1708160035-project] 10.222.0.33 "GET /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.466937 Jul 19 19:45:27.235746 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 19:45:26 2022] GET /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:27.368363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43728e53-3f2a-4dcc-a5c0-f0158fa6e25a tempest-AZAdminNegativeTestJSON-445975348 tempest-AZAdminNegativeTestJSON-445975348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.369277 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.369277 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:27.370380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43728e53-3f2a-4dcc-a5c0-f0158fa6e25a tempest-AZAdminNegativeTestJSON-445975348 tempest-AZAdminNegativeTestJSON-445975348-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '55c01c62473a420688ab1be2059ed1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63140c478484780bbefe61cbdb8ce24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43728e53-3f2a-4dcc-a5c0-f0158fa6e25a tempest-AZAdminNegativeTestJSON-445975348 tempest-AZAdminNegativeTestJSON-445975348-project] Request method failure captured: Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnUlAx_9sZKH2ckvFbcbQFlLN70tXc_ZaFQ-lXKVBf6iKd0CkdkY9m7f268VtEpHphkC_AKOcxDk79ONG_s9gGEOL8F-GhlyQLQHxgztungEvnTugbpCm2VQd1nQevidh27aEB98vAq6Yo3CmqDMx-HMdUOaJ3Kqg_pxBQMAPenxc8 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: b63140c478484780bbefe61cbdb8ce24 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AZAdminNegativeTestJSON-445975348 Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:27.373473 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b63140c478484780bbefe61cbdb8ce24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b63140c478484780bbefe61cbdb8ce24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b63140c478484780bbefe61cbdb8ce24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b63140c478484780bbefe61cbdb8ce24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AZAdminNegativeTestJSON-445975348 Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: b63140c478484780bbefe61cbdb8ce24 Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-445975348 Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AZAdminNegativeTestJSON-445975348-project Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 55c01c62473a420688ab1be2059ed1df Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AZAdminNegativeTestJSON-445975348-project Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:45:27.374772 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:27.375511 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:27.377125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43728e53-3f2a-4dcc-a5c0-f0158fa6e25a tempest-AZAdminNegativeTestJSON-445975348 tempest-AZAdminNegativeTestJSON-445975348-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:27.378039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43728e53-3f2a-4dcc-a5c0-f0158fa6e25a tempest-AZAdminNegativeTestJSON-445975348 tempest-AZAdminNegativeTestJSON-445975348-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.285514 Jul 19 19:45:27.379784 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2/5] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:27.385232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5d638ee-ebca-4d10-8e8d-815b441b73c6 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1627231216", "name": "tempest-test_aggregate-1278745404"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:27.418522 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.418522 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:27.420020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-a5d638ee-ebca-4d10-8e8d-815b441b73c6 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid 8bb03e30-af56-477d-9dc9-4f884f5a5479 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:45:27.503416 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5d638ee-ebca-4d10-8e8d-815b441b73c6 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.122340 Jul 19 19:45:27.504341 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3/6] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Jul 19 19:45:27 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:27.510254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4eb1e752-2b6b-456a-a9ee-b4ad4e85ac67 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:27.514487 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.514487 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:27.567848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4eb1e752-2b6b-456a-a9ee-b4ad4e85ac67 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062111 Jul 19 19:45:27.568585 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 4/7] 10.222.0.33 () {60 vars in 1223 bytes} [Tue Jul 19 19:45:27 2022] POST /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:27.756682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.759367 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.759367 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:27.760897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.761344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.762134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.762708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.808964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-641ab89f-038e-4fed-ab60-c6cef829349c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.571908 Jul 19 19:45:27.809541 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:27.813874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-746e8ff1-d574-48d8-9b0f-486a539515f7 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.814625 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:27.814625 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:27.826708 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-746e8ff1-d574-48d8-9b0f-486a539515f7 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.016016 Jul 19 19:45:27.827473 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.024455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Calling method '.version_select at 0x7fb88fec6af0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.025345 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.025345 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.026832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.028208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.042823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.044149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.054660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.055113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.060971 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8343c335-0650-4b55-a4d5-0ad4c11fbe35 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.491361 Jul 19 19:45:28.061636 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.066245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dadc66b9-1747-4db4-9db9-f385ea90369a tempest-FlavorsExtraSpecsTestJSON-1708160035 tempest-FlavorsExtraSpecsTestJSON-1708160035-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.080044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6fcd7ac-ebdc-48db-a095-bab01734cf76 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1458652942", "id": 154629440, "os-flavor-access:is_public": "False"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.082305 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.082305 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.085077 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dadc66b9-1747-4db4-9db9-f385ea90369a tempest-FlavorsExtraSpecsTestJSON-1708160035 tempest-FlavorsExtraSpecsTestJSON-1708160035-project] 10.222.0.33 "GET /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022271 Jul 19 19:45:28.085698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes => generated 22 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.093152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa848f65-ad30-44a3-90ba-fe03a3f14078 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.095065 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.095065 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.100166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6fcd7ac-ebdc-48db-a095-bab01734cf76 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.271456 Jul 19 19:45:28.104680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa848f65-ad30-44a3-90ba-fe03a3f14078 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.105136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa848f65-ad30-44a3-90ba-fe03a3f14078 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.107695 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 6/12] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:27 2022] POST /compute/v2.1/flavors => generated 428 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.167057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71e36f78-ddc2-4dbe-ad51-4008977c345e tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-333601869", "id": 13933105, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.184862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71e36f78-ddc2-4dbe-ad51-4008977c345e tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.075371 Jul 19 19:45:28.185641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 7/13] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/flavors => generated 423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.260144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.262226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.263505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.263981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.264737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.295968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f37321e1-8f65-4cdb-9d1c-e1845b56a9a3 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.108887 Jul 19 19:45:28.296815 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1163 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.303074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Calling method '.version_select at 0x7fb89075d1f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.304101 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.304101 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.310639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126008) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 19:45:28.311446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.311937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.340938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.341366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.378936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.379359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.388295 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-12f04bc7-7436-4a87-ab30-a9ba8f0be741 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-843861-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.089921 Jul 19 19:45:28.391937 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 9/15] 10.222.0.33 () {58 vars in 1211 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-843861-3/servers => generated 104 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.398892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c67c218-a92e-4bcd-a273-fa9cbda4f754 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.400312 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.400312 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.422446 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c67c218-a92e-4bcd-a273-fa9cbda4f754 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028082 Jul 19 19:45:28.423335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 10/16] 10.222.0.33 () {60 vars in 1223 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.431747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-637af1f0-0ac4-4174-bb5c-d8c109f547e4 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e919477f6d724edf9571009ba32b47df"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.432996 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.432996 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.493318 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa848f65-ad30-44a3-90ba-fe03a3f14078 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.405851 Jul 19 19:45:28.500201 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 7/17] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.509375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5e7b0a9-d756-4989-8136-528345be71ee tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.510154 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.510154 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.525850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-637af1f0-0ac4-4174-bb5c-d8c109f547e4 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/154629440/action" status: 200 len: 96 microversion: 2.1 time: 0.097718 Jul 19 19:45:28.526935 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 11/18] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/flavors/154629440/action => generated 96 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.531777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.532976 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.532976 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.534180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.534676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.535486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.535952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.546803 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5e7b0a9-d756-4989-8136-528345be71ee tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/13933105" status: 202 len: 0 microversion: 2.1 time: 0.051037 Jul 19 19:45:28.547416 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 8/19] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:45:28 2022] DELETE /compute/v2.1/flavors/13933105 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:28.551719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Calling method '.version_select at 0x7fb88ee07940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.552550 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.552550 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.559046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.559939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.564881 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecb906cd-7106-4293-8c30-2257e66b9fc5 tempest-AZAdminV2TestJSON-1160550171 tempest-AZAdminV2TestJSON-1160550171-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.036739 Jul 19 19:45:28.573304 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 12/20] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.573304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6bcb17ed-5e06-485a-9e40-fd579b39d38e tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.580929 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6bcb17ed-5e06-485a-9e40-fd579b39d38e tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014108 Jul 19 19:45:28.581723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 13/21] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.594309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.594828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.606392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.606845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.612811 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86661e51-1170-489c-9c4a-ccc8d3a7f9d7 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064401 Jul 19 19:45:28.613398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 9/22] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.618565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-924c9a5b-ca5a-4882-bea6-edf7e9843c82 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.651041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-924c9a5b-ca5a-4882-bea6-edf7e9843c82 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.036333 Jul 19 19:45:28.651622 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 10/23] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:28.664723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e3a784a0-d560-4b42-897c-2fc15d299dc7 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.666012 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.666012 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.694059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e3a784a0-d560-4b42-897c-2fc15d299dc7 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040786 Jul 19 19:45:28.699081 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 11/24] 10.222.0.33 () {60 vars in 1264 bytes} [Tue Jul 19 19:45:28 2022] PUT /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes => generated 22 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.704015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Calling method '.version_select at 0x7fb88ee079d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.704895 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.704895 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:28.706323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.706771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.725748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.726216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.732385 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6939272d-572e-43a5-9bb3-3ef83b325884 tempest-HypervisorAdminUnderV252Test-1910083746 tempest-HypervisorAdminUnderV252Test-1910083746-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-843861-3/search" status: 200 len: 104 microversion: 2.1 time: 0.032051 Jul 19 19:45:28.733144 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1208 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-843861-3/search => generated 104 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.844233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f199f2a3-8310-4663-bbcc-86df47bbf2ba tempest-FlavorsAccessTestJSON-1786541114 tempest-FlavorsAccessTestJSON-1786541114-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.879938 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f199f2a3-8310-4663-bbcc-86df47bbf2ba tempest-FlavorsAccessTestJSON-1786541114 tempest-FlavorsAccessTestJSON-1786541114-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.297004 Jul 19 19:45:28.880547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 14/26] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:28.886303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1febf39a-40ce-4f13-9eba-f4ff3ce65652 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-290267656", "id": 1836617605, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.887907 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.887907 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:28.903097 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1febf39a-40ce-4f13-9eba-f4ff3ce65652 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.021331 Jul 19 19:45:28.909027 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 15/27] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/flavors => generated 416 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.914262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bed29173-f795-41f1-9f84-9ecf34692cf7 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.922244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bed29173-f795-41f1-9f84-9ecf34692cf7 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011990 Jul 19 19:45:28.922953 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 16/28] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/flavors/1868978849/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:28.927705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19a514ba-775f-4a0c-8bc3-94f724418ff5 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e919477f6d724edf9571009ba32b47df"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.929518 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:28.929518 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:29.301898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-385380445", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "availability_zone": "tempest-test_az-1627231216"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:29.334293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.334854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.336362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.336912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.457360 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19a514ba-775f-4a0c-8bc3-94f724418ff5 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/154629440/action" status: 200 len: 21 microversion: 2.1 time: 0.533062 Jul 19 19:45:29.457965 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 17/29] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/flavors/154629440/action => generated 21 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:29.463611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a864cb72-a286-44f9-9798-8c1b34749309 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.497970 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a864cb72-a286-44f9-9798-8c1b34749309 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5802 microversion: 2.1 time: 0.038717 Jul 19 19:45:29.511865 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 18/30] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/detail => generated 5802 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:29.517026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e29097ad-46fa-493e-a588-d212851a3889 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.518748 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:29.518748 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:29.557888 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e29097ad-46fa-493e-a588-d212851a3889 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.040911 Jul 19 19:45:29.561606 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 19/31] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/1868978849/os-extra_specs/hw:numa_nodes => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:45:29.571937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f915a6e9-fa91-4d09-97d7-ccf26d5c9bf3 tempest-FlavorsAccessTestJSON-1786541114 tempest-FlavorsAccessTestJSON-1786541114-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.599799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f915a6e9-fa91-4d09-97d7-ccf26d5c9bf3 tempest-FlavorsAccessTestJSON-1786541114 tempest-FlavorsAccessTestJSON-1786541114-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5802 microversion: 2.1 time: 0.037049 Jul 19 19:45:29.599992 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 20/32] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/detail => generated 5802 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:29.614276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b867756-3991-44b7-b59b-e14603815239 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.615068 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:29.615068 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:29.671097 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b867756-3991-44b7-b59b-e14603815239 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1836617605" status: 202 len: 0 microversion: 2.1 time: 0.065185 Jul 19 19:45:29.671656 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 21/33] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/1836617605 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:29.686186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d35de87c-991b-440a-ad00-e423673a106e tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.689305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:29.710936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d35de87c-991b-440a-ad00-e423673a106e tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1868978849/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.034525 Jul 19 19:45:29.711931 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 22/34] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/1868978849/os-extra_specs/hw:cpu_policy => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:45:29.716519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-373ec237-a10e-4ee0-8180-2c33e7c8f26a tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.739385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-373ec237-a10e-4ee0-8180-2c33e7c8f26a tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/154629440" status: 202 len: 0 microversion: 2.1 time: 0.026231 Jul 19 19:45:29.740690 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 23/35] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/154629440 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:29.745743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4424736-e667-4712-b289-bde43510a58f tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.769456 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4424736-e667-4712-b289-bde43510a58f tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.027354 Jul 19 19:45:29.780630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 24/36] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:29.786888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41c51f16-b026-4e8e-8e86-20ec87bd8e1a tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.798668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41c51f16-b026-4e8e-8e86-20ec87bd8e1a tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1868978849/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016297 Jul 19 19:45:29.809792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 25/37] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/1868978849/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:29.814963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:29.820724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94ed1edd-46cc-434c-b67a-96b8e2e321a6 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.842032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94ed1edd-46cc-434c-b67a-96b8e2e321a6 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.031074 Jul 19 19:45:29.843959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 26/38] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:29.862930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c2726f4-2182-4372-92f0-298bb3f3d232 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1003613855", "id": 348307496, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:29.883994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c2726f4-2182-4372-92f0-298bb3f3d232 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038783 Jul 19 19:45:29.890796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 27/39] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:29 2022] POST /compute/v2.1/flavors => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:29.890796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f63e964-c712-474b-9dfb-aab50ce1ebe2 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.911462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f63e964-c712-474b-9dfb-aab50ce1ebe2 tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1868978849" status: 202 len: 0 microversion: 2.1 time: 0.025088 Jul 19 19:45:29.912950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 28/40] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/1868978849 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:29.918249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e03d3e1-c59b-4b3b-a5bf-99b7f6d293ca tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1351518577", "id": 29998402, "os-flavor-access:is_public": "False"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:29.937384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e03d3e1-c59b-4b3b-a5bf-99b7f6d293ca tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.023066 Jul 19 19:45:29.938671 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 29/41] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:29 2022] POST /compute/v2.1/flavors => generated 425 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:29.945278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1357fb83-5594-4402-9515-60a079da6029 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.966295 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1357fb83-5594-4402-9515-60a079da6029 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/348307496" status: 202 len: 0 microversion: 2.1 time: 0.025480 Jul 19 19:45:29.968109 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 30/42] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:45:29 2022] DELETE /compute/v2.1/flavors/348307496 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:29.974878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4803754-559f-4323-871e-f56111ce45ed tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.012877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4803754-559f-4323-871e-f56111ce45ed tempest-FlavorsExtraSpecsTestJSON-80039242 tempest-FlavorsExtraSpecsTestJSON-80039242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043322 Jul 19 19:45:30.023790 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 31/43] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.029601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8f3306b-c41a-4eb9-ade0-131bd6388fe7 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.030439 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:30.030439 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:30.059137 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8f3306b-c41a-4eb9-ade0-131bd6388fe7 tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/29998402/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032838 Jul 19 19:45:30.060970 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 32/44] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/29998402/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:30.066044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07547ac0-5abb-41bf-a9b0-09ed425bc2ba tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.096357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07547ac0-5abb-41bf-a9b0-09ed425bc2ba tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033963 Jul 19 19:45:30.097194 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 33/45] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.103588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7185b4c-08ed-4714-9bc4-402eca605a8f tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.130206 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7185b4c-08ed-4714-9bc4-402eca605a8f tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/29998402" status: 202 len: 0 microversion: 2.1 time: 0.031761 Jul 19 19:45:30.131627 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 34/46] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:45:30 2022] DELETE /compute/v2.1/flavors/29998402 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:30.138085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8119d210-8065-47cc-b022-6a17d5b72b85 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-482167531", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:30.156798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8119d210-8065-47cc-b022-6a17d5b72b85 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.022867 Jul 19 19:45:30.157724 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 35/47] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:30.162235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89830e09-c8c5-48c3-aa6f-31d7cc62121a tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.183006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89830e09-c8c5-48c3-aa6f-31d7cc62121a tempest-FlavorsAccessTestJSON-1258099722 tempest-FlavorsAccessTestJSON-1258099722-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.024190 Jul 19 19:45:30.183930 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 36/48] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.188499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e6a111f-db84-444c-aaa4-6f79e7046f10 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.225180 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e6a111f-db84-444c-aaa4-6f79e7046f10 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/5a490be4-2618-4d8a-9631-3154aa38d61b" status: 202 len: 0 microversion: 2.1 time: 0.039959 Jul 19 19:45:30.225822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 37/49] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:30 2022] DELETE /compute/v2.1/flavors/5a490be4-2618-4d8a-9631-3154aa38d61b => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:30.235123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef8db5ff-5085-440a-b356-6a52a9d7044a tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.258370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef8db5ff-5085-440a-b356-6a52a9d7044a tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027513 Jul 19 19:45:30.258882 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 38/50] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:30.274662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fdb46e3-84e0-49dc-b3ea-d59c9c34552e tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-284858690", "id": "4df3e255-539d-40dc-a791-c6d095f4f33e", "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:30.300171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fdb46e3-84e0-49dc-b3ea-d59c9c34552e tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029806 Jul 19 19:45:30.307326 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 39/51] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:30.313810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4c0de588-b25b-405e-964a-edd9849fb75b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.332213 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4c0de588-b25b-405e-964a-edd9849fb75b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/4df3e255-539d-40dc-a791-c6d095f4f33e" status: 202 len: 0 microversion: 2.1 time: 0.023633 Jul 19 19:45:30.337341 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 40/52] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:30 2022] DELETE /compute/v2.1/flavors/4df3e255-539d-40dc-a791-c6d095f4f33e => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:30.343404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb3b9123-a76b-4906-a26e-e3bce451bb9b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.352862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:30.353571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:30.354252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:30.354721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:30.355120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:30.369662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.370323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.371265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.372084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.374178 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb3b9123-a76b-4906-a26e-e3bce451bb9b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035127 Jul 19 19:45:30.386171 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 41/53] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.393669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab338841-0a2b-46e6-8c6c-fbd687f9f1ba tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1544147295", "id": 1162176044, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:30.416605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab338841-0a2b-46e6-8c6c-fbd687f9f1ba tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028581 Jul 19 19:45:30.417533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 42/54] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:30.427912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Getting quotas for project 1dacf2678b8c4bc793358cb79b48e333. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:30.429599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ccb59ee9-2955-44e8-ac94-27cbeab91a55 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.435583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Getting quotas for user bfd1fb66a65d43608ee639bc5dd03e2d and project 1dacf2678b8c4bc793358cb79b48e333. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:30.438232 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ccb59ee9-2955-44e8-ac94-27cbeab91a55 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1162176044" status: 200 len: 414 microversion: 2.1 time: 0.014296 Jul 19 19:45:30.439133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 43/55] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/1162176044 => generated 414 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:30.456251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:30.459608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:30.518954 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6e67554-3e67-4c2d-adf2-df4e5e1d9a59 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784406 Jul 19 19:45:30.519832 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 13/56] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:30.534921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1411377-323f-42ac-aaeb-902b4582cc58 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.535549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1411377-323f-42ac-aaeb-902b4582cc58 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:30.638163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1411377-323f-42ac-aaeb-902b4582cc58 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:30.660412 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1411377-323f-42ac-aaeb-902b4582cc58 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1242 microversion: 2.1 time: 0.130012 Jul 19 19:45:30.662574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 14/57] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.120334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1077032b-9148-4f97-96b6-50a7f7f29968 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.144815 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1077032b-9148-4f97-96b6-50a7f7f29968 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.698928 Jul 19 19:45:31.155001 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 44/58] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:31.160173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4d32143-ef2a-4020-87ca-ff87ae6f77f3 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.161063 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:31.161063 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:31.181596 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4d32143-ef2a-4020-87ca-ff87ae6f77f3 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1162176044" status: 202 len: 0 microversion: 2.1 time: 0.025259 Jul 19 19:45:31.187354 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 15/59] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:31 2022] DELETE /compute/v2.1/flavors/1162176044 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:45:31.190632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6bf8ee2e-afa1-4786-b856-2433bce628c5 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.225456 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6bf8ee2e-afa1-4786-b856-2433bce628c5 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038556 Jul 19 19:45:31.226674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 45/60] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.242847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cdd1de55-7037-4917-9f92-2b3f710e4c7f tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1837191688", "id": 2105440369, "os-flavor-access:is_public": "False"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.244449 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:31.244449 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:31.250054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:31.266502 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cdd1de55-7037-4917-9f92-2b3f710e4c7f tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.027377 Jul 19 19:45:31.266810 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 16/61] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.277053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3845891d-acb8-4d56-b9b2-ddede56e07d3 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "2105440369"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.286432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-3845891d-acb8-4d56-b9b2-ddede56e07d3 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] HTTP exception thrown: Flavor 2105440369 could not be found. Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3845891d-acb8-4d56-b9b2-ddede56e07d3 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Request method failure captured: Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 107 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnVX0e6bwoLOtA-svQmsPPmnlntAsjuVd9RsZ6c89bGXcVZShd7zG5VMZogYNv-kmdvdBBV72Gmpy-H1wJOgIJMJbVcrYlwgXR7f04W9TPkF57raA27sd0CRIl0T3RF_aX3ZQbvJtEosHh3CDgNX1gCdhuOYP69sz6tInkRDifv3MM Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09f4dd8c6db14acba3ac3ef5a5a819d6 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsAdminTestJSON-2069673985 Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:31.290990 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09f4dd8c6db14acba3ac3ef5a5a819d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09f4dd8c6db14acba3ac3ef5a5a819d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09f4dd8c6db14acba3ac3ef5a5a819d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09f4dd8c6db14acba3ac3ef5a5a819d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsAdminTestJSON-2069673985 Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09f4dd8c6db14acba3ac3ef5a5a819d6 Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2069673985 Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsAdminTestJSON-2069673985-project Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 9fa7d0e4865742a29af88f5207b57255 Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsAdminTestJSON-2069673985-project Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "test", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "2105440369"}} Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:45:31.292460 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor 2105440369 could not be found. Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '2105440369'}}} Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2105440369 could not be found. Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.293267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2105440369 could not be found. Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.294295 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2105440369 could not be found. Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3845891d-acb8-4d56-b9b2-ddede56e07d3 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Returning 400 to user: Flavor 2105440369 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:31.295301 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3845891d-acb8-4d56-b9b2-ddede56e07d3 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.019360 Jul 19 19:45:31.296470 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 46/62] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/servers => generated 81 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:45:31.301886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66687eda-e505-47be-891f-00de2b33c7e6 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.324087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66687eda-e505-47be-891f-00de2b33c7e6 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2105440369" status: 202 len: 0 microversion: 2.1 time: 0.025723 Jul 19 19:45:31.325189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 17/63] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:31 2022] DELETE /compute/v2.1/flavors/2105440369 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:31.333292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78041b9a-ce7d-43bd-9b23-1b8d998a4464 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.350350 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78041b9a-ce7d-43bd-9b23-1b8d998a4464 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021127 Jul 19 19:45:31.351457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 47/64] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.367488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad48f6fd-ed4f-4365-8764-970aeeb79643 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-698112466", "id": 1144164839, "os-flavor-access:is_public": "False"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.398137 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad48f6fd-ed4f-4365-8764-970aeeb79643 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034714 Jul 19 19:45:31.400407 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 18/65] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.420045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a77ea75c-72bc-4abb-993f-ed94a57298e7 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1183194409", "id": 98910482, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.428192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=19,nova_api:INSERT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:31.436997 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a77ea75c-72bc-4abb-993f-ed94a57298e7 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.030265 Jul 19 19:45:31.443516 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 48/66] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:31.447715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68743b22-c7d0-4929-8b76-1564fb2c2ba1 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.472237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68743b22-c7d0-4929-8b76-1564fb2c2ba1 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.027546 Jul 19 19:45:31.473479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 19/67] 10.222.0.33 () {58 vars in 1168 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:31.487127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1212747e-c1ac-4bf5-9193-6ad550e1c748 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.509825 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1212747e-c1ac-4bf5-9193-6ad550e1c748 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.027517 Jul 19 19:45:31.511180 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 49/68] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.524756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7ecaa9fc-21d9-4590-945d-9ae644d1a2c8 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.536417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7ecaa9fc-21d9-4590-945d-9ae644d1a2c8 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017791 Jul 19 19:45:31.537595 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 20/69] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.556507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-84a3012f-e375-488e-8004-9cc5d8050131 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.583102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-84a3012f-e375-488e-8004-9cc5d8050131 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.033374 Jul 19 19:45:31.584970 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 50/70] 10.222.0.33 () {58 vars in 1168 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.595616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-890046cd-7f2b-4e97-81b1-e11c29970676 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.621432 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-890046cd-7f2b-4e97-81b1-e11c29970676 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5389 microversion: 2.1 time: 0.029426 Jul 19 19:45:31.633179 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 21/71] 10.222.0.33 () {58 vars in 1168 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5389 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.637867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b294b5a-9c27-4c8e-b195-9f3e22990e8c tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.679915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ee52ee9-f720-4fe4-8162-dca75dc430d2 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.680775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ee52ee9-f720-4fe4-8162-dca75dc430d2 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:31.688077 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b294b5a-9c27-4c8e-b195-9f3e22990e8c tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5389 microversion: 2.1 time: 0.053957 Jul 19 19:45:31.688688 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 51/72] 10.222.0.33 () {58 vars in 1174 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5389 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.703071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c88da65b-5a95-44f0-a469-19072249d753 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.753939 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c88da65b-5a95-44f0-a469-19072249d753 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5389 microversion: 2.1 time: 0.054618 Jul 19 19:45:31.760123 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 52/73] 10.222.0.33 () {58 vars in 1172 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5389 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:31.774752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3689377a-5ba2-4ea7-9403-2567acf516cf tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.813009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3689377a-5ba2-4ea7-9403-2567acf516cf tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5389 microversion: 2.1 time: 0.040331 Jul 19 19:45:31.815074 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 53/74] 10.222.0.33 () {58 vars in 1168 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5389 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.829651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b359905-7d05-4db2-9d19-17f58d8941da tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.842134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ee52ee9-f720-4fe4-8162-dca75dc430d2 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:31.853567 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ee52ee9-f720-4fe4-8162-dca75dc430d2 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1242 microversion: 2.1 time: 0.178454 Jul 19 19:45:31.859524 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 22/75] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.873106 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b359905-7d05-4db2-9d19-17f58d8941da tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/98910482" status: 202 len: 0 microversion: 2.1 time: 0.047386 Jul 19 19:45:31.884901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7579230-4abe-4555-bf66-637e40e7256d tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.889048 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 54/76] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:45:31 2022] DELETE /compute/v2.1/flavors/98910482 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:45:31.955370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7579230-4abe-4555-bf66-637e40e7256d tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071177 Jul 19 19:45:31.957593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 23/77] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.971841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-215cc698-e0d6-4ec2-bcd0-686188a28e92 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.997264 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-215cc698-e0d6-4ec2-bcd0-686188a28e92 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1144164839" status: 202 len: 0 microversion: 2.1 time: 0.029515 Jul 19 19:45:32.001139 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 55/78] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:31 2022] DELETE /compute/v2.1/flavors/1144164839 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:32.006248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89cc8ed7-7025-40d9-a0d4-a751e6f8f578 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.038065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89cc8ed7-7025-40d9-a0d4-a751e6f8f578 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035573 Jul 19 19:45:32.050584 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 24/79] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:32.056297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4fe2b44-f80d-471a-a774-8aca8fcaac68 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1400167204", "id": 1742090537, "os-flavor-access:is_public": "False"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:32.078850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4fe2b44-f80d-471a-a774-8aca8fcaac68 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.023475 Jul 19 19:45:32.091001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f60828ee-bbca-4318-8fb4-ed551a86d96a tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.096196 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 56/80] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:32.110736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f60828ee-bbca-4318-8fb4-ed551a86d96a tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023951 Jul 19 19:45:32.111592 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 25/81] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:32.127039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-670919ee-cd39-4eef-b3f1-84d689285a0b tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.150143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-670919ee-cd39-4eef-b3f1-84d689285a0b tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026731 Jul 19 19:45:32.151614 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 57/82] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:32.166111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6be7e10-7b77-462f-8052-3ce732a7f595 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.167142 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:32.167142 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:32.188334 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6be7e10-7b77-462f-8052-3ce732a7f595 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1742090537" status: 202 len: 0 microversion: 2.1 time: 0.024960 Jul 19 19:45:32.189754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 26/83] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:32 2022] DELETE /compute/v2.1/flavors/1742090537 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:32.201439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-49d1f6a3-c463-4650-a868-5151e5b441f6 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.238162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-49d1f6a3-c463-4650-a868-5151e5b441f6 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043582 Jul 19 19:45:32.240055 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 58/84] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:32.255092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd79b459-db42-4ff6-8b38-566902f1055c tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-848495202", "id": 1058950821, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:32.258130 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:32.258130 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:32.277951 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd79b459-db42-4ff6-8b38-566902f1055c tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.025980 Jul 19 19:45:32.285894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 27/85] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:32.290371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4c075d7-774b-4a4b-96c7-e290190cbbc7 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.312799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4c075d7-774b-4a4b-96c7-e290190cbbc7 tempest-FlavorsAdminTestJSON-2069673985 tempest-FlavorsAdminTestJSON-2069673985-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.026807 Jul 19 19:45:32.313381 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 59/86] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:32.330145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ddcbc840-cc2d-473f-98b4-6a5f0023739b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.351610 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ddcbc840-cc2d-473f-98b4-6a5f0023739b tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1058950821" status: 202 len: 0 microversion: 2.1 time: 0.026712 Jul 19 19:45:32.352427 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 28/87] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:32 2022] DELETE /compute/v2.1/flavors/1058950821 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:32.359982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6c3a8ac-2695-4f93-97a9-09156fccc3d8 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.379941 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6c3a8ac-2695-4f93-97a9-09156fccc3d8 tempest-FlavorsAdminTestJSON-1691952668 tempest-FlavorsAdminTestJSON-1691952668-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023388 Jul 19 19:45:32.380532 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 60/88] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:32.871376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.873184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:32.898041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.898493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:32.899272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.906359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:33.148332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:33.160584 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-473c895b-1d19-4f8d-b186-d6cbf17eed45 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1290 microversion: 2.1 time: 0.293815 Jul 19 19:45:33.171350 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 29/89] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:32 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1290 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:34.178003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:34.179242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:34.205418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.206116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.211248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.211926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.291202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88ed601f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.292731 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:35.292731 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:35.294804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.296505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.298998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.299945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.406873 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a79e776-cabf-4a12-a489-d1cda5093717 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.947750 Jul 19 19:45:35.413396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 30/90] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 19:45:34 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:35.433978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88ed07430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.435750 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:35.435750 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:35.452571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.453251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.460978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.462241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.503223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c46be2c-e702-445a-b623-1b2138ebcf0d tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.082342 Jul 19 19:45:35.504406 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 31/91] 10.222.0.33 () {58 vars in 1138 bytes} [Tue Jul 19 19:45:35 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:35.520843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88ed07280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.523526 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:35.523526 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:35.528448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.529923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.531697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.533855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.647313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-652c34ed-4059-4ad2-950f-c3a91e2b8b26 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.132917 Jul 19 19:45:35.653477 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 32/92] 10.222.0.33 () {58 vars in 1144 bytes} [Tue Jul 19 19:45:35 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:36.439781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:36.461383 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba40ab9b-0ed3-4110-bbb5-883bdecfd9e8 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 2.287011 Jul 19 19:45:36.473671 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 61/93] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:34 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:37.756542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Calling method '.version_select at 0x7fb88ec32dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:37.758995 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:37.758995 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:37.760532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.761369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.762613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.763257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.793200 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62d3ccc6-c02b-476f-b702-a22fe845dd94 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.375289 Jul 19 19:45:37.794071 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 33/94] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 19:45:37 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:37.799558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:37.800192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:37.807212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.807662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.808467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.809166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.984418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9ad988c-5b28-4a95-b321-b1c9e121644e tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Calling method '.version_select at 0x7fb8905c8e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:37.987374 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:37.987374 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:37.989493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9ad988c-5b28-4a95-b321-b1c9e121644e tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b81d5ad276364c3fa302967e658bd653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb4724e5354abd8532e36ed783ad5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9ad988c-5b28-4a95-b321-b1c9e121644e tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Request method failure captured: Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneaiED6dlbDxx82jR2wXqzawJfhEZ7CyExKZ1Pn4HJ_cITeiGVS-tKEuuetPIJph5pxv15uG5lWs8GN-6SoJ0hwd0AFF1BDMBdQ1bCoTAE1WBac9Zl2h3OlknfluInwdYzgyqXs6HBy12gAbxBfRwQBevIW5rU1-XD-_vYrRCAiVQ Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:37.993279 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: b81d5ad276364c3fa302967e658bd653 Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 19:45:37.995205 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:37.996163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:45:37.997330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.003285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.006021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9ad988c-5b28-4a95-b321-b1c9e121644e tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.007566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9ad988c-5b28-4a95-b321-b1c9e121644e tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.562767 Jul 19 19:45:38.009299 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 62/95] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:45:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 565 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.017247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9bf64d5-d792-4200-a9da-f04362ccaf28 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.221835 Jul 19 19:45:38.018357 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 34/96] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:37 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:38.025179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f606f79-2435-444c-bd2c-d2462ca76b8f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Calling method '.version_select at 0x7fb88ec5edc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.026576 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.026576 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:38.028220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f606f79-2435-444c-bd2c-d2462ca76b8f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b81d5ad276364c3fa302967e658bd653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb4724e5354abd8532e36ed783ad5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f606f79-2435-444c-bd2c-d2462ca76b8f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Request method failure captured: Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wneaiED6dlbDxx82jR2wXqzawJfhEZ7CyExKZ1Pn4HJ_cITeiGVS-tKEuuetPIJph5pxv15uG5lWs8GN-6SoJ0hwd0AFF1BDMBdQ1bCoTAE1WBac9Zl2h3OlknfluInwdYzgyqXs6HBy12gAbxBfRwQBevIW5rU1-XD-_vYrRCAiVQ Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:38.034073 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b81d5ad276364c3fa302967e658bd653 Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 19:45:38.035375 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.036260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:45:38.037427 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.040572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f606f79-2435-444c-bd2c-d2462ca76b8f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.041583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f606f79-2435-444c-bd2c-d2462ca76b8f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.022109 Jul 19 19:45:38.046640 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 35/97] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.052444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22cffcb0-54bb-4289-a321-98f475bfcd2f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Calling method '.version_select at 0x7fb88ec32430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.053489 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.053489 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:38.055239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22cffcb0-54bb-4289-a321-98f475bfcd2f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b81d5ad276364c3fa302967e658bd653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb4724e5354abd8532e36ed783ad5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22cffcb0-54bb-4289-a321-98f475bfcd2f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Request method failure captured: Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wneaiED6dlbDxx82jR2wXqzawJfhEZ7CyExKZ1Pn4HJ_cITeiGVS-tKEuuetPIJph5pxv15uG5lWs8GN-6SoJ0hwd0AFF1BDMBdQ1bCoTAE1WBac9Zl2h3OlknfluInwdYzgyqXs6HBy12gAbxBfRwQBevIW5rU1-XD-_vYrRCAiVQ Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:38.057163 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b81d5ad276364c3fa302967e658bd653 Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 19:45:38.058464 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.059282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:45:38.060508 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.062597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22cffcb0-54bb-4289-a321-98f475bfcd2f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.063601 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22cffcb0-54bb-4289-a321-98f475bfcd2f tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015788 Jul 19 19:45:38.070461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 36/98] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.183729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-426b273a-6dba-4790-a5b5-4f164c9fec29 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Calling method '.version_select at 0x7fb89069bca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.186156 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.186156 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.190659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-426b273a-6dba-4790-a5b5-4f164c9fec29 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-426b273a-6dba-4790-a5b5-4f164c9fec29 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.194821 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 19:45:38.196102 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.196802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:45:38.197800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.200782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-426b273a-6dba-4790-a5b5-4f164c9fec29 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.200782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-426b273a-6dba-4790-a5b5-4f164c9fec29 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.187552 Jul 19 19:45:38.200782 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 63/99] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.208377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fd29828-d8e5-4e4f-9e82-f13c6193aa76 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Calling method '.version_select at 0x7fb890528430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.209419 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.209419 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.211200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fd29828-d8e5-4e4f-9e82-f13c6193aa76 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fd29828-d8e5-4e4f-9e82-f13c6193aa76 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/n-d-843861-3/reboot HTTP/1.1 Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.213002 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3'} Jul 19 19:45:38.214110 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.214783 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:45:38.215756 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.216640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fd29828-d8e5-4e4f-9e82-f13c6193aa76 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.216640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fd29828-d8e5-4e4f-9e82-f13c6193aa76 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-843861-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009930 Jul 19 19:45:38.216640 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 64/100] 10.222.0.33 () {58 vars in 1187 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/n-d-843861-3/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.234306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6cb09006-fb99-40c3-9454-717e127b038a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Calling method '.version_select at 0x7fb890528f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.282052 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-6cb09006-fb99-40c3-9454-717e127b038a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6cb09006-fb99-40c3-9454-717e127b038a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.288871 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:45:38.290479 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:38.291319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:45:38.296242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6cb09006-fb99-40c3-9454-717e127b038a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6cb09006-fb99-40c3-9454-717e127b038a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.066862 Jul 19 19:45:38.298698 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 65/101] 10.222.0.33 () {58 vars in 1211 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:38.302517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14f34b1e-5bc2-403a-8128-6b27aa57478f tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Calling method '.version_select at 0x7fb88fbaa670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.305339 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.305339 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.306497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-14f34b1e-5bc2-403a-8128-6b27aa57478f tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14f34b1e-5bc2-403a-8128-6b27aa57478f tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/n-d-843861-3 HTTP/1.1 Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.308064 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3'} Jul 19 19:45:38.309381 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.310333 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:45:38.311425 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.312682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14f34b1e-5bc2-403a-8128-6b27aa57478f tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.312682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-14f34b1e-5bc2-403a-8128-6b27aa57478f tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-843861-3" status: 403 len: 109 microversion: 2.1 time: 0.012471 Jul 19 19:45:38.312682 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 66/102] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/n-d-843861-3 => generated 109 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.321182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1b1c446-eac2-4680-b16c-0cbb55eae7d9 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Calling method '.version_select at 0x7fb88fbaac10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.329447 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c1b1c446-eac2-4680-b16c-0cbb55eae7d9 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1b1c446-eac2-4680-b16c-0cbb55eae7d9 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.331411 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:45:38.332818 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.333606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.334763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.336521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1b1c446-eac2-4680-b16c-0cbb55eae7d9 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.336521 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1b1c446-eac2-4680-b16c-0cbb55eae7d9 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017168 Jul 19 19:45:38.339334 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 67/103] 10.222.0.33 () {58 vars in 1190 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:38.346767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-940a4f91-cf78-437a-a291-5ce4d46a0c50 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Calling method '.version_select at 0x7fb88fbaa310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.347601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Calling method '.version_select at 0x7fb88fec6ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.347731 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.347731 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.348862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-940a4f91-cf78-437a-a291-5ce4d46a0c50 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-940a4f91-cf78-437a-a291-5ce4d46a0c50 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/n-d-843861-3/shutdown HTTP/1.1 Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.350386 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3'} Jul 19 19:45:38.351495 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.352562 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:45:38.353522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.354829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-940a4f91-cf78-437a-a291-5ce4d46a0c50 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.354829 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-940a4f91-cf78-437a-a291-5ce4d46a0c50 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-843861-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009892 Jul 19 19:45:38.354960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.354960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.358433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 68/104] 10.222.0.33 () {58 vars in 1193 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/n-d-843861-3/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.363420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e666896-095a-4e47-a2f0-0a0e45e12dcf tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Calling method '.version_select at 0x7fb88fbc3700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.375989 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-8e666896-095a-4e47-a2f0-0a0e45e12dcf tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e666896-095a-4e47-a2f0-0a0e45e12dcf tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.377812 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:45:38.378957 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:38.379615 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:45:38.380582 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e666896-095a-4e47-a2f0-0a0e45e12dcf tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.381517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e666896-095a-4e47-a2f0-0a0e45e12dcf tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020046 Jul 19 19:45:38.385623 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 69/105] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:38.387000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.387461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.390699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e3a0428-25e7-464e-880e-7d1417bd0e71 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Calling method '.version_select at 0x7fb88fbaa1f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.391487 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.391487 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.392594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e3a0428-25e7-464e-880e-7d1417bd0e71 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e3a0428-25e7-464e-880e-7d1417bd0e71 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/n-d-843861-3/startup HTTP/1.1 Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.394285 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3'} Jul 19 19:45:38.395366 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.396116 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:45:38.397046 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.398042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e3a0428-25e7-464e-880e-7d1417bd0e71 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.398042 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e3a0428-25e7-464e-880e-7d1417bd0e71 tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-843861-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.009585 Jul 19 19:45:38.398042 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 70/106] 10.222.0.33 () {58 vars in 1190 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/n-d-843861-3/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.410655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16b883f2-aa0a-49e1-893a-320877cca9c3 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Calling method '.version_select at 0x7fb88fbc3790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.410837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.411295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.419648 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7120d1ea-8ad3-42e5-a4e9-2006865ad5f2 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.348069 Jul 19 19:45:38.420872 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 37/107] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:38.435986 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-16b883f2-aa0a-49e1-893a-320877cca9c3 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.436729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1eb6d776-e7b1-4d96-88c4-02f8b0cd2d64 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Calling method '.version_select at 0x7fb88ec49b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.438088 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.438088 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:38.439562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1eb6d776-e7b1-4d96-88c4-02f8b0cd2d64 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b81d5ad276364c3fa302967e658bd653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb4724e5354abd8532e36ed783ad5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16b883f2-aa0a-49e1-893a-320877cca9c3 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.441241 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:45:38.442548 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:38.443355 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:45:38.444621 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.445747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16b883f2-aa0a-49e1-893a-320877cca9c3 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.446471 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16b883f2-aa0a-49e1-893a-320877cca9c3 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.042299 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1eb6d776-e7b1-4d96-88c4-02f8b0cd2d64 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Request method failure captured: Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wneaiED6dlbDxx82jR2wXqzawJfhEZ7CyExKZ1Pn4HJ_cITeiGVS-tKEuuetPIJph5pxv15uG5lWs8GN-6SoJ0hwd0AFF1BDMBdQ1bCoTAE1WBac9Zl2h3OlknfluInwdYzgyqXs6HBy12gAbxBfRwQBevIW5rU1-XD-_vYrRCAiVQ Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:38.447201 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b81d5ad276364c3fa302967e658bd653 Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1'} Jul 19 19:45:38.448365 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.450569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:45:38.452014 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.453021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 71/108] 10.222.0.33 () {58 vars in 1214 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 19:45:38.454384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1eb6d776-e7b1-4d96-88c4-02f8b0cd2d64 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.455861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1eb6d776-e7b1-4d96-88c4-02f8b0cd2d64 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024483 Jul 19 19:45:38.457388 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 38/109] 10.222.0.33 () {58 vars in 1172 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.462080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff42e150-2b5c-4a7f-8b58-5121a83c3a97 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Action: 'update', calling method: .version_select at 0x7fb88fbc3550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.468135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4439af93-b42d-4e8b-ac8d-6ff6d3d85f24 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Calling method '.version_select at 0x7fb88ec329d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.470891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4439af93-b42d-4e8b-ac8d-6ff6d3d85f24 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] HTTP exception thrown: Hypervisor with ID '2fa6f3e4-fa19-4cb4-8645-de81e816b994' could not be found. Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4439af93-b42d-4e8b-ac8d-6ff6d3d85f24 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Request method failure captured: Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-hypervisors/2fa6f3e4-fa19-4cb4-8645-de81e816b994/uptime HTTP/1.1 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnhwUO1F2VqkcZ3L3GoF2Jk_Mo1ydbVd-eFI_2sLi_SSTur4N-9KUwS0Rl2XLNp0PkGXiURaCKiS8cyZlZWNFgGC7P3g7R-KOSKLokglWDUsBdR4984ja7RzUjJam6yDY4RsY7EFAk0YiegwCcuPjd_P5jy1W2mVuRqFJmYfrfwVFY Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5907cf2c64e9403ba78ebd01505ed3c7 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:45:38.473551 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5907cf2c64e9403ba78ebd01505ed3c7 Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e60b164fcead49649a5393799d578dae Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: exception: Hypervisor with ID '2fa6f3e4-fa19-4cb4-8645-de81e816b994' could not be found. Jul 19 19:45:38.474907 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2fa6f3e4-fa19-4cb4-8645-de81e816b994'} Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2fa6f3e4-fa19-4cb4-8645-de81e816b994' Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 19:45:38.476275 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2fa6f3e4-fa19-4cb4-8645-de81e816b994' could not be found. Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.477628 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2fa6f3e4-fa19-4cb4-8645-de81e816b994' could not be found. Jul 19 19:45:38.478902 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.480503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4439af93-b42d-4e8b-ac8d-6ff6d3d85f24 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Returning 404 to user: Hypervisor with ID '2fa6f3e4-fa19-4cb4-8645-de81e816b994' could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.481806 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4439af93-b42d-4e8b-ac8d-6ff6d3d85f24 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2fa6f3e4-fa19-4cb4-8645-de81e816b994/uptime" status: 404 len: 123 microversion: 2.1 time: 0.017665 Jul 19 19:45:38.488865 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 39/110] 10.222.0.33 () {58 vars in 1277 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors/2fa6f3e4-fa19-4cb4-8645-de81e816b994/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff42e150-2b5c-4a7f-8b58-5121a83c3a97 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-hosts/n-d-843861-3 HTTP/1.1 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 51 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.493748 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: {"status": "enable", "maintenance_mode": "invalid"} Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.494962 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.495692 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.497237 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.498349 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.498349 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:45:38.498349 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:45:38.498349 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.498349 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.499371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff42e150-2b5c-4a7f-8b58-5121a83c3a97 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.499669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Calling method '.version_select at 0x7fb88ec49820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.500501 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff42e150-2b5c-4a7f-8b58-5121a83c3a97 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-843861-3" status: 400 len: 199 microversion: 2.1 time: 0.047161 Jul 19 19:45:38.501077 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.501077 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:38.502492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.503082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.506497 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 72/111] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:38 2022] PUT /compute/v2.1/os-hosts/n-d-843861-3 => generated 199 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:45:38.516253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d805ca00-d669-435e-b126-557616d0c427 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Action: 'update', calling method: .version_select at 0x7fb88fbaaee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d805ca00-d669-435e-b126-557616d0c427 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-hosts/n-d-843861-3 HTTP/1.1 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 51 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.520540 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: {"status": "invalid", "maintenance_mode": "enable"} Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.522824 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.523956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.525201 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.526340 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.526340 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:45:38.526340 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:45:38.526340 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:45:38.526340 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.533596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d805ca00-d669-435e-b126-557616d0c427 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.539143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d805ca00-d669-435e-b126-557616d0c427 tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-843861-3" status: 400 len: 189 microversion: 2.1 time: 0.029233 Jul 19 19:45:38.539889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.540348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.541357 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 73/112] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:38 2022] PUT /compute/v2.1/os-hosts/n-d-843861-3 => generated 189 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:45:38.562116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4645cba1-ea5a-4f4a-b867-58de522540cd tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Action: 'update', calling method: .version_select at 0x7fb88fbaad30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.564900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.566750 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.566750 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.566927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.569255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4645cba1-ea5a-4f4a-b867-58de522540cd tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f59ecae9841f43019740f6a096f8f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e23fae61e848478539cc910cea56bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4645cba1-ea5a-4f4a-b867-58de522540cd tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Request method failure captured: Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-hosts/n-d-843861-3 HTTP/1.1 Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 50 Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneV0zfpZNk8GDG9N-RvfQ7N8go0QH_DENMpMNngx_F_gik5-WrdrX-9JmcIaf36O79iTD78X40jqfmiqOr2T7bbC1_HNv6HUkxx3pXTCTWGqST3X_Qp8s13K3rkL_TaItzOjfpAuShVIYYOjsjg5jA_8QSdYnmWKPUlM6TSNNZhEU Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.575682 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12e23fae61e848478539cc910cea56bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12e23fae61e848478539cc910cea56bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12e23fae61e848478539cc910cea56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 12e23fae61e848478539cc910cea56bf Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1040708185 Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f59ecae9841f43019740f6a096f8f289 Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1040708185-project Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:45:38.576877 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-d-843861-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.577612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:45:38.578589 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.583444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4645cba1-ea5a-4f4a-b867-58de522540cd tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.584017 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46fa93fe-6efb-4254-b9fc-df20e0a9b6b6 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093508 Jul 19 19:45:38.585645 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4645cba1-ea5a-4f4a-b867-58de522540cd tempest-HostsAdminNegativeTestJSON-1040708185 tempest-HostsAdminNegativeTestJSON-1040708185-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-843861-3" status: 403 len: 111 microversion: 2.1 time: 0.036769 Jul 19 19:45:38.588747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 74/113] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:38 2022] PUT /compute/v2.1/os-hosts/n-d-843861-3 => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.596044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:38.597922 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 40/114] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:38.603550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da4925b3-63fd-4142-ac1a-0b06d125ca6c tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Action: 'update', calling method: .version_select at 0x7fb88ed074c0>, body: {"status": null, "maintenance_mode": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.603725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a928377-0a9b-4c90-9337-b9a0ed4c88e1 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Calling method '.version_select at 0x7fb88fbc3040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.604472 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.604472 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:38.605568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a928377-0a9b-4c90-9337-b9a0ed4c88e1 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b81d5ad276364c3fa302967e658bd653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb4724e5354abd8532e36ed783ad5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da4925b3-63fd-4142-ac1a-0b06d125ca6c tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/os-hosts/n-d-843861-3 HTTP/1.1 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 42 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:45:38.606901 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: {"status": null, "maintenance_mode": null} Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:45:38.608010 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'n-d-843861-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi None Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.608746 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.609934 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.610839 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:45:38.610839 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:45:38.610839 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:45:38.610839 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a928377-0a9b-4c90-9337-b9a0ed4c88e1 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Request method failure captured: Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wneaiED6dlbDxx82jR2wXqzawJfhEZ7CyExKZ1Pn4HJ_cITeiGVS-tKEuuetPIJph5pxv15uG5lWs8GN-6SoJ0hwd0AFF1BDMBdQ1bCoTAE1WBac9Zl2h3OlknfluInwdYzgyqXs6HBy12gAbxBfRwQBevIW5rU1-XD-_vYrRCAiVQ Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:38.611061 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4bb4724e5354abd8532e36ed783ad5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: f4bb4724e5354abd8532e36ed783ad5e Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-991640817 Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: b81d5ad276364c3fa302967e658bd653 Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-991640817-project Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1'} Jul 19 19:45:38.612174 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.612861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:45:38.613833 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.619822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da4925b3-63fd-4142-ac1a-0b06d125ca6c tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.619901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a928377-0a9b-4c90-9337-b9a0ed4c88e1 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.619969 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da4925b3-63fd-4142-ac1a-0b06d125ca6c tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-843861-3" status: 400 len: 127 microversion: 2.1 time: 0.009355 Jul 19 19:45:38.620045 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a928377-0a9b-4c90-9337-b9a0ed4c88e1 tempest-HypervisorAdminNegativeTestJSON-991640817 tempest-HypervisorAdminNegativeTestJSON-991640817-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015354 Jul 19 19:45:38.620045 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 75/115] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.622928 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 41/116] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:38 2022] PUT /compute/v2.1/os-hosts/n-d-843861-3 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:45:38.623544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27cf4a86-e66d-4ca0-aa1d-b5305a1db049 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Calling method '.version_select at 0x7fb88fb6caf0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.625723 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-27cf4a86-e66d-4ca0-aa1d-b5305a1db049 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] HTTP exception thrown: Hypervisor with ID '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' could not be found. Jul 19 19:45:38.627185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Action: 'update', calling method: .version_select at 0x7fb88ebf9f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27cf4a86-e66d-4ca0-aa1d-b5305a1db049 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Request method failure captured: Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/29b20bb1-99fb-4640-bf54-d9f9ba15d4e7 HTTP/1.1 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnhwUO1F2VqkcZ3L3GoF2Jk_Mo1ydbVd-eFI_2sLi_SSTur4N-9KUwS0Rl2XLNp0PkGXiURaCKiS8cyZlZWNFgGC7P3g7R-KOSKLokglWDUsBdR4984ja7RzUjJam6yDY4RsY7EFAk0YiegwCcuPjd_P5jy1W2mVuRqFJmYfrfwVFY Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5907cf2c64e9403ba78ebd01505ed3c7 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:38.628461 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5907cf2c64e9403ba78ebd01505ed3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5907cf2c64e9403ba78ebd01505ed3c7 Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693 Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e60b164fcead49649a5393799d578dae Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: exception: Hypervisor with ID '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' could not be found. Jul 19 19:45:38.629579 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7'} Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 19:45:38.630203 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:45:38.631369 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' could not be found. Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' could not be found. Jul 19 19:45:38.633493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.633999 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:38.633999 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:38.633999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.hosts [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Enabling host nonexistent_hostname. Jul 19 19:45:38.634168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27cf4a86-e66d-4ca0-aa1d-b5305a1db049 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] Returning 404 to user: Hypervisor with ID '29b20bb1-99fb-4640-bf54-d9f9ba15d4e7' could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.640831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27cf4a86-e66d-4ca0-aa1d-b5305a1db049 tempest-HypervisorAdminNegativeTestJSON-1775042693 tempest-HypervisorAdminNegativeTestJSON-1775042693-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/29b20bb1-99fb-4640-bf54-d9f9ba15d4e7" status: 404 len: 123 microversion: 2.1 time: 0.011477 Jul 19 19:45:38.641736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 76/117] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/os-hypervisors/29b20bb1-99fb-4640-bf54-d9f9ba15d4e7 => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:38.653971 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Request method failure captured: Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 50 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnhLujnonvc9dovt70DYDTSj3yHwY-zUVYeW5cgP53cO0108cWB62fNpalxYcEas5IJf7WWgbUU3jSuVyJUNehXcr0xWvgpWftEOg1VEEkm7UsIeFvt3amrC4E7vleSLsO2gPr1GOX2QoIyC0HhA0hLFCH7SqZrjazJLU3rlZGO-YY Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:45:38.670348 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b317f29b039b40be8bd36fe8cf4f01d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: b317f29b039b40be8bd36fe8cf4f01d9 Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2096640034 Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 061c2e1cf32148b39a390999e6369a4a Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2096640034-project-admin Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.671707 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:45:38.672592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:38.673638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:38.675239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:38.676246 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2580d0be-38b1-4d9c-ac43-7c03af04123a tempest-HostsAdminNegativeTestJSON-2096640034 tempest-HostsAdminNegativeTestJSON-2096640034-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049358 Jul 19 19:45:38.682525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 42/118] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 19:45:38 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:39.039058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.039797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:39.046595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.047298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.048476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.049067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.230471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:39.239121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-863f28b1-491d-4ea2-8163-b66d86596e52 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.208431 Jul 19 19:45:39.240013 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 77/119] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:39 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:40.094840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-99e988d4-16d3-4879-94ed-2e1d25aedd40 tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-371640950", "id": 831698752, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:40.101723 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:40.101723 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:40.135929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-99e988d4-16d3-4879-94ed-2e1d25aedd40 tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.664154 Jul 19 19:45:40.141681 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 43/120] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:45:39 2022] POST /compute/v2.1/flavors => generated 445 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:45:40.257853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.259451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:40.267753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:40.273631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:40.277619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:40.286348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:40.545903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:40.547638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-accb64fc-dc5d-48c9-922f-3be971932be7 tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.554338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df384071-047a-4ae8-8bbb-fa81aa9c1ff4 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.300241 Jul 19 19:45:40.559463 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 44/121] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:40.575631 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-accb64fc-dc5d-48c9-922f-3be971932be7 tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] 10.222.0.33 "GET /compute/v2.1/flavors/831698752" status: 200 len: 445 microversion: 2.55 time: 0.422892 Jul 19 19:45:40.576478 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 78/122] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/flavors/831698752 => generated 445 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:45:40.588243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebd4f5c1-0d46-43d5-9164-04df5a7f7249 tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] Action: 'update', calling method: .version_select at 0x7fb890c70b80>, body: {"flavor": {"description": "new"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:40.608059 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:40.608059 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:40.658135 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebd4f5c1-0d46-43d5-9164-04df5a7f7249 tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/831698752" status: 200 len: 446 microversion: 2.55 time: 0.074095 Jul 19 19:45:40.660344 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 45/123] 10.222.0.33 () {62 vars in 1215 bytes} [Tue Jul 19 19:45:40 2022] PUT /compute/v2.1/flavors/831698752 => generated 446 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:45:40.672553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f544580-6dcc-41be-a95d-73aab0afd99a tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.696115 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f544580-6dcc-41be-a95d-73aab0afd99a tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.028374 Jul 19 19:45:40.696954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 79/124] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:40.713908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d94d4ff5-93d9-4ffa-ac03-cae4c519be05 tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.758036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d94d4ff5-93d9-4ffa-ac03-cae4c519be05 tempest-FlavorsV255TestJSON-1240487116 tempest-FlavorsV255TestJSON-1240487116-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.048831 Jul 19 19:45:40.773310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fad41ba7-f5c9-43f4-b1fe-23cb4314721d tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.774336 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:40.774336 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:40.779821 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 46/125] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:40.794233 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fad41ba7-f5c9-43f4-b1fe-23cb4314721d tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/831698752" status: 202 len: 0 microversion: 2.55 time: 0.025036 Jul 19 19:45:40.803319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17eef8f0-785f-40b4-b095-78956b54850c tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.808630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 80/126] 10.222.0.33 () {60 vars in 1198 bytes} [Tue Jul 19 19:45:40 2022] DELETE /compute/v2.1/flavors/831698752 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:40.847025 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17eef8f0-785f-40b4-b095-78956b54850c tempest-FlavorsV255TestJSON-1669636921 tempest-FlavorsV255TestJSON-1669636921-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.047302 Jul 19 19:45:40.863252 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 47/127] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:41.755275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Calling method '.version_select at 0x7fb88fb6c430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.758055 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:41.758055 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:41.761053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.762261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.805200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.814276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.833751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.834446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.842118 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e9a628f-fa9b-4aa2-bc3f-01cb969769be tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.814822 Jul 19 19:45:41.843323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 81/128] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:41.849910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:41.853399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.854349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:41.869851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.870542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.871609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.872286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.191884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:42.230967 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-10912aaf-127c-4ee4-8f47-5ace709ceea9 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.386217 Jul 19 19:45:42.240699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 82/129] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:42.252037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ccea4ac-252a-4614-bbc6-a4c2e4914e2c tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-641433602", "id": 1143243187, "os-flavor-access:is_public": "False"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:42.254626 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.254626 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:42.276748 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ccea4ac-252a-4614-bbc6-a4c2e4914e2c tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.866643 Jul 19 19:45:42.279051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 48/130] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:42.289881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e078f04-c65c-498d-ada4-a1688b38fc87 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:42.291353 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.291353 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:42.821515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e11c6e26-3303-4403-9806-79c0f41abb4e tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Calling method '.version_select at 0x7fb88fb6cee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.824671 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.824671 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:42.826203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e11c6e26-3303-4403-9806-79c0f41abb4e tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1c2b3e041c8142d0b42a3750c5127b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b480dc7350471abbab1d23d27d652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e11c6e26-3303-4403-9806-79c0f41abb4e tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Request method failure captured: Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/n-h1-843861-3/search HTTP/1.1 Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnjL3M8lhxF_GlUptNFgWzZfAFwJ0GqUyuw0fLkipQduZQ7X2xbTfd6YpU3eB9fvcuFLO5-7trpXOzn4WhLkXfqauBCGFeIB-jtCFv49eZqCCRxFNItz0lkax5kd5FIsJr3PPzvPeQGw20rKv3dyqsxg_yGax71IO1F5PfCY_gRa2E Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 26b480dc7350471abbab1d23d27d652e Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:42.828610 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b480dc7350471abbab1d23d27d652e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 26b480dc7350471abbab1d23d27d652e Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-288765576-project Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1c2b3e041c8142d0b42a3750c5127b53 Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576-project Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:45:42.829848 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'n-h1-843861-3'} Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:42.830650 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:45:42.831668 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.833851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e11c6e26-3303-4403-9806-79c0f41abb4e tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:42.833851 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e11c6e26-3303-4403-9806-79c0f41abb4e tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-843861-3/search" status: 403 len: 117 microversion: 2.1 time: 0.588759 Jul 19 19:45:42.833851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 83/131] 10.222.0.33 () {58 vars in 1208 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/os-hypervisors/n-h1-843861-3/search => generated 117 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:42.841850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Calling method '.version_select at 0x7fb88fbc3700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.843758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.844251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.851355 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Request method failure captured: Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnk31f8-eFn3Tow1dtq6SslPNHiIGD7FnT64XeoNIa-f0pel0pP7jXcvuFsM3EzaJjzDagx5pqpBZhchpg_YHEMmYDOWJI2gIMoAHbiw2XVWm1etyOEPu5sJc4r3dl1nDPa3rK1nRdObUmY84dHc91EV4phuJZ2OUcX3bvY41Hs0pc Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 17165cf2fcd540cf86c9a70b13257675 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:42.852717 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 17165cf2fcd540cf86c9a70b13257675 Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2e493a53bf8b40948a9725f08df7e49b Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:45:42.853874 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.854575 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54c97337-5572-4d13-a96d-c8664049928c tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.016013 Jul 19 19:45:42.855624 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 84/132] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:42.863719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Calling method '.version_select at 0x7fb88fb99670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.864847 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.864847 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:42.866163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.866607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.895549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.896037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.908391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.908822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.915293 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d5cbe26a-6dc7-4976-9e59-25f65b2f95d9 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055284 Jul 19 19:45:42.920931 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 85/133] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:42.925869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeeb89cc-cebf-48d0-8729-dcdf81ce5aa7 tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Calling method '.version_select at 0x7fb88fb6c940>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.926657 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.926657 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:42.928088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eeeb89cc-cebf-48d0-8729-dcdf81ce5aa7 tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1c2b3e041c8142d0b42a3750c5127b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b480dc7350471abbab1d23d27d652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeeb89cc-cebf-48d0-8729-dcdf81ce5aa7 tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Request method failure captured: Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnjL3M8lhxF_GlUptNFgWzZfAFwJ0GqUyuw0fLkipQduZQ7X2xbTfd6YpU3eB9fvcuFLO5-7trpXOzn4WhLkXfqauBCGFeIB-jtCFv49eZqCCRxFNItz0lkax5kd5FIsJr3PPzvPeQGw20rKv3dyqsxg_yGax71IO1F5PfCY_gRa2E Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 26b480dc7350471abbab1d23d27d652e Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:42.929823 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b480dc7350471abbab1d23d27d652e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b480dc7350471abbab1d23d27d652e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 26b480dc7350471abbab1d23d27d652e Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576 Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-288765576-project Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1c2b3e041c8142d0b42a3750c5127b53 Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-288765576-project Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1'} Jul 19 19:45:42.930976 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:42.931664 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:45:42.933226 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.934115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeeb89cc-cebf-48d0-8729-dcdf81ce5aa7 tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:42.934115 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eeeb89cc-cebf-48d0-8729-dcdf81ce5aa7 tempest-HypervisorAdminNegativeUnderV252Test-288765576 tempest-HypervisorAdminNegativeUnderV252Test-288765576-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009268 Jul 19 19:45:42.935881 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 86/134] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:42.941164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Calling method '.version_select at 0x7fb88fb6c310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.943107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.943424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.951155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:42.951686 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] HTTP exception thrown: No hypervisor matching 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3' could be found. Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Request method failure captured: Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-hypervisors/a38d2f01-aad4-4ebc-b9b8-de5b21995dc3/servers HTTP/1.1 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnk31f8-eFn3Tow1dtq6SslPNHiIGD7FnT64XeoNIa-f0pel0pP7jXcvuFsM3EzaJjzDagx5pqpBZhchpg_YHEMmYDOWJI2gIMoAHbiw2XVWm1etyOEPu5sJc4r3dl1nDPa3rK1nRdObUmY84dHc91EV4phuJZ2OUcX3bvY41Hs0pc Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 17165cf2fcd540cf86c9a70b13257675 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:42.953092 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17165cf2fcd540cf86c9a70b13257675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 17165cf2fcd540cf86c9a70b13257675 Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366 Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2e493a53bf8b40948a9725f08df7e49b Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: exception: No hypervisor matching 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3' could be found. Jul 19 19:45:42.954500 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3'} Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3' could be found. Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.955243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3' could be found. Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] Returning 404 to user: No hypervisor matching 'a38d2f01-aad4-4ebc-b9b8-de5b21995dc3' could be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-304ff51e-1e50-44f4-8801-62d7d53356a0 tempest-HypervisorAdminNegativeUnderV252Test-333061366 tempest-HypervisorAdminNegativeUnderV252Test-333061366-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/a38d2f01-aad4-4ebc-b9b8-de5b21995dc3/servers" status: 404 len: 123 microversion: 2.1 time: 0.017304 Jul 19 19:45:42.956214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 87/135] 10.222.0.33 () {58 vars in 1280 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/os-hypervisors/a38d2f01-aad4-4ebc-b9b8-de5b21995dc3/servers => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:42.980565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e078f04-c65c-498d-ada4-a1688b38fc87 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1143243187/action" status: 200 len: 97 microversion: 2.1 time: 0.694707 Jul 19 19:45:42.981631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 49/136] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Jul 19 19:45:42 2022] POST /compute/v2.1/flavors/1143243187/action => generated 97 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:42.991421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dad80ee-559d-47bb-9618-69ea0efb64d3 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:42.993679 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:42.993679 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:43.247974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:43.248830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:43.260832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:43.262291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:43.263142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:43.263581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:43.528852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:43.536923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-625a55c9-78a4-43b2-a964-8a3944ae4731 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.292658 Jul 19 19:45:43.537504 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 50/137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:43 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:43.723007 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-6dad80ee-559d-47bb-9618-69ea0efb64d3 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dad80ee-559d-47bb-9618-69ea0efb64d3 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Request method failure captured: Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/flavors/1143243187/action HTTP/1.1 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 67 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnjK4_QdLSiBl9eDJ4WL8E65UXrhzrQgNao6dcUR-q3PBIbr9puwA-lUf5FodJabDUADG8QlYWRbz-CXJ-cVIm8KTYgSnN4EBJ2rGnTvSCXzl_3bWm7P9ROn_cOA881k8r8CDOgJQURSkHiKknkmAOeIj8dCwFdYqhsj7GaiDX2s2c Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:45:43.748562 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/355f4ba8af2a445e953eae039048a713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: b97eca51350e4545824523b6ff20cae1 Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} Jul 19 19:45:43.749866 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1143243187', 'body': {'addTenantAccess': {'tenant': 'cf51f215e70b47ddba7db2b1c33481dc'}}} Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:45:43.750647 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-cf51f215e70b47ddba7db2b1c33481dc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 19:45:43.751997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 19:45:43.753305 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:45:43.754773 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-cf51f215e70b47ddba7db2b1c33481dc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 19, 45, 43, 717385), 'updated_at': None, 'flavor_id': 30, 'project_id': 'cf51f215e70b47ddba7db2b1c33481dc'}] Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.755854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.760014 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:43.762136 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:43.763442 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. Jul 19 19:45:43.763442 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.763442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dad80ee-559d-47bb-9618-69ea0efb64d3 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project cf51f215e70b47ddba7db2b1c33481dc combination. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:43.763442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6dad80ee-559d-47bb-9618-69ea0efb64d3 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1143243187/action" status: 409 len: 152 microversion: 2.1 time: 0.763323 Jul 19 19:45:43.763442 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 88/138] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Jul 19 19:45:42 2022] POST /compute/v2.1/flavors/1143243187/action => generated 152 bytes in 765 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:43.763778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b417c54e-4379-402c-8fd4-c9e882fa9cbe tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:43.763778 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:43.763778 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:44.390306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b417c54e-4379-402c-8fd4-c9e882fa9cbe tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1143243187/action" status: 200 len: 21 microversion: 2.1 time: 0.635036 Jul 19 19:45:44.392908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 51/139] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Jul 19 19:45:43 2022] POST /compute/v2.1/flavors/1143243187/action => generated 21 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:44.402718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9475e02f-e420-456f-9600-e961e3761c8c tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.404346 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:44.404346 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:44.425428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9475e02f-e420-456f-9600-e961e3761c8c tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1143243187" status: 202 len: 0 microversion: 2.1 time: 0.026967 Jul 19 19:45:44.426723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 89/140] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:44 2022] DELETE /compute/v2.1/flavors/1143243187 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:44.438827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ae55f7d-515e-49f1-8445-6efec1c9f529 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.463322 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ae55f7d-515e-49f1-8445-6efec1c9f529 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031116 Jul 19 19:45:44.464404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 52/141] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:44.492493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d235761d-c2da-4d28-815c-edc370b39e7f tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-15607105", "id": 1010657444, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:44.494224 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:44.494224 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:44.519045 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d235761d-c2da-4d28-815c-edc370b39e7f tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.032035 Jul 19 19:45:44.520325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 90/142] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:44 2022] POST /compute/v2.1/flavors => generated 436 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:44.542764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7395999-dff0-4ee3-95d6-098338193967 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.544390 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:44.544390 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:44.552235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e7395999-dff0-4ee3-95d6-098338193967 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7395999-dff0-4ee3-95d6-098338193967 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Request method failure captured: Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/flavors/1010657444/os-flavor-access HTTP/1.1 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnjK4_QdLSiBl9eDJ4WL8E65UXrhzrQgNao6dcUR-q3PBIbr9puwA-lUf5FodJabDUADG8QlYWRbz-CXJ-cVIm8KTYgSnN4EBJ2rGnTvSCXzl_3bWm7P9ROn_cOA881k8r8CDOgJQURSkHiKknkmAOeIj8dCwFdYqhsj7GaiDX2s2c Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:45:44.554672 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/355f4ba8af2a445e953eae039048a713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b97eca51350e4545824523b6ff20cae1 Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: exception: Access list not available for public flavors. Jul 19 19:45:44.556176 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'flavor_id': '1010657444'} Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 19 19:45:44.557106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.559317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7395999-dff0-4ee3-95d6-098338193967 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:44.560345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.560565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7395999-dff0-4ee3-95d6-098338193967 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1010657444/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033432 Jul 19 19:45:44.561431 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 53/143] 10.222.0.33 () {58 vars in 1208 bytes} [Tue Jul 19 19:45:44 2022] GET /compute/v2.1/flavors/1010657444/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:44.561551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:44.568959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:44.570011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:44.571018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:44.571638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:44.574886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b68e6c04-9049-4e32-8cec-543349bcf883 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.575970 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:44.575970 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:44.594634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b68e6c04-9049-4e32-8cec-543349bcf883 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1010657444" status: 202 len: 0 microversion: 2.1 time: 0.028519 Jul 19 19:45:44.596026 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 54/144] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:44 2022] DELETE /compute/v2.1/flavors/1010657444 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:44.606264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a82a1f3b-bdea-4b2e-a4f2-1bd13e3a1078 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.633093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a82a1f3b-bdea-4b2e-a4f2-1bd13e3a1078 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032990 Jul 19 19:45:44.634009 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 55/145] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:44.652185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-37fd9a95-8078-4d79-9c7f-1c91c0d86cee tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2073667138", "id": 2051351402, "os-flavor-access:is_public": "False"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:44.653892 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:44.653892 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:44.672891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-37fd9a95-8078-4d79-9c7f-1c91c0d86cee tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.025815 Jul 19 19:45:44.673937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 56/146] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:44.834410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:44.845113 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-33d4645f-9e00-4b20-a0f4-615bf940ef43 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.294469 Jul 19 19:45:44.846057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 91/147] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:44 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:45.043016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-52de9bd5-a23a-4764-a202-41e9a0b4229d req-b811ed57-5c36-4446-bebb-6365a50bec52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c97aa19-0384-4dbf-9c33-176f910408a0", "tag": "43833fb9-b591-4324-b533-ff4320fd262e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.055568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-52de9bd5-a23a-4764-a202-41e9a0b4229d req-b811ed57-5c36-4446-bebb-6365a50bec52 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.056099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-52de9bd5-a23a-4764-a202-41e9a0b4229d req-b811ed57-5c36-4446-bebb-6365a50bec52 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:45.074937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-52de9bd5-a23a-4764-a202-41e9a0b4229d req-b811ed57-5c36-4446-bebb-6365a50bec52 service nova] Creating event network-changed:43833fb9-b591-4324-b533-ff4320fd262e for instance 1c97aa19-0384-4dbf-9c33-176f910408a0 on n-h1-843861-3 Jul 19 19:45:45.075725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-52de9bd5-a23a-4764-a202-41e9a0b4229d req-b811ed57-5c36-4446-bebb-6365a50bec52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:45:45.077128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.077677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:45.078597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.079058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:45.087922 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.rpcapi [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 19:45:45.088782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] Releasing lock "compute-rpcapi-router" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:45:45.105132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-932e31e5-1651-42df-9c1b-65d4099c3087 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429809 Jul 19 19:45:45.105737 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 57/148] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:45.199905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3b9c077-8152-4f05-8133-7fab89b1f332 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.201203 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:45.201203 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:45.202060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3b9c077-8152-4f05-8133-7fab89b1f332 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '210b7cbcbc3f4830ab114eaa548ac517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51f215e70b47ddba7db2b1c33481dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3b9c077-8152-4f05-8133-7fab89b1f332 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Request method failure captured: Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/flavors/2051351402/action HTTP/1.1 Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 67 Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnh4EgBFRQFMU6gcy5A4rmEF9LcNUTIUEbsOj2GZ8nRyOcqwL6SbonFSeXFulU_OlgRC4ZdwWUgMVYG8BY5IByymwjrDSHkaSRGQjkHb-5pdv_Fo-hQQiRVpqRpaxOmkzdFeu4-ZCYTfkrSXjCXal5oRquLEjJk6N4kCjhnckio1lA Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: cf51f215e70b47ddba7db2b1c33481dc Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:45.203623 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: cf51f215e70b47ddba7db2b1c33481dc Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsAccessNegativeTestJSON-1742860529-project Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 210b7cbcbc3f4830ab114eaa548ac517 Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529-project Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} Jul 19 19:45:45.204813 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2051351402', 'body': {'addTenantAccess': {'tenant': 'cf51f215e70b47ddba7db2b1c33481dc'}}} Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:45.205472 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:45:45.206438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.208193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3b9c077-8152-4f05-8133-7fab89b1f332 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:45.209136 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3b9c077-8152-4f05-8133-7fab89b1f332 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] 10.222.0.33 "POST /compute/v2.1/flavors/2051351402/action" status: 403 len: 130 microversion: 2.1 time: 0.361980 Jul 19 19:45:45.209909 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 92/149] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Jul 19 19:45:44 2022] POST /compute/v2.1/flavors/2051351402/action => generated 130 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:45.218442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f5cf29a-9cb3-4fd5-8f65-899aad58762a tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:45.219375 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:45.219375 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:45.245813 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f5cf29a-9cb3-4fd5-8f65-899aad58762a tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2051351402" status: 202 len: 0 microversion: 2.1 time: 0.030501 Jul 19 19:45:45.248310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 58/150] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:45 2022] DELETE /compute/v2.1/flavors/2051351402 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:45.256606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-969dd682-ab66-45f0-b69c-9691a6f6e2c1 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:45.293450 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-969dd682-ab66-45f0-b69c-9691a6f6e2c1 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037675 Jul 19 19:45:45.309389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09aefb2b-bc37-4159-964e-3966d672d92e tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-524608385", "id": 327685080, "os-flavor-access:is_public": "False"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.312080 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:45.312080 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:45.316298 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 93/151] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:45.345145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09aefb2b-bc37-4159-964e-3966d672d92e tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.036885 Jul 19 19:45:45.349595 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 59/152] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:45 2022] POST /compute/v2.1/flavors => generated 435 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:45.357088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7ca81be-0648-47c9-a1e8-b99542fc5380 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.792109 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7ca81be-0648-47c9-a1e8-b99542fc5380 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/327685080/action" status: 200 len: 96 microversion: 2.1 time: 0.438635 Jul 19 19:45:45.797345 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 94/153] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Jul 19 19:45:45 2022] POST /compute/v2.1/flavors/327685080/action => generated 96 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:45.807955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a69155b-fb60-430e-860f-c81044b744f4 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.809422 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:45.809422 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:45.810402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a69155b-fb60-430e-860f-c81044b744f4 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '210b7cbcbc3f4830ab114eaa548ac517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51f215e70b47ddba7db2b1c33481dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a69155b-fb60-430e-860f-c81044b744f4 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Request method failure captured: Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/flavors/327685080/action HTTP/1.1 Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 70 Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnh4EgBFRQFMU6gcy5A4rmEF9LcNUTIUEbsOj2GZ8nRyOcqwL6SbonFSeXFulU_OlgRC4ZdwWUgMVYG8BY5IByymwjrDSHkaSRGQjkHb-5pdv_Fo-hQQiRVpqRpaxOmkzdFeu4-ZCYTfkrSXjCXal5oRquLEjJk6N4kCjhnckio1lA Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: cf51f215e70b47ddba7db2b1c33481dc Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:45.812247 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf51f215e70b47ddba7db2b1c33481dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: cf51f215e70b47ddba7db2b1c33481dc Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529 Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FlavorsAccessNegativeTestJSON-1742860529-project Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 210b7cbcbc3f4830ab114eaa548ac517 Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1742860529-project Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: {"removeTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} Jul 19 19:45:45.813641 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '327685080', 'body': {'removeTenantAccess': {'tenant': 'cf51f215e70b47ddba7db2b1c33481dc'}}} Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can( Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:45.814520 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:45:45.816038 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:45.817255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a69155b-fb60-430e-860f-c81044b744f4 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:45.817255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a69155b-fb60-430e-860f-c81044b744f4 tempest-FlavorsAccessNegativeTestJSON-1742860529 tempest-FlavorsAccessNegativeTestJSON-1742860529-project] 10.222.0.33 "POST /compute/v2.1/flavors/327685080/action" status: 403 len: 133 microversion: 2.1 time: 0.011000 Jul 19 19:45:45.817932 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 60/154] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Jul 19 19:45:45 2022] POST /compute/v2.1/flavors/327685080/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:45.825321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29a07871-5d18-4ce0-a5f4-0a7d91bdc5ce tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cf51f215e70b47ddba7db2b1c33481dc"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:45.827456 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:45.827456 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:45.862278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:45.863318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:45.870056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.875306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:45.878478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.879298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:46.209560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=13,nova_api:INSERT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:46.224844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29a07871-5d18-4ce0-a5f4-0a7d91bdc5ce tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/327685080/action" status: 200 len: 21 microversion: 2.1 time: 0.405263 Jul 19 19:45:46.230825 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 95/155] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Jul 19 19:45:45 2022] POST /compute/v2.1/flavors/327685080/action => generated 21 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:45:46.236779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:46.236995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93775b4d-c0e2-42e6-b496-4f05ca4fe8d9 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:46.238722 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:46.238722 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:46.247321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8b1c0d0-da98-413e-8ee1-e0b368905610 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.388548 Jul 19 19:45:46.248420 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 61/156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:45 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:46.264029 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93775b4d-c0e2-42e6-b496-4f05ca4fe8d9 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/327685080" status: 202 len: 0 microversion: 2.1 time: 0.031766 Jul 19 19:45:46.268099 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 96/157] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:45:46 2022] DELETE /compute/v2.1/flavors/327685080 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:46.272804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6b14786-d4a3-4d28-9f32-ca9a0db3d5e2 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:46.295255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6b14786-d4a3-4d28-9f32-ca9a0db3d5e2 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026044 Jul 19 19:45:46.296196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 62/158] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:46.313915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00281076-50da-448a-bcfd-70d33ba99eba tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-641707288", "id": 1116017108, "os-flavor-access:is_public": "False"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:46.315456 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:46.315456 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:46.344072 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00281076-50da-448a-bcfd-70d33ba99eba tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.032185 Jul 19 19:45:46.345099 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 97/159] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:46 2022] POST /compute/v2.1/flavors => generated 438 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:46.360728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c525f38-b7de-47af-8219-4e8f6e6a8151 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c7e738003a5843999b297986929b7f49"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:46.363042 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:46.363042 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:46.924415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9c525f38-b7de-47af-8219-4e8f6e6a8151 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] HTTP exception thrown: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c525f38-b7de-47af-8219-4e8f6e6a8151 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Request method failure captured: Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/flavors/1116017108/action HTTP/1.1 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 70 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnjK4_QdLSiBl9eDJ4WL8E65UXrhzrQgNao6dcUR-q3PBIbr9puwA-lUf5FodJabDUADG8QlYWRbz-CXJ-cVIm8KTYgSnN4EBJ2rGnTvSCXzl_3bWm7P9ROn_cOA881k8r8CDOgJQURSkHiKknkmAOeIj8dCwFdYqhsj7GaiDX2s2c Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:45:46.929565 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/355f4ba8af2a445e953eae039048a713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355f4ba8af2a445e953eae039048a713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_355f4ba8af2a445e953eae039048a713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 355f4ba8af2a445e953eae039048a713 Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-195666875 Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b97eca51350e4545824523b6ff20cae1 Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: {"removeTenantAccess": {"tenant": "c7e738003a5843999b297986929b7f49"}} Jul 19 19:45:46.931007 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: exception: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1116017108', 'body': {'removeTenantAccess': {'tenant': 'c7e738003a5843999b297986929b7f49'}}} Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 19 19:45:46.931795 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:46.932993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. Jul 19 19:45:46.935260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:46.937062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c525f38-b7de-47af-8219-4e8f6e6a8151 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Returning 404 to user: Flavor access not found for 34 / c7e738003a5843999b297986929b7f49 combination. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:46.940562 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c525f38-b7de-47af-8219-4e8f6e6a8151 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1116017108/action" status: 404 len: 124 microversion: 2.1 time: 0.585552 Jul 19 19:45:46.941278 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 63/160] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Jul 19 19:45:46 2022] POST /compute/v2.1/flavors/1116017108/action => generated 124 bytes in 589 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:46.950827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ef12af3-3283-4afa-9d4c-78b323b3b85f tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:46.987340 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ef12af3-3283-4afa-9d4c-78b323b3b85f tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1116017108" status: 202 len: 0 microversion: 2.1 time: 0.039862 Jul 19 19:45:46.989592 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 98/161] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:45:46 2022] DELETE /compute/v2.1/flavors/1116017108 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:45:46.998676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ed6360c-0f31-441b-a0d5-a1088a542853 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:47.046039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ed6360c-0f31-441b-a0d5-a1088a542853 tempest-FlavorsAccessNegativeTestJSON-195666875 tempest-FlavorsAccessNegativeTestJSON-195666875-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046756 Jul 19 19:45:47.048400 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 64/162] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:47.264964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:47.265574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:47.278961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.279444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.280264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.280695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.512349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:47.522907 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.261194 Jul 19 19:45:47.524847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 65/163] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:47 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:47.722975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f7f7d18-e42a-42b5-8add-c486d3581ab0 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Calling method '.version_select at 0x7fb88f989430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.200242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.201919 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9d94e338-79e3-4fa0-9610-bef76729d950 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002265 Jul 19 19:45:48.202423 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 66/164] 10.222.0.33 () {56 vars in 885 bytes} [Tue Jul 19 19:45:48 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 19 19:45:48.376109 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f7f7d18-e42a-42b5-8add-c486d3581ab0 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 371 microversion: 2.1 time: 1.227242 Jul 19 19:45:48.377113 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 99/165] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:45:47 2022] GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 371 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:48.391211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88ec32dc0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:48.542390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.543017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:48.552397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.554455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.557908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.559587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.923737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:48.933782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d9b2b81-1e8b-48d7-ad67-ec72d820d98f tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.396997 Jul 19 19:45:48.934995 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 100/166] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:48 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:48.972830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.973392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.974331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.974824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:49.086948 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c683a219-036c-4998-9c4e-dfc9d6fc7a64 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 328 microversion: 2.1 time: 0.700186 Jul 19 19:45:49.088329 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 67/167] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:48 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 328 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:49.601389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1193836436", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:49.737788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:49.951276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:49.952520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:49.962936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:49.966506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:49.967550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:49.968427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.753330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:50.753802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:50.754222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:50.755230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:50.755643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:50.759635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:50.767863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1fa08ea4-7f85-4d9e-b984-125b2e64d457 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.820299 Jul 19 19:45:50.776593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 68/168] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:49 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:50.806788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.807484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.808661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.809458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.898939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:50.910776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for user cce4f9230c5b490da6ee2182f97ed2af and project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:50.940356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.utils [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] cores quota exceeded for 0f48f21136b445e8b1fe367f43ca114c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126008) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:45:50.942819 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Request method failure captured: Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 145 Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnpJ5eUuFk6_ifzVr8fJ4BnVnzHl51TSbqixj4OQKsxFkrDwbhUgfd-dmjI4aygjCyZgxGrGXHvixytKX0lp3buaCLC77WK1xAuWhC2mL2r0XwQ3kE4I1htC1ND43NOqz5ePYVveLJtarFSQ9X43DP9ercdTin1__e0ZbRdSK1wijk Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:50.952518 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: cce4f9230c5b490da6ee2182f97ed2af Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1193836436", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} Jul 19 19:45:50.954032 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1193836436', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452'}}} Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:45:50.954811 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.956076 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.957235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-498a319f-88ed-409b-9ae5-925811b2c438 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.587717 Jul 19 19:45:50.958320 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 101/169] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:49 2022] POST /compute/v2.1/servers => generated 111 bytes in 1589 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:50.966169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88ec32b80>, body: {"quota_set": {"cores": 20}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:51.405576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.406270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.407332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.408030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.417682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:51.517609 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32328aa8-15a1-4612-85ba-7ee8704f8f7b tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 329 microversion: 2.1 time: 0.555739 Jul 19 19:45:51.521187 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 69/170] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:50 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 329 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:51.537425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e51fb3a7-a038-4d04-a622-22ca3957fccf tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Calling method '.version_select at 0x7fb88f977c10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:51.796126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:51.798016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:51.820461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.823295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.827274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.828003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.942931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e51fb3a7-a038-4d04-a622-22ca3957fccf tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 371 microversion: 2.1 time: 0.412214 Jul 19 19:45:51.945897 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 102/171] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:45:51 2022] GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:51.956988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88f8c7310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:52.339645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.340583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.348398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:52.348977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.349551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.358665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70f5a7a3-8451-4355-beaa-b5f4ebc27c60 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.569208 Jul 19 19:45:52.375270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 70/172] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:51 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:52.555623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-694e5cec-5f09-4ca7-91e3-e8eafcb07375 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 328 microversion: 2.1 time: 0.603412 Jul 19 19:45:52.556822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 103/173] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:51 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 328 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:52.910866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1936693472", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:53.027473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:53.379794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:53.380457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:53.401732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:53.402224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:53.403012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:53.403448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:53.853151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:53.853680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:53.854198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:53.854606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:53.855022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:53.877438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:53.877894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:53.878833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:53.879369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:53.939834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:53.952329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for user cce4f9230c5b490da6ee2182f97ed2af and project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:53.971890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:53.979221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.utils [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] instances quota exceeded for 0f48f21136b445e8b1fe367f43ca114c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126007) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:45:53.980783 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Request method failure captured: Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 145 Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnpJ5eUuFk6_ifzVr8fJ4BnVnzHl51TSbqixj4OQKsxFkrDwbhUgfd-dmjI4aygjCyZgxGrGXHvixytKX0lp3buaCLC77WK1xAuWhC2mL2r0XwQ3kE4I1htC1ND43NOqz5ePYVveLJtarFSQ9X43DP9ercdTin1__e0ZbRdSK1wijk Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:53.993571 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: cce4f9230c5b490da6ee2182f97ed2af Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1936693472", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} Jul 19 19:45:53.994989 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1936693472', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452'}}} Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:45:53.995762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:53.996931 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:53.998955 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:45:54.000957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:54.003505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:54.004743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a31ade0-5200-4447-888e-c6c7f3343750 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.099885 Jul 19 19:45:54.006285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:54.009925 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 71/174] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:52 2022] POST /compute/v2.1/servers => generated 119 bytes in 1105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:54.016796 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e5162e25-248e-4299-8d44-e5947cf9d788 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.640731 Jul 19 19:45:54.031168 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 104/175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:53 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:54.031168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88f8c9940>, body: {"quota_set": {"instances": 10}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:54.201300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2a419604-71f4-4590-862d-ca9aea300c87 req-235cb62a-86ab-48f9-b8bc-598ae531b5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c97aa19-0384-4dbf-9c33-176f910408a0", "name": "network-vif-plugged", "status": "completed", "tag": "43833fb9-b591-4324-b533-ff4320fd262e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:54.224614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2a419604-71f4-4590-862d-ca9aea300c87 req-235cb62a-86ab-48f9-b8bc-598ae531b5c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.225102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2a419604-71f4-4590-862d-ca9aea300c87 req-235cb62a-86ab-48f9-b8bc-598ae531b5c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.255342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2a419604-71f4-4590-862d-ca9aea300c87 req-235cb62a-86ab-48f9-b8bc-598ae531b5c0 service nova] Creating event network-vif-plugged:43833fb9-b591-4324-b533-ff4320fd262e for instance 1c97aa19-0384-4dbf-9c33-176f910408a0 on n-h1-843861-3 Jul 19 19:45:54.291499 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2a419604-71f4-4590-862d-ca9aea300c87 req-235cb62a-86ab-48f9-b8bc-598ae531b5c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267099 Jul 19 19:45:54.296937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 72/176] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:54.458463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.459579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.461353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.461966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.613410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea1aa3e6-901b-4dd7-a2f8-f4a8580fbb12 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 329 microversion: 2.1 time: 0.589718 Jul 19 19:45:54.619414 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 105/177] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:54 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 329 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:54.634471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5ac7a0e-978b-4bf6-acc4-ae48cf53afdb tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Calling method '.version_select at 0x7fb88f8c9f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.725013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88ea0a310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.725951 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:54.725951 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:54.727301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.727969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.784263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.784714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.822800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.825007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.852716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe22f6e2-edb2-4785-b568-bdfeefe6ea25 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.551301 Jul 19 19:45:54.857054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 73/178] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:54.871306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88ea0a9d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.872417 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:54.872417 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:54.882618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.883504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.923050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.923505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.955080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.955584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.964389 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e80f9375-8b88-43be-8555-fa66d775f6d2 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.102034 Jul 19 19:45:54.973054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 74/179] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:54.984820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88ea0a670>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.985653 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:54.985653 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:54.986842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.987294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.028670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.033939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.074689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.075150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.086922 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eddea1ab-42b9-4afe-ab76-083d8896241e tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.112404 Jul 19 19:45:55.094163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 75/180] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:55.108223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.108981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:55.119504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.131798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.133077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.133985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.306755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5ac7a0e-978b-4bf6-acc4-ae48cf53afdb tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 371 microversion: 2.1 time: 0.672041 Jul 19 19:45:55.308007 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 106/181] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 371 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:55.318876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88f8b5dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.322773 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:55.322773 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:55.333440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.336393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.385709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.392072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.405100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f5316bc-1bfc-4faa-bf69-efdbba30c2a8 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.095225 Jul 19 19:45:55.408899 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 107/182] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:55.409735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:55.420175 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b27cff0-e06b-4ab5-b137-a2eb6a2fc749 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.323527 Jul 19 19:45:55.431317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88f9a1f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:55.433405 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 76/183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:55.447032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3bd3f7b-07f6-422e-9a3f-d3fd5ffbe4ec tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88ea22af0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.449037 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:55.449037 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:55.452013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3bd3f7b-07f6-422e-9a3f-d3fd5ffbe4ec tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.454026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3bd3f7b-07f6-422e-9a3f-d3fd5ffbe4ec tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.506723 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3bd3f7b-07f6-422e-9a3f-d3fd5ffbe4ec tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.071909 Jul 19 19:45:55.509750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 77/184] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:55.521676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88ea92280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.523043 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:55.523043 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:55.532760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.532760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.583138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.585964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.614425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.616071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.636646 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4eddbea3-f899-4f95-87d5-27d2e9d8d49b tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.115322 Jul 19 19:45:55.637315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 78/185] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:55.828724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.831140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.832948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.834291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.858515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=75 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:55.946808 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a38359e4-c3c0-494c-9e0f-e2c3422a3f5e tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 325 microversion: 2.1 time: 0.534194 Jul 19 19:45:55.949699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 108/186] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:55 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 325 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:55.956889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88f871040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.958410 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:55.958410 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:55.967998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.969035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.001676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.002410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.011767 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8bdd1bc3-13ac-409a-8138-3e33cc4f6640 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.060607 Jul 19 19:45:56.023507 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 109/187] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:56.028636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88f8c9670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.029720 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:56.029720 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:56.031646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.032602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.050493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.051113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.061791 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab537abe-3753-4ffe-94d6-ef09e6690031 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.036909 Jul 19 19:45:56.064188 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 110/188] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:45:56 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:56.089392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Calling method '.version_select at 0x7fb88f8c7820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.090519 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:56.090519 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:56.098154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.098610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.130785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.131545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.151617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b1b373c-6fcf-4e5e-89b2-c49a5f4dc991 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-102082852", "id": 1996777536, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:56.153294 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:56.153294 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:56.156101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:56.158150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.159086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.167993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cb53f93-bad9-45f7-9c60-cfe221ae72e0 tempest-HypervisorAdminTestJSON-1926358344 tempest-HypervisorAdminTestJSON-1926358344-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:45:56.171071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.172282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.173455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.174365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.185121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b1b373c-6fcf-4e5e-89b2-c49a5f4dc991 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.545068 Jul 19 19:45:56.193152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.rpcapi [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 19:45:56.193863 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 79/189] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:45:55 2022] POST /compute/v2.1/flavors => generated 470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:45:56.197917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] Releasing lock "compute-rpcapi-router" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:45:56.203220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dbfd3be2-608d-408a-bb63-94183f698183 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:56.206441 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:56.206441 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:45:56.424415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dbfd3be2-608d-408a-bb63-94183f698183 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1996777536/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.228551 Jul 19 19:45:56.425583 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 80/190] 10.222.0.33 () {62 vars in 1264 bytes} [Tue Jul 19 19:45:56 2022] POST /compute/v2.1/flavors/1996777536/os-extra_specs => generated 62 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:56.433616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-779672737", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:56.529913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-adb2e185-f492-44e2-ac5b-157ac85558ae None None] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.451753 Jul 19 19:45:56.532297 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 111/191] 10.222.0.33 () {58 vars in 1172 bytes} [Tue Jul 19 19:45:56 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:56.539855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76831102-aa01-4ff9-8838-2fc23aa5bd2e tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.541362 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:56.541362 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:45:56.547279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:56.590931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76831102-aa01-4ff9-8838-2fc23aa5bd2e tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1996777536" status: 202 len: 0 microversion: 2.86 time: 0.055257 Jul 19 19:45:56.595916 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 112/192] 10.222.0.33 () {60 vars in 1201 bytes} [Tue Jul 19 19:45:56 2022] DELETE /compute/v2.1/flavors/1996777536 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:56.602794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.603787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:56.619465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.620874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.621943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.622588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.093005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.101439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b0ad072e-c3ce-4462-9c5b-9b6682986e88 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1338 microversion: 2.1 time: 0.503983 Jul 19 19:45:57.113461 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 113/193] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:56 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1338 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:57.122760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8834a58-9d9a-45ee-b847-9a591a2a8467 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.168224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:57.168807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:57.169077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:57.169783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:57.170967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:57.184319 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8834a58-9d9a-45ee-b847-9a591a2a8467 tempest-FlavorMetadataValidation-578522392 tempest-FlavorMetadataValidation-578522392-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.069557 Jul 19 19:45:57.188709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.189484 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 114/194] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:57.190696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.193908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.196097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.245330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=21 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:57.277400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:57.290474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Getting quotas for user cce4f9230c5b490da6ee2182f97ed2af and project 0f48f21136b445e8b1fe367f43ca114c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:57.322415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.utils [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] ram quota exceeded for 0f48f21136b445e8b1fe367f43ca114c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126007) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:45:57.323227 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Request method failure captured: Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 144 Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnpJ5eUuFk6_ifzVr8fJ4BnVnzHl51TSbqixj4OQKsxFkrDwbhUgfd-dmjI4aygjCyZgxGrGXHvixytKX0lp3buaCLC77WK1xAuWhC2mL2r0XwQ3kE4I1htC1ND43NOqz5ePYVveLJtarFSQ9X43DP9ercdTin1__e0ZbRdSK1wijk Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:45:57.325467 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: cce4f9230c5b490da6ee2182f97ed2af Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-779672737", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} Jul 19 19:45:57.326705 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-779672737', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452'}}} Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:45:57.327357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:57.328364 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.329453 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:45:57.330539 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:45:57.344756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:57.346019 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-071fdee9-80c0-4b37-9e47-eaafdfab3a30 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.918724 Jul 19 19:45:57.346896 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 81/195] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 921 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:57.357220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Action: 'update', calling method: .version_select at 0x7fb88f8c95e0>, body: {"quota_set": {"ram": 51200}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:57.963519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.966096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.967173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.968040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.108302 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f76335a-05ac-483f-9f8f-177a26b2c996 tempest-QuotasAdminNegativeTest-1934022744 tempest-QuotasAdminNegativeTest-1934022744-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 200 len: 329 microversion: 2.1 time: 0.755413 Jul 19 19:45:58.110009 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 115/196] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:57 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 329 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:45:58.121586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:58.122054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:58.145637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.146091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.147072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.148084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.150156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7a13b90-9685-41ad-a819-9ee754742a35 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Action: 'update', calling method: .version_select at 0x7fb88f871430>, body: {"quota_set": {"ram": 0}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:58.152857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7a13b90-9685-41ad-a819-9ee754742a35 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cce4f9230c5b490da6ee2182f97ed2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f48f21136b445e8b1fe367f43ca114c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7a13b90-9685-41ad-a819-9ee754742a35 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Request method failure captured: Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c HTTP/1.1 Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 25 Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnpJ5eUuFk6_ifzVr8fJ4BnVnzHl51TSbqixj4OQKsxFkrDwbhUgfd-dmjI4aygjCyZgxGrGXHvixytKX0lp3buaCLC77WK1xAuWhC2mL2r0XwQ3kE4I1htC1ND43NOqz5ePYVveLJtarFSQ9X43DP9ercdTin1__e0ZbRdSK1wijk Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:45:58.173643 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f48f21136b445e8b1fe367f43ca114c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0f48f21136b445e8b1fe367f43ca114c Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1357205358 Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: cce4f9230c5b490da6ee2182f97ed2af Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-QuotasAdminNegativeTest-1357205358-project Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: {"quota_set": {"ram": 0}} Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:45:58.174958 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '0f48f21136b445e8b1fe367f43ca114c', 'body': {'quota_set': {'ram': 0}}} Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:45:58.176072 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:58.177102 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7a13b90-9685-41ad-a819-9ee754742a35 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:58.178146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7a13b90-9685-41ad-a819-9ee754742a35 tempest-QuotasAdminNegativeTest-1357205358 tempest-QuotasAdminNegativeTest-1357205358-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c" status: 403 len: 116 microversion: 2.1 time: 0.050110 Jul 19 19:45:58.183935 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 116/197] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:45:58 2022] PUT /compute/v2.1/os-quota-sets/0f48f21136b445e8b1fe367f43ca114c => generated 116 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:58.914167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:58.930675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b68c1d15-22ae-4785-87d3-6ea9bbb1e202 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1488 microversion: 2.1 time: 0.813745 Jul 19 19:45:58.931979 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 82/198] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:58 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1488 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:58.957982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:58.958607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:58.974463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.975436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.976456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.977140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.738852 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-685b322f-5468-4e02-ac14-c088e1926366 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1639 microversion: 2.1 time: 1.790837 Jul 19 19:46:00.742739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 117/199] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:58 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1639 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:00.760621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:00.779727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:00.820067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:00.823076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.825084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:00.828812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.924868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:01.208196 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0df88d27-a64c-4c5b-a475-21afa2547a75 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 204 len: 0 microversion: 2.1 time: 0.453106 Jul 19 19:46:01.210185 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 83/200] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:00 2022] DELETE /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:01.227212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:01.228558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:01.254413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:01.255180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:01.256103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:01.256687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:01.887417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:01.914437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee7aaee7-6c2a-4d7e-b038-918b697b9e33 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1494 microversion: 2.1 time: 0.692357 Jul 19 19:46:01.916346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 118/201] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:01 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1494 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:02.933821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:02.935070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:02.948653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.949554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.951220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.953971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.306794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.314660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-71a484ba-96aa-4261-9b54-2772df985c12 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1494 microversion: 2.1 time: 1.385271 Jul 19 19:46:04.317387 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 84/202] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:02 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1494 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:05.143202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc98c56d-44eb-42cb-9fc4-95042e906dbd tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-8001290", "id": 1055850533, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:05.149074 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:05.149074 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:05.181016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc98c56d-44eb-42cb-9fc4-95042e906dbd tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.326878 Jul 19 19:46:05.183896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 119/203] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:46:04 2022] POST /compute/v2.1/flavors => generated 465 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:05.428975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c0f5abf0-43ae-4bd4-b5c4-e6c17c94c38f tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.448238 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c0f5abf0-43ae-4bd4-b5c4-e6c17c94c38f tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] 10.222.0.33 "GET /compute/v2.1/flavors/1055850533" status: 200 len: 465 microversion: 2.61 time: 0.255819 Jul 19 19:46:05.450898 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 120/204] 10.222.0.33 () {60 vars in 1198 bytes} [Tue Jul 19 19:46:05 2022] GET /compute/v2.1/flavors/1055850533 => generated 465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:05.457711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.458761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:05.474803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.477373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.479445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.490404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-847faed6-9bdd-4d2d-b2a1-8d7fa2751c3d tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] Action: 'create', calling method: .version_select at 0x7fb88e9f5a60>, body: {"security_group": {"name": "tempest-securitygroup-845302445", "description": "tempest-description-592622380"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:05.498032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.433835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.445839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57b71dd2-4796-42ca-8804-bf4f0e393786 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1494 microversion: 2.1 time: 0.992770 Jul 19 19:46:06.446544 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 121/205] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:05 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1494 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:06.462196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-21468d15-dcb4-4b50-8dee-d2d1e8edd2e5 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] Action: 'update', calling method: .version_select at 0x7fb890c7c310>, body: {"flavor": {"description": "new"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:06.495868 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:06.495868 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:06.568135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-21468d15-dcb4-4b50-8dee-d2d1e8edd2e5 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1055850533" status: 200 len: 466 microversion: 2.61 time: 0.116924 Jul 19 19:46:06.568725 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 122/206] 10.222.0.33 () {62 vars in 1218 bytes} [Tue Jul 19 19:46:06 2022] PUT /compute/v2.1/flavors/1055850533 => generated 466 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:06.581406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fcf2e57d-2f39-495c-aca9-a20bb625b3bc tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.657770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fcf2e57d-2f39-495c-aca9-a20bb625b3bc tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.071704 Jul 19 19:46:06.658754 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 123/207] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:06.675746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ab44a29-2687-4608-9363-526107c0ce49 tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.731427 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ab44a29-2687-4608-9363-526107c0ce49 tempest-FlavorsV261TestJSON-488638798 tempest-FlavorsV261TestJSON-488638798-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.059905 Jul 19 19:46:06.740851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 124/208] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:06.746105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cb24081-4f48-4dca-b22a-762bf6f3b592 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.746869 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:06.746869 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:06.778979 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cb24081-4f48-4dca-b22a-762bf6f3b592 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1055850533" status: 202 len: 0 microversion: 2.61 time: 0.036656 Jul 19 19:46:06.780191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 125/209] 10.222.0.33 () {60 vars in 1201 bytes} [Tue Jul 19 19:46:06 2022] DELETE /compute/v2.1/flavors/1055850533 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:06.789246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3a93cb9-0ee1-40ae-a903-93a56524dd43 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.812946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3a93cb9-0ee1-40ae-a903-93a56524dd43 tempest-FlavorsV261TestJSON-1387036272 tempest-FlavorsV261TestJSON-1387036272-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.028530 Jul 19 19:46:06.814071 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 126/210] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.036556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0f47f337-dafe-4f87-9c67-97ce0e1e552d req-37f965bd-62d0-4bd4-8f2e-2a10423d64db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c97aa19-0384-4dbf-9c33-176f910408a0", "name": "network-vif-deleted", "tag": "43833fb9-b591-4324-b533-ff4320fd262e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.055348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0f47f337-dafe-4f87-9c67-97ce0e1e552d req-37f965bd-62d0-4bd4-8f2e-2a10423d64db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.055837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0f47f337-dafe-4f87-9c67-97ce0e1e552d req-37f965bd-62d0-4bd4-8f2e-2a10423d64db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.117279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0f47f337-dafe-4f87-9c67-97ce0e1e552d req-37f965bd-62d0-4bd4-8f2e-2a10423d64db service nova] Creating event network-vif-deleted:43833fb9-b591-4324-b533-ff4320fd262e for instance 1c97aa19-0384-4dbf-9c33-176f910408a0 on n-h1-843861-3 Jul 19 19:46:07.130927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0f47f337-dafe-4f87-9c67-97ce0e1e552d req-37f965bd-62d0-4bd4-8f2e-2a10423d64db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098038 Jul 19 19:46:07.134759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 127/211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:07.254679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:07.313842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=28 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:07.471741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-847faed6-9bdd-4d2d-b2a1-8d7fa2751c3d tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.504702 Jul 19 19:46:07.472455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 85/212] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:46:04 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:46:07.489363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.494686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:07.514253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.516228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.517119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.519661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.650571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.651547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.653523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lazy-loading 'fault' on Instance uuid 1c97aa19-0384-4dbf-9c33-176f910408a0 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:07.699818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1599662193", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "be49fee4-8a96-4ded-8c00-6bf222c5131e"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.784907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] validate_networks() for [('be49fee4-8a96-4ded-8c00-6bf222c5131e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:07.931002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd1fb66a65d43608ee639bc5dd03e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf2678b8c4bc793358cb79b48e333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.943601 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d23e8053-a0d6-488f-aae0-08ebb60596e1 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 200 len: 1328 microversion: 2.1 time: 0.462865 Jul 19 19:46:07.948396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 86/213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 1328 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:07.964731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a6ec745-3508-4079-84ca-0d01175008a5 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] Action: 'create', calling method: .version_select at 0x7fb88e9f5c10>, body: {"security_group": {"name": "tempest-securitygroup-466785075", "description": "tempest-description-1019785529"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.993058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:08.090013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=44 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:09.018749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a6ec745-3508-4079-84ca-0d01175008a5 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.064404 Jul 19 19:46:09.019913 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 87/214] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:46:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:09.024500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:09.025110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:09.049178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.049636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.050446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.050888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.085086 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] HTTP exception thrown: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Request method failure captured: Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 HTTP/1.1 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnTvFjAHNlZwItocyzA0o-MMzIZ6UHZ3UMx6KgHMKldm7fadLYZ8jzs6RwhjyMDfSPDLTAWL4N3_wtsCEz2MvxT12TXEOZyz96IM_HEHNnpjpo3dk36O_TZnqehRzXE_YORzbxoqvE41TbXZORK3fcW3yRLDeUkHS9nU5xl330rHkY Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:09.091437 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: bfd1fb66a65d43608ee639bc5dd03e2d Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:09.092932 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c97aa19-0384-4dbf-9c33-176f910408a0'} Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:09.093647 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:09.094889 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:09.102856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Returning 404 to user: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:09.103960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d70f9a7a-cbb3-440c-8076-72070d091506 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 404 len: 111 microversion: 2.1 time: 0.083068 Jul 19 19:46:09.105798 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 88/215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:09 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:09.434864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e24ce9c8-9130-41e0-b8f0-52678083ed71 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] Action: 'create', calling method: .version_select at 0x7fb88e8b1310>, body: {"security_group": {"name": "tempest-securitygroup-836432030", "description": "tempest-description-1084486214"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:10.390564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:10.391550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:10.392250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:10.392803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:10.393209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:10.414067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.414518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.415318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.415748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.465281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:10.473772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for user 937de5092f1d4e10b36c151ebf1db333 and project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:10.506288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:10.514291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:10.673223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bfbdaec7-1963-4dd3-9c46-10651a8fce4b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.482839 Jul 19 19:46:10.678859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 128/216] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:46:10.679201 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e24ce9c8-9130-41e0-b8f0-52678083ed71 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.569877 Jul 19 19:46:10.679611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-012c57d7-3d45-4a51-88e2-1a4a9169d389 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:10.680101 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 89/217] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:46:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:10.685886 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:10.685886 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:10.691232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:10.692020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:10.708102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012c57d7-3d45-4a51-88e2-1a4a9169d389 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.710639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012c57d7-3d45-4a51-88e2-1a4a9169d389 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.931361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.958307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.965837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.967509 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da5e7e3e-65c0-4615-b353-fb37aa89aec4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1262 microversion: 2.25 time: 0.286174 Jul 19 19:46:10.970274 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 90/218] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:10 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1262 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:10.981998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bee60bd-78cc-4ea9-8c49-7208c987033e tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] Action: 'create', calling method: .version_select at 0x7fb88e9f5a60>, body: {"security_group": {"name": "tempest-securitygroup-1112997613", "description": "tempest-description-1540456181"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:11.605177 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-012c57d7-3d45-4a51-88e2-1a4a9169d389 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.927401 Jul 19 19:46:11.608684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 129/219] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:11.624609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2bb08885-c711-452b-bedf-e8c79f51d30d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:11.625670 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:11.625670 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:11.703022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2bb08885-c711-452b-bedf-e8c79f51d30d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.087837 Jul 19 19:46:11.708435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 130/220] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:11.730565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-62daa060-b1f1-45ea-bf38-897ff5d9d866 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1971856917"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:11.733185 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:11.733185 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:11.735943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-62daa060-b1f1-45ea-bf38-897ff5d9d866 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid 14cf3871-fb2e-43b4-9d26-92ded8eff45b for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:11.844681 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-62daa060-b1f1-45ea-bf38-897ff5d9d866 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.115760 Jul 19 19:46:11.845751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bee60bd-78cc-4ea9-8c49-7208c987033e tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.873060 Jul 19 19:46:11.847250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 91/221] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:46:10 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:11.852847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 131/222] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:46:11.877481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-144aa87f-5c6c-4d63-979a-10ad6fb52ad6 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] Calling method '.version_select at 0x7fb88f850f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:12.149682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Calling method '.version_select at 0x7fb88e8b1e50>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:12.151723 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:12.151723 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:12.155075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.155541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.557234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.565846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.602823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.602823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.620937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.624280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.657407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.658427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.676641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6102a0ca-4cf1-4505-8f68-f3b1c0ce792d tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.828021 Jul 19 19:46:12.677956 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 92/223] 10.222.0.33 () {60 vars in 1242 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:12.691325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d439224-ac90-4e17-b88b-0753fc077856 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:12.699632 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:12.699632 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:12.728450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d439224-ac90-4e17-b88b-0753fc077856 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.729119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d439224-ac90-4e17-b88b-0753fc077856 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.962775 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d439224-ac90-4e17-b88b-0753fc077856 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.280655 Jul 19 19:46:12.968160 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 93/224] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:12.975798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:12.981725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:12.995386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.996737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.997949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.998699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.037066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:13.192384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.204590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.224160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.226339 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8e2b9211-fae7-468d-b1dd-434e1531f7f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1314 microversion: 2.25 time: 0.256183 Jul 19 19:46:13.228535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 94/225] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:12 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:13.252346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Calling method '.version_select at 0x7fb88e9f2b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.269626 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.269626 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.271103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.271552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.310265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.310711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.340399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.340851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.357179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.357627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.386494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.389426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.409627 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-229b1f74-bbc3-4ae6-9678-da54825408d3 tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.165789 Jul 19 19:46:13.411580 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 95/226] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Jul 19 19:46:13 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:13.420586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b701a9ef-b5b5-4e1f-ab2b-cd9c33293ab0 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.421433 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.421433 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.433651 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b701a9ef-b5b5-4e1f-ab2b-cd9c33293ab0 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.021160 Jul 19 19:46:13.434250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 96/227] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:46:13 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:13.453142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Calling method '.version_select at 0x7fb88e9f5ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.464606 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.464606 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.467112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.472587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.511490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.511987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.520390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-177e2f51-cd89-4eed-955f-44e06f8e801a tempest-HypervisorAdminV253TestBase-533024663 tempest-HypervisorAdminV253TestBase-533024663-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/08c0d81c-b3bf-4dd6-a9b2-ffc617c7ee43" status: 200 len: 792 microversion: 2.53 time: 0.084986 Jul 19 19:46:13.521018 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 97/228] 10.222.0.33 () {60 vars in 1297 bytes} [Tue Jul 19 19:46:13 2022] GET /compute/v2.1/os-hypervisors/08c0d81c-b3bf-4dd6-a9b2-ffc617c7ee43 => generated 792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:13.528035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-95f3a96a-c62c-4bd6-8166-e2d3c6fa296a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:13.530862 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.530862 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.540331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:13.548874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95f3a96a-c62c-4bd6-8166-e2d3c6fa296a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.549842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95f3a96a-c62c-4bd6-8166-e2d3c6fa296a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.778020 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-95f3a96a-c62c-4bd6-8166-e2d3c6fa296a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.254580 Jul 19 19:46:13.778840 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 98/229] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:13 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:13.824866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef7177e7-656f-4610-aaab-716d4f225008 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.832612 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.832612 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.895564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef7177e7-656f-4610-aaab-716d4f225008 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.096834 Jul 19 19:46:13.898549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 99/230] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:13 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:13.910162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c72481ce-18c7-4926-b461-02a09161fa13 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-779628649"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:13.912421 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.912421 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.914592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-c72481ce-18c7-4926-b461-02a09161fa13 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid dd5b125c-2eed-46b9-b71b-acb6ed56c1bb for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:13.958848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c72481ce-18c7-4926-b461-02a09161fa13 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052986 Jul 19 19:46:13.965106 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 100/231] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:46:13.972444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a75a5269-794d-4a00-8b93-a40bd44bb78c tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:13.976018 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:13.976018 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:13.996710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a75a5269-794d-4a00-8b93-a40bd44bb78c tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.997270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a75a5269-794d-4a00-8b93-a40bd44bb78c tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.263059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a75a5269-794d-4a00-8b93-a40bd44bb78c tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.296307 Jul 19 19:46:14.263835 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 101/232] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:13 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:14.271912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.275763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.301798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.303058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.304957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.305490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.643869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.654916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.658162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.668305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eaf74633-6450-4287-ad74-8542df0c0a8a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1320 microversion: 2.25 time: 0.394776 Jul 19 19:46:14.670054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 102/233] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:14.676931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1b8f1fa1-7756-4b2c-8815-a3914d5ee108 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.677699 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:14.677699 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:14.698574 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1b8f1fa1-7756-4b2c-8815-a3914d5ee108 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.027279 Jul 19 19:46:14.699491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 103/234] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:14.710147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc6127fc-2d40-494d-9135-dbefd4c42e61 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:14.716275 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:14.716275 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:14.738266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc6127fc-2d40-494d-9135-dbefd4c42e61 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.738715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc6127fc-2d40-494d-9135-dbefd4c42e61 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.933634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc6127fc-2d40-494d-9135-dbefd4c42e61 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.226768 Jul 19 19:46:14.935034 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 104/235] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:14.953576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72003781-b7ca-4fe8-be0a-1b4a6eba684d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.956393 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:14.956393 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:15.012359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72003781-b7ca-4fe8-be0a-1b4a6eba684d tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.068281 Jul 19 19:46:15.020691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 105/236] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:14 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:15.026836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-765bab40-33ff-4618-bceb-cf989dd80318 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1609895481"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:15.042315 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:15.042315 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:15.046963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-765bab40-33ff-4618-bceb-cf989dd80318 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid 9d8037d3-6190-47f6-9fa9-34ad8c63ef4a for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:15.110232 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-765bab40-33ff-4618-bceb-cf989dd80318 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087773 Jul 19 19:46:15.112562 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 106/237] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:15.141971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4d99a4cc-b1f0-4bc9-ae42-cf352367c460 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:15.146086 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:15.146086 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:15.159248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d99a4cc-b1f0-4bc9-ae42-cf352367c460 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.159701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d99a4cc-b1f0-4bc9-ae42-cf352367c460 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.427742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4d99a4cc-b1f0-4bc9-ae42-cf352367c460 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.307774 Jul 19 19:46:15.428986 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 107/238] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:15.445681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d553f9c3-ed6b-4ab4-8cdc-f6325bf3d264 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:15.448199 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:15.448199 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:15.460800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d553f9c3-ed6b-4ab4-8cdc-f6325bf3d264 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.461561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d553f9c3-ed6b-4ab4-8cdc-f6325bf3d264 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.710554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d553f9c3-ed6b-4ab4-8cdc-f6325bf3d264 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.263941 Jul 19 19:46:15.716355 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 108/239] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:46:15.729438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.730076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:15.753776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.754228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.755028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.755460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.024482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.035872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.041788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.044177 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9498350-1665-4ad2-bdd7-4ee0e6673d64 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1320 microversion: 2.25 time: 0.331476 Jul 19 19:46:16.046230 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 109/240] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:15 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:16.078850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41ce3ec5-4757-410d-a921-f1d50a7c23b6 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.079758 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.079758 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.151912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41ce3ec5-4757-410d-a921-f1d50a7c23b6 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.090755 Jul 19 19:46:16.152528 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 110/241] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:16 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:16.163147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46176da2-d791-4c3e-a9c5-73d323c0d934 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1277511144"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.164825 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.164825 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.165753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-46176da2-d791-4c3e-a9c5-73d323c0d934 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid b3b5f5b4-d1ae-4679-a044-12eb1981ce37 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:16.205898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46176da2-d791-4c3e-a9c5-73d323c0d934 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047802 Jul 19 19:46:16.211871 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 111/242] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:46:16.218720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6238497-f244-4653-9e56-4c8c7e0652aa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1915952077"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.226435 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.226435 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.227457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-f6238497-f244-4653-9e56-4c8c7e0652aa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 83dde0ea-3b13-49f9-bb67-f81e74805ff4 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:16.281047 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6238497-f244-4653-9e56-4c8c7e0652aa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072792 Jul 19 19:46:16.286664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 112/243] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:16.296543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd463393-2e48-4c74-bde3-b698d835b2a3 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.297348 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.297348 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.353581 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd463393-2e48-4c74-bde3-b698d835b2a3 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.065910 Jul 19 19:46:16.357170 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 113/244] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:16.359260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08bded83-8b2b-464f-a40b-82642194e186 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.383967 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.383967 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.409680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bded83-8b2b-464f-a40b-82642194e186 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.410135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bded83-8b2b-464f-a40b-82642194e186 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.645624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08bded83-8b2b-464f-a40b-82642194e186 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.289966 Jul 19 19:46:16.646474 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 114/245] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:16.656172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2362d8b-aaa1-486a-889a-f5c229e08b28 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.657221 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.657221 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.668393 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e2362d8b-aaa1-486a-889a-f5c229e08b28 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2362d8b-aaa1-486a-889a-f5c229e08b28 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Request method failure captured: Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnVoCIpY3atR3M1BZkOIJF1mk72Vw97ZEMjruTqIIinePe0ihe0xmvN8o0FHkKj_3DkNHm8CUSJi1ACeTyi0f2n4P8CsvbP6nEpzU6KeE5un1mghYDhL2OvPRvn9MBUFc6yC6Odd4LvATiKqlhqtUWTR5VPyMjgPXpuNg091Wt0jZY Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:16.672364 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a34c410b96a54b35bae1016891c88465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 447407958a5747c2919eb741e19ee2c9 Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: exception: Aggregate 5 could not be found. Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5'} Jul 19 19:46:16.673595 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.674460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 19 19:46:16.675530 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.679155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2362d8b-aaa1-486a-889a-f5c229e08b28 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:16.694426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2362d8b-aaa1-486a-889a-f5c229e08b28 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.046662 Jul 19 19:46:16.697443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 115/246] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:46:16 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:16.704727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.706390 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.706390 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.725603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.726278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.788756 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-843861-3. Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 39 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:16.817238 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: {"add_host": {"host": "n-h1-843861-3"}} Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:16.818740 n-d-843861-3 devstack@n-api.service[126007]: exception: Aggregate 6 already has host n-h1-843861-3. Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-843861-3'}}} Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:46:16.819665 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-843861-3-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 19:46:16.820929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 19:46:16.822178 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:46:16.823317 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-843861-3-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 19, 46, 16, 752383), 'updated_at': None, 'host': 'n-h1-843861-3', 'aggregate_id': 6}] Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.825392 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-843861-3. Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.829619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-843861-3. Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:16.831929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:16.834469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-843861-3. Jul 19 19:46:16.834469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.834469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-843861-3. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:16.834469 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b184e3e-b4ca-4924-90e0-df4489198252 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.123770 Jul 19 19:46:16.834469 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 116/247] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 19 19:46:16.841162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98a771c9-f2e4-4634-9364-a19895a58f04 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.846812 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.846812 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.881981 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-98a771c9-f2e4-4634-9364-a19895a58f04 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98a771c9-f2e4-4634-9364-a19895a58f04 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Request method failure captured: Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnVoCIpY3atR3M1BZkOIJF1mk72Vw97ZEMjruTqIIinePe0ihe0xmvN8o0FHkKj_3DkNHm8CUSJi1ACeTyi0f2n4P8CsvbP6nEpzU6KeE5un1mghYDhL2OvPRvn9MBUFc6yC6Odd4LvATiKqlhqtUWTR5VPyMjgPXpuNg091Wt0jZY Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:16.887127 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a34c410b96a54b35bae1016891c88465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 447407958a5747c2919eb741e19ee2c9 Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: exception: Aggregate 5 could not be found. Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5'} Jul 19 19:46:16.888699 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:16.889477 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.890672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98a771c9-f2e4-4634-9364-a19895a58f04 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:16.892037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98a771c9-f2e4-4634-9364-a19895a58f04 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.054779 Jul 19 19:46:16.892521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 117/248] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:16.911275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78255edb-7a71-4a5c-b1bc-7f9d691eaeb5 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.914538 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:16.914538 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:16.932564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:16.934590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78255edb-7a71-4a5c-b1bc-7f9d691eaeb5 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.935038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78255edb-7a71-4a5c-b1bc-7f9d691eaeb5 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:17.131319 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78255edb-7a71-4a5c-b1bc-7f9d691eaeb5 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.237742 Jul 19 19:46:17.132321 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 118/249] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:17.142648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a95c396c-80ed-4206-8735-9c7527ad22aa tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-472271344", "name": "tempest-test_aggregate-1530368245"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:17.181886 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:17.181886 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:17.183703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-a95c396c-80ed-4206-8735-9c7527ad22aa tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid 43f885e1-c1db-41dc-8562-4a16b5601a69 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:17.232586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a95c396c-80ed-4206-8735-9c7527ad22aa tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.098651 Jul 19 19:46:17.233556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 119/250] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Jul 19 19:46:17 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:17.244540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:17.246518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:17.257115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:17.258092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:17.259429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:17.261106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.577689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.594778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.596541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.597717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7ba254a7-9924-48fc-bcb0-fd92b281af0a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 1.362883 Jul 19 19:46:18.604952 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 120/251] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:17 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:18.629260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c35d116-71f2-40e4-b243-b29e25eab552 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.635132 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:18.635132 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:18.761763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c35d116-71f2-40e4-b243-b29e25eab552 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.118948 Jul 19 19:46:18.763075 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 121/252] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:18.771217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-94ff70bb-a663-4ca2-bbc2-352e5d51dc20 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.772683 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:18.772683 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:18.824450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-94ff70bb-a663-4ca2-bbc2-352e5d51dc20 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.057728 Jul 19 19:46:18.832048 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 122/253] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:19.535872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-494447986", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "58406271-8733-4495-9c0c-acccb6026722"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:19.671340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] validate_networks() for [('58406271-8733-4495-9c0c-acccb6026722', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:20.451243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:20.502188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:20.774105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=51 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:20.950283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:21.306055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:21.306771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:21.307421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:21.308009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:21.308616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:21.328616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.336573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.344364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.345112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.414625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:21.420582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for user 99eac0488e77448cb55a255d49ad2c58 and project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:21.458143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:21.461549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:21.579578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07074003-7383-46fe-955f-0328b26d6131 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.746338 Jul 19 19:46:21.580631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 123/254] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:21.588848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2281b5f-1648-4aa4-86c6-9ea20210fafa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-731888292"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:21.599225 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:21.599225 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:21.600902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-f2281b5f-1648-4aa4-86c6-9ea20210fafa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 39d59dc8-5f9a-4f3f-b0d0-2b747f127b38 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:21.648149 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2281b5f-1648-4aa4-86c6-9ea20210fafa tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066275 Jul 19 19:46:21.648752 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 124/255] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:21.657855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88ea4d040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.659050 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:21.659050 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:21.660247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.660692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.661503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.670836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.712098 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-144aa87f-5c6c-4d63-979a-10ad6fb52ad6 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9061 microversion: 2.1 time: 9.855537 Jul 19 19:46:21.712705 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 132/256] 10.222.0.33 () {58 vars in 1190 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9061 bytes in 9857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:21.717090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66ea56a0-2a3f-4e71-b9ee-63f7fc824486 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.717857 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:21.717857 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:21.737279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-66ea56a0-2a3f-4e71-b9ee-63f7fc824486 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66ea56a0-2a3f-4e71-b9ee-63f7fc824486 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Request method failure captured: Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnVoCIpY3atR3M1BZkOIJF1mk72Vw97ZEMjruTqIIinePe0ihe0xmvN8o0FHkKj_3DkNHm8CUSJi1ACeTyi0f2n4P8CsvbP6nEpzU6KeE5un1mghYDhL2OvPRvn9MBUFc6yC6Odd4LvATiKqlhqtUWTR5VPyMjgPXpuNg091Wt0jZY Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:21.739380 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a34c410b96a54b35bae1016891c88465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 447407958a5747c2919eb741e19ee2c9 Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: exception: Aggregate 7 could not be found. Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7'} Jul 19 19:46:21.740605 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:21.741326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 19 19:46:21.742776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:21.751289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66ea56a0-2a3f-4e71-b9ee-63f7fc824486 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:21.760236 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66ea56a0-2a3f-4e71-b9ee-63f7fc824486 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.046249 Jul 19 19:46:21.760841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 133/257] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:21.771608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-78a7d4df-3d90-4fa0-8c5d-5c041fd4264e req-7698d80f-a151-4862-a940-5c7f192f1e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:21.782510 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-88e5d35c-f95d-4ea4-9dfa-5b66cde38954 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.132664 Jul 19 19:46:21.789622 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 125/258] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:21.796025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.796630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:21.798712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:21.803058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-78a7d4df-3d90-4fa0-8c5d-5c041fd4264e req-7698d80f-a151-4862-a940-5c7f192f1e89 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.805128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-78a7d4df-3d90-4fa0-8c5d-5c041fd4264e req-7698d80f-a151-4862-a940-5c7f192f1e89 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.823574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.824061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.824835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.825385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.846121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-78a7d4df-3d90-4fa0-8c5d-5c041fd4264e req-7698d80f-a151-4862-a940-5c7f192f1e89 service nova] Creating event network-changed:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h1-843861-3 Jul 19 19:46:21.862950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-78a7d4df-3d90-4fa0-8c5d-5c041fd4264e req-7698d80f-a151-4862-a940-5c7f192f1e89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098214 Jul 19 19:46:21.867054 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 134/259] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:21.902365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e083d0a2-02a5-4d71-83e1-9cdbd8d229e2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.903098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e083d0a2-02a5-4d71-83e1-9cdbd8d229e2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:22.076325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e083d0a2-02a5-4d71-83e1-9cdbd8d229e2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.112312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e083d0a2-02a5-4d71-83e1-9cdbd8d229e2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1210 microversion: 2.1 time: 0.228428 Jul 19 19:46:22.113567 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 135/260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1210 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:22.411794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.434658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.442288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.449237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae459ea0-c3bf-4ee8-b129-514d0c42315e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.658394 Jul 19 19:46:22.452219 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 126/261] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:22.473777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6882c604-b0f1-436b-a1ab-4f82150902d4 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] Calling method '.version_select at 0x7fb88e6049d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:22.533574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddd141b4-aa6b-448a-978b-10adafa2f99e tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:22.535207 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:22.535207 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:22.536962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ddd141b4-aa6b-448a-978b-10adafa2f99e tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddd141b4-aa6b-448a-978b-10adafa2f99e tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 39 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:22.543631 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: {"add_host": {"host": "n-h1-843861-3"}} Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:22.546443 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-843861-3'}}} Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:22.547306 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:46:22.548416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.549439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddd141b4-aa6b-448a-978b-10adafa2f99e tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:22.552700 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddd141b4-aa6b-448a-978b-10adafa2f99e tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.437801 Jul 19 19:46:22.559015 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 136/262] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:22 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 445 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:22.569073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee778163-16df-436f-9e72-d67d06903e78 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:22.574910 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:22.574910 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:22.887396 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ee778163-16df-436f-9e72-d67d06903e78 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee778163-16df-436f-9e72-d67d06903e78 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Request method failure captured: Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnVoCIpY3atR3M1BZkOIJF1mk72Vw97ZEMjruTqIIinePe0ihe0xmvN8o0FHkKj_3DkNHm8CUSJi1ACeTyi0f2n4P8CsvbP6nEpzU6KeE5un1mghYDhL2OvPRvn9MBUFc6yC6Odd4LvATiKqlhqtUWTR5VPyMjgPXpuNg091Wt0jZY Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:22.892366 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a34c410b96a54b35bae1016891c88465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a34c410b96a54b35bae1016891c88465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a34c410b96a54b35bae1016891c88465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a34c410b96a54b35bae1016891c88465 Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2140365647 Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 447407958a5747c2919eb741e19ee2c9 Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminTestJSON-2140365647-project-admin Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: exception: Aggregate 7 could not be found. Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7'} Jul 19 19:46:22.893540 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:22.894263 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:22.895264 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:22.896427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:22.896427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:22.896427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:22.896427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 19 19:46:22.896427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:22.902424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee778163-16df-436f-9e72-d67d06903e78 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:22.903754 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee778163-16df-436f-9e72-d67d06903e78 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.338528 Jul 19 19:46:22.904504 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 137/263] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:22 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:22.910696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88f8500d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:22.912210 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:22.912210 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:22.913993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:22.914438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:22.915234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:22.915792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:22.970087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e5efb69-629b-4e94-8bc2-dbf19d58c257 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.064069 Jul 19 19:46:22.976930 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 138/264] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:22 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.111553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-229d2ceb-f880-49c6-84b6-7b2954c8d9be tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] Calling method '.version_select at 0x7fb88e70e0d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.112688 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.112688 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.140513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-229d2ceb-f880-49c6-84b6-7b2954c8d9be tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.167995 Jul 19 19:46:23.152263 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 139/265] 10.222.0.33 () {60 vars in 1225 bytes} [Tue Jul 19 19:46:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:23.158730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0193c33a-552d-45f8-a69d-b76ab4f88c40 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.167210 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.167210 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.231930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0193c33a-552d-45f8-a69d-b76ab4f88c40 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078945 Jul 19 19:46:23.233680 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 140/266] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:23.241785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f6cace0-ddee-4548-98b9-212675d6f10e tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153208850"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:23.247094 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.247094 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.252962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-3f6cace0-ddee-4548-98b9-212675d6f10e tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid c9a2333e-3eca-4851-af69-f0d5ba1484fa for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:23.317999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f6cace0-ddee-4548-98b9-212675d6f10e tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082351 Jul 19 19:46:23.320782 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 141/267] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.332087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88fba8dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.333544 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.333544 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.345453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.345901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.346703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.354841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.416663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87984f18-6fdb-4bd2-9651-df575e1e0ebf tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.094528 Jul 19 19:46:23.417310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 142/268] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.436363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.437010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:23.449716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6882c604-b0f1-436b-a1ab-4f82150902d4 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.994252 Jul 19 19:46:23.450949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 127/269] 10.222.0.33 () {58 vars in 1190 bytes} [Tue Jul 19 19:46:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:23.458427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.458427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.458652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.461325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.465191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34c29ff8-b919-45ae-8436-c57d2d280b45 tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e8fe280>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:23.469643 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.469643 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:23.778339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:23.788899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3318cac0-d3a0-43eb-8b66-e9edcacba671 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1270 microversion: 2.1 time: 0.365058 Jul 19 19:46:23.789585 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 143/270] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1270 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:23.804376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67922fdc-9805-4a55-b1fa-d3359fa7edfd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865104025"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:23.806081 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.806081 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.808703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-67922fdc-9805-4a55-b1fa-d3359fa7edfd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 09fc5bd9-3a2b-4c64-87ef-95714cb57218 for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:23.851553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67922fdc-9805-4a55-b1fa-d3359fa7edfd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058264 Jul 19 19:46:23.857052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 144/271] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.869511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d978c50e-d8b2-4db5-99c2-fa066a4f9007 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.871766 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.871766 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:23.881008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34c29ff8-b919-45ae-8436-c57d2d280b45 tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.417062 Jul 19 19:46:23.890847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 128/272] 10.222.0.33 () {62 vars in 1246 bytes} [Tue Jul 19 19:46:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:23.891760 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d978c50e-d8b2-4db5-99c2-fa066a4f9007 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.033229 Jul 19 19:46:23.896231 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 145/273] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.897829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88e8fe310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.898805 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:23.898805 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:23.906154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c838ad56-8104-424c-a840-30e588cedba3 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] Calling method '.version_select at 0x7fb890528dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.907315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.908014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.945270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:23.950597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.987675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c03e7338-31ab-40a5-8400-c016c72b23cd tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h1-843861-3" status: 200 len: 467 microversion: 2.1 time: 0.095268 Jul 19 19:46:23.993533 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 129/274] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/os-hosts/n-h1-843861-3 => generated 467 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:23.999697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:24.000819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:24.014275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.015132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.016547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.017372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.601883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:24.614434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:24.622007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:24.623707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a767f44-f2d4-4c58-8505-610019eeb797 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.628697 Jul 19 19:46:24.628957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 130/275] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:24.643177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1854762748"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:24.644813 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:24.644813 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:24.660757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.662286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.681410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.682232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.702723 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1854762748 could not be found. Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 58 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:24.708281 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: {"add_host": {"host": "tempest-nonexist_host-1854762748"}} Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:24.709601 n-d-843861-3 devstack@n-api.service[126007]: exception: Compute host tempest-nonexist_host-1854762748 could not be found. Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '10', 'body': {'add_host': {'host': 'tempest-nonexist_host-1854762748'}}} Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1854762748' is not mapped to any cell Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:24.710310 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 19 19:46:24.711732 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1854762748 could not be found. Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1854762748 could not be found. Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:24.712877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1854762748 could not be found. Jul 19 19:46:24.713985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:24.716423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1854762748 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:24.717543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e0d1bff-a3e2-4198-8f18-53b0f37a159b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 111 microversion: 2.1 time: 0.087257 Jul 19 19:46:24.718371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 131/276] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:46:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:24.739172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbeb94f0-f068-4bd1-bcac-cac19cf44df2 tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] Calling method '.version_select at 0x7fb88ea22c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:24.745070 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:24.745070 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:24.761821 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbeb94f0-f068-4bd1-bcac-cac19cf44df2 tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042132 Jul 19 19:46:24.768456 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 132/277] 10.222.0.33 () {60 vars in 1225 bytes} [Tue Jul 19 19:46:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:24.775486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e6b8833-96b3-440c-b804-88fd5423bec7 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:24.777643 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:24.777643 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:24.780814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=5,nova_api:INSERT=13,nova_api:UPDATE=7 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:24.845255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e6b8833-96b3-440c-b804-88fd5423bec7 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.074287 Jul 19 19:46:24.846425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 133/278] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 19 19:46:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:24.852926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Calling method '.version_select at 0x7fb88e63d9d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:24.857184 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:24.857184 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:24.878903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.880022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.946123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.966000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:25.023678 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8acba2ad-2211-4164-ac5f-c46317ece220 tempest-HostsAdminTestJSON-732109208 tempest-HostsAdminTestJSON-732109208-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h2-843861-3" status: 200 len: 467 microversion: 2.1 time: 0.175757 Jul 19 19:46:25.028728 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 134/279] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 19:46:24 2022] GET /compute/v2.1/os-hosts/n-h2-843861-3 => generated 467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:25.042905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c792855f-a2f1-44d6-ac3b-a450be66f470 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:25.062115 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:25.062115 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:25.210311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c792855f-a2f1-44d6-ac3b-a450be66f470 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.180369 Jul 19 19:46:25.226242 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 135/280] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:25.263492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c4eda8bd-fa7d-42b3-b373-eca04e8d94ab tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] Action: 'update', calling method: .version_select at 0x7fb88ea22c10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:25.271445 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:25.271445 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:25.514418 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c4eda8bd-fa7d-42b3-b373-eca04e8d94ab tempest-QuotaClassesAdmin257Test-1639185782 tempest-QuotaClassesAdmin257Test-1639185782-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.283531 Jul 19 19:46:25.515051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 136/281] 10.222.0.33 () {62 vars in 1246 bytes} [Tue Jul 19 19:46:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:25.543694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:25.544351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:25.581706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:25.584172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:25.588476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:25.588930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:25.714926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:26.171934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.188133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e2b681f-08e6-4a50-8fc8-78d499856118 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.655361 Jul 19 19:46:26.204123 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 137/282] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:25 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:26.221977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b19450ba-e6cb-48a6-a781-c51b244834ab tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.226576 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:26.226576 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:26.252055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b19450ba-e6cb-48a6-a781-c51b244834ab tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.042515 Jul 19 19:46:26.252923 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 138/283] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:46:26 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:26.273498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7ff7de0-e4b4-4658-95ec-2d200c75649f tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7ff7de0-e4b4-4658-95ec-2d200c75649f tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 283 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:26.284508 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:46:26.286384 n-d-843861-3 devstack@n-api.service[126007]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:46:26.287194 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:46:26.287943 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:46:26.289059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:46:26.289803 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:46:26.289803 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.289803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7ff7de0-e4b4-4658-95ec-2d200c75649f tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:26.289803 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7ff7de0-e4b4-4658-95ec-2d200c75649f tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.030120 Jul 19 19:46:26.290735 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 139/284] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Jul 19 19:46:26 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:26.321757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c838ad56-8104-424c-a840-30e588cedba3 tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/669137c8-e6f7-46ab-a3af-88c1ec48eeee" status: 202 len: 0 microversion: 2.1 time: 2.424228 Jul 19 19:46:26.323375 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 146/285] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:23 2022] DELETE /compute/v2.1/os-security-groups/669137c8-e6f7-46ab-a3af-88c1ec48eeee => generated 0 bytes in 2427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:26.329578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c3598d1-55bb-4e60-b415-4d3d16295f59 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.330654 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:26.330654 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:26.342502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.346600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:26.383533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:26.388383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:26.391054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:26.396024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:26.415774 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c3598d1-55bb-4e60-b415-4d3d16295f59 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.091066 Jul 19 19:46:26.428921 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 147/286] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:26 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:26.452073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-719c0527-bde5-4857-b056-fdbf83accdf9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-719c0527-bde5-4857-b056-fdbf83accdf9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 27 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:26.460944 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: {"aggregate": {"name": ""}} Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:26.462249 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi '' Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:26.463077 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:46:26.464896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.471422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-719c0527-bde5-4857-b056-fdbf83accdf9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:26.473148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-719c0527-bde5-4857-b056-fdbf83accdf9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.039496 Jul 19 19:46:26.474923 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 148/287] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:26.491056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a2404c6b-e3a7-4fac-bc7d-bc12ec2e687b tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] Calling method '.version_select at 0x7fb890528b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.762685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.776798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.781340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.785761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8626f261-7a10-45c4-a4f2-864b1d089617 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.488788 Jul 19 19:46:26.798919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 140/288] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:26 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:26.804781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed578610-e4c6-4190-bbd4-119b99a0356a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-113219444", "availability_zone": "tempest-test_az-173858258"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:26.806690 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:26.806690 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:26.808856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-ed578610-e4c6-4190-bbd4-119b99a0356a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid bda33307-48a3-41c4-9e27-a8eb3f2c117d for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:26.868313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed578610-e4c6-4190-bbd4-119b99a0356a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.078305 Jul 19 19:46:26.870646 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 141/289] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Jul 19 19:46:26 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:26.889003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7f1f273-f5eb-452b-aa32-7f4a5a919a78 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-453829867"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:26.894134 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:26.894134 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:26.896798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e7f1f273-f5eb-452b-aa32-7f4a5a919a78 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7f1f273-f5eb-452b-aa32-7f4a5a919a78 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 59 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:26.901649 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: {"aggregate": {"name": "tempest-test_aggregate-453829867"}} Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:26.902959 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-453829867'}}} Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:26.903668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:26.905385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:46:26.908097 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:26.909116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7f1f273-f5eb-452b-aa32-7f4a5a919a78 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:26.910741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7f1f273-f5eb-452b-aa32-7f4a5a919a78 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.036759 Jul 19 19:46:26.914287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 142/290] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:26 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:26.926451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1058a679-89a0-4575-9408-4d4378e0b162 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-113219444_new", "availability_zone": "tempest-test_az-173858258_new"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:27.169922 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:27.169922 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:27.268845 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a2404c6b-e3a7-4fac-bc7d-bc12ec2e687b tempest-SecurityGroupsTestAdminJSON-1733448949 tempest-SecurityGroupsTestAdminJSON-1733448949-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ec66dbf2-8e89-43bd-a70e-c20bab2fa1ff" status: 202 len: 0 microversion: 2.1 time: 0.791553 Jul 19 19:46:27.273920 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 149/291] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:26 2022] DELETE /compute/v2.1/os-security-groups/ec66dbf2-8e89-43bd-a70e-c20bab2fa1ff => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:27.280840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3b46f150-b045-4ead-a4ad-ab0dca36e823 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1001277104"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:27.288044 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:27.288044 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:27.288301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1058a679-89a0-4575-9408-4d4378e0b162 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.288707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1058a679-89a0-4575-9408-4d4378e0b162 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.290007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-3b46f150-b045-4ead-a4ad-ab0dca36e823 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid bcfad77c-e9fd-45ad-949d-d92b0de2c806 for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:27.339297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3b46f150-b045-4ead-a4ad-ab0dca36e823 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063898 Jul 19 19:46:27.349112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 150/292] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:27.366761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:27.367762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:27.390332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.390865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.391938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.414029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.421772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1058a679-89a0-4575-9408-4d4378e0b162 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.506021 Jul 19 19:46:27.426485 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 143/293] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 19:46:26 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:27.456163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5803a8c-4d90-448a-a8f9-c894a6431886 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] Calling method '.version_select at 0x7fb88e5b5430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:27.989978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.015701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3eb27c3-f37e-41c3-aa6c-64d89a17e93c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.665294 Jul 19 19:46:28.025959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 151/294] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:27 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:28.035348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1001277104"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:28.052247 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.052247 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.061705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 924c72a0-c211-4ae8-9b48-5eb68c53907b for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:28.094415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1001277104 already exists. Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 60 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:28.097961 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: {"aggregate": {"name": "tempest-test_aggregate-1001277104"}} Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:28.099153 n-d-843861-3 devstack@n-api.service[126008]: exception: Aggregate tempest-test_aggregate-1001277104 already exists. Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1001277104'}}} Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 19 19:46:28.100448 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1001277104 already exists. Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:28.101632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1001277104 already exists. Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1001277104 already exists. Jul 19 19:46:28.102713 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.108472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1001277104 already exists. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:28.111554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-559f00ab-dce7-4785-8cfb-642e601f43be tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.084348 Jul 19 19:46:28.112582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 152/295] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:28 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:28.123054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31b7f186-e85b-406c-96d3-3d49679a3c14 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.126788 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.126788 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.155455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31b7f186-e85b-406c-96d3-3d49679a3c14 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 552 microversion: 2.1 time: 0.040738 Jul 19 19:46:28.169403 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 153/296] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/os-aggregates => generated 552 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:28.173375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5803a8c-4d90-448a-a8f9-c894a6431886 tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/73674e9c-34bb-48fc-9f46-a9c228b2c652" status: 202 len: 0 microversion: 2.1 time: 0.742794 Jul 19 19:46:28.174694 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 144/297] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:27 2022] DELETE /compute/v2.1/os-security-groups/73674e9c-34bb-48fc-9f46-a9c228b2c652 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:28.175869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.179642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-469d1ed5-9bc6-4303-a427-03546278a396 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.180818 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.180818 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:28.182220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:28.205386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.206842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.210121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.212887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.255138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-469d1ed5-9bc6-4303-a427-03546278a396 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.078563 Jul 19 19:46:28.256496 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 145/298] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:28.268831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cbca6c0b-c632-4bde-8992-83a03d721a55 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.281827 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.281827 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:28.331101 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cbca6c0b-c632-4bde-8992-83a03d721a55 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.065803 Jul 19 19:46:28.336691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 146/299] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:28.345726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e00f19a5-0934-4e48-b376-d1463b05254b tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] Calling method '.version_select at 0x7fb88e61e160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.732613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.749740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.753606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.758981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82fe339f-40e0-4b48-85fb-c2edfb953751 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.584787 Jul 19 19:46:28.759797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 154/300] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:28.767564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18dc24f2-b3ec-4522-a464-d9b88c976e72 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-179283031"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:28.774623 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.774623 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.775918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-18dc24f2-b3ec-4522-a464-d9b88c976e72 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 6e15aa21-20ea-421e-8dbc-18b63420dae7 for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:28.806414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18dc24f2-b3ec-4522-a464-d9b88c976e72 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043260 Jul 19 19:46:28.809096 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 155/301] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:28.816212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-117ee794-d5d7-4444-9943-69dd99bee22a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1235804957"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:28.817884 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.817884 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.820665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-117ee794-d5d7-4444-9943-69dd99bee22a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Generated uuid f7c72cc7-ef9b-48d8-9b1e-199adf1e77ca for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:28.857025 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-117ee794-d5d7-4444-9943-69dd99bee22a tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045483 Jul 19 19:46:28.858257 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 156/302] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:28.864696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a8ccd31-7717-4e21-b121-4283d9ca26a0 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.866423 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.866423 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.868117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a8ccd31-7717-4e21-b121-4283d9ca26a0 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a8ccd31-7717-4e21-b121-4283d9ca26a0 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:28.871184 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:46:28.872843 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '13'} Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:28.873806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:46:28.875268 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:28.879079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a8ccd31-7717-4e21-b121-4283d9ca26a0 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:28.880290 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a8ccd31-7717-4e21-b121-4283d9ca26a0 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 403 len: 116 microversion: 2.1 time: 0.020898 Jul 19 19:46:28.881603 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 157/303] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:28.888844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe21af74-e680-4bd1-a721-f70163819fa1 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.890848 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.890848 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.901733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe21af74-e680-4bd1-a721-f70163819fa1 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.018662 Jul 19 19:46:28.902901 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 158/304] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:28.907951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64451761-1e61-4145-8764-44007952c14b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.910582 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.910582 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.944839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64451761-1e61-4145-8764-44007952c14b tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.040411 Jul 19 19:46:28.946259 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 159/305] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:28.953113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51fb3581-cba7-471f-a11e-328763e03892 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.954251 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:28.954251 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:28.996729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51fb3581-cba7-471f-a11e-328763e03892 tempest-AggregatesAdminTestJSON-2140365647 tempest-AggregatesAdminTestJSON-2140365647-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048467 Jul 19 19:46:29.002447 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 160/306] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:29.010459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca644d0d-e208-4059-810d-8fe464a7b622 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.011262 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.011262 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:29.035442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ca644d0d-e208-4059-810d-8fe464a7b622 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca644d0d-e208-4059-810d-8fe464a7b622 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:29.037768 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: exception: Aggregate -1 could not be found. Jul 19 19:46:29.039063 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '-1'} Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:29.039774 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.041403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca644d0d-e208-4059-810d-8fe464a7b622 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca644d0d-e208-4059-810d-8fe464a7b622 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035766 Jul 19 19:46:29.044243 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 161/307] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:29 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:29.046447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.046794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:29.054560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.055012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.055781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.056489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.080924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] HTTP exception thrown: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Request method failure captured: Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 HTTP/1.1 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnTvFjAHNlZwItocyzA0o-MMzIZ6UHZ3UMx6KgHMKldm7fadLYZ8jzs6RwhjyMDfSPDLTAWL4N3_wtsCEz2MvxT12TXEOZyz96IM_HEHNnpjpo3dk36O_TZnqehRzXE_YORzbxoqvE41TbXZORK3fcW3yRLDeUkHS9nU5xl330rHkY Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:29.083383 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: bfd1fb66a65d43608ee639bc5dd03e2d Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.087048 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c97aa19-0384-4dbf-9c33-176f910408a0'} Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.088169 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.089424 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.093254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Returning 404 to user: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.094469 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9be932e1-e549-47c7-9c78-1644fa82ac07 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 404 len: 111 microversion: 2.1 time: 0.052804 Jul 19 19:46:29.095457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 162/308] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:29 2022] DELETE /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:29.101762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.102497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:29.109558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.110306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.111319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.111968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.147256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e00f19a5-0934-4e48-b376-d1463b05254b tempest-SecurityGroupsTestAdminJSON-987917704 tempest-SecurityGroupsTestAdminJSON-987917704-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a85a43f0-3dec-4ef1-8201-164e5e6292d6" status: 202 len: 0 microversion: 2.1 time: 0.812989 Jul 19 19:46:29.148696 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 147/309] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:28 2022] DELETE /compute/v2.1/os-security-groups/a85a43f0-3dec-4ef1-8201-164e5e6292d6 => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:29.168451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a032bf4b-3f2c-441a-80e6-59b4b227b70c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2049539611"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:29.169895 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.169895 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.175367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-a032bf4b-3f2c-441a-80e6-59b4b227b70c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 1e4492ae-4c5f-4b70-828e-03b5c9ee3afe for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:29.241889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a032bf4b-3f2c-441a-80e6-59b4b227b70c tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087688 Jul 19 19:46:29.247892 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 148/310] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:29.256153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.257746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] [instance: 1c97aa19-0384-4dbf-9c33-176f910408a0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:29.278595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.280043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.280892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.281911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.355399 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] HTTP exception thrown: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Request method failure captured: Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 HTTP/1.1 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnTvFjAHNlZwItocyzA0o-MMzIZ6UHZ3UMx6KgHMKldm7fadLYZ8jzs6RwhjyMDfSPDLTAWL4N3_wtsCEz2MvxT12TXEOZyz96IM_HEHNnpjpo3dk36O_TZnqehRzXE_YORzbxoqvE41TbXZORK3fcW3yRLDeUkHS9nU5xl330rHkY Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:29.361276 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1dacf2678b8c4bc793358cb79b48e333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1dacf2678b8c4bc793358cb79b48e333 Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1029631620 Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: bfd1fb66a65d43608ee639bc5dd03e2d Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminTestJSON-1029631620-project Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.362755 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c97aa19-0384-4dbf-9c33-176f910408a0'} Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.363524 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. Jul 19 19:46:29.364877 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.373330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] Returning 404 to user: Instance 1c97aa19-0384-4dbf-9c33-176f910408a0 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.377784 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d16fc006-cc1f-4c7b-8dda-48e09f059933 tempest-AggregatesAdminTestJSON-1029631620 tempest-AggregatesAdminTestJSON-1029631620-project] 10.222.0.33 "GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0" status: 404 len: 111 microversion: 2.1 time: 0.127472 Jul 19 19:46:29.380411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 149/311] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/servers/1c97aa19-0384-4dbf-9c33-176f910408a0 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:29.398280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d07347c9-5a07-485e-8679-439b7a9bb5fc tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.405882 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.405882 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.411105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d07347c9-5a07-485e-8679-439b7a9bb5fc tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d07347c9-5a07-485e-8679-439b7a9bb5fc tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:29.416423 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:46:29.418019 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '15'} Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:29.419009 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:46:29.420409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.425783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d07347c9-5a07-485e-8679-439b7a9bb5fc tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.426830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d07347c9-5a07-485e-8679-439b7a9bb5fc tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.044699 Jul 19 19:46:29.427780 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 150/312] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:29.466054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86332faf-d9cb-4481-9084-8da17d8d07c8 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.468662 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.468662 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.538982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86332faf-d9cb-4481-9084-8da17d8d07c8 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.105930 Jul 19 19:46:29.546680 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 151/313] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:29.558475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d01d0167-ba17-4e5e-be9a-c3983e4e32cf tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.567121 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.567121 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.593513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d01d0167-ba17-4e5e-be9a-c3983e4e32cf tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d01d0167-ba17-4e5e-be9a-c3983e4e32cf tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:46:29.602127 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: exception: Aggregate -1 could not be found. Jul 19 19:46:29.603355 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '-1'} Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.604053 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 19:46:29.605130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.608928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d01d0167-ba17-4e5e-be9a-c3983e4e32cf tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.612638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d01d0167-ba17-4e5e-be9a-c3983e4e32cf tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.062032 Jul 19 19:46:29.618676 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 152/314] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:29.636802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e557fee5-5949-41e6-a67f-b9f8cdf2cbe2 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.640790 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.640790 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.644960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e557fee5-5949-41e6-a67f-b9f8cdf2cbe2 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e557fee5-5949-41e6-a67f-b9f8cdf2cbe2 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:29.653004 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:46:29.654513 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:29.655594 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:46:29.656945 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.661596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e557fee5-5949-41e6-a67f-b9f8cdf2cbe2 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.663313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e557fee5-5949-41e6-a67f-b9f8cdf2cbe2 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.037776 Jul 19 19:46:29.666475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 153/315] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:29.682163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d04e43d7-bff0-4fcf-a4c4-3d921721aefb tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1377841588"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:29.687675 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.687675 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.690394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-d04e43d7-bff0-4fcf-a4c4-3d921721aefb tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 0294d1c6-7440-43a9-b9b6-35620be86907 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:29.740475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d04e43d7-bff0-4fcf-a4c4-3d921721aefb tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066665 Jul 19 19:46:29.742244 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 154/316] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:29.790922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-92b914c2-26bd-46eb-92d3-ccf97315d4de tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:29.795470 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:29.795470 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:29.826777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92b914c2-26bd-46eb-92d3-ccf97315d4de tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.828596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92b914c2-26bd-46eb-92d3-ccf97315d4de tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.987954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:29.996269 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e2127d9-9d33-49d3-a09e-fe6fa1539377 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.899447 Jul 19 19:46:29.996854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 163/317] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:30.005108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.014823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:30.038652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.039419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.040526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.042060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.056937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-92b914c2-26bd-46eb-92d3-ccf97315d4de tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 243 microversion: 2.1 time: 0.287951 Jul 19 19:46:30.057850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 155/318] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:46:29 2022] POST /compute/v2.1/os-aggregates/16/action => generated 243 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:30.074808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4019bbd8-4608-44ab-945c-b2569f683556 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:30.077514 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:30.077514 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:30.078673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4019bbd8-4608-44ab-945c-b2569f683556 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '43a1d2a334724aa4a988a180ce16de5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6735a3c4b5774d1eb0f65e475f51a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4019bbd8-4608-44ab-945c-b2569f683556 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Request method failure captured: Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 42 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnULyidptfvXEpvhj16PRweGqKt-rb0oQNjMr-JMbf2QBY3KI63laYxHDVuoHYEtdFf31XwQEpbXNCfj4UjbAql_JyMDpROXKQJq3_lIDkmO3zwA-mhbrobI2OCIcyUuLlTM64qpQbdcZ-GzWfFbXcJ8qV3fpk34tAoqLWLJlTLO1w Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:46:30.080675 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6735a3c4b5774d1eb0f65e475f51a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6735a3c4b5774d1eb0f65e475f51a029 Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260 Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 43a1d2a334724aa4a988a180ce16de5b Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1839923260-project Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: {"remove_host": {"host": "n-h1-843861-3"}} Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:46:30.082231 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h1-843861-3'}}} Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:30.083210 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:46:30.085080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.087026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4019bbd8-4608-44ab-945c-b2569f683556 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:30.088911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4019bbd8-4608-44ab-945c-b2569f683556 tempest-AggregatesAdminNegativeTestJSON-1839923260 tempest-AggregatesAdminNegativeTestJSON-1839923260-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.024310 Jul 19 19:46:30.090113 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 156/319] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:46:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:30.103536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-724d2785-d1d2-4cb9-8b5b-70f0014a11f9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:30.140577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-724d2785-d1d2-4cb9-8b5b-70f0014a11f9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.141034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-724d2785-d1d2-4cb9-8b5b-70f0014a11f9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.286443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.301764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.308154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.310207 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d3bfad2-fcb6-4b70-ad88-6f46fee6f80f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.312233 Jul 19 19:46:30.310995 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 164/320] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:30.326716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-724d2785-d1d2-4cb9-8b5b-70f0014a11f9 tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 228 microversion: 2.1 time: 0.231762 Jul 19 19:46:30.328448 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 157/321] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:46:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:30.341996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67db9a9c-9f72-4b0b-94ce-c4efe9990acb tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.343344 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:30.343344 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:30.415067 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67db9a9c-9f72-4b0b-94ce-c4efe9990acb tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.077651 Jul 19 19:46:30.421091 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 165/322] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:46:30.425411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1fe02540-5870-4f2d-9d52-63c692a7955d tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-612360884"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:30.427530 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:30.427530 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:30.429087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-1fe02540-5870-4f2d-9d52-63c692a7955d tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Generated uuid 03492313-1b02-405b-9fae-8096a7462e68 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:30.450982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=9,nova_api:UPDATE=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:30.479868 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1fe02540-5870-4f2d-9d52-63c692a7955d tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056180 Jul 19 19:46:30.483061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 158/323] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 19:46:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:30.495683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:30.497247 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:30.497247 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:30.510509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.511307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.523943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.525010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.535763 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.compute.aggregates [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 19:46:30.536718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Request method failure captured: Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 42 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnWqYXMCUBL6DgwyMNPh3ImALiU1LlSl4y3KoFq8iWJyrQjhOb2MqcKfoSCBuEMisjSRl608ymJ9efr05cyPAowwL71Oi8BQTy68xL-tsCSr_EBIA5JUp7IKO8LQ_k8T6dWreWwQnreMcK0lEXc365wW-eSQe7Pi_yzQVwdDchi2bM Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:30.539059 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8280d82be484b28842ad1c53166d496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8280d82be484b28842ad1c53166d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8280d82be484b28842ad1c53166d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d8280d82be484b28842ad1c53166d496 Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365 Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3dd5d5ce544d44debb82e4461489f6f4 Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: {"remove_host": {"host": "nonexist_host"}} Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:30.540306 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 19:46:30.541054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 19 19:46:30.542218 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.543357 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:46:30.544568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:30.547206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:30.548485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-907be270-5ab6-41c0-9b68-a488a7ac92bd tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.058031 Jul 19 19:46:30.553814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 166/324] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 19:46:30 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:30.559904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d741367b-5fe9-49de-87b1-cbe1705c7a9e tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.561243 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:30.561243 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:30.598969 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d741367b-5fe9-49de-87b1-cbe1705c7a9e tempest-AggregatesAdminNegativeTestJSON-1345199365 tempest-AggregatesAdminNegativeTestJSON-1345199365-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.044609 Jul 19 19:46:30.605469 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 159/325] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 19:46:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 19 19:46:30.934323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6b5360ec-8dd8-4eea-8ed3-9246261085ff req-7b6784c6-34d6-4dfa-9758-f216ceb99507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "name": "network-vif-plugged", "status": "completed", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:30.967134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6b5360ec-8dd8-4eea-8ed3-9246261085ff req-7b6784c6-34d6-4dfa-9758-f216ceb99507 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.968014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6b5360ec-8dd8-4eea-8ed3-9246261085ff req-7b6784c6-34d6-4dfa-9758-f216ceb99507 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.986762 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6b5360ec-8dd8-4eea-8ed3-9246261085ff req-7b6784c6-34d6-4dfa-9758-f216ceb99507 service nova] Creating event network-vif-plugged:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h1-843861-3 Jul 19 19:46:31.005323 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6b5360ec-8dd8-4eea-8ed3-9246261085ff req-7b6784c6-34d6-4dfa-9758-f216ceb99507 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098964 Jul 19 19:46:31.007135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 167/326] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:31.016168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.016796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:31.036128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.038929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.040193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.042818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.332301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.333153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:31.347207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.354220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.355744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.356528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.840285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:31.853608 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e5e2e29-5de0-40d8-a631-79f1af2aa9b0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.844738 Jul 19 19:46:31.854202 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 160/327] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:31.965149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:31.981507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:31.986407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:31.987895 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-314a08d2-da0e-4591-807a-d399e3fb8487 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.662641 Jul 19 19:46:31.988717 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 168/328] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:32.872248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:32.874546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:32.891477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.892460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:32.895688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.902889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.008731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:33.009917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:33.027486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.027969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.028769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.029191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.138140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:33.473932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.491432 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a890d7fa-03b5-44bd-938f-261c31ea5cab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.616906 Jul 19 19:46:33.491432 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 161/329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:32 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:33.598971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.624331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.636519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.637864 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-75e264c2-6b20-4ebc-9cc6-52e6ade097f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1362 microversion: 2.25 time: 0.635703 Jul 19 19:46:33.652237 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 169/330] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:33 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1362 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:33.768266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ef80a884-ecab-4a02-8757-2d0660e8624a req-2c5ee9cf-2874-4a4e-b8e4-4884781258fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:33.788604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef80a884-ecab-4a02-8757-2d0660e8624a req-2c5ee9cf-2874-4a4e-b8e4-4884781258fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.788604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef80a884-ecab-4a02-8757-2d0660e8624a req-2c5ee9cf-2874-4a4e-b8e4-4884781258fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.825305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ef80a884-ecab-4a02-8757-2d0660e8624a req-2c5ee9cf-2874-4a4e-b8e4-4884781258fa service nova] Creating event network-changed:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h2-843861-3 Jul 19 19:46:33.832018 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ef80a884-ecab-4a02-8757-2d0660e8624a req-2c5ee9cf-2874-4a4e-b8e4-4884781258fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069995 Jul 19 19:46:33.836725 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 162/331] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:34.507101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:34.508331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:34.535953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.536298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:34.540755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.541220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:34.657269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:34.658163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:34.668836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.673402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:34.674385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.675064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:34.675898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:35.228140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:35.237399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9313b620-8f48-43f7-ba88-b1ca857d67ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.735108 Jul 19 19:46:35.241143 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 170/332] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:34 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:35.292221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:35.313448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:35.313448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:35.313830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70ad8f11-2e89-4155-a6bd-8597121732c7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1559 microversion: 2.25 time: 0.660934 Jul 19 19:46:35.314568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 163/333] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:34 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1559 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:35.823551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:35.824768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:35.826846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:35.841079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:35.843924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:35.849214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:35.851269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.123547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:36.197280 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31247806-81f4-4c90-b9b1-50cce3136337 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 2052 microversion: 2.25 time: 0.865707 Jul 19 19:46:36.210761 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 171/334] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:35 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 2052 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:36.220480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:36.220480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:36.226714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:36.230688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.231332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.232338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.232919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.256198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:36.257026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:36.269910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.270372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.271192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.271654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.585901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:36.598528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9bda58a8-ac6b-4e72-81ed-dedee3a6b311 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.345328 Jul 19 19:46:36.600963 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 172/335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:36 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:36.656053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:36.744150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c916784-3e5f-45a6-a4ba-0458ba6c22ea tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 2052 microversion: 2.25 time: 0.531480 Jul 19 19:46:36.745924 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 164/336] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:36 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 2052 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:36.782819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:36.786971 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:36.786971 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:36.790232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.791571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.794294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.794963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.839688 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f79f0795-1389-4290-bd58-474b0c20f0df tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077039 Jul 19 19:46:36.841365 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 173/337] 10.222.0.33 () {60 vars in 1216 bytes} [Tue Jul 19 19:46:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:36.854429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843861-3", "block_migration": "auto"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:36.856317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:36.879860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.880732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.882634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:36.883625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:36.999515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'flavor' on Instance uuid 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:37.085553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Going to try to live migrate instance to n-h2-843861-3 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:46:37.635594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Calling method '.version_select at 0x7fb88fba80d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:37.637257 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:37.637257 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:37.639002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.642105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.680629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.681124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.704896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.705622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.717094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71e71d86-19e8-489e-bfa5-37eb4ae799d5 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.515857 Jul 19 19:46:37.718365 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 174/338] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 19:46:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:37.737999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:37.739278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:37.748272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.749148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.750385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.751033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.969056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.983399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-600cc994-140e-423b-bd77-c9d50b4f7044 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.263780 Jul 19 19:46:37.994489 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 175/339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:37 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:37.999274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Calling method '.version_select at 0x7fb88e81c700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:38.000111 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:38.000111 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:38.001375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.001818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.018143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.018591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.027443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3032f3e2-cb97-49de-b67b-d977ea40f1f4 tempest-HypervisorAdminV228Test-229530099 tempest-HypervisorAdminV228Test-229530099-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.031755 Jul 19 19:46:38.037036 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 176/340] 10.222.0.33 () {60 vars in 1192 bytes} [Tue Jul 19 19:46:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:38.628510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dba9f1f1-a900-4014-b417-5ac08599f605 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88fb99dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:39.508453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dba9f1f1-a900-4014-b417-5ac08599f605 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133" status: 200 len: 371 microversion: 2.1 time: 1.467992 Jul 19 19:46:39.511108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 177/341] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:46:38 2022] GET /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133 => generated 371 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:39.517635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:39.518484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:39.526441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.527098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.528142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.528782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.966995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:39.977620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89331073-cb81-4291-9d42-7b4fc4fa2594 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.465060 Jul 19 19:46:39.989156 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 178/342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:39 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:39.989156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e714670>, body: {"quota_set": {"ram": "5120"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:40.472805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.473268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.492144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.492675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.510816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:40.619702 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-999fa721-f16d-45b9-9944-6a4954111cdc tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133" status: 200 len: 328 microversion: 2.1 time: 0.636161 Jul 19 19:46:40.625259 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 179/343] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:46:39 2022] PUT /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133 => generated 328 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:40.918997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1702964410", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:40.993800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:41.254504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:41.255040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:41.256185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:41.257056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:41.257400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:41.269195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.269716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.270654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.271279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.304783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Getting quotas for project b5b4fd6b0ef64c4688cda7eb26ed3c2f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:41.312418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Getting quotas for user 51a6d00491e746af8de8ee94e669b756 and project b5b4fd6b0ef64c4688cda7eb26ed3c2f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:41.328371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:41.330834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:41.384975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-17228005-95d2-4e32-8dd1-18863aef2d08 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762974 Jul 19 19:46:41.386639 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 180/344] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:41.392362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e515551a-5fdb-41cd-bdb2-dfd9acca8356 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.411685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e515551a-5fdb-41cd-bdb2-dfd9acca8356 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133" status: 202 len: 0 microversion: 2.1 time: 0.022658 Jul 19 19:46:41.416927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 181/345] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 19:46:41 2022] DELETE /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:41.783545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Calling method '.version_select at 0x7fb88e70ee50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.785810 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:41.785810 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:41.787412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.788107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.810123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.810736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.829082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.829952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.850817 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1496bf85-94b7-4539-95a3-45b610494c07 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.434339 Jul 19 19:46:41.866419 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 182/346] 10.222.0.33 () {60 vars in 1207 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:41.872917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.873736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:41.881720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.883877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.884850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.885471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.191445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.201357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9872b7f-c2d3-4e55-aed1-ed81ea6b67d5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.333770 Jul 19 19:46:42.204369 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 183/347] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:42.480570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c68c99df-484f-4822-8e80-78294a4c5aba tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221/action" status: 202 len: 0 microversion: 2.25 time: 5.631056 Jul 19 19:46:42.485331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 165/348] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:46:36 2022] POST /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221/action => generated 0 bytes in 5633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:42.488274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:42.488965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:42.500214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:42.500965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.501932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:42.502571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.582811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.591164 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a8670c05-38f8-48f9-bee2-a7e09c1551fd tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1275 microversion: 2.1 time: 0.107890 Jul 19 19:46:42.593232 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 166/349] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:42 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:42.597687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-37b434c5-395d-4c85-9f13-cf98976a7891 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88e52a940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:42.671141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-970990851", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:42.770310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:43.018242 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-37b434c5-395d-4c85-9f13-cf98976a7891 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133" status: 200 len: 371 microversion: 2.1 time: 0.423756 Jul 19 19:46:43.019188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 167/350] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:46:42 2022] GET /compute/v2.1/os-quota-sets/b6b984e7fed242bc81ea7dc0b9edb133 => generated 371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:43.024238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-716891a1-3a7f-4418-b5c7-7b5fd193a4f2 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1412135687"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:43.038077 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:43.038077 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:43.040331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.aggregate [None req-716891a1-3a7f-4418-b5c7-7b5fd193a4f2 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Generated uuid 38fdbda4-a006-48d5-9aff-80d0a1ebdf13 for aggregate {{(pid=126007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:46:43.077593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-716891a1-3a7f-4418-b5c7-7b5fd193a4f2 tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.056282 Jul 19 19:46:43.083206 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 168/351] 10.222.0.33 () {62 vars in 1204 bytes} [Tue Jul 19 19:46:43 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:43.098382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d9055079-79f1-493d-b4d1-538c8bd2dca1 req-90c2ddcd-1847-4240-8bbd-bbeb5332f8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "name": "network-vif-plugged", "status": "completed", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:43.120719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d9055079-79f1-493d-b4d1-538c8bd2dca1 req-90c2ddcd-1847-4240-8bbd-bbeb5332f8d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.121739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d9055079-79f1-493d-b4d1-538c8bd2dca1 req-90c2ddcd-1847-4240-8bbd-bbeb5332f8d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.135185 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d9055079-79f1-493d-b4d1-538c8bd2dca1 req-90c2ddcd-1847-4240-8bbd-bbeb5332f8d4 service nova] Creating event network-vif-plugged:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h2-843861-3 Jul 19 19:46:43.145293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d9055079-79f1-493d-b4d1-538c8bd2dca1 req-90c2ddcd-1847-4240-8bbd-bbeb5332f8d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058446 Jul 19 19:46:43.147750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 169/352] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:43.161208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.163041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:43.181532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.182359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.183517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.184196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.265276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:43.265871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:43.266178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:43.266585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:43.266998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:43.290228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.292356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.295877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.296486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.342089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Getting quotas for project dd8ad00c8dcf46549255411fd05f6c72. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:43.347255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Getting quotas for user 4232e411040b43129bec0aba0ef763ed and project dd8ad00c8dcf46549255411fd05f6c72. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:43.374227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:43.376423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:43.465962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c3dcb1f3-fe8a-4de9-8f8f-5944985cdaf7 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260016 Jul 19 19:46:43.466931 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 184/353] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:43.484378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056c8951-a53c-46dd-8bfe-1c4201a7d53d tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-233634645"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:43.603001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.616675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.620515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.625281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9b9d3b02-2f37-49f1-9639-443547f1383b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.475539 Jul 19 19:46:43.630495 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:43.630495 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:43.642703 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 170/354] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:43.672328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.673421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:43.688908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.689390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-056c8951-a53c-46dd-8bfe-1c4201a7d53d tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.221330 Jul 19 19:46:43.689958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.691189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.691845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.695351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 185/355] 10.222.0.33 () {62 vars in 1212 bytes} [Tue Jul 19 19:46:43 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:43.704088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7ffe622-9ac7-45a5-af0e-d43e3cd8f21d tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88fba8700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.948722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.957088 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f25c812-d917-4b06-931e-6634310b7f87 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.313025 Jul 19 19:46:43.957968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 171/356] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:43.963591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72da0c48-5944-4cd4-ab2d-6ac7b6d2d830 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.964287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72da0c48-5944-4cd4-ab2d-6ac7b6d2d830 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.042646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72da0c48-5944-4cd4-ab2d-6ac7b6d2d830 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.053528 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72da0c48-5944-4cd4-ab2d-6ac7b6d2d830 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1219 microversion: 2.1 time: 0.091138 Jul 19 19:46:44.054171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 172/357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:44.067559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.068198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.080908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.081360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.082138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.084511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.211402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.224357 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7162bf2c-6137-4be9-85bb-cbb81a6845a2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1281 microversion: 2.1 time: 0.160430 Jul 19 19:46:44.225524 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 173/358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:44 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:44.234697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d688865-eb7d-4c3d-af83-b3947775fd2e tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.237208 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:44.237208 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:44.251408 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d688865-eb7d-4c3d-af83-b3947775fd2e tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.024097 Jul 19 19:46:44.253846 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 174/359] 10.222.0.33 () {60 vars in 1192 bytes} [Tue Jul 19 19:46:44 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:44.263870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e581d62-a195-472c-8e86-633b6a229fda tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:44.266153 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:44.266153 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:44.276953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e581d62-a195-472c-8e86-633b6a229fda tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.277688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e581d62-a195-472c-8e86-633b6a229fda tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.284529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c7ffe622-9ac7-45a5-af0e-d43e3cd8f21d tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849/defaults" status: 200 len: 371 microversion: 2.1 time: 0.587810 Jul 19 19:46:44.285121 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 186/360] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849/defaults => generated 371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:44.445039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e581d62-a195-472c-8e86-633b6a229fda tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.185041 Jul 19 19:46:44.445916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 175/361] 10.222.0.33 () {62 vars in 1234 bytes} [Tue Jul 19 19:46:44 2022] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:44.455875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ad28641-bd21-43c5-8bba-1e5e0322f1fa tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:44.457414 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:44.457414 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:44.468413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ad28641-bd21-43c5-8bba-1e5e0322f1fa tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.468796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ad28641-bd21-43c5-8bba-1e5e0322f1fa tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.598284 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ad28641-bd21-43c5-8bba-1e5e0322f1fa tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.146029 Jul 19 19:46:44.600479 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 187/362] 10.222.0.33 () {62 vars in 1234 bytes} [Tue Jul 19 19:46:44 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:46:44.610712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6124700-b3d7-4435-a905-aafa89f7885b tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.612267 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:44.612267 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:44.642529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6124700-b3d7-4435-a905-aafa89f7885b tempest-AggregatesAdminTestV241-165849201 tempest-AggregatesAdminTestV241-165849201-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.035221 Jul 19 19:46:44.650699 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 176/363] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Jul 19 19:46:44 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:44.651057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.651791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.660746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.661508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.662329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.662950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.938127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.949884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.953056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.958289 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1e930e0-b1cc-4d67-9557-2947e2f977bd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.312979 Jul 19 19:46:44.959378 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 188/364] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:44 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:44.975153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.975792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.985285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.986040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.987365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.988362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.025135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:45.070730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:45.071340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:45.078427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.078870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.079635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.084656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.217210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.226643 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e635c8a4-c70f-4d12-ad06-210f27ea0c3f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1271 microversion: 2.1 time: 0.159927 Jul 19 19:46:45.227232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 189/365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:45 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:45.240035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Action: 'update', calling method: .version_select at 0x7fb88f886790>, body: {"quota_set": {"ram": "5120"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:45.560236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.572160 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9023b3c-abe9-443c-9eaa-57a44663a8b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1310 microversion: 2.1 time: 0.601345 Jul 19 19:46:45.574016 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 177/366] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:44 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1310 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:45.582418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:45.589346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:45.609127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.610937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.613777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.614385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.819146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.820271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.821490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.822285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.846196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:45.903556 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef79b094-4e98-4407-ba66-c3f233d8089c tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60" status: 200 len: 328 microversion: 2.1 time: 0.668964 Jul 19 19:46:45.905208 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 190/367] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:46:45 2022] PUT /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60 => generated 328 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:46.129108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:46.141873 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bfde0e1-f4bf-4266-a3bc-5ce46caaf03d tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.566714 Jul 19 19:46:46.143508 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 178/368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:45 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:46.151342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88e3af820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.196956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57baf862-f7c0-4bba-942d-88f6eebeb14a tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.197940 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:46.197940 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:46.200324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-57baf862-f7c0-4bba-942d-88f6eebeb14a tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57baf862-f7c0-4bba-942d-88f6eebeb14a tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin] Request method failure captured: Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wolUS1L_QjAcVzDEIbnCF3vTiscDVC9rI3aLAYqUOPyYduTmiYI8Gw-a_25__YtW93xycm6w-cpOMf23KpM8JRxbs5E7AkQjrBhtUwO_s-lP-plvSBUtyQ38SqKYDeAB1w5t3KZqigaU6dcesnqFyAMRG4w4jig8yeCZmeLqtTTnII Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c63ff1359c3e4abb92627cd92112375f Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:46:46.205335 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c63ff1359c3e4abb92627cd92112375f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c63ff1359c3e4abb92627cd92112375f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c63ff1359c3e4abb92627cd92112375f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c63ff1359c3e4abb92627cd92112375f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c63ff1359c3e4abb92627cd92112375f Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 34c39cedfce940919de8c10979685f7c Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid timestamp for date invalid_time Jul 19 19:46:46.206921 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'invalid_time'} Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:46.207859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 19 19:46:46.209391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:46.211236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57baf862-f7c0-4bba-942d-88f6eebeb14a tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:46.212393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57baf862-f7c0-4bba-942d-88f6eebeb14a tempest-InstanceUsageAuditLogNegativeTestJSON-20177977 tempest-InstanceUsageAuditLogNegativeTestJSON-20177977-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.305594 Jul 19 19:46:46.213224 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 191/369] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 19 19:46:45 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:46:46.220618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.221626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:46.231334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.232484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.233623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.234331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.368755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.370188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.371910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.373105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.403838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8bbca480-949a-4f7b-9335-0bc41a769584 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60/detail" status: 200 len: 916 microversion: 2.1 time: 0.259204 Jul 19 19:46:46.404461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 179/370] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60/detail => generated 916 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:46.470710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-44019cf2-0ccb-4d81-9164-36ccb76dfa3b tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] Calling method '.version_select at 0x7fb88e3f7280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.719548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:46.737332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:46.738962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:46.741817 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd53e221-c1e3-4cf0-b25b-eed6a1bfb972 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.525610 Jul 19 19:46:46.742264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 192/371] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:46.935213 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-44019cf2-0ccb-4d81-9164-36ccb76dfa3b tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 4678 microversion: 2.1 time: 0.529482 Jul 19 19:46:46.935839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 180/372] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/os-networks => generated 4678 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:46.940972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.941884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:46.957272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.958280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.960482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.963032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.175033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.183617 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bfbd136-645f-425a-8c7d-833452df6204 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1277 microversion: 2.1 time: 0.246152 Jul 19 19:46:47.184235 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 181/373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:47.199570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.200427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:47.208257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.209497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.210611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.211202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.268427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92821d8b-49ac-4b32-adc4-ee42af8f78fe tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.269250 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:47.269250 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:47.271408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92821d8b-49ac-4b32-adc4-ee42af8f78fe tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5673c55652a84590b99af610f02e5290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb3e35b96de4d7a9828f3c2e5185491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92821d8b-49ac-4b32-adc4-ee42af8f78fe tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Request method failure captured: Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wojcmiMx9CnSbTfkKPNeWkRAdIK-lFkMIx6ItZv3Ouo9WqWJszp_o6lqnERiu_KIEouP8s3x7245uUBuuq0MlJXg1MF1YOSWQYX2zHPH4-EYnZAbwyWDWezKR-r6VB7XA51h4S0msJpJFBwjshcjirWOXD0gtWZEZLT_n4qtHpF9fA Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: abb3e35b96de4d7a9828f3c2e5185491 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:47.273622 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: abb3e35b96de4d7a9828f3c2e5185491 Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5673c55652a84590b99af610f02e5290 Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:47.275044 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:47.275895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:47.282438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92821d8b-49ac-4b32-adc4-ee42af8f78fe tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:47.284854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92821d8b-49ac-4b32-adc4-ee42af8f78fe tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.527018 Jul 19 19:46:47.284854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 193/374] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 540 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:47.291577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fb947ce-4981-4688-ba78-f9370d8b9f31 tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] Calling method '.version_select at 0x7fb88e6709d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.722760 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fb947ce-4981-4688-ba78-f9370d8b9f31 tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/02c2b43a-dc9b-4bb5-bc11-df88962220ed" status: 200 len: 652 microversion: 2.1 time: 0.436309 Jul 19 19:46:47.723288 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 194/375] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/os-networks/02c2b43a-dc9b-4bb5-bc11-df88962220ed => generated 652 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:47.781813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-931f02d9-f7e4-46b0-8649-c6cdb4c68f80 req-7aae7baa-2f83-4cc3-b490-2d80b12121f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "name": "network-vif-unplugged", "status": "completed", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:47.790955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-931f02d9-f7e4-46b0-8649-c6cdb4c68f80 req-7aae7baa-2f83-4cc3-b490-2d80b12121f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.791395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-931f02d9-f7e4-46b0-8649-c6cdb4c68f80 req-7aae7baa-2f83-4cc3-b490-2d80b12121f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.794358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.802341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-931f02d9-f7e4-46b0-8649-c6cdb4c68f80 req-7aae7baa-2f83-4cc3-b490-2d80b12121f4 service nova] Creating event network-vif-unplugged:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h1-843861-3 Jul 19 19:46:47.804168 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c86f139b-6c0e-4828-ab17-73b893d4bc67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1493 microversion: 2.1 time: 0.608330 Jul 19 19:46:47.809841 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 182/376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1493 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:47.810015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-931f02d9-f7e4-46b0-8649-c6cdb4c68f80 req-7aae7baa-2f83-4cc3-b490-2d80b12121f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083569 Jul 19 19:46:47.810015 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 195/377] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:47.813585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.813711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e670b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:47.814200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:47.823837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.824760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.825222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.825661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.897371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.897818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.899145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.899784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.935664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.936069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.937060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.937493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.023024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43eded10-a301-4af0-9860-7179a05c1230 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60?user_id=6d0edea71f1b424187a73d3a71202858" status: 200 len: 328 microversion: 2.1 time: 0.212951 Jul 19 19:46:48.024217 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 196/378] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:46:47 2022] PUT /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60?user_id=6d0edea71f1b424187a73d3a71202858 => generated 328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:48.030633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef092034-203f-4cb1-b24d-5b6357e9ae6c tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:48.031870 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:48.031870 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:46:48.033379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ef092034-203f-4cb1-b24d-5b6357e9ae6c tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5673c55652a84590b99af610f02e5290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb3e35b96de4d7a9828f3c2e5185491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef092034-203f-4cb1-b24d-5b6357e9ae6c tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Request method failure captured: Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019:46:47 HTTP/1.1 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wojcmiMx9CnSbTfkKPNeWkRAdIK-lFkMIx6ItZv3Ouo9WqWJszp_o6lqnERiu_KIEouP8s3x7245uUBuuq0MlJXg1MF1YOSWQYX2zHPH4-EYnZAbwyWDWezKR-r6VB7XA51h4S0msJpJFBwjshcjirWOXD0gtWZEZLT_n4qtHpF9fA Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: abb3e35b96de4d7a9828f3c2e5185491 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:48.035409 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_abb3e35b96de4d7a9828f3c2e5185491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: abb3e35b96de4d7a9828f3c2e5185491 Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5673c55652a84590b99af610f02e5290 Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:48.036650 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2022-07-19 19:46:47'} Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:48.037281 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:46:48.038358 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:48.041144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef092034-203f-4cb1-b24d-5b6357e9ae6c tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:48.042293 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef092034-203f-4cb1-b24d-5b6357e9ae6c tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462 tempest-InstanceUsageAuditLogNegativeTestJSON-1196970462-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 19:46:47" status: 403 len: 128 microversion: 2.1 time: 0.016514 Jul 19 19:46:48.043025 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 197/379] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019%3A46%3A47 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:48.052766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a38afdc3-1808-4055-b173-40c0fb2c48c3 req-6575b2bd-ac4a-46a0-838f-bed6a6493ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3807ec75-9b47-4db7-be7c-d15e16b00567", "tag": "618b8bc2-daf2-4293-b9fa-f7731f0c7680"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:48.064057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a38afdc3-1808-4055-b173-40c0fb2c48c3 req-6575b2bd-ac4a-46a0-838f-bed6a6493ba1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.064507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a38afdc3-1808-4055-b173-40c0fb2c48c3 req-6575b2bd-ac4a-46a0-838f-bed6a6493ba1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.077148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a38afdc3-1808-4055-b173-40c0fb2c48c3 req-6575b2bd-ac4a-46a0-838f-bed6a6493ba1 service nova] Creating event network-changed:618b8bc2-daf2-4293-b9fa-f7731f0c7680 for instance 3807ec75-9b47-4db7-be7c-d15e16b00567 on n-h1-843861-3 Jul 19 19:46:48.083651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a38afdc3-1808-4055-b173-40c0fb2c48c3 req-6575b2bd-ac4a-46a0-838f-bed6a6493ba1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037884 Jul 19 19:46:48.084640 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 198/380] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:48.090591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-069cf9f6-7d9c-43bf-bc59-54668ec01222 tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] Calling method '.version_select at 0x7fb88e670820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:48.097200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.107729 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-210e001e-cfa8-4b9d-b873-93689ddaa445 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.301311 Jul 19 19:46:48.109608 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 183/381] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:48.123048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:48.124079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:48.133033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.133695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.134475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.134909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.745040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.757707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.760395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.761131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-069cf9f6-7d9c-43bf-bc59-54668ec01222 tempest-NetworksTest-1906859720 tempest-NetworksTest-1906859720-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 4678 microversion: 2.1 time: 0.674962 Jul 19 19:46:48.761976 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 199/382] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/os-networks => generated 4678 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:48.763508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6f6f22c-c3b7-4048-8afb-f0f51ee8b13e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.652728 Jul 19 19:46:48.778699 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 184/383] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:48.794605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56e5db79-bb39-4923-9b2a-7e44e35c59ff tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88e417dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.124050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.124872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.139170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.139733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.141448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.143668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.462855 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5caddc9a-56d9-450d-b0bd-484a2356478f tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1644 microversion: 2.1 time: 0.699763 Jul 19 19:46:49.473468 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 200/384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1644 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:49.477424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.478053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.489106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.489558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.490873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.491308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.735158 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56e5db79-bb39-4923-9b2a-7e44e35c59ff tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60?user_id=6d0edea71f1b424187a73d3a71202858" status: 200 len: 370 microversion: 2.1 time: 0.954793 Jul 19 19:46:49.741949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 185/385] 10.222.0.33 () {58 vars in 1322 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/os-quota-sets/6fd2c8ea3649432695c8d1f96be73e60?user_id=6d0edea71f1b424187a73d3a71202858 => generated 370 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:49.759912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.760535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.767314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.767768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.768583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.769018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.940707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.949893 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c2bcbe7-9eeb-4018-b10b-866674a633c4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.482161 Jul 19 19:46:49.962205 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 201/386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:49.967234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.969194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.984744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.986146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.987643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.988704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.278156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.286292 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dee67300-867c-474c-9d78-2cdc2d051cf2 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.543030 Jul 19 19:46:50.286754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 186/387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:50.298970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.300512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:50.308916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.309521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.310542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.310977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.602461 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df54ab67-ada7-418e-86a0-04d64140b133 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1644 microversion: 2.1 time: 0.637266 Jul 19 19:46:50.618992 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 202/388] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1644 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:50.632251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5e32f7de-2437-4bf0-8757-513ace2c7ce9 req-dc62dae0-6d7e-4643-964c-246c1cea6df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:50.641966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5e32f7de-2437-4bf0-8757-513ace2c7ce9 req-dc62dae0-6d7e-4643-964c-246c1cea6df7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.644448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5e32f7de-2437-4bf0-8757-513ace2c7ce9 req-dc62dae0-6d7e-4643-964c-246c1cea6df7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.667105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5e32f7de-2437-4bf0-8757-513ace2c7ce9 req-dc62dae0-6d7e-4643-964c-246c1cea6df7 service nova] Creating event network-changed:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h1-843861-3 Jul 19 19:46:50.675449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5e32f7de-2437-4bf0-8757-513ace2c7ce9 req-dc62dae0-6d7e-4643-964c-246c1cea6df7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048911 Jul 19 19:46:50.681137 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 203/389] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:50.700052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9011403e-9199-4eef-bf76-847918b568f7 req-00d0dfd3-4dad-4281-b9d7-902c924625aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e79b1af-47e8-4bf6-95c9-16b1df852140", "tag": "49f9a38e-d178-4148-9d5f-582ddd977819"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:50.712164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9011403e-9199-4eef-bf76-847918b568f7 req-00d0dfd3-4dad-4281-b9d7-902c924625aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.713158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9011403e-9199-4eef-bf76-847918b568f7 req-00d0dfd3-4dad-4281-b9d7-902c924625aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.728429 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9011403e-9199-4eef-bf76-847918b568f7 req-00d0dfd3-4dad-4281-b9d7-902c924625aa service nova] Creating event network-changed:49f9a38e-d178-4148-9d5f-582ddd977819 for instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 on n-h2-843861-3 Jul 19 19:46:50.734877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9011403e-9199-4eef-bf76-847918b568f7 req-00d0dfd3-4dad-4281-b9d7-902c924625aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046582 Jul 19 19:46:50.736289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 204/390] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:50.743038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5a22063-2411-4e18-9979-5a678c872552 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Calling method '.version_select at 0x7fb88e6dc160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.899836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.922151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.924179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.925611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e1cc6b2-24e5-4426-983e-206615ff76b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.635906 Jul 19 19:46:50.926397 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 187/391] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:50 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:50.947455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.952018 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:50.952018 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:50.954740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.955545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.957075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.957760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.015909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c37764d-b8d2-4027-b135-fc5b95ed9b94 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088112 Jul 19 19:46:51.016799 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 188/392] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:46:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:51.022542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:51.023565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:51.032148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.032999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.034111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.035059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.277642 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5a22063-2411-4e18-9979-5a678c872552 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849/defaults" status: 200 len: 371 microversion: 2.1 time: 0.539796 Jul 19 19:46:51.278759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 205/393] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:46:50 2022] GET /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849/defaults => generated 371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:51.292008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843861-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:51.297213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:51.311499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.312145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.313162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.313894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.420825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lazy-loading 'flavor' on Instance uuid ec386b1d-f373-4656-80b0-47a57ca6a118 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:51.425274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:51.436908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70c84414-75d5-484a-b428-12fd39a11800 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.418392 Jul 19 19:46:51.437679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 189/394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:51 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:51.442524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e36b5e0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:51.542511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Going to try to live migrate instance to n-h1-843861-3 {{(pid=126008) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:46:51.842042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.842683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.844454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.845045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.936813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:52.352089 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-471b7c7d-7e44-4b12-acf2-9e50373bede3 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849" status: 200 len: 329 microversion: 2.1 time: 0.912721 Jul 19 19:46:52.352907 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 190/395] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Jul 19 19:46:51 2022] PUT /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849 => generated 329 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:52.358419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.359246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.367756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.368629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.369762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.370518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.588929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.597282 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-240cfd09-112b-47e6-91f2-a2b512dfef50 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.243034 Jul 19 19:46:52.597848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 191/396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:52.602784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.603381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.609546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.609986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.610739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.611163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.765536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.776433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.779265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.780803 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c941821-9edd-44db-961e-0a0c795f4630 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.181806 Jul 19 19:46:52.781576 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 192/397] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:52.790530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e36b550>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:53.106447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.107071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.108298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.108675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.450713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=28,nova_api:UPDATE=14 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:53.475028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a38bef0a-81d4-488c-a959-33938e27b475 tempest-QuotasAdminTestJSON-687698553 tempest-QuotasAdminTestJSON-687698553-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849" status: 200 len: 329 microversion: 2.1 time: 0.691756 Jul 19 19:46:53.475916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 193/398] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Jul 19 19:46:52 2022] PUT /compute/v2.1/os-quota-sets/e16fb47a60e447659eb03e1727b88849 => generated 329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:53.480650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.481527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.487875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.488274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.489032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.489619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.659712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:53.669179 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-230f1d01-fe87-478a-b119-0a9e1a8921e2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.191869 Jul 19 19:46:53.669891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 194/399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:53 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:53.685593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.686188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.694475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.695151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.696084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.696638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.865618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:53.876519 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2fb3fac-9daf-42a5-9ab2-eb4a5a791a45 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.195244 Jul 19 19:46:53.877642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 195/400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:53 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:53.884539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.885154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.892317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.892827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.893652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.893958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.079830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.092321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.098788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.104815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2a508cf-74de-4eed-959d-c2b48fc21b9f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.225987 Jul 19 19:46:54.105859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 196/401] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:53 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:54.110442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-deb3c996-63d8-494e-8c91-cbed3267144f req-99e75f3c-9a3d-4fcb-b59e-ace5e0021e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3807ec75-9b47-4db7-be7c-d15e16b00567", "name": "network-vif-plugged", "status": "completed", "tag": "618b8bc2-daf2-4293-b9fa-f7731f0c7680"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:54.130986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-deb3c996-63d8-494e-8c91-cbed3267144f req-99e75f3c-9a3d-4fcb-b59e-ace5e0021e58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.131402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-deb3c996-63d8-494e-8c91-cbed3267144f req-99e75f3c-9a3d-4fcb-b59e-ace5e0021e58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.166981 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-deb3c996-63d8-494e-8c91-cbed3267144f req-99e75f3c-9a3d-4fcb-b59e-ace5e0021e58 service nova] Creating event network-vif-plugged:618b8bc2-daf2-4293-b9fa-f7731f0c7680 for instance 3807ec75-9b47-4db7-be7c-d15e16b00567 on n-h1-843861-3 Jul 19 19:46:54.180040 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-deb3c996-63d8-494e-8c91-cbed3267144f req-99e75f3c-9a3d-4fcb-b59e-ace5e0021e58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068089 Jul 19 19:46:54.181244 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 197/402] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:54.788132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5dc19b12-e80e-440a-9e7c-8ef4a9ec8734 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] Calling method '.version_select at 0x7fb88e3f78b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.789095 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:54.789095 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:54.817711 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5dc19b12-e80e-440a-9e7c-8ef4a9ec8734 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.197570 Jul 19 19:46:54.819330 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 198/403] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:54.828738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.833881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:54.847079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.850496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.851487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.851834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.241432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:55.256779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49cd567c-0330-4d56-ad2e-2c2a4c3a0ce2 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.435206 Jul 19 19:46:55.257733 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 199/404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:55.262488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6a684a1-ca00-4f93-ab6d-ff5375eabb74 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e3cd4c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:55.269158 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:55.269158 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:55.481488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=95,nova_cell0:UPDATE=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:55.553770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc2f9da7-9128-4eef-a8b5-34f02789e508 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118/action" status: 202 len: 0 microversion: 2.1 time: 4.270525 Jul 19 19:46:55.557522 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 206/405] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:46:51 2022] POST /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118/action => generated 0 bytes in 4275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:55.571301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fa67d46c-6b94-42c3-81d9-5fb2d6673135 req-9451b1bf-3df5-4423-b903-a2fa932bffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "name": "network-vif-unplugged", "status": "completed", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:55.597798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa67d46c-6b94-42c3-81d9-5fb2d6673135 req-9451b1bf-3df5-4423-b903-a2fa932bffb0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.608053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa67d46c-6b94-42c3-81d9-5fb2d6673135 req-9451b1bf-3df5-4423-b903-a2fa932bffb0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.651114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fa67d46c-6b94-42c3-81d9-5fb2d6673135 req-9451b1bf-3df5-4423-b903-a2fa932bffb0 service nova] Creating event network-vif-unplugged:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h1-843861-3 Jul 19 19:46:55.671711 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fa67d46c-6b94-42c3-81d9-5fb2d6673135 req-9451b1bf-3df5-4423-b903-a2fa932bffb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114008 Jul 19 19:46:55.674542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 207/406] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:55.688348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:55.690325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:55.701764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.702572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.703692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.705576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.722757 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6a684a1-ca00-4f93-ab6d-ff5375eabb74 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.463570 Jul 19 19:46:55.744265 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 200/407] 10.222.0.33 () {60 vars in 1205 bytes} [Tue Jul 19 19:46:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:55.749223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:55.750038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:55.767106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.767549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.773098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.773820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.813050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:56.154325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.164507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e2602372-5f1f-4caa-a6db-23dd94b4eba8 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1323 microversion: 2.1 time: 0.487818 Jul 19 19:46:56.164715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.175324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 208/408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:55 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.178314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.180498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.183312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a00cf6e4-acc6-477d-9ea2-1e921f8f16d5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.437940 Jul 19 19:46:56.185927 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 201/409] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:55 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:56.193523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.198922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:56.212763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.213512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.214612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.216186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.495930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.507269 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-25b6159a-32af-49cf-af0b-77bc4f16025a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.315429 Jul 19 19:46:56.509763 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 202/410] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.523013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f80f5617-d7eb-4747-987f-8cbdbbf41cef tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] Calling method '.version_select at 0x7fb88e61e0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.525982 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:56.525982 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:56.549925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f80f5617-d7eb-4747-987f-8cbdbbf41cef tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.038101 Jul 19 19:46:56.550698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 203/411] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:56.564975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.565802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:56.577120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.581010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.582037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.586368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-709409504", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:56.586853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.661654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:56.837629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.847413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-13da416c-a7db-4b08-a7f7-88177c70ec14 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.293061 Jul 19 19:46:56.859064 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 204/412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.869538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-509472fb-a881-45b4-9127-793c3d542f53 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e3af310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:56.872217 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:56.872217 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:46:57.088504 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-509472fb-a881-45b4-9127-793c3d542f53 tempest-QuotaClassesAdminTestJSON-523807949 tempest-QuotaClassesAdminTestJSON-523807949-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.226833 Jul 19 19:46:57.089526 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 205/413] 10.222.0.33 () {60 vars in 1205 bytes} [Tue Jul 19 19:46:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:57.135540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:57.143282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:57.144158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:57.145168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:57.146261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:57.169590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.173510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.174373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.174812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.185440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.186521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:57.194141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.195154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.196168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=22 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:57.196849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.198357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.210158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Getting quotas for project 2ded267358b64e77b1a6a4a2b34be879. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:57.219003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Getting quotas for user 7d5f935eb5a74b60bbbf066bdd6d901f and project 2ded267358b64e77b1a6a4a2b34be879. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:57.243592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:57.246151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:57.310992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f900e8b-8a09-469a-b0ea-95c7fb266b66 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133524 Jul 19 19:46:57.319756 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 209/414] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:57.325386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.336252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:57.348341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.348888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.352020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.355460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.414081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:57.835101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:57.846399 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8bb7e5eb-a83b-4469-8659-e7e174d38b3a tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1472 microversion: 2.1 time: 0.666307 Jul 19 19:46:57.848538 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 206/415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:57.878059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc092769-bd63-4b99-8cbd-a095533ff460 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.879656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc092769-bd63-4b99-8cbd-a095533ff460 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:57.881932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=24,nova_api:INSERT=7 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:57.940379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:57.954602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:57.959037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:57.962332 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-75e90f74-6262-4682-9e2b-f88efcbb7309 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1569 microversion: 2.25 time: 0.641044 Jul 19 19:46:57.967586 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 210/416] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1569 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:57.985743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.990116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.006056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.008773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.012870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.013640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.036716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc092769-bd63-4b99-8cbd-a095533ff460 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.054736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc092769-bd63-4b99-8cbd-a095533ff460 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1221 microversion: 2.1 time: 0.187890 Jul 19 19:46:58.055408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 207/417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:58.087129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.090195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.103371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.103851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.110469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.110932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.513606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.522695 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-450bc3d4-d0aa-47fc-b44b-9fb95edff014 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.549794 Jul 19 19:46:58.523286 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 211/418] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:58.535914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.544877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.589945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.592624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.599776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.600437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.609433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.611610 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84ffc054-b4bf-4f3e-96a5-5e06f48df0ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.543459 Jul 19 19:46:58.612249 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 208/419] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:58.629476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4782bfcf-b5ad-4c60-9cce-1ae2f3faa5fe req-10762698-734b-4406-abd5-bed323cad191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "name": "network-vif-unplugged", "status": "completed", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:58.655176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4782bfcf-b5ad-4c60-9cce-1ae2f3faa5fe req-10762698-734b-4406-abd5-bed323cad191 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.655176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4782bfcf-b5ad-4c60-9cce-1ae2f3faa5fe req-10762698-734b-4406-abd5-bed323cad191 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.697625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4782bfcf-b5ad-4c60-9cce-1ae2f3faa5fe req-10762698-734b-4406-abd5-bed323cad191 service nova] Creating event network-vif-unplugged:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h2-843861-3 Jul 19 19:46:58.710516 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4782bfcf-b5ad-4c60-9cce-1ae2f3faa5fe req-10762698-734b-4406-abd5-bed323cad191 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096219 Jul 19 19:46:58.710931 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 209/420] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:58.823466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Request method failure captured: Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567/diagnostics HTTP/1.1 Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wodOafibnH4e3y7T7bhd3bcGyAxOn5kmIDP0XZIku7U0qd9lprMMHnOeAyLrNcb0PIfOqb3k9Q4gEDvG8lBuHZou-9qT62F5MSQBCLi7JMFosNEBixkHITi5gXHLROQKBDCc8YqqsJpRbkoJdOczrh7GywRRLZhQbhXhfOBBlnh1jk Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b5b4fd6b0ef64c4688cda7eb26ed3c2f Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:46:58.830731 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b5b4fd6b0ef64c4688cda7eb26ed3c2f Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiagnosticsNegativeTest-333402937-project Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 51a6d00491e746af8de8ee94e669b756 Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-333402937-project Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:46:58.832091 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '3807ec75-9b47-4db7-be7c-d15e16b00567'} Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:58.832788 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:46:58.833912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:58.834867 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5caa117-eb47-4487-b2dc-06d14ade4ef6 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.300324 Jul 19 19:46:58.837118 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 212/421] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567/diagnostics => generated 117 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:58.848562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.850412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.864992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.866014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.868605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.871310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.924392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:58.982770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.983417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.992958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.998549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.999652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.000433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.042499 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35ff4741-bd76-4e5b-b225-2e5201baec55 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 204 len: 0 microversion: 2.1 time: 0.196731 Jul 19 19:46:59.043582 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 210/422] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:58 2022] DELETE /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:59.057495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.058820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.074058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.075241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.077237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.078968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.758922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.774685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.776264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.777545 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5125ce8a-5d14-485a-9470-b93e72c211f4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1559 microversion: 2.25 time: 0.798584 Jul 19 19:46:59.778289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 213/423] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1559 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:59.787256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.792227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.808164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.808879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.809955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.811142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.941695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.946541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.951137 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6cdd4efd-a71a-4a2a-8b96-d4d9848b34ef tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1273 microversion: 2.1 time: 0.167492 Jul 19 19:46:59.951727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 214/424] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:59.956908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-159427db-5611-4cfe-9b94-fdeb08729e4c tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1478 microversion: 2.1 time: 0.908834 Jul 19 19:46:59.968572 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 211/425] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1478 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:59.969213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.969742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.977194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.977881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.978815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.979250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.985174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.985802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:00.001528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.001969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.002930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.003507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.442858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.458615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19352d7f-063b-424a-aefc-53033452d8c6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.485546 Jul 19 19:47:00.469222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 212/426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:00.474355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b61396f7-3524-4385-9ff8-cc4f8712454b tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '.version_select at 0x7fb88e33df70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:00.478106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b61396f7-3524-4385-9ff8-cc4f8712454b tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.478734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b61396f7-3524-4385-9ff8-cc4f8712454b tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.498236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b61396f7-3524-4385-9ff8-cc4f8712454b tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1344 microversion: 2.25 time: 0.026965 Jul 19 19:47:00.499375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 213/427] 10.222.0.33 () {60 vars in 1183 bytes} [Tue Jul 19 19:47:00 2022] GET /compute/v2.1/os-migrations => generated 1344 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:00.571948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.590681 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d90cddce-0b71-4360-a51b-d8facb7bd75c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.626455 Jul 19 19:47:00.594204 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 215/428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:00.605316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2c311134-e847-42b4-9cdd-7a890eb0cbb3 req-65800aae-cfa0-4663-a823-a2aae05a2f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e79b1af-47e8-4bf6-95c9-16b1df852140", "name": "network-vif-plugged", "status": "completed", "tag": "49f9a38e-d178-4148-9d5f-582ddd977819"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:00.627559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2c311134-e847-42b4-9cdd-7a890eb0cbb3 req-65800aae-cfa0-4663-a823-a2aae05a2f37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.628181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2c311134-e847-42b4-9cdd-7a890eb0cbb3 req-65800aae-cfa0-4663-a823-a2aae05a2f37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.662625 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2c311134-e847-42b4-9cdd-7a890eb0cbb3 req-65800aae-cfa0-4663-a823-a2aae05a2f37 service nova] Creating event network-vif-plugged:49f9a38e-d178-4148-9d5f-582ddd977819 for instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 on n-h2-843861-3 Jul 19 19:47:00.668912 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2c311134-e847-42b4-9cdd-7a890eb0cbb3 req-65800aae-cfa0-4663-a823-a2aae05a2f37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073150 Jul 19 19:47:00.670277 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 216/429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:00.678392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:00.679487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:00.688877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.689704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.690649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.691260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.959051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-472961294", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:01.037747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:01.067401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:01.084339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b51f7d57-1b4d-41eb-be9f-8ccb387f2626 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 2052 microversion: 2.25 time: 0.412550 Jul 19 19:47:01.085202 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 217/430] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:00 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 2052 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:01.100319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c7e6a0ab-4b63-43cf-8f07-58d466c43ccb req-8c595b7a-2d2b-4494-a860-91775b914ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:01.126363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c7e6a0ab-4b63-43cf-8f07-58d466c43ccb req-8c595b7a-2d2b-4494-a860-91775b914ef0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.127453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c7e6a0ab-4b63-43cf-8f07-58d466c43ccb req-8c595b7a-2d2b-4494-a860-91775b914ef0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.157229 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c7e6a0ab-4b63-43cf-8f07-58d466c43ccb req-8c595b7a-2d2b-4494-a860-91775b914ef0 service nova] Creating event network-changed:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h2-843861-3 Jul 19 19:47:01.169151 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c7e6a0ab-4b63-43cf-8f07-58d466c43ccb req-8c595b7a-2d2b-4494-a860-91775b914ef0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082524 Jul 19 19:47:01.169826 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 218/431] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:01.185965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.187174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:01.203037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.204378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.206492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.208604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.389131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:01.414578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e926a041-3fe1-476f-aa32-a18e527a28a0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1279 microversion: 2.1 time: 0.239244 Jul 19 19:47:01.416086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 219/432] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:01.424308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.425223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:01.437809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.438485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.439830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.440334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.738328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:01.739146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:01.740074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:01.741171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:01.741579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:01.756291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.756733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.757516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.761083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.811914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:01.824973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:01.878183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:01.882868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:01.992508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-793487cf-2edd-4194-a3f5-8a4b9a6d4a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484541 Jul 19 19:47:01.994815 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 214/433] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:02.015221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1797252402", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "be49fee4-8a96-4ded-8c00-6bf222c5131e"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:02.101421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] validate_networks() for [('be49fee4-8a96-4ded-8c00-6bf222c5131e', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:02.183912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6d00491e746af8de8ee94e669b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4fd6b0ef64c4688cda7eb26ed3c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.195701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-329393e4-24de-4f3b-b93c-a23cd1c05db4 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 200 len: 1478 microversion: 2.1 time: 0.778340 Jul 19 19:47:02.207650 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 220/434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 1478 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:02.219178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:02.222566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:02.238657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.241062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.244193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.249937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.122801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:03.131364 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32de91db-4b6e-4348-902c-492b449a0d10 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1319 microversion: 2.1 time: 0.922355 Jul 19 19:47:03.141646 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 221/435] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:02 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1319 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:03.147272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.147975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:03.150969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:03.156162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.156598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.157377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.157805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.847151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:03.861914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab0a126d-09b6-483e-b033-557f8b4ff4e8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.718678 Jul 19 19:47:03.862619 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 222/436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:03.867497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.875700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:03.886561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.902150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.903347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.904430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.093655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:04.101423 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ccd2b406-8dfc-4a77-a6c0-2448d09a4dbf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1274 microversion: 2.1 time: 0.237653 Jul 19 19:47:04.102001 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 223/437] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:04.106826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.107586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.116031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.116297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.117415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.117852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.300101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:04.308313 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72883b4a-fbb0-4ddb-bf99-62d97a13244c tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1279 microversion: 2.1 time: 0.205038 Jul 19 19:47:04.309170 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 224/438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:04.315250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.315889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] [instance: 3807ec75-9b47-4db7-be7c-d15e16b00567] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.322550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.323002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.323849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.324262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.337942 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] HTTP exception thrown: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Request method failure captured: Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 HTTP/1.1 Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wodOafibnH4e3y7T7bhd3bcGyAxOn5kmIDP0XZIku7U0qd9lprMMHnOeAyLrNcb0PIfOqb3k9Q4gEDvG8lBuHZou-9qT62F5MSQBCLi7JMFosNEBixkHITi5gXHLROQKBDCc8YqqsJpRbkoJdOczrh7GywRRLZhQbhXhfOBBlnh1jk Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b5b4fd6b0ef64c4688cda7eb26ed3c2f Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:47:04.339550 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5b4fd6b0ef64c4688cda7eb26ed3c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b5b4fd6b0ef64c4688cda7eb26ed3c2f Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-333402937 Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiagnosticsNegativeTest-333402937-project Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 51a6d00491e746af8de8ee94e669b756 Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-333402937-project Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. Jul 19 19:47:04.341015 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3807ec75-9b47-4db7-be7c-d15e16b00567'} Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:04.344785 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. Jul 19 19:47:04.346031 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:04.347245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] Returning 404 to user: Instance 3807ec75-9b47-4db7-be7c-d15e16b00567 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:04.347245 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63a12f91-1a60-4f2f-9318-8f6fa225b674 tempest-ServerDiagnosticsNegativeTest-333402937 tempest-ServerDiagnosticsNegativeTest-333402937-project] 10.222.0.33 "GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jul 19 19:47:04.347245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 225/439] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/3807ec75-9b47-4db7-be7c-d15e16b00567 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:04.347245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ccd7e5ff-b1ed-4bf5-980b-e09baf1d820b req-d2742a1c-0f13-4f10-89d6-5794609f8b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3807ec75-9b47-4db7-be7c-d15e16b00567", "name": "network-vif-deleted", "tag": "618b8bc2-daf2-4293-b9fa-f7731f0c7680"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:04.355583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ccd7e5ff-b1ed-4bf5-980b-e09baf1d820b req-d2742a1c-0f13-4f10-89d6-5794609f8b99 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.356258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ccd7e5ff-b1ed-4bf5-980b-e09baf1d820b req-d2742a1c-0f13-4f10-89d6-5794609f8b99 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.369803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ccd7e5ff-b1ed-4bf5-980b-e09baf1d820b req-d2742a1c-0f13-4f10-89d6-5794609f8b99 service nova] Creating event network-vif-deleted:618b8bc2-daf2-4293-b9fa-f7731f0c7680 for instance 3807ec75-9b47-4db7-be7c-d15e16b00567 on n-h1-843861-3 Jul 19 19:47:04.374900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ccd7e5ff-b1ed-4bf5-980b-e09baf1d820b req-d2742a1c-0f13-4f10-89d6-5794609f8b99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Jul 19 19:47:04.375652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 226/440] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:04.381790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.382488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.389175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.389624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.390535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.390970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.436137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:04.436642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:04.437101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:04.437500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:04.437913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:04.447945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.448632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.449532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.450188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.469772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:04.475201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for user 937de5092f1d4e10b36c151ebf1db333 and project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:04.489798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:04.492757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:04.553424 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ff1929b-3b12-4559-b0ca-c1e303dcacdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.557425 Jul 19 19:47:04.554407 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 215/441] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:47:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:47:04.567334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.567976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.104092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.115193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.122334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.123747 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f02c82e3-8161-4599-bb78-c9f95903d7ab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1262 microversion: 2.25 time: 0.561963 Jul 19 19:47:05.126376 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 216/442] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1262 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:05.140497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.141372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.153433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.161238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.162836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.163427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.422643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.439762 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e600627d-e592-420b-9ed9-1c48eb68bb43 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1469 microversion: 2.1 time: 1.062534 Jul 19 19:47:05.455226 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 227/443] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1469 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:05.467032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.471503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.489320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.490093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.492111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.492868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.042038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:06.071363 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a2b178d8-0751-4861-a565-fede053e214c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.939584 Jul 19 19:47:06.074026 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 217/444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:05 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:06.104129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.106204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.117605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:06.128778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.130949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.131767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.132255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.132430 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb11afa4-0563-4cc9-a772-65b2b2e62edd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.675079 Jul 19 19:47:06.132963 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 228/445] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:05 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:06.640344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.641052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.657817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.661389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.667481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.668603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.716021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:06.749137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:06.901003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:06.910438 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b744cd8-a7ce-4f97-a488-e50bb2fa4a3b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.819892 Jul 19 19:47:06.929497 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 218/446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:06.936996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.937619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.955016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.955475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.964111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.964565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.967094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a85d400f-2ce5-45b1-b16e-6d6d4e124305 tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 204 len: 0 microversion: 2.1 time: 0.831871 Jul 19 19:47:06.969679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 229/447] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:06 2022] DELETE /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:06.983133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.985064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.995504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.995937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.998324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.998812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.181503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.194968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.200780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:07.206249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.208133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e5db26e-7207-4d11-aa48-dbd31aa92216 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1320 microversion: 2.25 time: 0.276500 Jul 19 19:47:07.232251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=48 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:07.239226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 219/448] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:07.245541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:07.246278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:07.253087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.253974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.254942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.255624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.669974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.705161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3a0200b-885f-414e-84a3-813ae0369912 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1475 microversion: 2.1 time: 0.730576 Jul 19 19:47:07.709990 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 230/449] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1475 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:07.727574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:07.732051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:07.744858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.746322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.747573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.748207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.978723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.991626 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c72a598f-f05b-48d2-949c-447f52d9c847 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.750378 Jul 19 19:47:07.992875 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 220/450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:07 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.012103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-22ef8371-1f28-4857-a0b2-c50a1459a8b9 req-8463470a-f52f-4dea-9a27-5ab0f6f27a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "name": "network-vif-unplugged", "status": "completed", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:08.026597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-22ef8371-1f28-4857-a0b2-c50a1459a8b9 req-8463470a-f52f-4dea-9a27-5ab0f6f27a4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.027426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-22ef8371-1f28-4857-a0b2-c50a1459a8b9 req-8463470a-f52f-4dea-9a27-5ab0f6f27a4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.048831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-22ef8371-1f28-4857-a0b2-c50a1459a8b9 req-8463470a-f52f-4dea-9a27-5ab0f6f27a4d service nova] Creating event network-vif-unplugged:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h2-843861-3 Jul 19 19:47:08.054751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-22ef8371-1f28-4857-a0b2-c50a1459a8b9 req-8463470a-f52f-4dea-9a27-5ab0f6f27a4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060312 Jul 19 19:47:08.055640 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 221/451] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:08.065026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.070347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:08.082631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.082631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.083228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.083650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.912825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.923665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5723a5f2-0f50-4e54-bfe5-0b2c8f2b1688 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.864763 Jul 19 19:47:08.926260 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 222/452] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.936931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.939789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.942992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:08.948068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4758401f-a8ac-415c-932c-4355be8ef3ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 1.232545 Jul 19 19:47:08.955374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.956439 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 231/453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:07 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.957289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.961776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.962865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.969134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.977399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:09.017623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.025922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.028422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.031182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.719470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:09.723185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:09.732371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:09.734476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:09.735861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6832ac25-c77c-4c8e-bda4-0a0942e821bf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.808346 Jul 19 19:47:09.750488 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 223/454] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:09.757136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:09.758055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:09.776755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.778193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.781083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.782179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.998320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:10.012041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-86d2cd9b-c048-42b1-91a4-da26d622da7c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1475 microversion: 2.1 time: 1.052791 Jul 19 19:47:10.013696 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 232/455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1475 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:10.028763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fca6098b-9421-4f03-8413-d2f32e0dc5c4 req-021f4765-1da7-4838-a890-00a1e63e202d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0", "tag": "89a962ec-3c9e-415f-9539-83f6c18d57e6"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:10.058193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fca6098b-9421-4f03-8413-d2f32e0dc5c4 req-021f4765-1da7-4838-a890-00a1e63e202d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.060722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fca6098b-9421-4f03-8413-d2f32e0dc5c4 req-021f4765-1da7-4838-a890-00a1e63e202d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.092745 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fca6098b-9421-4f03-8413-d2f32e0dc5c4 req-021f4765-1da7-4838-a890-00a1e63e202d service nova] Creating event network-changed:89a962ec-3c9e-415f-9539-83f6c18d57e6 for instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 on n-h1-843861-3 Jul 19 19:47:10.100989 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fca6098b-9421-4f03-8413-d2f32e0dc5c4 req-021f4765-1da7-4838-a890-00a1e63e202d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085576 Jul 19 19:47:10.103367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 233/456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:10.113555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.115747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:10.124588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.126175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.129423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.130351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.534630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:10.545927 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca1b6540-efa4-475e-90e3-73f953c4dcb7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 0.793432 Jul 19 19:47:10.546519 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 224/457] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:09 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:10.561510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.562523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:10.571222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.572108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.573149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.573813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.752680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:10.762691 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58ca31db-cd2c-437b-95bd-124eaa299f08 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.657864 Jul 19 19:47:10.763642 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 234/458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:10.778345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-32a0d832-8781-46db-aa96-ae165b271b9a req-fcf0472a-a119-446d-b352-e9c1661b54c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d5a511-d1d6-40e2-a3c4-055c7c6a192c", "tag": "c7003400-b0ae-4535-ab0f-94b03d89dc9a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:10.787567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32a0d832-8781-46db-aa96-ae165b271b9a req-fcf0472a-a119-446d-b352-e9c1661b54c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.788045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32a0d832-8781-46db-aa96-ae165b271b9a req-fcf0472a-a119-446d-b352-e9c1661b54c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.804468 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-32a0d832-8781-46db-aa96-ae165b271b9a req-fcf0472a-a119-446d-b352-e9c1661b54c0 service nova] Creating event network-changed:c7003400-b0ae-4535-ab0f-94b03d89dc9a for instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c on n-h1-843861-3 Jul 19 19:47:10.809260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-32a0d832-8781-46db-aa96-ae165b271b9a req-fcf0472a-a119-446d-b352-e9c1661b54c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034959 Jul 19 19:47:10.810127 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 235/459] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:10.815255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.816109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:10.823855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.824309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.825165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.825623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.350465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:11.392938 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de4e9e4d-f2e1-4cdd-817a-5d06fc1bb41b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.842823 Jul 19 19:47:11.399292 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 225/460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:11.431042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:11.433450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:11.452847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.453899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.459794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.460738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.566518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.567145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.567999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid 8e79b1af-47e8-4bf6-95c9-16b1df852140 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:11.650972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:11.673676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:11.679787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:11.682126 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d7224585-6f60-499a-8a4f-e5f098937389 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.870918 Jul 19 19:47:11.685668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 236/461] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:11.704589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:11.705660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:11.719969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.722423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.723445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.726614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.772646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:11.788721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7265bf12-3807-4f5c-8391-87347cacce20 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 200 len: 1309 microversion: 2.1 time: 0.387049 Jul 19 19:47:11.791447 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 226/462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:11 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:11.806211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:11.812465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:11.839687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.840886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.845835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.852595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.673211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:12.688151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:12.688856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36b1f443-5718-4db5-8503-e04e61d1df96 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.895747 Jul 19 19:47:12.690730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 227/463] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:11 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:12.704003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fe7e9e66-93d2-4dcd-ad72-1de671093f17 req-877087ad-70c3-43ec-bc48-5ddec151706e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e79b1af-47e8-4bf6-95c9-16b1df852140", "name": "network-vif-deleted", "tag": "49f9a38e-d178-4148-9d5f-582ddd977819"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:12.714496 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecdf42c1-8f47-4963-8e69-fa1ef85e9962 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1503 microversion: 2.1 time: 1.025902 Jul 19 19:47:12.723074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fe7e9e66-93d2-4dcd-ad72-1de671093f17 req-877087ad-70c3-43ec-bc48-5ddec151706e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.724412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fe7e9e66-93d2-4dcd-ad72-1de671093f17 req-877087ad-70c3-43ec-bc48-5ddec151706e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.725415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 237/464] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:11 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1503 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:12.733267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:12.734163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:12.742598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.743335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.744324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.744945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.753961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fe7e9e66-93d2-4dcd-ad72-1de671093f17 req-877087ad-70c3-43ec-bc48-5ddec151706e service nova] Creating event network-vif-deleted:49f9a38e-d178-4148-9d5f-582ddd977819 for instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 on n-h2-843861-3 Jul 19 19:47:12.763072 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fe7e9e66-93d2-4dcd-ad72-1de671093f17 req-877087ad-70c3-43ec-bc48-5ddec151706e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070873 Jul 19 19:47:12.765663 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 228/465] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:12.782846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:12.784023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:12.799169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.799627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.812901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.813283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.232444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:13.243229 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eddb0049-3e62-4660-861b-574e9b4fa987 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.515635 Jul 19 19:47:13.244771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 238/466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:12 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:13.251837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:13.258122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:13.271089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.271582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.272431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.292782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.327793 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 HTTP/1.1 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:47:13.329995 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:13.331689 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8e79b1af-47e8-4bf6-95c9-16b1df852140'} Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:13.332491 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:13.333933 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:47:13.336077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:13.337146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7921e96-a8f7-45e9-8bfd-68b7e870daa1 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 404 len: 111 microversion: 2.1 time: 0.091238 Jul 19 19:47:13.338180 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 239/467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:13 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:13.368985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:13.380591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:13.386979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:13.388594 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbada255-3217-4c6f-bcd2-b69662cdfa6b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.620870 Jul 19 19:47:13.388765 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 229/468] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:12 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:13.627182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-760013976", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:13.710178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:13.710808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:13.717757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.718210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.719013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.719434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.828574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:14.459207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:15.082199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:15.082969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:15.083072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:15.083451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:15.084472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:15.106409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.109420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=28,nova_cell0:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:15.110524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.113828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.116178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.182443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Getting quotas for project dd8ad00c8dcf46549255411fd05f6c72. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:15.198793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Getting quotas for user 4232e411040b43129bec0aba0ef763ed and project dd8ad00c8dcf46549255411fd05f6c72. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:15.215952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:15.225779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be57e469-2d3e-4341-9ed8-61b7b404e47d tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 1.520136 Jul 19 19:47:15.231560 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 230/469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:13 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:15.232981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:15.235394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:15.239977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:15.252754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:15.261127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.265789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.266632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.267073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.304443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-faeced5d-31fe-4a29-8867-e746b9cd7b7e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681567 Jul 19 19:47:15.310875 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 240/470] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:15.316311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:15.318716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:15.332586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.340317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.341439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.342239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.182304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.186421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.201495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6673548c-74c3-4098-8722-6ceb19f84cdb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.889033 Jul 19 19:47:16.201741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e03d3aeb-3d59-463f-b20a-360a3f1a5038 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1493 microversion: 2.1 time: 0.965491 Jul 19 19:47:16.215829 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 231/472] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:15 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1493 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:16.216066 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 241/472] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:15 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:16.216172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.216270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-29766bcd-16a6-4dcd-a039-3f7e2d9f9326 req-2f40a91e-9029-4719-9a5f-c6d3c47b68df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:16.216377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:16.218091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.222703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.223747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.224208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.247439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-29766bcd-16a6-4dcd-a039-3f7e2d9f9326 req-2f40a91e-9029-4719-9a5f-c6d3c47b68df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.248183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-29766bcd-16a6-4dcd-a039-3f7e2d9f9326 req-2f40a91e-9029-4719-9a5f-c6d3c47b68df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.277416 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-29766bcd-16a6-4dcd-a039-3f7e2d9f9326 req-2f40a91e-9029-4719-9a5f-c6d3c47b68df service nova] Creating event network-changed:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h2-843861-3 Jul 19 19:47:16.287698 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-29766bcd-16a6-4dcd-a039-3f7e2d9f9326 req-2f40a91e-9029-4719-9a5f-c6d3c47b68df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080710 Jul 19 19:47:16.289567 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 242/473] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:16.298309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.299174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:16.307480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.308858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.313268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.313987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.465432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.500204 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a3e2176-5988-40a2-bdd8-86f8da9867f5 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1223 microversion: 2.1 time: 0.209518 Jul 19 19:47:16.502668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 243/474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1223 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:16.511591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8fb5635b-bfb6-43c0-8cd8-02ab783340ab tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '.version_select at 0x7fb88e3da790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.516913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8fb5635b-bfb6-43c0-8cd8-02ab783340ab tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.519417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8fb5635b-bfb6-43c0-8cd8-02ab783340ab tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.552907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.563119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.567798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:16.570527 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9d69258f-2bd6-47d3-865d-c75b38be242c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.367101 Jul 19 19:47:16.571162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 232/475] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:16.582960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.585097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:16.601797 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8fb5635b-bfb6-43c0-8cd8-02ab783340ab tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.097787 Jul 19 19:47:16.602760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 244/476] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:16.609432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.609432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.609432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.609432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.618848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.619903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:16.629382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.630217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.633515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.634498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.110132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5599b2d6-4a5a-482d-bbac-71ccb5d9423d tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1644 microversion: 2.1 time: 0.494886 Jul 19 19:47:17.112960 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 245/477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1644 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.141306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:17.162960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34684ca6-762c-4dfc-bd40-c6bf8d1c3812 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.589697 Jul 19 19:47:17.178050 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 233/478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.231356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:17.232160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:17.248367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.248849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.249658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.253486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.424506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-229606504", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "58406271-8733-4495-9c0c-acccb6026722"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:17.514708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] validate_networks() for [('58406271-8733-4495-9c0c-acccb6026722', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:17.876277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:17.893102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79168b4e-f69b-4534-a2ba-b76fae0009ae tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.659391 Jul 19 19:47:17.899361 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 246/479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:17 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.904179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:17.904798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:17.924785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.925906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.927105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.927935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.321607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:18.334776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c55a58a-d0fa-41a6-97f7-91903ed8f220 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1271 microversion: 2.1 time: 0.434191 Jul 19 19:47:18.341038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 247/480] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:17 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1271 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:18.356379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:18.357019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:18.373673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.376811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.378707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.380036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.423260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:18.763973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:18.773964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:18.775777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:18.777219 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d60728e6-d328-444e-98bc-589fdf998400 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.430964 Jul 19 19:47:18.790116 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 248/481] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:18 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:18.795242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:18.796193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:18.802713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.803489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.804545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.805205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.820374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:18.821404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:18.822005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:18.822576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:18.823233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:18.839507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.840224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.843426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:18.844048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:18.878782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:18.885728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for user 99eac0488e77448cb55a255d49ad2c58 and project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:18.890971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:18.903489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:18.906214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:18.970005 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a15f067-353d-437e-aa8d-227c50f374bc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549817 Jul 19 19:47:18.985476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 234/482] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:19.000295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.008130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.029928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.030883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.032233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.037321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.219295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.239063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61bd00b2-9501-40af-8624-968ea1429c87 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.439996 Jul 19 19:47:19.243546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 249/483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:18 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.254384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19b30d66-be37-4d93-9740-cc295a13ed10 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.260907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19b30d66-be37-4d93-9740-cc295a13ed10 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.402871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19b30d66-be37-4d93-9740-cc295a13ed10 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.423925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19b30d66-be37-4d93-9740-cc295a13ed10 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1210 microversion: 2.1 time: 0.178559 Jul 19 19:47:19.437015 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 250/484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:19 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1210 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.453589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.457919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.462277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.474433 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b043b1fa-76a3-4e4f-b429-d55e61d8ca3e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 0.487389 Jul 19 19:47:19.474860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.477933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.479147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.480121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.493401 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 235/485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:18 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.532293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-05084b07-2d76-4504-9d2a-27bbdd3ebcc9 req-85069991-65c9-4608-a85b-7ac4d49cd46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0", "name": "network-vif-plugged", "status": "completed", "tag": "89a962ec-3c9e-415f-9539-83f6c18d57e6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:19.556849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-05084b07-2d76-4504-9d2a-27bbdd3ebcc9 req-85069991-65c9-4608-a85b-7ac4d49cd46e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.559058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-05084b07-2d76-4504-9d2a-27bbdd3ebcc9 req-85069991-65c9-4608-a85b-7ac4d49cd46e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.587194 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-05084b07-2d76-4504-9d2a-27bbdd3ebcc9 req-85069991-65c9-4608-a85b-7ac4d49cd46e service nova] Creating event network-vif-plugged:89a962ec-3c9e-415f-9539-83f6c18d57e6 for instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 on n-h1-843861-3 Jul 19 19:47:19.598005 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-05084b07-2d76-4504-9d2a-27bbdd3ebcc9 req-85069991-65c9-4608-a85b-7ac4d49cd46e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069304 Jul 19 19:47:19.601890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 236/486] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:19.623279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.633725 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-277fcd99-c771-4a1f-ae23-7f1b4be1160e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1277 microversion: 2.1 time: 0.187415 Jul 19 19:47:19.639909 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 251/487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:19 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.798537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.799616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.811172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.814915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.819088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.820185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.195132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.203791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.207082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.209175 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d531bd92-a111-4d13-a2aa-d765816cb9e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.414935 Jul 19 19:47:20.210373 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 237/488] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:19 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:20.251349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.252241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.260026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.261038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.262038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.262687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.448540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.449926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.467786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.471568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.475645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.476840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.503167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.516399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-329a1d6e-38fb-4deb-a086-3146b414be7e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.270465 Jul 19 19:47:20.518597 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 252/489] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:20.533173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.534021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.549058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.550076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.554055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.557376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.722021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.739001 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f99c2725-2a18-4305-8fd5-70c8fbc2495f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1262 microversion: 2.1 time: 0.296861 Jul 19 19:47:20.742322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 238/490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1262 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:20.757859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.759051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.793644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.794386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.800348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.803769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.064288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:21.081992 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-02e9634b-2347-472e-a533-f612b76ab713 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1277 microversion: 2.1 time: 0.336935 Jul 19 19:47:21.082950 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 239/491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1277 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:21.228156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:21.228811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:21.244739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.245288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.246472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.249187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.585620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:21.605660 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d335bcc4-ad3b-4ff5-9c3c-859365527e94 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1316 microversion: 2.1 time: 1.082920 Jul 19 19:47:21.609081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 253/492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:21.626454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:21.627096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:21.649571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.650035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.650830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.651272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.086221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.097477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.103668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.106615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4896c6e-b5bc-400e-974d-f2fd27a42fcd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.881467 Jul 19 19:47:22.117415 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 240/493] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:21 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:47:22.123024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.123971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:22.130712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.131444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.132464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.136501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.255994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.265436 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c58d39c-a9f0-47ef-bae2-2906d044646c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1268 microversion: 2.1 time: 0.146539 Jul 19 19:47:22.281663 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 241/494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:22.288818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.290676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:22.305538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.306297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.307330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.308317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.317296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:22.335346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.345021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be087418-3de0-4d08-9139-a32d3eba38a6 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.731890 Jul 19 19:47:22.348545 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 254/495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:21 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:22.363558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9125328d-7966-4500-bcfe-101a7d7d3a96 req-afca7f82-f0ad-47ae-864b-6a7940d85a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d5a511-d1d6-40e2-a3c4-055c7c6a192c", "name": "network-vif-plugged", "status": "completed", "tag": "c7003400-b0ae-4535-ab0f-94b03d89dc9a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:22.378112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9125328d-7966-4500-bcfe-101a7d7d3a96 req-afca7f82-f0ad-47ae-864b-6a7940d85a6d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.378917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9125328d-7966-4500-bcfe-101a7d7d3a96 req-afca7f82-f0ad-47ae-864b-6a7940d85a6d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.406115 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9125328d-7966-4500-bcfe-101a7d7d3a96 req-afca7f82-f0ad-47ae-864b-6a7940d85a6d service nova] Creating event network-vif-plugged:c7003400-b0ae-4535-ab0f-94b03d89dc9a for instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c on n-h1-843861-3 Jul 19 19:47:22.427693 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9125328d-7966-4500-bcfe-101a7d7d3a96 req-afca7f82-f0ad-47ae-864b-6a7940d85a6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067852 Jul 19 19:47:22.430145 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 255/496] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:22.627636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.638201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:22.659922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.660543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.662110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.663258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.094330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.107578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-679a8a4e-4850-4c3f-baf3-df99eee6c85b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.822159 Jul 19 19:47:23.112968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 242/497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.126449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:23.127379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:23.141076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.142895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.144031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.148218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.491439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.502816 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f6fbc8c-64ae-4907-96ae-6f79ac7caec2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1466 microversion: 2.1 time: 0.880959 Jul 19 19:47:23.508763 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 256/498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1466 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.514320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:23.519377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:23.534189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.536123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.538102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.539025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.669927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.695476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.699174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.702887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eb26a5f7-a46d-4c8e-ae3b-fb5953889679 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.579262 Jul 19 19:47:23.704322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 243/499] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:47:23.711878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:23.713055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:23.722059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.742333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90f1be81-ce41-4076-a2c8-83a884732d7d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1268 microversion: 2.1 time: 0.221153 Jul 19 19:47:23.745620 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 257/500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.751420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.753332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.756077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.758825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.299829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:24.309119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36e4e48e-0f56-43ee-9987-878c3b5053d9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1321 microversion: 2.1 time: 0.603131 Jul 19 19:47:24.311925 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 244/501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:24.325480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:24.326548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:24.342305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.345285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.346467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.347118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.355178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:24.355869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:24.373424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.374023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.376872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.377437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:25.168538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:25.457135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:25.473079 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96d76fea-9d99-4327-8985-3bce0bc13d84 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 1.157822 Jul 19 19:47:25.474225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 245/502] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:24 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:25.488006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:25.488735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:25.501549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:25.502177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:25.506638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:25.507881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.385102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:26.404512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:26.410346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:26.412545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04c5949f-251a-4e88-8113-1b7dd9b2170f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.935963 Jul 19 19:47:26.413719 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd31311d-eedf-4675-a986-b08893e4dad6 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1617 microversion: 2.1 time: 2.666306 Jul 19 19:47:26.415719 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 258/503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1617 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:26.417827 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 246/504] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:25 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:26.422056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:26.423079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:26.426577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:26.427463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:26.432620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.435788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.436875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.438237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.440621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.441077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.441861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.450991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.071173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:27.092458 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa26f1da-70bf-46a4-8b90-91fd033e7f25 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1471 microversion: 2.1 time: 0.673429 Jul 19 19:47:27.094127 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 247/505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:26 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1471 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:27.103226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-de516bc3-de94-4309-9bbe-7d5a9b063d06 req-84e3488e-b12c-4c83-bb0b-17e8ddc016b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794", "tag": "2fd92420-7969-4849-a0de-b373673602b8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:27.136216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-de516bc3-de94-4309-9bbe-7d5a9b063d06 req-84e3488e-b12c-4c83-bb0b-17e8ddc016b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.136673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-de516bc3-de94-4309-9bbe-7d5a9b063d06 req-84e3488e-b12c-4c83-bb0b-17e8ddc016b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.162026 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-de516bc3-de94-4309-9bbe-7d5a9b063d06 req-84e3488e-b12c-4c83-bb0b-17e8ddc016b6 service nova] Creating event network-changed:2fd92420-7969-4849-a0de-b373673602b8 for instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 on n-h2-843861-3 Jul 19 19:47:27.177109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:27.185742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-de516bc3-de94-4309-9bbe-7d5a9b063d06 req-84e3488e-b12c-4c83-bb0b-17e8ddc016b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075965 Jul 19 19:47:27.186440 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 248/506] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:27.189231 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c01a3059-1b95-448a-8328-04de39826b2c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 0.771122 Jul 19 19:47:27.189833 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 259/507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:26 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:27.203691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:27.204354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:27.211270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: .version_select at 0x7fb88e33db80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1454653054", "policies": ["affinity"]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:27.240940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.247227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.250243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.256590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.285153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:27.314917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:27.466804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:27.482921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:27.517965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-607bdb8d-e942-4a9a-b153-313b80605a81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.330224 Jul 19 19:47:27.519454 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 249/508] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Jul 19 19:47:27 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:27.815275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:27.828359 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd556a5d-b21d-41de-8639-7b6fa7ebce7b tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.635872 Jul 19 19:47:27.830878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 260/509] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:27 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:27.844651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:27.846272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:27.863211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.863680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.865227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.865227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.894020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:27.894712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] [instance: 90d471f9-53fe-4b13-a988-7a4c77c131ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:27.908397 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] HTTP exception thrown: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Request method failure captured: Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/90d471f9-53fe-4b13-a988-7a4c77c131ea/action HTTP/1.1 Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 15 Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wovlRiTNC34FMYlKnw-uFQig1MhpsRTiBXcT_nFXoCNcvtlgYmxL4PANQKyCp7NIlLKrX11vITT0GVk-vr78xQT1FsJNg41eGD8ooVlcwtNnT9dAC8YH6HGmfvxRyLZAiWDu7VGj-dOMabfPeYYSmfY6l-18NXQfE0mZZBpn3nwrKg Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:47:27.910313 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/94ebea962216481c812e8605e9e5043c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8f45f8b3ddbb4ceeb9fd0a820abadb96 Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: {"migrate": {}} Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:47:27.911634 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '90d471f9-53fe-4b13-a988-7a4c77c131ea', 'body': {'migrate': {}}} Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:27.912632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. Jul 19 19:47:27.913837 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:27.914849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Returning 404 to user: Instance 90d471f9-53fe-4b13-a988-7a4c77c131ea could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:27.914849 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-641a7172-91f1-4304-9ca4-182d7131218e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/90d471f9-53fe-4b13-a988-7a4c77c131ea/action" status: 404 len: 111 microversion: 2.1 time: 0.380511 Jul 19 19:47:27.926757 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 250/510] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:27 2022] POST /compute/v2.1/servers/90d471f9-53fe-4b13-a988-7a4c77c131ea/action => generated 111 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:27.932012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1312943914", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "68bf49ec-613e-4e88-a36d-874fd7e73dbd"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:28.016904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:28.864522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:28.969068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:28.981992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:28.994348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:28.996341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23191eab-4b9f-42cb-aa52-f1d6cada3c59 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 1.162277 Jul 19 19:47:29.001600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 261/511] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:27 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:29.009238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-763321377", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:29.030813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:29.093508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:29.111125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:29.111656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:29.112292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:29.112838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:29.113348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:29.165749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.167168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.169081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.169758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.199420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:29.206153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:29.243125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 2 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:29.246901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:29.330483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126007) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 19:47:29.360431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:29.373112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:29.410589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:29.452221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:29.468992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:29.479463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:29.500626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=54c7731d-87f2-4128-ad1e-c010c4a4b481,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:29.567152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:29.574518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:29.650843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:29.659853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:29.702321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15ab6707-fefa-4ea7-8c84-0f975f6411fb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.774018 Jul 19 19:47:29.703614 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 251/512] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 1776 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:47:29.709736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:29.710594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:29.731258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.732644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.733782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.734438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:30.991015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:31.003435 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2087f40-2d69-4e46-a232-bb225c9637e9 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 1.298242 Jul 19 19:47:31.007876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 252/513] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:29 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:31.018938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-539d31ab-29f2-4f74-a6a5-cc373d7cd9c9 req-5f05554e-e206-41ba-9ae0-732d60455a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "name": "network-vif-plugged", "status": "completed", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:31.048631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-539d31ab-29f2-4f74-a6a5-cc373d7cd9c9 req-5f05554e-e206-41ba-9ae0-732d60455a2b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.049185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-539d31ab-29f2-4f74-a6a5-cc373d7cd9c9 req-5f05554e-e206-41ba-9ae0-732d60455a2b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.062321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-539d31ab-29f2-4f74-a6a5-cc373d7cd9c9 req-5f05554e-e206-41ba-9ae0-732d60455a2b service nova] Creating event network-vif-plugged:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h2-843861-3 Jul 19 19:47:31.069213 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-539d31ab-29f2-4f74-a6a5-cc373d7cd9c9 req-5f05554e-e206-41ba-9ae0-732d60455a2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062015 Jul 19 19:47:31.070277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 253/514] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:31.196392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-617243454", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f8081125-1f0f-4d89-8040-cb2f528626b5"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:31.197350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:31.198260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:31.200341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:31.201303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:31.202467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:31.263748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.272742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.273914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.274376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.343595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Getting quotas for project 2ded267358b64e77b1a6a4a2b34be879. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:31.371350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Getting quotas for user 7d5f935eb5a74b60bbbf066bdd6d901f and project 2ded267358b64e77b1a6a4a2b34be879. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:31.374295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] validate_networks() for [('f8081125-1f0f-4d89-8040-cb2f528626b5', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:31.445682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:31.450675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:31.551936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b65a3f7-e552-46f8-b676-8572d0310dcf tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.547227 Jul 19 19:47:31.554256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 262/515] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:31.565945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:31.566834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:31.577054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.577821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.578795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.580340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.122147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.144937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e13d9c5-9a76-45ac-9839-82073ae1ec7f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.589336 Jul 19 19:47:32.145553 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 263/516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:31 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:32.169077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6d7d8901-1b02-4a30-ae8c-5ff7b6788b44 req-f57eb766-3e97-4a9a-9deb-8d0514051532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:32.197033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6d7d8901-1b02-4a30-ae8c-5ff7b6788b44 req-f57eb766-3e97-4a9a-9deb-8d0514051532 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.204896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6d7d8901-1b02-4a30-ae8c-5ff7b6788b44 req-f57eb766-3e97-4a9a-9deb-8d0514051532 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.236471 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6d7d8901-1b02-4a30-ae8c-5ff7b6788b44 req-f57eb766-3e97-4a9a-9deb-8d0514051532 service nova] Creating event network-changed:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h1-843861-3 Jul 19 19:47:32.242642 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6d7d8901-1b02-4a30-ae8c-5ff7b6788b44 req-f57eb766-3e97-4a9a-9deb-8d0514051532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087405 Jul 19 19:47:32.243818 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 264/517] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:32.250817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.256336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.258472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Searching by: {'deleted': False, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:32.267396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.268247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.269390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.270044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.421603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:32.491927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:32.492514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:32.493602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:32.494021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:32.495054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:32.510021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.510465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.513379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.513954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.534621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Getting quotas for project 1daba1b3ce8e4e55aba8c2d684ca6601. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:32.541774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Getting quotas for user 93ce351fde36493eb6ffce973ee2e3c1 and project 1daba1b3ce8e4e55aba8c2d684ca6601. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:32.541987 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3b5cbab-c75f-4048-a142-ce68fb0b5b7c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.296038 Jul 19 19:47:32.543028 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 265/518] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers => generated 1003 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:32.548046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.548935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:32.556025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.556806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.557827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.558542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.569493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:32.573023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:32.650863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43a2dd42-8bb9-483e-9597-8b9c406c0162 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579342 Jul 19 19:47:32.659280 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 254/519] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:32.753872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.768150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.770456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.773028 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d8d533b-ebc2-4b30-9ea1-03f43c3f18ac tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1362 microversion: 2.25 time: 0.228652 Jul 19 19:47:32.784973 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 266/520] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:32.791603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.792267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:32.799210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.799975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.801003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.801786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.884374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:32.886679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:32.896547 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-429cc3c5-d4a4-4d91-8109-5225646a2da9 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1225 microversion: 2.1 time: 0.109396 Jul 19 19:47:32.898324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d4529037-51e4-478e-9059-2aacd550cce5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.906721 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 267/521] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:32.912889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.913500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:32.914252 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d4529037-51e4-478e-9059-2aacd550cce5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.250070 Jul 19 19:47:32.915466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 255/522] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:32.927090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.929953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.931027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:32.932495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.933316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.933754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.940116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.940765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.941742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.942282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.047190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:33.056094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0bc955c-1864-4075-a585-cba337239ff5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1271 microversion: 2.1 time: 0.131180 Jul 19 19:47:33.060956 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 256/523] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:33.067744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d8aa50c-4811-4bd6-bd61-908ec4fbaade tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.069273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d8aa50c-4811-4bd6-bd61-908ec4fbaade tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:33.194158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d8aa50c-4811-4bd6-bd61-908ec4fbaade tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:33.207263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d8aa50c-4811-4bd6-bd61-908ec4fbaade tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1223 microversion: 2.1 time: 0.143414 Jul 19 19:47:33.211115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 257/524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:33.219539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:33.232023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e391cc2-6b48-4db5-8b3d-7b32c1cf3d4b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 0.324088 Jul 19 19:47:33.251998 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 268/525] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:33.300562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.302894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:33.329042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.332251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.335781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.340097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.395975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd37dc03-27c4-47ca-9109-8f0682e016b0 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-222906704", "id": 2119075084, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:33.398782 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:47:33.398782 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:47:33.434037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd37dc03-27c4-47ca-9109-8f0682e016b0 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.220502 Jul 19 19:47:33.437685 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 258/526] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:33 2022] POST /compute/v2.1/flavors => generated 424 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:33.452737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ac98483-41a0-4fe8-ad88-32456bd42096 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.473863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ac98483-41a0-4fe8-ad88-32456bd42096 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027197 Jul 19 19:47:33.479602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 259/527] 10.222.0.33 () {58 vars in 1181 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:33.490023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33cd03f5-d076-4341-9d39-b9006b3e0624 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-209634833", "id": 346731123, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:33.536472 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33cd03f5-d076-4341-9d39-b9006b3e0624 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.048028 Jul 19 19:47:33.541574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 260/528] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:33 2022] POST /compute/v2.1/flavors => generated 421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:33.552848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36f3d7a1-6352-41cb-a8e6-32aaa92be525 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.575281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36f3d7a1-6352-41cb-a8e6-32aaa92be525 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028187 Jul 19 19:47:33.582051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 261/529] 10.222.0.33 () {58 vars in 1181 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:47:33.600445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b86076ba-7bae-495b-a277-b17d260f7b11 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Action: 'create', calling method: .version_select at 0x7fb88e2caca0>, body: {"keypair": {"name": "tempest-keypair-1204217529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVx1zsuQsykH6FmX5MFusL0hY5msYW7veI21C1OvYXnZ4GXc/dtPOWaIkzrHuv2YUwLT+onObV5n50qSNewtLAP9tN7Z2MivAo4RHQUlW8FgAAIOCWQhAF2z7k9+D9QTA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:33.655695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-b86076ba-7bae-495b-a277-b17d260f7b11 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:33.665386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-b86076ba-7bae-495b-a277-b17d260f7b11 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for user 0ec0c5c154014ebcb2640ed9e91474ee and project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:33.701763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b86076ba-7bae-495b-a277-b17d260f7b11 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107588 Jul 19 19:47:33.709825 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 262/530] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:47:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:47:33.792830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.793882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:33.809878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.810719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.815334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.816295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.154168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.167397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f1c6bf1-6ac4-4793-83a8-16019d20a51f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.912769 Jul 19 19:47:34.169180 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 269/531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.180463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.181414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.190887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.191696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.192954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.194700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.214502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.272021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.274242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.276853 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-faed6efb-7fd0-48fa-85f1-e3261a11f99a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1558 microversion: 2.25 time: 0.489764 Jul 19 19:47:34.283841 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 263/532] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1558 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:34.295564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.303501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.320145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.328165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.340332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.341378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.411982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.425642 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8be042ba-e676-4be5-bbd9-919e6ccb63f2 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1273 microversion: 2.1 time: 0.252377 Jul 19 19:47:34.433324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 270/533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.439524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.442281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.453041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.453871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.455158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.455887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.505117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.516107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8a537b5b-af7b-4501-967e-ec6718a7b9de tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1277 microversion: 2.1 time: 0.230861 Jul 19 19:47:34.517378 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 264/534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.543744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.546798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.557671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.574981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.578892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.582146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.584839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.598495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29a29aae-ba0e-4677-9954-7df24ad18388 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1275 microversion: 2.1 time: 0.163134 Jul 19 19:47:34.611599 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 271/535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.631230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.636833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.643024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.643957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.645127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.645793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.671746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:35.685343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:35.699247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c2b30e6-8449-45dc-a8f2-e33cb09d9388 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 1.179322 Jul 19 19:47:35.701864 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 265/536] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:35.704238 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b52cb8d-50d0-4bf1-9f1f-5f7f4af793dd tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 2051 microversion: 2.25 time: 1.089343 Jul 19 19:47:35.712817 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 272/537] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 2051 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:35.717394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.718092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.718827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.719676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.730741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.731197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.732019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.732447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.733207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.735517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.736719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.738568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.874765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:35.884999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ae2c92c3-80e1-4c59-9df6-1e8f4f944393 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1279 microversion: 2.1 time: 0.170866 Jul 19 19:47:35.891021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 273/538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:35.899986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.904099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.917446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.920485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.921529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.928526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.062629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.075613 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51dfdf4c-8ca2-4dea-9e0d-68bcfd01f1eb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1277 microversion: 2.1 time: 0.180914 Jul 19 19:47:36.079430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 274/539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.089165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.090190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.101876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.112549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.113784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.114481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.212295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.220219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59e89ebe-9392-4e45-9eff-40abe6a888b9 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.516615 Jul 19 19:47:36.227482 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 266/540] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.243740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.244740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.263663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.264491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.265454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.266032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.301377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.314569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70574168-26dc-480e-b3da-be634d7a8111 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1281 microversion: 2.1 time: 0.233743 Jul 19 19:47:36.318927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 275/541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.339525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-32305083-24d7-4a6a-a0be-2a2b8bd48ef2 req-47435800-936d-4dc6-8fae-592e0d868243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794", "name": "network-vif-plugged", "status": "completed", "tag": "2fd92420-7969-4849-a0de-b373673602b8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:36.365181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32305083-24d7-4a6a-a0be-2a2b8bd48ef2 req-47435800-936d-4dc6-8fae-592e0d868243 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.365623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32305083-24d7-4a6a-a0be-2a2b8bd48ef2 req-47435800-936d-4dc6-8fae-592e0d868243 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.390167 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-32305083-24d7-4a6a-a0be-2a2b8bd48ef2 req-47435800-936d-4dc6-8fae-592e0d868243 service nova] Creating event network-vif-plugged:2fd92420-7969-4849-a0de-b373673602b8 for instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 on n-h2-843861-3 Jul 19 19:47:36.403976 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-32305083-24d7-4a6a-a0be-2a2b8bd48ef2 req-47435800-936d-4dc6-8fae-592e0d868243 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070378 Jul 19 19:47:36.404915 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 276/542] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:36.611945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:36.644969 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-466886cd-98e4-4408-802c-18a3fcde79f5 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 2051 microversion: 2.25 time: 0.405362 Jul 19 19:47:36.646791 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 267/543] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 2051 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:36.665080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.666551 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:47:36.666551 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:47:36.667794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.668267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.669205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.669644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.709185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8608d497-7d26-45f3-8fa0-af80bf66ca67 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048148 Jul 19 19:47:36.717612 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 277/544] 10.222.0.33 () {60 vars in 1216 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:47:36.718092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.718708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.721822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:36.725025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:36.725919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.728745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.729212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.733611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.734267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.734397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.734719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.735856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.736574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.855937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e5d79df-6a30-4164-8350-c8bd52945d90 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131/action" status: 202 len: 0 microversion: 2.25 time: 0.133073 Jul 19 19:47:36.859418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 278/545] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:47:36 2022] POST /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:36.891928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.897642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.918484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.920750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.923768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.924256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.380020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:37.390000 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab11b415-00e2-4a75-8a7f-a658990fd1d2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 0.675711 Jul 19 19:47:37.395837 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 268/546] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:37.406519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.407038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:37.428818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.436078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.437218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.437666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.620755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:37.624637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:37.629334 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3f7bc0e-7f1a-4349-87d8-65c9b92c05d3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1279 microversion: 2.1 time: 0.232154 Jul 19 19:47:37.632388 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 269/547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:37.639327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.642593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:37.649297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2c953d2-0ec8-44e7-a3e9-6c626920ec34 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 2056 microversion: 2.25 time: 0.785497 Jul 19 19:47:37.650919 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 279/548] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 2056 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:37.651369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.652002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.653343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.654021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.667782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.669030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:37.681874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.684985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.685971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.686634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.708538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:38.410614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:38.423415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2291195-b491-4d84-a389-85e2b89bca3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.789534 Jul 19 19:47:38.425309 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 270/549] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:38.438789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.439618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.453123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.456412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.461813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.462445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.558862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:38.569582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69741d28-0b99-4fdd-9031-f2af1e719ad6 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1319 microversion: 2.1 time: 0.917329 Jul 19 19:47:38.573565 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 280/550] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1319 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:38.579370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.580529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.600959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.602534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.603608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.604321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.040039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:39.049308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dcbf29d5-8c68-410b-9f15-8858c86f83ad tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1323 microversion: 2.1 time: 0.621906 Jul 19 19:47:39.054618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 271/551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:39.061299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-15ce6285-87dc-4776-9d21-816be2eb8313 req-ca4e6842-b061-4d26-ba68-16aac97adf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "name": "network-vif-plugged", "status": "completed", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:39.086333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15ce6285-87dc-4776-9d21-816be2eb8313 req-ca4e6842-b061-4d26-ba68-16aac97adf80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.086994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15ce6285-87dc-4776-9d21-816be2eb8313 req-ca4e6842-b061-4d26-ba68-16aac97adf80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.112920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-15ce6285-87dc-4776-9d21-816be2eb8313 req-ca4e6842-b061-4d26-ba68-16aac97adf80 service nova] Creating event network-vif-plugged:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h1-843861-3 Jul 19 19:47:39.124470 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-15ce6285-87dc-4776-9d21-816be2eb8313 req-ca4e6842-b061-4d26-ba68-16aac97adf80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068101 Jul 19 19:47:39.129175 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 272/552] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:39.138651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.140698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.165127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.166006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.167548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.168343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.493194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:39.508455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c70d4763-5fd0-44c4-bce4-77431f3870d4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1310 microversion: 2.1 time: 0.933408 Jul 19 19:47:39.509052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 281/553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1310 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:39.514020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.514878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.528678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.529423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.530416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.531037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.894563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:39.908353 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d60c79f0-ef69-4a4c-9e9b-98f816c8dd9b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.777499 Jul 19 19:47:39.909568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 273/554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:39.922993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.923618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.932558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.933396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.934982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.935588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.107286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:40.129371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d74ca09-43c0-44e2-8d77-9437103252e0 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 2036 microversion: 2.25 time: 0.617915 Jul 19 19:47:40.130547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 282/555] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 2036 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:40.136646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:40.137737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:40.150970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.151621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.153196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.153636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.644465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:40.660402 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7ca2d5a-ff35-4503-8ba5-51d23c817c81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.748933 Jul 19 19:47:40.660918 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 274/556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:40.687233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:40.694117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:40.707529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.712582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.713689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.714818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.727283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:40.730338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:40.751618 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5f6a3ab-93bf-45fb-95cc-1761a6b556ea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1467 microversion: 2.1 time: 0.619666 Jul 19 19:47:40.756381 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 283/557] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:40 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1467 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:40.764392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843861-3", "block_migration": "auto"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:40.787539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:40.820914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.822266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.851972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.857935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.976011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'flavor' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:40.996011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Going to try to live migrate instance to n-h1-843861-3 {{(pid=126008) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:47:41.385074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:41.618608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:41.633989 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b604dcce-f2ee-49c3-bbda-d32dc700f325 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1323 microversion: 2.1 time: 0.968084 Jul 19 19:47:41.644951 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 275/558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:40 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1323 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:41.650772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:41.651356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:41.665309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.667418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:41.668357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.668922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.184584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:42.200751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c182982c-ef67-4656-8732-8161fcf3053b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1492 microversion: 2.1 time: 0.562799 Jul 19 19:47:42.201331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 276/559] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:41 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1492 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.254403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:42.255857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:42.271834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.276004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.276977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.279000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.524834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:42.598454 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-859d54e5-cce5-4c1c-ab2d-ac9933222cbc tempest-DeleteServersAdminTestJSON-2000201013 tempest-DeleteServersAdminTestJSON-2000201013-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794/action" status: 202 len: 0 microversion: 2.1 time: 0.395895 Jul 19 19:47:42.606212 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 277/560] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:42 2022] POST /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:42.644163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-960c7129-2c62-4b33-818b-045c9faf7f2a req-ed4966f5-23e9-4ec6-9794-c4604a380ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:42.681826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-960c7129-2c62-4b33-818b-045c9faf7f2a req-ed4966f5-23e9-4ec6-9794-c4604a380ee8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.682370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-960c7129-2c62-4b33-818b-045c9faf7f2a req-ed4966f5-23e9-4ec6-9794-c4604a380ee8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.695006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-960c7129-2c62-4b33-818b-045c9faf7f2a req-ed4966f5-23e9-4ec6-9794-c4604a380ee8 service nova] Creating event network-changed:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:47:42.702780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-960c7129-2c62-4b33-818b-045c9faf7f2a req-ed4966f5-23e9-4ec6-9794-c4604a380ee8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093298 Jul 19 19:47:42.703938 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 278/561] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:42.711715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.712629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:42.732460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.733167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.734137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.734743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.952043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:42.962048 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e71b7f6e-b0a2-475a-87c2-c4857969b292 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.256715 Jul 19 19:47:42.963878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 279/562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.969973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.970974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:42.978566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.979377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.980909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.981527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.402307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:43.410479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c749ba1-16f8-4e59-8eea-cc20ed2c9cd3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.445278 Jul 19 19:47:43.422807 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 280/563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.428185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.428806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:43.449385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.449847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.450647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.451089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.678449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=48 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:43.771305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-022f945c-0641-4b34-99b4-1646bd410d72 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1643 microversion: 2.1 time: 0.344617 Jul 19 19:47:43.776248 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 281/564] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1643 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.799166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.800502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:43.825190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.830721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.841253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.859530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.944732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.945513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.946149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:44.585617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:44.596401 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b11fe6a5-39c4-423b-8abf-8b3e742c643f tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1450 microversion: 2.1 time: 0.818724 Jul 19 19:47:44.611964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 282/565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1450 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:44.633203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.634127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:44.651785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.652297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:44.653865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.655444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:45.338808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:45.354313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3680501d-fe00-432c-b341-7751b592e252 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1323 microversion: 2.1 time: 0.741102 Jul 19 19:47:45.379526 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 283/566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:44 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1323 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:45.392630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-856814389", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "346731123", "adminPass": "***", "networks": [{"uuid": "d1d09029-5226-4025-a604-8d40681eadd9"}], "security_groups": [{"name": "tempest-securitygroup--61775886"}], "key_name": "tempest-keypair-1204217529", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:45.705492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] validate_networks() for [('d1d09029-5226-4025-a604-8d40681eadd9', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:45.960611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a73e2b3-bad6-41a5-bab5-08009de988f9 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131/action" status: 202 len: 0 microversion: 2.25 time: 5.202855 Jul 19 19:47:45.965453 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 284/567] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:47:40 2022] POST /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131/action => generated 0 bytes in 5208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:45.975851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:45.976696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:46.015172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.033384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:46.036536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.036987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:46.682264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:47.019862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5d52e27-976d-4fb0-a910-3fd31c41f4be tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1643 microversion: 2.1 time: 1.051444 Jul 19 19:47:47.023631 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 285/568] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:45 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1643 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:47.031520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.034154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.054556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.054914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.056386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.057983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.356098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.366005 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f4e83c2-f03b-4f14-8cb8-ae27aa2e63ca tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.339898 Jul 19 19:47:47.366955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 286/569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:47.372161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e9dd9b71-af67-464a-b33c-4033921eb93c req-e8aee795-4a61-48a1-8a5d-7b402ff568eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c7731d-87f2-4128-ad1e-c010c4a4b481", "tag": "b4b488f4-5ec8-4227-b7ea-edd7825ce90b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:47.381430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e9dd9b71-af67-464a-b33c-4033921eb93c req-e8aee795-4a61-48a1-8a5d-7b402ff568eb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.381988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e9dd9b71-af67-464a-b33c-4033921eb93c req-e8aee795-4a61-48a1-8a5d-7b402ff568eb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.395402 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e9dd9b71-af67-464a-b33c-4033921eb93c req-e8aee795-4a61-48a1-8a5d-7b402ff568eb service nova] Creating event network-changed:b4b488f4-5ec8-4227-b7ea-edd7825ce90b for instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 on n-h2-843861-3 Jul 19 19:47:47.401411 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e9dd9b71-af67-464a-b33c-4033921eb93c req-e8aee795-4a61-48a1-8a5d-7b402ff568eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Jul 19 19:47:47.402766 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 287/570] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:47.408970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.410053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.418007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.418695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.419518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.420281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.436292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:47.436821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:47.438787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:47.439206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:47.439617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:47.458146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.459039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.459886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.460378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.483750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:47.489563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for user 0ec0c5c154014ebcb2640ed9e91474ee and project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:47.503634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:47.506066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:47.558162 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-06a84046-dc3e-4f48-bfc3-58e88800ebf0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.176149 Jul 19 19:47:47.564044 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 284/571] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:47.569240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.569821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.576142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.576289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.576594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.577363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.577797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.590840 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8412573-a454-4662-8c3a-e76ec6734d8b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.186722 Jul 19 19:47:47.602439 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 288/572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:47.607917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:47.609365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.609977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.616855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.617537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.619092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.619677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.659936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:47.701942 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ecc9f0a-cd2e-436a-9d4c-0b34b5c70577 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 204 len: 0 microversion: 2.1 time: 0.136348 Jul 19 19:47:47.703171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 285/573] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:47 2022] DELETE /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:47.713778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.714680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.721905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.722537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.723462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.724673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.800020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.811005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.815180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.816747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e679015-4df9-477b-bc35-9a2b7cf98845 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.212875 Jul 19 19:47:47.817419 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 289/574] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:47.822552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.824230 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:47:47.824230 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:47:47.825747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.826413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.827561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.828259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.858151 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2da3a8bb-90c3-4f62-909e-b5455461e8e3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038889 Jul 19 19:47:47.864253 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 290/575] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:47.869258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-75350565-37da-4725-bf20-a8909e898abc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.870259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-75350565-37da-4725-bf20-a8909e898abc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.948276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75350565-37da-4725-bf20-a8909e898abc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.950706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.955921 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-75350565-37da-4725-bf20-a8909e898abc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1262 microversion: 2.1 time: 0.093795 Jul 19 19:47:47.963831 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 291/576] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:47.963984 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cdc56dbe-0cf2-4756-8cab-05a141ee4164 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1323 microversion: 2.1 time: 0.254011 Jul 19 19:47:47.963984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 286/577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:47.964399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.964399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.971339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.972134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.972818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:47.973450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.973611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.974804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.989033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.992414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.993732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.995258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.014091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.014789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.015422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:48.076865 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-196f4957-d57a-40ab-9b2d-c065954941f0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6/action" status: 202 len: 0 microversion: 2.1 time: 0.110780 Jul 19 19:47:48.078566 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 287/578] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:47 2022] POST /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:48.098001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.100132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.116594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.117138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.118218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.118699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.186978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.195102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d3d3136-93f6-4127-bccc-ef4f920d8182 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1456 microversion: 2.1 time: 0.237085 Jul 19 19:47:48.196364 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 292/579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1456 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:48.314713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6705a6f4-aaed-4653-a0da-984e8e927875 req-11b77868-3fca-4b76-a5e5-5fbd7800b6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "name": "network-vif-plugged", "status": "completed", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:48.324318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6705a6f4-aaed-4653-a0da-984e8e927875 req-11b77868-3fca-4b76-a5e5-5fbd7800b6ae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.324757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6705a6f4-aaed-4653-a0da-984e8e927875 req-11b77868-3fca-4b76-a5e5-5fbd7800b6ae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.340808 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6705a6f4-aaed-4653-a0da-984e8e927875 req-11b77868-3fca-4b76-a5e5-5fbd7800b6ae service nova] Creating event network-vif-plugged:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:47:48.346212 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6705a6f4-aaed-4653-a0da-984e8e927875 req-11b77868-3fca-4b76-a5e5-5fbd7800b6ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035108 Jul 19 19:47:48.347172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 293/580] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:48.390773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.393014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.404470 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9f11cc1-a166-487b-890b-0b16a85d91bf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1648 microversion: 2.1 time: 0.319262 Jul 19 19:47:48.413301 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 288/581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1648 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:48.444792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.445253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.451902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.454145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.616661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.617289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.625314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.625756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.629655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.630898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.783676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.792942 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42151e3a-8c11-49a3-a2f6-1b81bf982b43 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.412937 Jul 19 19:47:48.794139 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 294/582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:48.839600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.841058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.862876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.864043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.864415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.865555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.916790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.924572 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be87952b-a89c-4146-aaef-fc7335dfbeb3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.312376 Jul 19 19:47:48.935386 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 289/583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:48.986748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.987546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.994677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.995139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.995935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.996551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.080442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.101207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1cd04fcf-1ba9-4a2d-b9a4-ccea206e1cc4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1266 microversion: 2.1 time: 0.128918 Jul 19 19:47:49.101833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 290/584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:49.128154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.130956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:49.142604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.143465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.144678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.145210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.157963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.169863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.171634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.172864 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd6b3943-f875-4056-81b6-a9a0cf6a877e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.337673 Jul 19 19:47:49.179272 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 295/585] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:47:49.222981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.226536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:49.244271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.245680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.248145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.258935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.301291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.302241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.302426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:49.783350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.790043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.808585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fd58115-ae0a-4602-91d1-3794a423332c tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1323 microversion: 2.1 time: 0.705481 Jul 19 19:47:49.809445 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 291/586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:49.821009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be815de6-a436-4f2a-b86d-2004868eed3d tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1456 microversion: 2.1 time: 0.609478 Jul 19 19:47:49.821625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 296/587] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1456 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:49.824110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d9cbfa-c3bf-4a90-9028-aef627a173a6", "tag": "76460fc4-2d88-431c-9477-8111202e7dc3"}, {"name": "network-changed", "server_uuid": "61c2af52-06ad-4c61-9baa-26435425e7ea", "tag": "5f6e4636-7355-4b5b-a523-d95a7fc2eb79"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:49.835833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.835833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:49.838712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.838712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.843189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.844302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.844919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.849802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.876591 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] Creating event network-changed:76460fc4-2d88-431c-9477-8111202e7dc3 for instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 on n-h1-843861-3 Jul 19 19:47:49.877831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] Creating event network-changed:5f6e4636-7355-4b5b-a523-d95a7fc2eb79 for instance 61c2af52-06ad-4c61-9baa-26435425e7ea on n-h2-843861-3 Jul 19 19:47:49.898071 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a39f59b2-bb28-4273-8bbe-cad6731b2e01 req-461d2222-03e5-4a25-8a3c-3a72a23ce73a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077880 Jul 19 19:47:49.899275 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 292/588] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:49.918671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-02fdc069-35f1-4243-b5de-5090a1f550c0 req-ce510963-1235-4eff-9595-e338dfa352bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "name": "network-vif-unplugged", "status": "completed", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:49.945755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-02fdc069-35f1-4243-b5de-5090a1f550c0 req-ce510963-1235-4eff-9595-e338dfa352bf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.946194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-02fdc069-35f1-4243-b5de-5090a1f550c0 req-ce510963-1235-4eff-9595-e338dfa352bf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.972237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-02fdc069-35f1-4243-b5de-5090a1f550c0 req-ce510963-1235-4eff-9595-e338dfa352bf service nova] Creating event network-vif-unplugged:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h2-843861-3 Jul 19 19:47:49.982970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-02fdc069-35f1-4243-b5de-5090a1f550c0 req-ce510963-1235-4eff-9595-e338dfa352bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079563 Jul 19 19:47:49.984490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 293/589] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:49.998215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.999939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.015968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.017050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.018890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.019994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.202883 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca9674b3-9e02-4d26-92f7-5f6eec95038a tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1628 microversion: 2.1 time: 0.379634 Jul 19 19:47:50.213450 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 297/590] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1628 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:50.229590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.236321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.249747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.250410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.251348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.256025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.854989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:50.866935 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62ba6bcf-aec3-43ba-82db-8f72512868a4 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.877722 Jul 19 19:47:50.868581 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 294/591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:50.873638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.874542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.882845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:50.893570 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70843d4b-fd6d-4ce5-846a-0da9f09652f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.677391 Jul 19 19:47:50.898730 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 298/592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:50.900783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.902837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.906683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.907798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.909998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.917925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.922811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:50.939954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.940387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.941372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.941971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.058982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.067235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9c1a845-6336-4d47-89d0-54cd8502c9dc tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1314 microversion: 2.1 time: 0.197171 Jul 19 19:47:51.077645 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 295/593] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:51.084004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843861-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:51.086798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.093496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.094163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.095129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.095719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.132928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lazy-loading 'flavor' on Instance uuid ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:51.152712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Going to try to live migrate instance to n-h2-843861-3 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:47:51.242102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.252867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.258409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.261305 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a9aabba-7f66-45b8-b5af-dff230902d5e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.361175 Jul 19 19:47:51.266435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 299/594] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:51.273197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:51.277754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.292035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.292699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.294180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.297209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.626449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.629846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:51.642076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9d02e900-652c-441d-841d-6c7d4002bdc3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1519 microversion: 2.1 time: 0.374165 Jul 19 19:47:51.651713 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 300/595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:51 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1519 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:51.661185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:51.662239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.669413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.669975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.670821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.671568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.714068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.714880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.715702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:51.916415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.927799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e9f6075-32f9-4c4a-8102-90551e79024c tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1456 microversion: 2.1 time: 0.274831 Jul 19 19:47:51.929353 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 301/596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:51 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1456 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:51.935605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a54057f-47c1-4b7b-8fb0-39c167bcdf58 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'create', calling method: .version_select at 0x7fb88e391790>, body: {"pool": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:53.329294 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a54057f-47c1-4b7b-8fb0-39c167bcdf58 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.398626 Jul 19 19:47:53.343769 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 302/597] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:47:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:53.353115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.354621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.363832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.364465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.365776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.366527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.581766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.593230 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-429c20a2-8818-4064-9117-58b06a78f63e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.247602 Jul 19 19:47:53.594080 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 303/598] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:53.608909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.609776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.615878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.616509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.617078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.617500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.784370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.797818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b15aa803-e7f8-4a7d-bfd8-0c40ed64f849 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.195020 Jul 19 19:47:53.799113 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 304/599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:53.806587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a5b364a4-fd0e-4dc3-b4e7-21e769179102 req-1ccf31c1-5bbf-46c3-8300-218480bc2dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:53.815182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a5b364a4-fd0e-4dc3-b4e7-21e769179102 req-1ccf31c1-5bbf-46c3-8300-218480bc2dba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.815686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a5b364a4-fd0e-4dc3-b4e7-21e769179102 req-1ccf31c1-5bbf-46c3-8300-218480bc2dba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.829606 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a5b364a4-fd0e-4dc3-b4e7-21e769179102 req-1ccf31c1-5bbf-46c3-8300-218480bc2dba service nova] Creating event network-changed:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h2-843861-3 Jul 19 19:47:53.835514 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a5b364a4-fd0e-4dc3-b4e7-21e769179102 req-1ccf31c1-5bbf-46c3-8300-218480bc2dba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Jul 19 19:47:53.836153 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 305/600] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:53.841961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.842586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.849109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.849731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.850494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.851151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.934356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.943744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53147892-0f3e-41b3-b522-4ad98a9633f4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1314 microversion: 2.1 time: 0.105311 Jul 19 19:47:53.944591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 306/601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:53.949889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.950305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.957221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.957744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.958626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.959181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:54.988909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.000440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.002590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.004098 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f23ae791-b83f-4f5b-9cd2-ccbdfc3c6c98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 1.058656 Jul 19 19:47:55.005131 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 307/602] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:55.010181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-45816504-56fc-4eba-ae20-e9a4bd9a40b3 req-77e2452c-6bc3-4af7-99c2-f752488b696f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d9cbfa-c3bf-4a90-9028-aef627a173a6", "name": "network-vif-plugged", "status": "completed", "tag": "76460fc4-2d88-431c-9477-8111202e7dc3"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:55.021943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-45816504-56fc-4eba-ae20-e9a4bd9a40b3 req-77e2452c-6bc3-4af7-99c2-f752488b696f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.022509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-45816504-56fc-4eba-ae20-e9a4bd9a40b3 req-77e2452c-6bc3-4af7-99c2-f752488b696f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.034575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-45816504-56fc-4eba-ae20-e9a4bd9a40b3 req-77e2452c-6bc3-4af7-99c2-f752488b696f service nova] Creating event network-vif-plugged:76460fc4-2d88-431c-9477-8111202e7dc3 for instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 on n-h1-843861-3 Jul 19 19:47:55.040242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-45816504-56fc-4eba-ae20-e9a4bd9a40b3 req-77e2452c-6bc3-4af7-99c2-f752488b696f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Jul 19 19:47:55.041187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 308/603] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:55.050511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:55.051513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:55.059894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.060631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.061621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.062236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.101707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.102160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.102621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lazy-loading 'fault' on Instance uuid fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:55.613559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4232e411040b43129bec0aba0ef763ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ad00c8dcf46549255411fd05f6c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.625484 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1eed2bb-3d17-4896-b912-d291ccfba5de tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 200 len: 1456 microversion: 2.1 time: 0.582608 Jul 19 19:47:55.636912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 309/604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:55 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 1456 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:55.642314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1933092241", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f8081125-1f0f-4d89-8040-cb2f528626b5"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:55.703191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] validate_networks() for [('f8081125-1f0f-4d89-8040-cb2f528626b5', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:56.074279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f54468d-1fbd-4f00-a584-77a975d2b838 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6/action" status: 202 len: 0 microversion: 2.1 time: 4.995119 Jul 19 19:47:56.076457 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 296/605] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:51 2022] POST /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6/action => generated 0 bytes in 4998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:56.086038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:56.086864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:56.109699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.110445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.111448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.111967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.861454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:56.920534 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0bacf2ae-5599-43c1-899e-30f87c1a3035 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1321 microversion: 2.1 time: 0.836845 Jul 19 19:47:56.925351 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 297/606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:56 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:56.946981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:56.955154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:56.966395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.967565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.969627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.970648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.176644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:57.177965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:57.178592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:57.180787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:57.181422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:57.247676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.248417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.249879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.250529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.274059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Getting quotas for project 1daba1b3ce8e4e55aba8c2d684ca6601. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:57.283479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Getting quotas for user 93ce351fde36493eb6ffce973ee2e3c1 and project 1daba1b3ce8e4e55aba8c2d684ca6601. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:57.299298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:57.303891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:57.378784 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aaa49c94-79ce-4dd5-a888-c55bc8a26323 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740444 Jul 19 19:47:57.382890 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 310/607] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:57.392286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:57.394342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.400993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8d73cb5-33ce-4404-babd-bc1ea2c57ad1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.471921 Jul 19 19:47:57.401585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:57.412361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.412594 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 298/608] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:56 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:57.413406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.414385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.414977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.425007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.425630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:57.435202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.435651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.444705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.445144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.482891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:57.497643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:57.570024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:57.577806 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-08d6eaf4-a905-4440-8c35-8f78ab77422d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1320 microversion: 2.1 time: 0.192935 Jul 19 19:47:57.578386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 311/609] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:57 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:57.595527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.596178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:57.606291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.614716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.617277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.617944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.300590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.307943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.317191 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a7d5b9c-12ff-4a47-9e14-bdc28ac0c8a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.733599 Jul 19 19:47:58.319546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 312/610] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:57 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:58.324197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.324388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-452e786c-a407-4402-8437-f8afef1c9859 req-7712117e-4828-4968-a6b6-c5deab4a9c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794", "name": "network-vif-deleted", "tag": "2fd92420-7969-4849-a0de-b373673602b8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:58.326705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.328470 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72e072db-bd69-46b6-be86-ddb781ca0c12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.915036 Jul 19 19:47:58.333212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-452e786c-a407-4402-8437-f8afef1c9859 req-7712117e-4828-4968-a6b6-c5deab4a9c8f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.340356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-452e786c-a407-4402-8437-f8afef1c9859 req-7712117e-4828-4968-a6b6-c5deab4a9c8f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.343242 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 299/611] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:57 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:58.349687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.350607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.359635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.360679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.362318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.363258 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-452e786c-a407-4402-8437-f8afef1c9859 req-7712117e-4828-4968-a6b6-c5deab4a9c8f service nova] Creating event network-vif-deleted:2fd92420-7969-4849-a0de-b373673602b8 for instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 on n-h2-843861-3 Jul 19 19:47:58.363712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.369832 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-452e786c-a407-4402-8437-f8afef1c9859 req-7712117e-4828-4968-a6b6-c5deab4a9c8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048738 Jul 19 19:47:58.372327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 313/612] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:58.387949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c7731d-87f2-4128-ad1e-c010c4a4b481", "name": "network-vif-plugged", "status": "completed", "tag": "b4b488f4-5ec8-4227-b7ea-edd7825ce90b"}, {"server_uuid": "fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794", "name": "network-vif-unplugged", "status": "completed", "tag": "2fd92420-7969-4849-a0de-b373673602b8"}, {"server_uuid": "61c2af52-06ad-4c61-9baa-26435425e7ea", "name": "network-vif-plugged", "status": "completed", "tag": "5f6e4636-7355-4b5b-a523-d95a7fc2eb79"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:58.392659 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 HTTP/1.1 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:47:58.395800 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.397409 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794'} Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:58.398282 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.399847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.402984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:58.404554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a66c40c-686f-4872-95d5-9a6cb78a4bfd tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 404 len: 111 microversion: 2.1 time: 0.059060 Jul 19 19:47:58.407487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.408215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.409985 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 300/613] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:58.416854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.417452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.424555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.425417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.426421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.427545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.428427 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Creating event network-vif-plugged:b4b488f4-5ec8-4227-b7ea-edd7825ce90b for instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 on n-h2-843861-3 Jul 19 19:47:58.430788 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Creating event network-vif-unplugged:2fd92420-7969-4849-a0de-b373673602b8 for instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 on n-h2-843861-3 Jul 19 19:47:58.431032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:58.432202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] Creating event network-vif-plugged:5f6e4636-7355-4b5b-a523-d95a7fc2eb79 for instance 61c2af52-06ad-4c61-9baa-26435425e7ea on n-h2-843861-3 Jul 19 19:47:58.449039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1972cfa4-ad2f-4f8d-8fd4-25cd9d7acb0e req-94cf1495-c1b9-4048-be41-042f5999d168 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.071934 Jul 19 19:47:58.450824 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 314/614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:58.463014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.464138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.474064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.475473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.476608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.477362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.532541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.548070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6aad50ef-c1b2-4935-8112-6f768c836658 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1276 microversion: 2.1 time: 0.136352 Jul 19 19:47:58.559754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 301/615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:58.566343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.567120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.577123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.577988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.579441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.580820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.596898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 HTTP/1.1 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:47:58.599720 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.601331 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794'} Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:58.602191 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:58.603695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.607723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:58.609779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb984249-48d3-40a3-acda-d64ca3a6fbe4 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 404 len: 111 microversion: 2.1 time: 0.047182 Jul 19 19:47:58.613268 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 302/616] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:58 2022] DELETE /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:58.618172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.618865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.633143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.633667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.634529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.635305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.916021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:58.925374 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8306018a-dbeb-4cd8-9e75-21ea26a78936 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1471 microversion: 2.1 time: 0.470706 Jul 19 19:47:58.928800 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 315/617] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:58.942967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.944023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.957160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.958001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.959414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.964400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.178908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:59.187185 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fdbaa44-ae86-4b98-83e1-d2363f2fecd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.575224 Jul 19 19:47:59.199800 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 303/618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:59.204840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.205552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.228634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.230847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.232001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.232665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.248342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 HTTP/1.1 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:47:59.250224 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:59.251929 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794'} Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:59.252772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. Jul 19 19:47:59.254137 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.256146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:59.257221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be1e58e1-36f2-4b38-a433-93c69318116e tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794" status: 404 len: 111 microversion: 2.1 time: 0.056221 Jul 19 19:47:59.258311 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 304/619] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:59 2022] GET /compute/v2.1/servers/fdcae1a9-fe4d-46ea-a5cb-e9b3553a3794 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:59.263868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:59.264653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.268033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:59.276295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.277114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.278086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.278803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.311827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lazy-loading 'flavor' on Instance uuid 24d9cbfa-c3bf-4a90-9028-aef627a173a6 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:59.438648 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-192fc7ff-59cc-4c1c-93ab-281acc0bdafd tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6/action" status: 202 len: 0 microversion: 2.1 time: 0.178569 Jul 19 19:47:59.443510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 305/620] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:59 2022] POST /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:59.446229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.447128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.454511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.457487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.459673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.460185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.476906 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 HTTP/1.1 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:47:59.478714 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:59.480047 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '8e79b1af-47e8-4bf6-95c9-16b1df852140'} Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:59.480788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:47:59.481924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:47:59.483106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:59.483106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-93fad0dc-5bee-4518-9a5b-f9ccaeef9e85 tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 404 len: 111 microversion: 2.1 time: 0.039302 Jul 19 19:47:59.483106 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 306/621] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:59 2022] DELETE /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:59.486386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.487072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.493946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.494538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.495587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.496118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.861372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:59.878425 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1ab6996-d06b-4bc9-83f1-5761ff959c61 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.944891 Jul 19 19:47:59.879285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 316/622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:59.892377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.894720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.913725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.914495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.916664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.917274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.223235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.241859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d3a99e3-2c05-456d-ad40-5bdd18f8bd50 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.749364 Jul 19 19:48:00.242557 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 307/623] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:59 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:00.252215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.253365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.268648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.269383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.270183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.270615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.317833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.331790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.333712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.337670 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8320847f-8174-4148-b2d6-d621d6702e02 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.453823 Jul 19 19:48:00.338430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 317/624] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:59 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:00.353694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.354481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] [instance: 8e79b1af-47e8-4bf6-95c9-16b1df852140] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.367148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.368854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.370637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.376312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.408320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] HTTP exception thrown: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Request method failure captured: Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 HTTP/1.1 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1woenKQXFw-FlwKXVBx6wH-R7tHU8JnP4jJPItRxyL7fhYJdynGYfLCsOsZZGTzV9xZAYJc5kpUeXqQVJHBEDuHnFJbk2pIHx0UOKYmO0bagWADCl5qdys8vjyZ7Yr768rT4Nkm2FWJQuLBO5aj-O7-v1kE_oYar9GqWqXgl-VXKUyM Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:48:00.410153 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd8ad00c8dcf46549255411fd05f6c72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dd8ad00c8dcf46549255411fd05f6c72 Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1758923460 Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4232e411040b43129bec0aba0ef763ed Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersAdminTestJSON-1758923460-project Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:48:00.412294 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8e79b1af-47e8-4bf6-95c9-16b1df852140'} Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:00.413176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. Jul 19 19:48:00.414632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:00.416506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] Returning 404 to user: Instance 8e79b1af-47e8-4bf6-95c9-16b1df852140 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:00.422160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd03c83d-515a-4474-abdc-77f676a7deea tempest-DeleteServersAdminTestJSON-1758923460 tempest-DeleteServersAdminTestJSON-1758923460-project] 10.222.0.33 "GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140" status: 404 len: 111 microversion: 2.1 time: 0.082356 Jul 19 19:48:00.422859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 318/625] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/8e79b1af-47e8-4bf6-95c9-16b1df852140 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:00.433574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.436320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.452624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.456094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.457038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.457701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.939498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.951095 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82090bcd-c983-4b53-b3bc-b2617774f624 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.522233 Jul 19 19:48:00.952927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 319/626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:00.976544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.988691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.996021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.996749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.997663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.998273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.526003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:01.557602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5e4d65b-a6d8-48ed-af2f-6da57cf0e159 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1319 microversion: 2.1 time: 0.592214 Jul 19 19:48:01.560839 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 320/627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:01.576973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-14e8f4f5-0c0b-4c13-a977-f687b4bb3614 req-4b4efe93-c95f-4b13-8da7-564f8d4bde62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "name": "network-vif-unplugged", "status": "completed", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:01.601035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-14e8f4f5-0c0b-4c13-a977-f687b4bb3614 req-4b4efe93-c95f-4b13-8da7-564f8d4bde62 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.602938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-14e8f4f5-0c0b-4c13-a977-f687b4bb3614 req-4b4efe93-c95f-4b13-8da7-564f8d4bde62 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.639274 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-14e8f4f5-0c0b-4c13-a977-f687b4bb3614 req-4b4efe93-c95f-4b13-8da7-564f8d4bde62 service nova] Creating event network-vif-unplugged:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h2-843861-3 Jul 19 19:48:01.651089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-14e8f4f5-0c0b-4c13-a977-f687b4bb3614 req-4b4efe93-c95f-4b13-8da7-564f8d4bde62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088743 Jul 19 19:48:01.651796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 321/628] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:01.671241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:01.678207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:01.697583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.698457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.700492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.702434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.743331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:02.101845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a19a5bd7-a579-49c8-8190-d2c0e6b8864e tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1613 microversion: 2.1 time: 1.854903 Jul 19 19:48:02.106927 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 308/629] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1613 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:02.127225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:02.131778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:02.143343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.144122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.145094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.145739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.408163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:02.420952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-513a00b7-7000-4258-9748-35d53b27bab4 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.765364 Jul 19 19:48:02.432951 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 322/630] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:01 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:02.446133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:02.447119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:02.456977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.457907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.459970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.460649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.055601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.104464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.108977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.112627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.114181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83779a70-338a-4920-a0a5-6cb31fc073b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1568 microversion: 2.25 time: 0.679812 Jul 19 19:48:03.122211 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e1addedc-c230-464d-beb5-b5b05d16e204 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 1.013704 Jul 19 19:48:03.123495 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 309/631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:02 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:03.129185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-973b5a3d-1bc2-4d40-baba-3034925b1120 req-b7a40ce1-e63b-4aeb-9d60-b1b5eb3ab6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:03.136838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 323/632] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:02 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1568 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:03.142711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-973b5a3d-1bc2-4d40-baba-3034925b1120 req-b7a40ce1-e63b-4aeb-9d60-b1b5eb3ab6ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.143701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-973b5a3d-1bc2-4d40-baba-3034925b1120 req-b7a40ce1-e63b-4aeb-9d60-b1b5eb3ab6ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.143948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:03.144360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.152158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.152618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.153420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.153942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.162514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-973b5a3d-1bc2-4d40-baba-3034925b1120 req-b7a40ce1-e63b-4aeb-9d60-b1b5eb3ab6ed service nova] Creating event network-changed:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:03.170095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-973b5a3d-1bc2-4d40-baba-3034925b1120 req-b7a40ce1-e63b-4aeb-9d60-b1b5eb3ab6ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043438 Jul 19 19:48:03.171374 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 310/633] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:03.179339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:03.180627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.200918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.201738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.203867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.204498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.333247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] HTTP exception thrown: Cannot 'migrate' instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 while it is in vm_state suspended Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Request method failure captured: Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6/action HTTP/1.1 Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 15 Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wovlRiTNC34FMYlKnw-uFQig1MhpsRTiBXcT_nFXoCNcvtlgYmxL4PANQKyCp7NIlLKrX11vITT0GVk-vr78xQT1FsJNg41eGD8ooVlcwtNnT9dAC8YH6HGmfvxRyLZAiWDu7VGj-dOMabfPeYYSmfY6l-18NXQfE0mZZBpn3nwrKg Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:48:03.335043 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/94ebea962216481c812e8605e9e5043c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8f45f8b3ddbb4ceeb9fd0a820abadb96 Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: {"migrate": {}} Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:48:03.336695 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'migrate' instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 while it is in vm_state suspended Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '24d9cbfa-c3bf-4a90-9028-aef627a173a6', 'body': {'migrate': {}}} Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 in vm_state suspended. Cannot resize while the instance is in this state. Jul 19 19:48:03.337639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 while it is in vm_state suspended Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.339059 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 while it is in vm_state suspended Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Returning 409 to user: Cannot 'migrate' instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 while it is in vm_state suspended {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:03.340525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f29b5970-44af-4513-845e-5869cc7fbe6b tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6/action" status: 409 len: 148 microversion: 2.1 time: 0.164916 Jul 19 19:48:03.341374 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 311/634] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:03 2022] POST /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:03.346740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:03.346990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.354139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.354674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.355531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.356055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.739095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.755823 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8eb4a338-da47-4f72-8aed-af1858a9bafb tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.611769 Jul 19 19:48:03.757166 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 324/635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:03 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:03.762265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-368dfaaf-4acd-46fb-a34d-b949ab3b557c tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-368dfaaf-4acd-46fb-a34d-b949ab3b557c tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Request method failure captured: Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action HTTP/1.1 Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 39 Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wovlRiTNC34FMYlKnw-uFQig1MhpsRTiBXcT_nFXoCNcvtlgYmxL4PANQKyCp7NIlLKrX11vITT0GVk-vr78xQT1FsJNg41eGD8ooVlcwtNnT9dAC8YH6HGmfvxRyLZAiWDu7VGj-dOMabfPeYYSmfY6l-18NXQfE0mZZBpn3nwrKg Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:48:03.764682 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/94ebea962216481c812e8605e9e5043c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8f45f8b3ddbb4ceeb9fd0a820abadb96 Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: {"os-resetState": {"state": "invalid"}} Jul 19 19:48:03.766089 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '08d5a511-d1d6-40e2-a3c4-055c7c6a192c', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:03.766786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:48:03.768221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:48:03.769352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:03.770902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-368dfaaf-4acd-46fb-a34d-b949ab3b557c tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:03.772079 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-368dfaaf-4acd-46fb-a34d-b949ab3b557c tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action" status: 400 len: 144 microversion: 2.1 time: 0.013608 Jul 19 19:48:03.773331 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 325/636] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:03 2022] POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:48:03.778516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:03.779409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.787872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.788608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.789608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.790240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.894095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:03.903551 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a5c8795-49b5-41a5-82ef-94a95bb15c70 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1469 microversion: 2.1 time: 0.560919 Jul 19 19:48:03.916218 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 312/637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:03 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1469 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:03.932402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "name": "network-vif-unplugged", "status": "completed", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}, {"name": "network-changed", "server_uuid": "93d6ae0e-2945-4327-acef-5be53b8d649e", "tag": "78fdbece-5f32-4a6c-9006-5bb3bceb65d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:03.949058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.949498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.011333 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] Creating event network-vif-unplugged:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h1-843861-3 Jul 19 19:48:04.012134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] Creating event network-changed:78fdbece-5f32-4a6c-9006-5bb3bceb65d0 for instance 93d6ae0e-2945-4327-acef-5be53b8d649e on n-h2-843861-3 Jul 19 19:48:04.032503 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-392e330f-3ff8-42fb-b5e3-a61ca7aefdc1 req-0eeca33a-fa7d-4b03-a975-634e9dfa0b9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.119274 Jul 19 19:48:04.034455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 313/638] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:04.041166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2fcb24f-2c46-4296-a6ce-8c94b18308dc tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2fcb24f-2c46-4296-a6ce-8c94b18308dc tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Request method failure captured: Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action HTTP/1.1 Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 31 Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wovlRiTNC34FMYlKnw-uFQig1MhpsRTiBXcT_nFXoCNcvtlgYmxL4PANQKyCp7NIlLKrX11vITT0GVk-vr78xQT1FsJNg41eGD8ooVlcwtNnT9dAC8YH6HGmfvxRyLZAiWDu7VGj-dOMabfPeYYSmfY6l-18NXQfE0mZZBpn3nwrKg Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:48:04.048849 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/94ebea962216481c812e8605e9e5043c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8f45f8b3ddbb4ceeb9fd0a820abadb96 Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: {"os-resetState": {"state": 1}} Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:48:04.051095 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '08d5a511-d1d6-40e2-a3c4-055c7c6a192c', 'body': {'os-resetState': {'state': 1}}} Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 1 Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:04.052935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:48:04.056723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.060982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2fcb24f-2c46-4296-a6ce-8c94b18308dc tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:04.062082 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2fcb24f-2c46-4296-a6ce-8c94b18308dc tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action" status: 400 len: 120 microversion: 2.1 time: 0.026121 Jul 19 19:48:04.064764 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 314/639] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:04 2022] POST /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:48:04.071904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:04.073610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:04.083246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.084059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.085123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.085776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.149911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:04.174449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-075440c2-0222-423b-bfc3-6b110685bf9d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.399784 Jul 19 19:48:04.179839 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 326/640] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:03 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:04.189325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:04.190694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Failed to fetch instance by id 999 {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:48:04.191408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Request method failure captured: Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 37 Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wovlRiTNC34FMYlKnw-uFQig1MhpsRTiBXcT_nFXoCNcvtlgYmxL4PANQKyCp7NIlLKrX11vITT0GVk-vr78xQT1FsJNg41eGD8ooVlcwtNnT9dAC8YH6HGmfvxRyLZAiWDu7VGj-dOMabfPeYYSmfY6l-18NXQfE0mZZBpn3nwrKg Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:48:04.202029 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/94ebea962216481c812e8605e9e5043c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/94ebea962216481c812e8605e9e5043c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_94ebea962216481c812e8605e9e5043c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 94ebea962216481c812e8605e9e5043c Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-45473105 Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8f45f8b3ddbb4ceeb9fd0a820abadb96 Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminNegativeTestJSON-45473105-project-admin Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: {"os-resetState": {"state": "error"}} Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:04.203609 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 999 could not be found. Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:04.204561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:04.205921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:04.207830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ceb40da6-d1a4-4248-ae26-4ffea5656f38 tempest-ServersAdminNegativeTestJSON-45473105 tempest-ServersAdminNegativeTestJSON-45473105-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025652 Jul 19 19:48:04.210626 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 327/641] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Jul 19 19:48:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:04.225193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:04.228363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:04.238201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.239095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.240111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.240732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.749338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:04.763498 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a2f7f1e-0f16-4183-b366-694262e4d32f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1467 microversion: 2.1 time: 0.696271 Jul 19 19:48:04.765257 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 315/642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:04 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1467 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:04.780255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:04.781402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:04.791760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:04.793887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.794331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.795102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.795531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.803087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6c92e69-a6c9-4487-97a0-08eb0195b627 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.588431 Jul 19 19:48:04.803695 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 328/643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:04 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:04.811584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:04.813315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:04.825328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.826077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.827178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.827798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.858378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:05.022425 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe2e1da8-9289-47a3-9d58-5d7248271c8e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 204 len: 0 microversion: 2.1 time: 0.215780 Jul 19 19:48:05.023998 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 329/644] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:04 2022] DELETE /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:05.034284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.035337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:05.044406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.045159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.046145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.046737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.057013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.068929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.070538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.072414 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52a302a2-3173-4f2b-aebf-7ef5c30f100b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1543 microversion: 2.25 time: 0.303463 Jul 19 19:48:05.086911 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 316/645] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:04 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1543 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:05.106179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.112808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.113676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Searching by: {'reservation_id': 'r-mivhwojt', 'deleted': False, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:48:05.123577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.124128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.124925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.125360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.293354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:48:05.313361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.322463 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cdcfca7-02a2-4d7a-a1a9-b7e7500c8e5b tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.293954 Jul 19 19:48:05.323781 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 330/646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:05.336816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.337658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:05.344731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.345416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.346347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.347504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.441938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.454119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.455737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.903315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.920574 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-62e7ed84-e13b-4297-b8b6-2fe609ea6e75 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1468 microversion: 2.1 time: 0.595251 Jul 19 19:48:05.921292 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 331/647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1468 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:05.926133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc9478e6-0c3f-44ab-93b6-b2aaf141027c tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '.version_select at 0x7fb88e219ca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.936300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc9478e6-0c3f-44ab-93b6-b2aaf141027c tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.937169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc9478e6-0c3f-44ab-93b6-b2aaf141027c tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.950346 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bc9478e6-0c3f-44ab-93b6-b2aaf141027c tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2184 microversion: 2.25 time: 0.027760 Jul 19 19:48:05.951294 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 332/648] 10.222.0.33 () {60 vars in 1183 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/os-migrations => generated 2184 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:05.956012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.956862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:05.963420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.964242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.965083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.965571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.975577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a2a4b48-981f-4908-8e65-6229723b8d08 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-mivhwojt" status: 200 len: 2929 microversion: 2.1 time: 0.887134 Jul 19 19:48:05.976510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 317/649] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mivhwojt => generated 2929 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.230463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b2d55f4-2afb-456e-aaf8-aa43ceb18ca6 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Action: 'create', calling method: .version_select at 0x7fb88e367ca0>, body: {"keypair": {"name": "tempest-keypair-1747104151", "type": "ssh", "user_id": "2037e6b75a864183a13700d0725c28c7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAexC6+7vcSai5QvhXZyyFwcI2PuVz1IdopmROkNEwgp0wq+FprfiUDLmN/Bust3/ySkCemKHGU1ADiAgC1smtRb3CvSj0YPX3O2ZSSWwCakce7pUG0HMDhISMueriEspA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:06.266966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4b2d55f4-2afb-456e-aaf8-aa43ceb18ca6 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:06.285803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4b2d55f4-2afb-456e-aaf8-aa43ceb18ca6 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for user 8e57549ca18d4092adff9325f9a3e47e and project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:06.344716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b2d55f4-2afb-456e-aaf8-aa43ceb18ca6 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.367055 Jul 19 19:48:06.345326 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 318/650] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 19:48:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 368 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:48:06.356275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.359285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.366150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.366861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.367792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.368396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.531965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:06.542344 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-21e238a7-4184-45a4-aba2-300c467156ea tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.589741 Jul 19 19:48:06.558955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 333/651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.566328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.569441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.577985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.581882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.583539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.584975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.656084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:06.664170 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-014f6dd2-76fc-43ae-a9fe-61de63389da4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.317817 Jul 19 19:48:06.665840 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 319/652] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.681488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f232ba8-0be9-444e-b523-192572008801 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.703471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.server_groups [None req-6f232ba8-0be9-444e-b523-192572008801 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Querying cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) for 2 instances {{(pid=126007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 19:48:06.704310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f232ba8-0be9-444e-b523-192572008801 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.704751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f232ba8-0be9-444e-b523-192572008801 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.741584 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f232ba8-0be9-444e-b523-192572008801 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/68bf49ec-613e-4e88-a36d-874fd7e73dbd" status: 200 len: 266 microversion: 2.1 time: 0.074326 Jul 19 19:48:06.747427 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 320/653] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/os-server-groups/68bf49ec-613e-4e88-a36d-874fd7e73dbd => generated 266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:06.747427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ccd50fe5-4140-4231-be45-59e710b3d643 req-b183182c-e5d0-45c8-a6ce-c0365555fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:06.756754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ccd50fe5-4140-4231-be45-59e710b3d643 req-b183182c-e5d0-45c8-a6ce-c0365555fe1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.757388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ccd50fe5-4140-4231-be45-59e710b3d643 req-b183182c-e5d0-45c8-a6ce-c0365555fe1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.772514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ccd50fe5-4140-4231-be45-59e710b3d643 req-b183182c-e5d0-45c8-a6ce-c0365555fe1a service nova] Creating event network-changed:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h1-843861-3 Jul 19 19:48:06.776766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ccd50fe5-4140-4231-be45-59e710b3d643 req-b183182c-e5d0-45c8-a6ce-c0365555fe1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Jul 19 19:48:06.777848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 321/654] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:06.785367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.786202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.796730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.797171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.798262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.798520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.836950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:07.264347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:07.294399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:07.421357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:07.437094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca682ada-d847-4393-9742-6074fc309d19 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 2036 microversion: 2.25 time: 0.875950 Jul 19 19:48:07.438022 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 334/655] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 2036 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:07.442857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de235326-c8b6-4aec-b504-138a3eff9f05 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Action: 'create', calling method: .version_select at 0x7fb88e1fb040>, body: {"keypair": {"name": "tempest-keypair-1525832591", "type": "ssh", "user_id": "2037e6b75a864183a13700d0725c28c7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqG1tVfFbFLeq5bxAthHefW5MwYMdNGDk3X73uuB9NMOWKQf/TR8Oy4g1wJj3sFfmI5GXky8mIWYPi9xj8mrZbyi7//KVBGrCQWvqbB0RKyT3NGhde+TPtSj0W6N5l0ZQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:07.464301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-de235326-c8b6-4aec-b504-138a3eff9f05 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:07.470653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-de235326-c8b6-4aec-b504-138a3eff9f05 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for user 8e57549ca18d4092adff9325f9a3e47e and project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:07.539431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de235326-c8b6-4aec-b504-138a3eff9f05 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.100121 Jul 19 19:48:07.545752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 335/656] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 19:48:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:48:07.550873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:07.551648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:07.556914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:07.562677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:07.563340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:07.564438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:07.565309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:07.766823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:07.776841 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a2e4c4df-c651-4125-8f81-b5c29edb0d78 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.996060 Jul 19 19:48:07.777732 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 322/657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:07.783222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:07.784164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:07.799375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:07.800231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:07.801222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:07.801846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.137399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dad8dec3-c1a8-4266-841c-2cb8b95c55da tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 200 len: 1620 microversion: 2.1 time: 0.590592 Jul 19 19:48:08.148583 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 336/658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:07 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 1620 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:08.153480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53f94ceb-84af-45b0-8543-a61b80fab10e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: .version_select at 0x7fb88e1e65e0>, body: {"keypair": {"name": "tempest-keypair-2077298325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEt7/aVAlttcHsSG21yEpVKfz8NTcaTPjLH4zyDDAvapYKp2f/B/6Y8GO+OCkbmoC7MEQpzuewFIs0Emhruts1CH+JqpECgD0hJB53n6XvVjzzCcNy2NgeH99oaA5CgTQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:08.171567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-53f94ceb-84af-45b0-8543-a61b80fab10e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for project 5577704b5db34579abdb9bba3932b73b. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:08.177715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-53f94ceb-84af-45b0-8543-a61b80fab10e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for user 937de5092f1d4e10b36c151ebf1db333 and project 5577704b5db34579abdb9bba3932b73b. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:08.205054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53f94ceb-84af-45b0-8543-a61b80fab10e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.065803 Jul 19 19:48:08.210857 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 337/659] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 19:48:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:48:08.210857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36658fba-ccc7-480b-b59e-98ded9ff718b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Calling method '.version_select at 0x7fb88e24d040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.220644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36658fba-ccc7-480b-b59e-98ded9ff718b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1747104151?user_id=2037e6b75a864183a13700d0725c28c7" status: 200 len: 512 microversion: 2.10 time: 0.013891 Jul 19 19:48:08.221191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 338/660] 10.222.0.33 () {60 vars in 1339 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1747104151?user_id=2037e6b75a864183a13700d0725c28c7 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:08.226037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.226656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:08.236964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.237417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.238208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.238643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.400017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:08.414557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab258d7e-82c2-4ac2-850f-b2e1cd5c8193 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1468 microversion: 2.1 time: 0.635414 Jul 19 19:48:08.415511 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 323/661] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:07 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1468 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:08.422008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.422921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:08.429892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.430454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.431622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.432148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.732243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:08.742790 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cc46aed-0837-497a-a142-2a43351c5481 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.520452 Jul 19 19:48:08.756719 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 339/662] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:08.764301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-61811797-fe35-4827-aca4-828af248f04b req-2972c83c-4446-4a0e-bc01-5d7d2e424dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "name": "network-vif-plugged", "status": "completed", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:08.775060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61811797-fe35-4827-aca4-828af248f04b req-2972c83c-4446-4a0e-bc01-5d7d2e424dab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.775716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61811797-fe35-4827-aca4-828af248f04b req-2972c83c-4446-4a0e-bc01-5d7d2e424dab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.789497 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-61811797-fe35-4827-aca4-828af248f04b req-2972c83c-4446-4a0e-bc01-5d7d2e424dab service nova] Creating event network-vif-plugged:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:08.797721 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-61811797-fe35-4827-aca4-828af248f04b req-2972c83c-4446-4a0e-bc01-5d7d2e424dab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037309 Jul 19 19:48:08.798628 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 340/663] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:08.804358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.809621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:08.816528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.817285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.818828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.820023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.994323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.004241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0481d68-fb32-403f-9c52-5dc9cfc02db8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.585794 Jul 19 19:48:09.014891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 324/664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.020482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-429923e1-b0d9-493f-b0d8-115e40ac069b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Action: 'create', calling method: .version_select at 0x7fb88e0d0430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1926099276", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuY59Ydbu/ScSmPHB/6NuWNR27O+/twgOMEUg+S2GjfM8lvsdm54IVUGCyQaXO8AnsqirlFU7hwwddOE+s/o4XM/eeKb4n1qAmlWMO4NtNXREFNHZwFNQjJ6IXn17UYsg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:09.043606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-429923e1-b0d9-493f-b0d8-115e40ac069b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:09.051203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-429923e1-b0d9-493f-b0d8-115e40ac069b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Getting quotas for user 8e57549ca18d4092adff9325f9a3e47e and project afe0d071086c4079a6928b7890abd92b. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:09.088634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-429923e1-b0d9-493f-b0d8-115e40ac069b tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.071164 Jul 19 19:48:09.089756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 325/665] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 19:48:09 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:48:09.106277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1a58c58-b1de-4485-b44f-4260a929559f tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1618 microversion: 2.1 time: 0.305408 Jul 19 19:48:09.106898 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 341/666] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1618 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.123558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.124285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:09.131362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.132131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.133117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.133734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.231497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b94ebea-ce09-471b-bed2-3787930b738d tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Action: 'create', calling method: .version_select at 0x7fb88e20d9d0>, body: {"keypair": {"name": "tempest-keypair-728376678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJRD8rwSUNLau2FqJWllR9iB6a62PZXPlddJiun5iCrxw0ofd0ajAT0cSCXIZGge12rSjXcsCPB/ed2U8Z5FtCDfAP5SOGsfq68mAsUq93IIL9XojRVHHp1h1xAWTADAQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:09.247175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b94ebea-ce09-471b-bed2-3787930b738d tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Getting quotas for project cdc76d55bfad4286830d598a8c47d0fe. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:09.253918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b94ebea-ce09-471b-bed2-3787930b738d tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Getting quotas for user 5388effbf8a4448e9922d65b33d5e35c and project cdc76d55bfad4286830d598a8c47d0fe. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:09.283267 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b94ebea-ce09-471b-bed2-3787930b738d tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192289 Jul 19 19:48:09.289424 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 326/667] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:48:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:09.289424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f9512381-853e-4866-9997-7c0f7aeab3d5 req-46af1c3f-174b-444c-b3db-d5fbd9b48a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d9cbfa-c3bf-4a90-9028-aef627a173a6", "name": "network-vif-deleted", "tag": "76460fc4-2d88-431c-9477-8111202e7dc3"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:09.299403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f9512381-853e-4866-9997-7c0f7aeab3d5 req-46af1c3f-174b-444c-b3db-d5fbd9b48a27 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.299994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f9512381-853e-4866-9997-7c0f7aeab3d5 req-46af1c3f-174b-444c-b3db-d5fbd9b48a27 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.313794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f9512381-853e-4866-9997-7c0f7aeab3d5 req-46af1c3f-174b-444c-b3db-d5fbd9b48a27 service nova] Creating event network-vif-deleted:76460fc4-2d88-431c-9477-8111202e7dc3 for instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 on n-h1-843861-3 Jul 19 19:48:09.314130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.320891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f9512381-853e-4866-9997-7c0f7aeab3d5 req-46af1c3f-174b-444c-b3db-d5fbd9b48a27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Jul 19 19:48:09.322154 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 327/668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:09.325493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f5c1d06-24a0-48b8-911c-a8d1e845444f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.212173 Jul 19 19:48:09.327015 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 342/669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.327589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-81b75e2e-f4cb-49fe-a6eb-da2e13921d52 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Calling method '.version_select at 0x7fb88e0d0550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.330203 n-d-843861-3 devstack@n-api.service[126007]: WARNING oslo_db.sqlalchemy.utils [None req-81b75e2e-f4cb-49fe-a6eb-da2e13921d52 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:48:09.332334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: .version_select at 0x7fb88e24d1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-507554673", "policies": ["anti-affinity"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:09.346080 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-81b75e2e-f4cb-49fe-a6eb-da2e13921d52 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=2037e6b75a864183a13700d0725c28c7" status: 200 len: 726 microversion: 2.10 time: 0.022540 Jul 19 19:48:09.348418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 328/670] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/os-keypairs?user_id=2037e6b75a864183a13700d0725c28c7 => generated 726 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:09.351128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:09.358139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9583f3e4-d22a-45d3-a8d8-39568ba35474 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Calling method '.version_select at 0x7fb88e0d0dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.358513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:09.414551 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9583f3e4-d22a-45d3-a8d8-39568ba35474 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1926099276" status: 204 len: 0 microversion: 2.10 time: 0.059847 Jul 19 19:48:09.416934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 329/671] 10.222.0.33 () {60 vars in 1324 bytes} [Tue Jul 19 19:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1926099276 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:48:09.438308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-038b7569-ae23-448a-87b0-070011a4918e tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Calling method '.version_select at 0x7fb88e8f9700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.479592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:09.487716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:09.506553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6fe66988-9c96-4e65-9709-342d9b7ac291 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.178092 Jul 19 19:48:09.507520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-038b7569-ae23-448a-87b0-070011a4918e tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525832591?user_id=2037e6b75a864183a13700d0725c28c7" status: 204 len: 0 microversion: 2.10 time: 0.083442 Jul 19 19:48:09.514399 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 330/672] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525832591?user_id=2037e6b75a864183a13700d0725c28c7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:48:09.518727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 343/673] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Jul 19 19:48:09 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:09.526965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab71f7b7-ac5e-406d-a3ad-43da5514c620 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] Calling method '.version_select at 0x7fb88e24d820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.544969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.548429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:09.553420 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab71f7b7-ac5e-406d-a3ad-43da5514c620 tempest-KeyPairsV210TestJSON-218773045 tempest-KeyPairsV210TestJSON-218773045-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747104151?user_id=2037e6b75a864183a13700d0725c28c7" status: 204 len: 0 microversion: 2.10 time: 0.032092 Jul 19 19:48:09.555674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 344/674] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747104151?user_id=2037e6b75a864183a13700d0725c28c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:48:09.581369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.588918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.590619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.597413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.704834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.707538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.708275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lazy-loading 'fault' on Instance uuid 24d9cbfa-c3bf-4a90-9028-aef627a173a6 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:09.710551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-217333653", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d98a12ee-897b-491a-b996-28bfa8fc06e7"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:09.791139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:09.823376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.840791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffb2cfe8-9e46-4f2c-bd8c-55f3c3dbe1a3 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 200 len: 1311 microversion: 2.1 time: 0.324149 Jul 19 19:48:09.841817 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 331/675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.846647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.847466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:09.868475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.868910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.869683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.870111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.116569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:10.135582 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b9a8f10-9cdf-4d32-9c4b-7563d6d3368c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.292083 Jul 19 19:48:10.136755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 332/676] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:10.154871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.156193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.170976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.171463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.185674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.186131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.236243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:10.236868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:10.237346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:10.237754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:10.238162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:10.279302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.279990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.281689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.282248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.309876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:10.317190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:10.334621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 2 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:10.339927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:10.384256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:10.384809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126008) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 19:48:10.394845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f704145f-c562-48d2-b814-0e87c5bb0a15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.255602 Jul 19 19:48:10.406718 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 333/677] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:10.408564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:10.413365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-900984869", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "be49fee4-8a96-4ded-8c00-6bf222c5131e"}], "security_groups": [{"name": "tempest-securitygroup--2137728324"}], "key_name": "tempest-keypair-2077298325", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:10.416413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:10.504905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:10.512771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:10.536171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=57d7f6c4-be10-45cb-9e6a-adbd7f1066c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:10.559122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] validate_networks() for [('be49fee4-8a96-4ded-8c00-6bf222c5131e', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:10.564190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:10.609945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:10.615298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:10.666521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:10.674231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'server_group_members'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:10.718608 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1786bb12-7120-4fea-a167-5e32ef364f47 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.013232 Jul 19 19:48:10.722578 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 345/678] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:48:10.727861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.729517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.738577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.739037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.740047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.740511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.746214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:11.473930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:11.485800 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1940c7d3-b54d-41e5-b389-242c1e5cb7df tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.764553 Jul 19 19:48:11.498542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 346/679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:11.503384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:11.512830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:11.514600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Searching by: {'deleted': False, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:48:11.558390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.559438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.560559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.561870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.624399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:48:11.701770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa9b816b-90ef-473c-a2ef-94670bb06cf2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.209890 Jul 19 19:48:11.710792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 347/680] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:48:11 2022] GET /compute/v2.1/servers => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:11.728935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:11.734048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 24d9cbfa-c3bf-4a90-9028-aef627a173a6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:11.746117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.749234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.751884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.754512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.809225 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] HTTP exception thrown: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Request method failure captured: Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 HTTP/1.1 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wouNmCknEn2qVjctdUqLObODO5bfhCk2XbqVaYIOKK7monH8p-DlHm3-oNcZ9XlvEn21RZiWEY0_QDcrH8Lr-yfR0cVf6nu3ktmr_LzLtCmKho48x1F5AYPKJui35x1CRNlhH_MnS41oCDFdeQm7Rf3whbLc3oBxXY6wAELathr21Q Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2ded267358b64e77b1a6a4a2b34be879 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:48:11.810976 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2ded267358b64e77b1a6a4a2b34be879 Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminNegativeTestJSON-462795230-project Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d5f935eb5a74b60bbbf066bdd6d901f Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminNegativeTestJSON-462795230-project Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. Jul 19 19:48:11.812288 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '24d9cbfa-c3bf-4a90-9028-aef627a173a6'} Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:11.813013 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. Jul 19 19:48:11.814180 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:11.815202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Returning 404 to user: Instance 24d9cbfa-c3bf-4a90-9028-aef627a173a6 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:11.815202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ca1a105-cc91-4215-930f-671159a38f0e tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6" status: 404 len: 111 microversion: 2.1 time: 0.101005 Jul 19 19:48:11.819367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 348/681] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:11 2022] GET /compute/v2.1/servers/24d9cbfa-c3bf-4a90-9028-aef627a173a6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:11.824679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:11.825307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:11.834884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.835407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.836255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.836691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.857808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:11.858332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:11.858689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:11.859101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:11.859553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:11.866138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:11.900441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.902289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.907343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.909713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.959047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:11.967844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for user 937de5092f1d4e10b36c151ebf1db333 and project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:11.984494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:11.988373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:12.067678 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce7a63ca-0728-4c3d-a74f-5d931bbf0b2e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.659357 Jul 19 19:48:12.070487 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 334/682] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:48:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:48:12.092669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.092885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.113930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.120875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.124539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.126027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.262312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:12.277711 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-088b9512-b107-4dce-af2a-48bcb5cbc8f2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.457107 Jul 19 19:48:12.278302 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 349/683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:11 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:12.290482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-831025367", "imageRef": "92b69ce2-e79d-48b5-8b82-709ba5617cf7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2afddbd7-61cc-4493-acaf-cfd828e10fa9"}], "security_groups": [{"name": "tempest-securitygroup--467110262"}], "key_name": "tempest-keypair-728376678", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:12.595701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] validate_networks() for [('2afddbd7-61cc-4493-acaf-cfd828e10fa9', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:12.688045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:12.697583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b079713-f15f-4f8b-b222-a9488fe023a8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.625647 Jul 19 19:48:12.699239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 335/684] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:12 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:12.707902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.708957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.725174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.725672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.726706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.727144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.909749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:12.921318 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19d67791-25a4-4e55-a1ae-32f71de2d901 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1278 microversion: 2.1 time: 0.220825 Jul 19 19:48:12.933835 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 336/685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:12 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:12.939874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.940606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.947267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.948097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.949093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.949739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.001288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:13.118251 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a32e69f4-db3c-4bb4-b50c-ae465528c4f8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 204 len: 0 microversion: 2.1 time: 0.182236 Jul 19 19:48:13.124758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 337/686] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:12 2022] DELETE /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:13.132014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.133122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.155726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.156246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.157045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.157508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.331354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.348240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.350594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.352207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-170e28b8-ff0d-4ef6-9b26-0d7d01919b12 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1281 microversion: 2.25 time: 0.224742 Jul 19 19:48:13.353535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 338/687] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:13.372259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.373351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.382881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.387322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.388510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.389251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.601345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:13.601870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:13.602246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:13.602661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:13.603611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:13.614067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.615241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.615695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.616578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.617020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.624390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59532078-0eea-4f99-82c2-d2d55e4afdec tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1324 microversion: 2.1 time: 0.269287 Jul 19 19:48:13.624988 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 339/688] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:13.629389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8b363679-a5f1-4e64-96a6-5b70fc6a662a req-d5f5d83f-9e3f-49b6-a41a-6a3e10753540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "name": "network-vif-unplugged", "status": "completed", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:13.640261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Getting quotas for project cdc76d55bfad4286830d598a8c47d0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:13.640503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8b363679-a5f1-4e64-96a6-5b70fc6a662a req-d5f5d83f-9e3f-49b6-a41a-6a3e10753540 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.640789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8b363679-a5f1-4e64-96a6-5b70fc6a662a req-d5f5d83f-9e3f-49b6-a41a-6a3e10753540 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.645604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Getting quotas for user 5388effbf8a4448e9922d65b33d5e35c and project cdc76d55bfad4286830d598a8c47d0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:13.657193 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8b363679-a5f1-4e64-96a6-5b70fc6a662a req-d5f5d83f-9e3f-49b6-a41a-6a3e10753540 service nova] Creating event network-vif-unplugged:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h1-843861-3 Jul 19 19:48:13.662980 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8b363679-a5f1-4e64-96a6-5b70fc6a662a req-d5f5d83f-9e3f-49b6-a41a-6a3e10753540 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036197 Jul 19 19:48:13.663597 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 340/689] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:13.669564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.670276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.678578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.679033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.679917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.680277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.683217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:13.686720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92b69ce2-e79d-48b5-8b82-709ba5617cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:13.752515 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da6a28fc-a3cf-41c5-b92a-9156502ee059 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.469756 Jul 19 19:48:13.753792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 350/690] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:13.766037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.768111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.777842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.778596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.781027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.783083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.932375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.952684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db00bc11-1fbf-4963-8803-6dd78435f382 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1477 microversion: 2.1 time: 0.279897 Jul 19 19:48:13.953669 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 341/691] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:13.967375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.968528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.976161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.977000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.978455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.979083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.137793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.146392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57fda027-d5a3-498d-8f70-f678e3ccfc46 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 0.389660 Jul 19 19:48:14.148290 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 351/692] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.166312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e3ec852-b343-4edc-81db-9a84e587b571 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.167224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e3ec852-b343-4edc-81db-9a84e587b571 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.344553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e3ec852-b343-4edc-81db-9a84e587b571 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.357408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e3ec852-b343-4edc-81db-9a84e587b571 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1244 microversion: 2.1 time: 0.194987 Jul 19 19:48:14.358874 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 352/693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1244 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.369470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.371134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.399350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.402637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.405012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.406873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.446027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.463463 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d325cab9-1a0a-4574-9364-7518532f7bb8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.506060 Jul 19 19:48:14.467967 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 342/694] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.490845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f8bbe602-2fb3-4a25-9728-c64465e67609 req-7e900ed2-73e3-4065-89a3-74d759b912ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d6ae0e-2945-4327-acef-5be53b8d649e", "name": "network-vif-plugged", "status": "completed", "tag": "78fdbece-5f32-4a6c-9006-5bb3bceb65d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:14.509678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f8bbe602-2fb3-4a25-9728-c64465e67609 req-7e900ed2-73e3-4065-89a3-74d759b912ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.511688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f8bbe602-2fb3-4a25-9728-c64465e67609 req-7e900ed2-73e3-4065-89a3-74d759b912ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.565845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f8bbe602-2fb3-4a25-9728-c64465e67609 req-7e900ed2-73e3-4065-89a3-74d759b912ef service nova] Creating event network-vif-plugged:78fdbece-5f32-4a6c-9006-5bb3bceb65d0 for instance 93d6ae0e-2945-4327-acef-5be53b8d649e on n-h2-843861-3 Jul 19 19:48:14.578721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f8bbe602-2fb3-4a25-9728-c64465e67609 req-7e900ed2-73e3-4065-89a3-74d759b912ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104434 Jul 19 19:48:14.587423 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 343/695] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:14.607914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.608786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.616645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.618508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.618953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.629520 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fe7141a-7509-44c2-8879-924c1706ffe2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1276 microversion: 2.1 time: 0.266176 Jul 19 19:48:14.630699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.631577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.634034 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 353/696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.675433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.676607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.687090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:14.698122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.700435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.703357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.705349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.978779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.992488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.997815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.999349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d57094e-763a-4129-abf6-6f24dd2ce0a6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1355 microversion: 2.25 time: 0.409500 Jul 19 19:48:15.000111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 344/697] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1355 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:15.232756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e266310>, body: {"quota_set": {"ram": "5120"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:15.306447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.306993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.307888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.308397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.413893 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26974672-eea7-4c26-8641-f78c8add8d20 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb" status: 200 len: 240 microversion: 2.36 time: 0.411783 Jul 19 19:48:15.414609 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 345/698] 10.222.0.33 () {62 vars in 1302 bytes} [Tue Jul 19 19:48:15 2022] PUT /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb => generated 240 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:15.419578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:15.420635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:15.427395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.428043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.429036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.429569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.846311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:15.854580 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6655f83-c1af-4b7a-8531-6c4fe447de33 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 200 len: 1520 microversion: 2.1 time: 1.216517 Jul 19 19:48:15.867469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 354/699] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 1520 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:15.873244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:15.874140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:15.882124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.882969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.884442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.885876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.279831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:16.307306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b5c4f4a-72d2-442d-9633-7f02d8325208 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1477 microversion: 2.1 time: 0.890139 Jul 19 19:48:16.316804 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 346/700] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:15 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1477 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:16.316804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.316804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:16.325349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.326076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.326925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.327369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.634601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:16.643719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abb1a733-7a9c-4b68-bc71-b58c3b3caf14 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1302 microversion: 2.1 time: 0.334261 Jul 19 19:48:16.646668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 347/701] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1302 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:16.654504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Calling method '.version_select at 0x7fb88e20d4c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.760902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.761354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.762157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.762815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.809275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46553458-a774-4798-93e6-c7ea2cdaa153 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb/detail" status: 200 len: 672 microversion: 2.36 time: 0.158382 Jul 19 19:48:16.821874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 348/702] 10.222.0.33 () {60 vars in 1303 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb/detail => generated 672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:16.826925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.827732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:16.853970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.855358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.858370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.863208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.877986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:16.899184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aec93590-aee2-44e0-8e85-748bee5df2e7 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1386 microversion: 2.1 time: 1.026661 Jul 19 19:48:16.913039 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 355/703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:15 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1386 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:16.928514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.931216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:16.959306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.959306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.959306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.959306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.820448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:17.831956 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67e8db8c-10b3-4454-a1a0-167383047347 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 1.006313 Jul 19 19:48:17.847587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 349/704] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:17.855139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: .version_select at 0x7fb890b0fd30>, body: {"addFloatingIp": {"address": "172.25.7.26"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:17.859693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:17.876507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.876959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.877749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.878702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:18.033955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Acquired lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:18.347206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:18.368771 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7eb0363-1ccd-42a2-9b27-bfe350227912 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 1.453587 Jul 19 19:48:18.369681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 356/705] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:18.375761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:18.376638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:18.393737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:18.396564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:18.397602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:18.402472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:19.632952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:19.645363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:19.647383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:19.659329 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aca6d05-5706-46fc-bb4d-db198767a6fa tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1411 microversion: 2.25 time: 1.288139 Jul 19 19:48:19.676216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 357/706] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:18 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1411 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:19.696257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-68c52870-797a-4132-a78f-7b198b2fe75d req-bc2e4931-d413-41b9-a93b-e039ddc6b0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:19.712738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-68c52870-797a-4132-a78f-7b198b2fe75d req-bc2e4931-d413-41b9-a93b-e039ddc6b0f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:19.713559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-68c52870-797a-4132-a78f-7b198b2fe75d req-bc2e4931-d413-41b9-a93b-e039ddc6b0f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:19.730050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-68c52870-797a-4132-a78f-7b198b2fe75d req-bc2e4931-d413-41b9-a93b-e039ddc6b0f0 service nova] Creating event network-changed:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:48:19.753634 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-68c52870-797a-4132-a78f-7b198b2fe75d req-bc2e4931-d413-41b9-a93b-e039ddc6b0f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073832 Jul 19 19:48:19.755741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 358/707] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:19.762522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e0b6af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:19.916733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:19.918250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:19.920360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:19.922054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.009189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.025225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.026889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.028448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.130331 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11e08002-7283-45a7-8d6d-c91e41efe5b7 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb?user_id=567424fcd7ba47dc9fbd7420a6d44e35" status: 200 len: 240 microversion: 2.36 time: 0.372866 Jul 19 19:48:20.131563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 359/708] 10.222.0.33 () {62 vars in 1383 bytes} [Tue Jul 19 19:48:19 2022] PUT /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb?user_id=567424fcd7ba47dc9fbd7420a6d44e35 => generated 240 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:20.137043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:20.137776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:20.146378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.147084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.148325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.148983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.190150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.190595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.191044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lazy-loading 'fault' on Instance uuid 08d5a511-d1d6-40e2-a3c4-055c7c6a192c {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:20.272303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:20.281239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb5a231b-5d69-474d-a443-433eb2b7359b tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1311 microversion: 2.1 time: 0.148692 Jul 19 19:48:20.282008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 360/709] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:20 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:20.294199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:20.294199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:20.303915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.303915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.303915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.303915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.513371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:20.526962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01e4d6a6-d26f-4ec1-b11d-e098d8e01b34 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1302 microversion: 2.1 time: 0.243806 Jul 19 19:48:20.538002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 361/710] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:20 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:20.543135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:20.543761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:20.546991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:20.561817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.562286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.563066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.563502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:22.188283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:22.206583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d6316f7-08f4-4385-b193-f424ddd7e92f tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1586 microversion: 2.1 time: 1.667412 Jul 19 19:48:22.211131 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 362/711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:20 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1586 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:22.224857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:22.238401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:22.257556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:22.258151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:22.258953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:22.259391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:23.089501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:23.110114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8551307e-3458-4a48-be77-364632fae0fa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1502 microversion: 2.1 time: 0.892560 Jul 19 19:48:23.111390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 363/712] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:22 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1502 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:23.125328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:23.128486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:23.141143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:23.144092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:23.147992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:23.148677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:23.808781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:23.819328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f38dacef-0f30-46ed-9724-910e4be55b0f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 0.706381 Jul 19 19:48:23.819960 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 364/713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:23 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:23.833692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-445e48bc-169c-4789-84a1-57e0939c86e3 req-e7ba8a32-2ba1-44d0-9ea8-6a8a5830ebdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d5a511-d1d6-40e2-a3c4-055c7c6a192c", "name": "network-vif-deleted", "tag": "c7003400-b0ae-4535-ab0f-94b03d89dc9a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:23.842826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-445e48bc-169c-4789-84a1-57e0939c86e3 req-e7ba8a32-2ba1-44d0-9ea8-6a8a5830ebdf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:23.843540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-445e48bc-169c-4789-84a1-57e0939c86e3 req-e7ba8a32-2ba1-44d0-9ea8-6a8a5830ebdf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:23.847951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:23.879544 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-445e48bc-169c-4789-84a1-57e0939c86e3 req-e7ba8a32-2ba1-44d0-9ea8-6a8a5830ebdf service nova] Creating event network-vif-deleted:c7003400-b0ae-4535-ab0f-94b03d89dc9a for instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c on n-h1-843861-3 Jul 19 19:48:23.891691 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-445e48bc-169c-4789-84a1-57e0939c86e3 req-e7ba8a32-2ba1-44d0-9ea8-6a8a5830ebdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061491 Jul 19 19:48:23.892619 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 365/714] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:23.904842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07d5dfc1-b6de-4183-9690-93e240788773 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] Calling method '.version_select at 0x7fb88e1fbc10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:24.008940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07d5dfc1-b6de-4183-9690-93e240788773 tempest-QuotasAdminTestV236-245759158 tempest-QuotasAdminTestV236-245759158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb?user_id=567424fcd7ba47dc9fbd7420a6d44e35" status: 200 len: 282 microversion: 2.36 time: 0.114693 Jul 19 19:48:24.010582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 366/715] 10.222.0.33 () {60 vars in 1363 bytes} [Tue Jul 19 19:48:23 2022] GET /compute/v2.1/os-quota-sets/bd2d8a2bb3b74c43b077edd07588aaeb?user_id=567424fcd7ba47dc9fbd7420a6d44e35 => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:24.016388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:24.029879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:24.048129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.049980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:24.051094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.053160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:24.284608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Building network info cache for instance {{(pid=126007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:25.218844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.232993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.235387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.236820 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48d08927-f641-4649-90ca-e86f93f5fea3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1411 microversion: 2.25 time: 1.225038 Jul 19 19:48:25.237833 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 367/716] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:24 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1411 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:25.243157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:25.244078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:25.251578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.252286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.253383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.254017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.306267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.307354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.308211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lazy-loading 'fault' on Instance uuid 08d5a511-d1d6-40e2-a3c4-055c7c6a192c {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:25.406427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5f935eb5a74b60bbbf066bdd6d901f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ded267358b64e77b1a6a4a2b34be879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.416353 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34fc5ed7-d8ec-4d00-978e-de4890e352e8 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 200 len: 1311 microversion: 2.1 time: 0.175215 Jul 19 19:48:25.417747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 368/717] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:25 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:25.422833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:25.425266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:25.432716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.433249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.434107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.434621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.957887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.975828 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-04e73968-3af3-4bc1-9a06-80f06e8b0ca8 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.556343 Jul 19 19:48:25.977049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 369/718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:25 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:25.983895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:25.984874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:26.001332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.002593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.005202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.005924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.288150 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72413d9c-5b7c-46bb-9405-c3142c01cb70 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.309896 Jul 19 19:48:26.295763 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 370/719] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:48:25 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:26.304040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:26.305298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:26.312478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.313465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.314766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.315507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.681222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Updating instance_info_cache with network_info: [{"id": "a9ec7238-b9f7-415f-9933-0d12e2c06a74", "address": "fa:16:3e:b4:0a:1e", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa9ec7238-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:26.710153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Releasing lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:26.713141 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffbaf683-af34-47cc-8ca0-d6d977b201cc tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action" status: 202 len: 0 microversion: 2.1 time: 8.862735 Jul 19 19:48:26.713846 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 350/720] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:17 2022] POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action => generated 0 bytes in 8866 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:26.720868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:26.721642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:26.730176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.730684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.732796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.733209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.761765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=30 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:26.784829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:26.789624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:26.797773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cce1059-6fe0-462c-8ef8-de6b74db5c41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1477 microversion: 2.1 time: 0.500871 Jul 19 19:48:26.810847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 371/721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:26 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:26.816769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-35213cba-f21b-48f8-9cfb-5afe419d766f req-14cd73db-04ee-4e39-ad18-a7a10ad92a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "name": "network-vif-plugged", "status": "completed", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:26.827791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-35213cba-f21b-48f8-9cfb-5afe419d766f req-14cd73db-04ee-4e39-ad18-a7a10ad92a9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.828342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-35213cba-f21b-48f8-9cfb-5afe419d766f req-14cd73db-04ee-4e39-ad18-a7a10ad92a9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.840317 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-35213cba-f21b-48f8-9cfb-5afe419d766f req-14cd73db-04ee-4e39-ad18-a7a10ad92a9e service nova] Creating event network-vif-plugged:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:48:26.846343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-35213cba-f21b-48f8-9cfb-5afe419d766f req-14cd73db-04ee-4e39-ad18-a7a10ad92a9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 Jul 19 19:48:26.847512 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 372/722] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:26.852943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3", "tag": "74ece4f1-e135-46b9-9e8e-c08313305083"}, {"name": "network-changed", "server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}, {"name": "network-changed", "server_uuid": "57d7f6c4-be10-45cb-9e6a-adbd7f1066c4", "tag": "855e56f4-5f45-4009-be1c-e1a31de4869c"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:26.862552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.863079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.878030 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Creating event network-changed:74ece4f1-e135-46b9-9e8e-c08313305083 for instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 on n-h1-843861-3 Jul 19 19:48:26.878624 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Creating event network-changed:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:48:26.879192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] Creating event network-changed:855e56f4-5f45-4009-be1c-e1a31de4869c for instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 on n-h2-843861-3 Jul 19 19:48:26.890732 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-04957b42-903d-49ee-b015-ca8d67aea22c req-f943713d-d183-43e7-a723-5d92f4aceb91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.041718 Jul 19 19:48:26.891440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 373/723] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:26.897954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:26.898994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:26.905818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.906515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.907677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.908171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.235780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:27.245623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a94d386-8b7e-4f86-a8bb-48e17b28b105 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 0.529277 Jul 19 19:48:27.246862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 351/724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:26 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:27.269896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:27.270741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] [instance: 08d5a511-d1d6-40e2-a3c4-055c7c6a192c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:27.277869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.278583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.279504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.280212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.296184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] HTTP exception thrown: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Request method failure captured: Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c HTTP/1.1 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wouNmCknEn2qVjctdUqLObODO5bfhCk2XbqVaYIOKK7monH8p-DlHm3-oNcZ9XlvEn21RZiWEY0_QDcrH8Lr-yfR0cVf6nu3ktmr_LzLtCmKho48x1F5AYPKJui35x1CRNlhH_MnS41oCDFdeQm7Rf3whbLc3oBxXY6wAELathr21Q Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2ded267358b64e77b1a6a4a2b34be879 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:48:27.297962 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ded267358b64e77b1a6a4a2b34be879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2ded267358b64e77b1a6a4a2b34be879 Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-462795230 Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminNegativeTestJSON-462795230-project Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d5f935eb5a74b60bbbf066bdd6d901f Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-462795230-project Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. Jul 19 19:48:27.299366 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '08d5a511-d1d6-40e2-a3c4-055c7c6a192c'} Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:27.301159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. Jul 19 19:48:27.303054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:27.305338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] Returning 404 to user: Instance 08d5a511-d1d6-40e2-a3c4-055c7c6a192c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:27.305338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68592249-bdc2-4cde-bf71-ee11961bc4c0 tempest-ServersAdminNegativeTestJSON-462795230 tempest-ServersAdminNegativeTestJSON-462795230-project] 10.222.0.33 "GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c" status: 404 len: 111 microversion: 2.1 time: 0.051352 Jul 19 19:48:27.305338 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 352/725] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:27 2022] GET /compute/v2.1/servers/08d5a511-d1d6-40e2-a3c4-055c7c6a192c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:27.308913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.26"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:27.309899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:27.312713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:27.316464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.317120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.318147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.318930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.331058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:27.332612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:27.333768 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95eb9e19-0dfb-4220-a1da-c6d55efef485 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1411 microversion: 2.25 time: 0.440841 Jul 19 19:48:27.334325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 374/726] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:26 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1411 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:27.338555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73d74130-71eb-4fd4-929a-f1b1c7522145 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '.version_select at 0x7fb88e237f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:27.351683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d74130-71eb-4fd4-929a-f1b1c7522145 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.352193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d74130-71eb-4fd4-929a-f1b1c7522145 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.361064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73d74130-71eb-4fd4-929a-f1b1c7522145 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.025745 Jul 19 19:48:27.361658 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 375/727] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:48:27 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:27.361820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Acquired lock "refresh_cache-7432f760-6895-4c0e-af5e-59fbe3c814c8" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:27.381135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:27.381846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:27.396593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.397280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.400028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:27.401530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.121093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:28.132276 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47dd00ea-7fb6-4633-88ec-eb67f8b5e9db tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.766818 Jul 19 19:48:28.132851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 376/728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:27 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:28.140565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:28.141179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:28.157097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.157548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.158331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.158756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.779937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a517c2fe-8657-48f8-bf8f-7995814469f1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1628 microversion: 2.1 time: 0.645824 Jul 19 19:48:28.781672 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 377/729] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:28 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1628 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:28.791844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:28.796226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:28.809620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.810075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.810847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.811278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:29.360049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:29.369540 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79a6fb06-a82d-45a3-a7bd-e6dc1ea69d0e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 200 len: 1586 microversion: 2.1 time: 0.586631 Jul 19 19:48:29.370428 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 378/730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:28 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 1586 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:29.375212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9da35125-9750-4b79-9a9d-718590bb1878 req-4dadc093-ddb3-4f08-9bdc-d973c73cdec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d6ae0e-2945-4327-acef-5be53b8d649e", "tag": "78fdbece-5f32-4a6c-9006-5bb3bceb65d0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:29.384531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9da35125-9750-4b79-9a9d-718590bb1878 req-4dadc093-ddb3-4f08-9bdc-d973c73cdec7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:29.385238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9da35125-9750-4b79-9a9d-718590bb1878 req-4dadc093-ddb3-4f08-9bdc-d973c73cdec7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:29.406268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9da35125-9750-4b79-9a9d-718590bb1878 req-4dadc093-ddb3-4f08-9bdc-d973c73cdec7 service nova] Creating event network-changed:78fdbece-5f32-4a6c-9006-5bb3bceb65d0 for instance 93d6ae0e-2945-4327-acef-5be53b8d649e on n-h2-843861-3 Jul 19 19:48:29.413272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9da35125-9750-4b79-9a9d-718590bb1878 req-4dadc093-ddb3-4f08-9bdc-d973c73cdec7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041375 Jul 19 19:48:29.414391 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 379/731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:29.433241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:29.434639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:29.445016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:29.445757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:29.446613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:29.447215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:29.969211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:29.976994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f19b212c-88c1-436e-b7ba-0f4bececbe96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 0.561149 Jul 19 19:48:29.977562 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 380/732] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:29 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:29.992879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:29.993535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:30.000303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.000948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.002145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.002722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.048104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=11 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:30.692570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:30.701170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:30.702807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:30.704084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8db18bb1-d7ed-442b-92f1-6fde755cfc9b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1411 microversion: 2.25 time: 0.715421 Jul 19 19:48:30.704954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 381/733] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:29 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1411 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:30.710405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e5b329b-2416-406e-a93b-d77b35576ad2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: .version_select at 0x7fb88e1c9940>, body: {"keypair": {"name": "tempest-keypair-1933181618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYtk3Tt369tR2lfnjUeHHXzNJzlKdVU8EOlxSl+Uey0U7W+6e5EKBoDNMTEwEuRWRU4Q7RU7vedykocy1P2u52+m1xcsN9w7RiQo5bAr9rb+8UX91ABjLUkvXsBLswjTg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:30.726970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8e5b329b-2416-406e-a93b-d77b35576ad2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:30.736905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8e5b329b-2416-406e-a93b-d77b35576ad2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for user 99eac0488e77448cb55a255d49ad2c58 and project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:30.763781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e5b329b-2416-406e-a93b-d77b35576ad2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057454 Jul 19 19:48:30.764490 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 382/734] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:48:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:30.776283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dc98e7c2-6693-49d5-9f60-1b26735d50f1 req-b38ce4ac-f274-4bea-ab9c-f3fa9adaa2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed09279-8d38-45cf-a366-26e46bf4eaf1", "tag": "1297fa33-cf14-4564-b2a4-57fca8cda87f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:30.790449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc98e7c2-6693-49d5-9f60-1b26735d50f1 req-b38ce4ac-f274-4bea-ab9c-f3fa9adaa2e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.790895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc98e7c2-6693-49d5-9f60-1b26735d50f1 req-b38ce4ac-f274-4bea-ab9c-f3fa9adaa2e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.809220 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dc98e7c2-6693-49d5-9f60-1b26735d50f1 req-b38ce4ac-f274-4bea-ab9c-f3fa9adaa2e4 service nova] Creating event network-changed:1297fa33-cf14-4564-b2a4-57fca8cda87f for instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 on n-h1-843861-3 Jul 19 19:48:30.815373 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dc98e7c2-6693-49d5-9f60-1b26735d50f1 req-b38ce4ac-f274-4bea-ab9c-f3fa9adaa2e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049420 Jul 19 19:48:30.816075 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 383/735] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:30.824182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:30.825189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:30.848069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.849765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.852083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.853275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.471189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:31.481024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6281a04f-556a-42bb-8a17-efe261608e95 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.663545 Jul 19 19:48:31.481655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 384/736] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:30 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:31.787243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:31.789616 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:31.789616 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:31.791182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.792014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.793479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.794930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.883325 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0009e4c-2bf0-4bdb-9908-11b48d1c10ed tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.400340 Jul 19 19:48:31.887953 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 385/737] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:48:31 2022] GET /compute/v2.1/os-services => generated 944 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:32.009231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-409416265", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:32.081147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:33.213435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:33.214065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:33.214650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:33.215179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:33.215899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:33.227476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.228121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.229721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.230334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.250480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Getting quotas for project a935a5f142994bfa905b6785251e9d52. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:33.256096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Getting quotas for user fe8cd277f71a4852a8402c7841cbee72 and project a935a5f142994bfa905b6785251e9d52. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:33.269601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:33.272225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:33.342725 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ea3f95f-f6af-450d-93a6-4a416af9b6f9 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452741 Jul 19 19:48:33.343672 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 386/738] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:33.351166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:33.352061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:33.359439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.360353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.361300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.361893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.565089 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.neutron [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] re-assign floating IP 172.25.7.26 from instance 5aff775e-62bf-47f1-8271-712f28a34bac Jul 19 19:48:33.601141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:33.610193 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1b9486a-5961-4ff8-8c34-35fc9f0da4a6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 0.264609 Jul 19 19:48:33.611255 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 387/739] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:33 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:33.616176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:33.616872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:33.624652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.627494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.628833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.629500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.702236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Building network info cache for instance {{(pid=126007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:33.885405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:33.904396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:33.909510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:33.911014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5d555a7-9f6e-4279-babc-685bbaba5f2c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1607 microversion: 2.25 time: 0.298601 Jul 19 19:48:33.911652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 388/740] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:33 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1607 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:33.918079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:33.921245 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:33.921245 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:33.922477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.928570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.930451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.931205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.942819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:33.964376 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b43fb8a-94f4-48c2-ae18-255c0a29a025 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.049394 Jul 19 19:48:33.965061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 389/741] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 19:48:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:33.970612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:33.971281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:33.980063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.980578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.981628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:33.982118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:34.229469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:34.238606 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9957ef6-47f0-4e4e-ace1-d0978cc8dae7 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.272313 Jul 19 19:48:34.248162 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 390/742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:33 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:34.248162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-871457384", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "58406271-8733-4495-9c0c-acccb6026722"}], "security_groups": [{"name": "tempest-securitygroup--17970854"}], "key_name": "tempest-keypair-1933181618", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:34.381032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] validate_networks() for [('58406271-8733-4495-9c0c-acccb6026722', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:34.567189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Updating instance_info_cache with network_info: [{"id": "a9ec7238-b9f7-415f-9933-0d12e2c06a74", "address": "fa:16:3e:b4:0a:1e", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa9ec7238-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:34.579523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Building network info cache for instance {{(pid=126007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:35.567377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:35.567871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:35.568329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:35.568742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:35.569286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:35.578049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.578502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.579329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.579767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.597288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:35.604680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for user 99eac0488e77448cb55a255d49ad2c58 and project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:35.608483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:35.623152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:35.625340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:35.677460 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76c7e7ad-69f2-45a4-a44c-7a28bd791697 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.436502 Jul 19 19:48:35.683451 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 391/743] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:34 2022] POST /compute/v2.1/servers => generated 404 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:35.684361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:35.685276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:35.693220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.694685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.696212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.697206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.801069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:35.812487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c58936ec-5e4e-4bd6-b5d6-b1a420daec90 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1271 microversion: 2.1 time: 0.133145 Jul 19 19:48:35.823848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 392/744] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:35 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:35.823848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4f69efe6-0ec2-41b4-997a-49b6d93a5f87 req-2c2c4f05-337a-41f5-be66-efe5307586a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:35.828582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4f69efe6-0ec2-41b4-997a-49b6d93a5f87 req-2c2c4f05-337a-41f5-be66-efe5307586a4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.828875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4f69efe6-0ec2-41b4-997a-49b6d93a5f87 req-2c2c4f05-337a-41f5-be66-efe5307586a4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.842676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4f69efe6-0ec2-41b4-997a-49b6d93a5f87 req-2c2c4f05-337a-41f5-be66-efe5307586a4 service nova] Creating event network-changed:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:48:35.849612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4f69efe6-0ec2-41b4-997a-49b6d93a5f87 req-2c2c4f05-337a-41f5-be66-efe5307586a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033760 Jul 19 19:48:35.850521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 393/745] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:35.857768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e4221788-fb17-40c6-a576-3a6efecc86ae req-123f9ea5-ea08-4786-a9ea-121fad92834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3", "name": "network-vif-plugged", "status": "completed", "tag": "74ece4f1-e135-46b9-9e8e-c08313305083"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:35.872115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e4221788-fb17-40c6-a576-3a6efecc86ae req-123f9ea5-ea08-4786-a9ea-121fad92834a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.872115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e4221788-fb17-40c6-a576-3a6efecc86ae req-123f9ea5-ea08-4786-a9ea-121fad92834a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.889612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e4221788-fb17-40c6-a576-3a6efecc86ae req-123f9ea5-ea08-4786-a9ea-121fad92834a service nova] Creating event network-vif-plugged:74ece4f1-e135-46b9-9e8e-c08313305083 for instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 on n-h1-843861-3 Jul 19 19:48:35.897351 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e4221788-fb17-40c6-a576-3a6efecc86ae req-123f9ea5-ea08-4786-a9ea-121fad92834a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044097 Jul 19 19:48:35.898826 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 394/746] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:35.912723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:35.913308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:35.923146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.923656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.924865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.925268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.163473 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1519848e-a55b-40a5-bd76-907f5f75a19b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.261107 Jul 19 19:48:36.164221 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 395/747] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 19:48:35 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:36.169335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.182770 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:36.182770 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:36.184620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Updating instance_info_cache with network_info: [{"id": "bc569f5b-81fe-4917-9937-1ddd9e087aac", "address": "fa:16:3e:56:fc:b3", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbc569f5b-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:36.185537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.188207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.191357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.191800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.199894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Releasing lock "refresh_cache-7432f760-6895-4c0e-af5e-59fbe3c814c8" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:36.201046 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7766839-2968-433c-b11d-e258bcdf87fe tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8/action" status: 202 len: 0 microversion: 2.1 time: 8.896212 Jul 19 19:48:36.201894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 353/748] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:27 2022] POST /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8/action => generated 0 bytes in 8898 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:36.221405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.222966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:36.237094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.238265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.241427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.241954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.249486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa63c8ea-411b-4e2f-a7ad-0da70c1aec0f tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.084242 Jul 19 19:48:36.257699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 396/749] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:36.263418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.264264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:36.273438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.274456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.275427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.276583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.632570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:36.641324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de7aedd3-46ee-4a43-a2c2-fc535b02863b tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.382278 Jul 19 19:48:36.642243 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 397/750] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:36.647375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.648979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:36.656659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.657204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.657403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:36.658111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.658640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.667314 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-946b9167-4269-4b05-8fc2-7b6a900887f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1318 microversion: 2.1 time: 0.464057 Jul 19 19:48:36.673908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 354/751] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:36.679393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: .version_select at 0x7fb890b0fdc0>, body: {"removeFloatingIp": {"address": "172.25.7.26"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:36.788278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:36.798970 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b860832-4dd5-4adf-8985-d1f2139c4b38 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1286 microversion: 2.1 time: 0.155166 Jul 19 19:48:36.810953 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 398/752] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:36.815968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.817484 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:36.817484 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:36.819056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.819722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.820546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.821774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.849767 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c6b6027-d40e-49ea-a88d-fae3f90d86d1 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-843861-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.036499 Jul 19 19:48:36.856797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 399/753] 10.222.0.33 () {58 vars in 1193 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/os-services?host=n-d-843861-3&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:48:36.856797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:36.857000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:36.864123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.865164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.865974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.866413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.947324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:36.957649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.958287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.960670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:36.961990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.427468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:37.456944 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54c95c25-c876-4764-922e-504cddd48375 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1313 microversion: 2.1 time: 0.602525 Jul 19 19:48:37.459185 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 400/754] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:36 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:37.464483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.465941 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:37.465941 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:37.467723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.468196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.469028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.469460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.498928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1aad3f8f-b59a-4dc6-8493-8f7221d4d469 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.038440 Jul 19 19:48:37.499543 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 401/755] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:37.504161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2cdcd98c-4e69-4865-b908-7c8a0f6145ef req-0060e538-93cf-4725-96df-93d6741c4ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:37.513969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2cdcd98c-4e69-4865-b908-7c8a0f6145ef req-0060e538-93cf-4725-96df-93d6741c4ba6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.514984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2cdcd98c-4e69-4865-b908-7c8a0f6145ef req-0060e538-93cf-4725-96df-93d6741c4ba6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.526508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2cdcd98c-4e69-4865-b908-7c8a0f6145ef req-0060e538-93cf-4725-96df-93d6741c4ba6 service nova] Creating event network-changed:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:48:37.531681 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2cdcd98c-4e69-4865-b908-7c8a0f6145ef req-0060e538-93cf-4725-96df-93d6741c4ba6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030788 Jul 19 19:48:37.532411 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 402/756] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:37.539044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.540432 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:37.540432 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:37.541626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.542069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.542849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.543446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.567786 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-46d892d1-3fd5-4a49-a07f-ecddb3377486 tempest-ServicesAdminNegativeTestJSON-1623785506 tempest-ServicesAdminNegativeTestJSON-1623785506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.033840 Jul 19 19:48:37.568440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 403/757] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:48:37.695380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1632b34b-d1f0-49cb-aafd-a9c28dff0598 tempest-ServicesAdminNegativeTestJSON-576471352 tempest-ServicesAdminNegativeTestJSON-576471352-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.696651 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:48:37.696651 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:48:37.697772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1632b34b-d1f0-49cb-aafd-a9c28dff0598 tempest-ServicesAdminNegativeTestJSON-576471352 tempest-ServicesAdminNegativeTestJSON-576471352-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2fb35ff5c4ca4d1f874a55316120c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eea75a30ad0414792b22529770a9a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:37.703743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] HTTP exception thrown: Floating IP 172.25.7.26 is not associated with instance 5aff775e-62bf-47f1-8271-712f28a34bac. Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1632b34b-d1f0-49cb-aafd-a9c28dff0598 tempest-ServicesAdminNegativeTestJSON-576471352 tempest-ServicesAdminNegativeTestJSON-576471352-project] Request method failure captured: Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqM-D_Rarxigmk41OfSZwp06bwjeXpP83yXscj7w_7eWUYFI7sN2svbzlauVE-69fYl7Zd6Clrg00NMPdwdGDyBNATQjxVZRgmCHkcxTj26vA2nWU_-cuunTmPYLVpEKPhYP-KlXsDU20afCeAssYww4jllf7v6ux8K1_B1eE_hl8c Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 4eea75a30ad0414792b22529770a9a46 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-576471352 Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:48:37.706414 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4eea75a30ad0414792b22529770a9a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4eea75a30ad0414792b22529770a9a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4eea75a30ad0414792b22529770a9a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4eea75a30ad0414792b22529770a9a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-576471352 Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 4eea75a30ad0414792b22529770a9a46 Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-576471352 Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServicesAdminNegativeTestJSON-576471352-project Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2fb35ff5c4ca4d1f874a55316120c880 Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-576471352-project Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:48:37.707721 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:48:37.708565 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:48:37.709734 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.710913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1632b34b-d1f0-49cb-aafd-a9c28dff0598 tempest-ServicesAdminNegativeTestJSON-576471352 tempest-ServicesAdminNegativeTestJSON-576471352-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:37.710913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1632b34b-d1f0-49cb-aafd-a9c28dff0598 tempest-ServicesAdminNegativeTestJSON-576471352 tempest-ServicesAdminNegativeTestJSON-576471352-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.132414 Jul 19 19:48:37.710913 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 404/758] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/os-services => generated 112 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Request method failure captured: Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action HTTP/1.1 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 48 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wpQ0mvRUWz5MG8u7udL8MqofowHwMlSwDRCI3CPSA3YZYPkiFOlq3L7iINKQ3chmzETioEot8i65CBlojBCAOZ921eCupgamQ0RKLdwmUSnhESA5cKfBUETqC_ONeE7zzMV4GQZxbGdCsUN4QfiYYYumKKEuEZntvE8Ew1IL8Qarhs Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:48:37.712878 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 93ce351fde36493eb6ffce973ee2e3c1 Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: {"removeFloatingIp": {"address": "172.25.7.26"}} Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:48:37.714241 n-d-843861-3 devstack@n-api.service[126007]: exception: Floating IP 172.25.7.26 is not associated with instance 5aff775e-62bf-47f1-8271-712f28a34bac. Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5aff775e-62bf-47f1-8271-712f28a34bac', 'body': {'removeFloatingIp': {'address': '172.25.7.26'}}} Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.26 is not associated with instance 5aff775e-62bf-47f1-8271-712f28a34bac. Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.715044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.26 is not associated with instance 5aff775e-62bf-47f1-8271-712f28a34bac. Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Returning 409 to user: Floating IP 172.25.7.26 is not associated with instance 5aff775e-62bf-47f1-8271-712f28a34bac. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:37.716245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df64b12d-1213-4821-8c34-434027fe9eb5 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action" status: 409 len: 145 microversion: 2.1 time: 1.039356 Jul 19 19:48:37.718844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 355/759] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:36 2022] POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action => generated 145 bytes in 1044 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:37.726359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.727350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:37.727492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.728033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:37.736654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.737480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.738472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.739121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.744405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.745628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.746425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.748601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.738359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:38.740588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:38.748087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86301696-25bb-4691-ad9c-1aaa230701dd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1467 microversion: 2.1 time: 1.025180 Jul 19 19:48:38.748442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1d859ac-a177-4a13-8501-6b910553fd27 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 1.038224 Jul 19 19:48:38.749890 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 405/760] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:38.755896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: .version_select at 0x7fb890b05e50>, body: {"removeFloatingIp": {"address": "172.25.7.26"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:38.760146 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 356/761] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1467 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:38.765487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:38.766093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:38.779556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.780678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.782641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.783391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.950340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:38.959910 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8378cb16-bc40-487e-878c-554b3322e39b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1292 microversion: 2.1 time: 0.198133 Jul 19 19:48:38.969401 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 357/762] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:38 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:38.969401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a8931dd7-4c94-4841-aeaf-485c4faa3046 req-98f61422-8021-4657-99c5-78b59224b709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:38.975547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a8931dd7-4c94-4841-aeaf-485c4faa3046 req-98f61422-8021-4657-99c5-78b59224b709 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.976325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a8931dd7-4c94-4841-aeaf-485c4faa3046 req-98f61422-8021-4657-99c5-78b59224b709 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.990925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a8931dd7-4c94-4841-aeaf-485c4faa3046 req-98f61422-8021-4657-99c5-78b59224b709 service nova] Creating event network-changed:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:38.996982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a8931dd7-4c94-4841-aeaf-485c4faa3046 req-98f61422-8021-4657-99c5-78b59224b709 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 Jul 19 19:48:38.998010 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 358/763] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:39.003542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d7f6c4-be10-45cb-9e6a-adbd7f1066c4", "name": "network-vif-plugged", "status": "completed", "tag": "855e56f4-5f45-4009-be1c-e1a31de4869c"}, {"server_uuid": "6ed09279-8d38-45cf-a366-26e46bf4eaf1", "name": "network-vif-plugged", "status": "completed", "tag": "1297fa33-cf14-4564-b2a4-57fca8cda87f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:39.014863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.015620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.038268 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] Creating event network-vif-plugged:855e56f4-5f45-4009-be1c-e1a31de4869c for instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 on n-h2-843861-3 Jul 19 19:48:39.038791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] Creating event network-vif-plugged:1297fa33-cf14-4564-b2a4-57fca8cda87f for instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 on n-h1-843861-3 Jul 19 19:48:39.049086 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7056cfbd-4833-4ac9-8bed-dc3b88047bdb req-e047c5d9-82e6-4c4a-9f3a-54aa07035605 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049332 Jul 19 19:48:39.049856 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 359/764] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:39.058986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:39.060029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:39.069692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.070437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.071442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.072860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.403303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:39.428639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.429566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.431334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.432522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.789273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:39.796836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8d6f39c-f2fd-4807-9053-792c21360f91 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1313 microversion: 2.1 time: 0.743728 Jul 19 19:48:39.806286 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 360/765] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:39 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:39.811381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:39.812246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:39.819434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.820141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.821138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.821761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:40.195930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Acquired lock "refresh_cache-7432f760-6895-4c0e-af5e-59fbe3c814c8" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:40.321127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:40.323478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:40.341973 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c741459-86b4-44fc-81e6-aa85719cad79 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1318 microversion: 2.1 time: 0.534220 Jul 19 19:48:40.342559 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 361/766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:39 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:40.347675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:40.349340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:40.357994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:40.358592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:40.359459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:40.359958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:41.247102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:41.254782 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c850abf-b935-4aa3-b8b4-4ab4f5cbabf6 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1369 microversion: 2.1 time: 0.910962 Jul 19 19:48:41.255722 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 362/767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:40 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1369 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:41.271343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:41.272618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:41.279252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.280397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:41.281388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.282030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:41.798455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:41.807460 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f1495db-e3ff-44a5-8b8a-915fbf7c35b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.540325 Jul 19 19:48:41.808249 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 363/768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:41 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:41.815518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:41.816175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:41.835491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.836306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:41.837530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.838354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:42.350513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:42.362048 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87bd124a-463b-465d-91bd-479da12bf5fc tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1313 microversion: 2.1 time: 0.552724 Jul 19 19:48:42.363490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 364/769] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:41 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:42.368222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-880e0cdb-4933-4432-8e21-f4dee8df2d0a req-aa657c3a-6cac-48a4-a1a8-89d91915ede2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138a3d94-21a8-4781-8567-e814f670732e", "tag": "383982ab-a57a-42d5-9528-10d22cbe4ed7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:42.372093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:42.377747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-880e0cdb-4933-4432-8e21-f4dee8df2d0a req-aa657c3a-6cac-48a4-a1a8-89d91915ede2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:42.378395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-880e0cdb-4933-4432-8e21-f4dee8df2d0a req-aa657c3a-6cac-48a4-a1a8-89d91915ede2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:42.394264 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-880e0cdb-4933-4432-8e21-f4dee8df2d0a req-aa657c3a-6cac-48a4-a1a8-89d91915ede2 service nova] Creating event network-changed:383982ab-a57a-42d5-9528-10d22cbe4ed7 for instance 138a3d94-21a8-4781-8567-e814f670732e on n-h1-843861-3 Jul 19 19:48:42.401109 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-880e0cdb-4933-4432-8e21-f4dee8df2d0a req-aa657c3a-6cac-48a4-a1a8-89d91915ede2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036229 Jul 19 19:48:42.402382 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 365/770] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:42.407631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:42.408366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:42.415089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:42.415537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:42.416350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:42.416786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:42.643509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:42.708445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:42.716652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba113000-a46f-4bd2-b942-ae023421db96 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1468 microversion: 2.1 time: 0.312902 Jul 19 19:48:42.731894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 366/771] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:42 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:42.734153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:42.734743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:42.747440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:42.747910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:42.748892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:42.753156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.104575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:43.112256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5302857-9353-4a97-b783-4f0c0cae1eae tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1556 microversion: 2.1 time: 0.382165 Jul 19 19:48:43.123211 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 367/772] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:42 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1556 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:43.129379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:43.133560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:43.139292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Searching by: {'reservation_id': 'r-yamq7oy4', 'deleted': False, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:48:43.145236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:43.146455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.147555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:43.148170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.324637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:48:43.468585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:43.477512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:43.478288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:44.204538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-736a6201-c04b-45e2-bda4-7f1313459a38 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-yamq7oy4" status: 200 len: 2928 microversion: 2.1 time: 1.079820 Jul 19 19:48:44.205467 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 368/773] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Jul 19 19:48:43 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yamq7oy4 => generated 2928 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:44.211055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:44.211943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:44.245135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:44.245708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:44.246855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:44.247031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.029758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Updating instance_info_cache with network_info: [{"id": "bc569f5b-81fe-4917-9937-1ddd9e087aac", "address": "fa:16:3e:56:fc:b3", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbc569f5b-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:45.056192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Releasing lock "refresh_cache-7432f760-6895-4c0e-af5e-59fbe3c814c8" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:45.058130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-accc585c-35e7-488b-8328-aaba20e138c0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8/action" status: 202 len: 0 microversion: 2.1 time: 6.305718 Jul 19 19:48:45.058767 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 406/774] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:38 2022] POST /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8/action => generated 0 bytes in 6308 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:45.069919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:45.073449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:45.086841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.087301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.088132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.088574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.389484 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4dfbbb02-a75c-41dc-b919-e87870844f97 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328854 Jul 19 19:48:45.390665 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 407/775] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:48:45 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-interface => generated 285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:45.396412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:45.397528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:45.405276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:45.414934 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77da0b30-f0e7-4e60-9c3b-131a439486f4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 1.208161 Jul 19 19:48:45.416286 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 369/776] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:44 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:45.421547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee1a40df-8a86-4874-9222-0c2eef2bada5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:45.430990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.438386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.448665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.449030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.450254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.server_groups [None req-ee1a40df-8a86-4874-9222-0c2eef2bada5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Querying cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) for 2 instances {{(pid=126007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 19:48:45.451065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a40df-8a86-4874-9222-0c2eef2bada5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.458495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a40df-8a86-4874-9222-0c2eef2bada5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.520475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee1a40df-8a86-4874-9222-0c2eef2bada5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d98a12ee-897b-491a-b996-28bfa8fc06e7" status: 200 len: 270 microversion: 2.1 time: 0.102111 Jul 19 19:48:45.525776 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 370/777] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:45 2022] GET /compute/v2.1/os-server-groups/d98a12ee-897b-491a-b996-28bfa8fc06e7 => generated 270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:45.534709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}, {"name": "network-changed", "server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:45.547921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.548952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.568132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] Creating event network-changed:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:45.569356 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] Creating event network-changed:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:48:45.576968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c84b4cba-de5c-4011-b7d1-7d4b37d0732b req-b44a5923-90b3-428c-a55b-e190c82255c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053883 Jul 19 19:48:45.578188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 371/778] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:45.587114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:45.593064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:45.611876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.615333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.615504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=78 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:45.616349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.616867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.676473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:45.825555 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9c40d03-fb4d-4168-a3f6-7bbd695780d0 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 204 len: 0 microversion: 2.1 time: 0.244580 Jul 19 19:48:45.827247 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 372/779] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:45 2022] DELETE /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:45.836958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:45.838030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:45.855666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.856644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.857708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:45.858390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.109633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:46.127874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00d5a4d4-048b-42f8-99aa-d860a5149ab2 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1313 microversion: 2.1 time: 0.735565 Jul 19 19:48:46.128993 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 408/780] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:45 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:46.139664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: .version_select at 0x7fb890b05940>, body: {"addFloatingIp": {"address": "172.25.7.26"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:46.142207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:46.174110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.177885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.179021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.182448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.200357 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3bf8bdd2-57a5-4d0e-bf53-fb44c48cbc44 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1619 microversion: 2.1 time: 0.371306 Jul 19 19:48:46.203212 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 373/781] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:45 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1619 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:46.225004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:46.225856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:46.234435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.234972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.235956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.236484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.244169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Acquired lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:46.509147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48fcb59a-6ce0-415e-aab3-53a23fff7a8c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 200 len: 1618 microversion: 2.1 time: 0.289928 Jul 19 19:48:46.510077 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 374/782] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:46 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 1618 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:46.516191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:46.517210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:46.531686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.532174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.532967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.533405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.818300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:46.826730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9760ea3c-a198-4c86-91f6-09d82e1e4c33 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.315532 Jul 19 19:48:46.827488 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 375/783] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:46 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:47.049555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42269dab-5488-4a4f-84ef-0410326ea2fc tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Calling method '.version_select at 0x7fb88e266550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:47.187211 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42269dab-5488-4a4f-84ef-0410326ea2fc tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.348884 Jul 19 19:48:47.187823 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 376/784] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:48:46 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:48:47.200324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-854488871", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:47.298848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:47.549201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=16 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:47.924442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:47.926144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:47.928132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:47.928952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:47.930322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:47.947083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:47.948092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:47.952441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:47.953192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:47.979915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:47.988093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:48.006175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:48.012034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:48.077381 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18b6123f-c6a5-4cff-92a9-b4aa7130951b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877163 Jul 19 19:48:48.080055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 377/785] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:48.086081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-eb25ede0-0b2b-4308-9c75-3a0026b32df2 req-75495495-3eb1-4352-b3a1-8ee12abdf4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138a3d94-21a8-4781-8567-e814f670732e", "name": "network-vif-plugged", "status": "completed", "tag": "383982ab-a57a-42d5-9528-10d22cbe4ed7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:48.097755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-eb25ede0-0b2b-4308-9c75-3a0026b32df2 req-75495495-3eb1-4352-b3a1-8ee12abdf4f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.099735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-eb25ede0-0b2b-4308-9c75-3a0026b32df2 req-75495495-3eb1-4352-b3a1-8ee12abdf4f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:48.116083 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-eb25ede0-0b2b-4308-9c75-3a0026b32df2 req-75495495-3eb1-4352-b3a1-8ee12abdf4f2 service nova] Creating event network-vif-plugged:383982ab-a57a-42d5-9528-10d22cbe4ed7 for instance 138a3d94-21a8-4781-8567-e814f670732e on n-h1-843861-3 Jul 19 19:48:48.125758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-eb25ede0-0b2b-4308-9c75-3a0026b32df2 req-75495495-3eb1-4352-b3a1-8ee12abdf4f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043532 Jul 19 19:48:48.126532 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 378/786] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:48.132682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:48.133542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:48.152848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.153594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:48.154296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.154844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:48.468926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:48.537790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:48.554951 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f53e1bd-f838-48dc-8389-4f6affa6e0f1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1313 microversion: 2.1 time: 0.427077 Jul 19 19:48:48.555561 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 379/787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:48 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:48.566351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8095fec-accb-45b1-93fa-5a6012b51c58 tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Action: 'create', calling method: .version_select at 0x7fb88e3cd8b0>, body: {"pool": "non_exist_pool"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:48.645862 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c8095fec-accb-45b1-93fa-5a6012b51c58 tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] HTTP exception thrown: Floating IP pool not found. Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8095fec-accb-45b1-93fa-5a6012b51c58 tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Request method failure captured: Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 26 Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqe4-eRxxMpefpueFJq0tpV-20UVI_c4xIkSRg0-ugH0yWPhMJNkzEiJLUsW15DIRR0adH5HhfCpV4lOFxORQfZTJ9J96MzJ_s8SrRrJizwAIX3nf0kng-_jZzRoI29mRNaz_Rd4m6_2fRVuvjStXx3qCekV51NzUhj60_YArMqF7M Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2e122d4d72c04915a92d74cd345821ce Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:48:48.659153 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2e122d4d72c04915a92d74cd345821ce Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsNegativeTestJSON-316318893-project Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 938971f6b2674ea2a32bdd4e1e6ab1da Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-316318893-project Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: {"pool": "non_exist_pool"} Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: exception: Floating IP pool not found. Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 19 19:48:48.660782 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:48.662339 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8095fec-accb-45b1-93fa-5a6012b51c58 tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Returning 404 to user: Floating IP pool not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:48.670354 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8095fec-accb-45b1-93fa-5a6012b51c58 tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.105125 Jul 19 19:48:48.673172 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 380/788] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:48:48 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:48.673752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c7847bb6-fa89-4727-8438-ef9c96d8a698 req-880c6da4-1317-40b1-bef7-be81e449edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed09279-8d38-45cf-a366-26e46bf4eaf1", "tag": "1297fa33-cf14-4564-b2a4-57fca8cda87f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:48.698484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c7847bb6-fa89-4727-8438-ef9c96d8a698 req-880c6da4-1317-40b1-bef7-be81e449edc5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.698926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c7847bb6-fa89-4727-8438-ef9c96d8a698 req-880c6da4-1317-40b1-bef7-be81e449edc5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:48.714736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:48.743789 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c7847bb6-fa89-4727-8438-ef9c96d8a698 req-880c6da4-1317-40b1-bef7-be81e449edc5 service nova] Creating event network-changed:1297fa33-cf14-4564-b2a4-57fca8cda87f for instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 on n-h1-843861-3 Jul 19 19:48:48.748983 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c7847bb6-fa89-4727-8438-ef9c96d8a698 req-880c6da4-1317-40b1-bef7-be81e449edc5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084293 Jul 19 19:48:48.749900 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 381/789] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:48.762963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:48.764568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:48.773479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.774447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:48.775456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:48.776310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.543309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:49.570867 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-94af2b42-3adf-4b1e-befb-28c81a1c4710 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.812852 Jul 19 19:48:49.575062 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 382/790] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:48 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:49.594779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:49.595947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:49.605484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.606346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.607163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.607764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.841033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:49.849890 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39e5dbe6-6534-40ad-94d5-e11614a9ee0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1220 microversion: 2.1 time: 0.269206 Jul 19 19:48:49.850484 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 383/791] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:49 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1220 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:49.855330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5cd56bba-6f8d-445b-8e12-072e68450e6f req-bfd5179e-2fdb-42b0-9dfd-7125dfb5c4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:49.869223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5cd56bba-6f8d-445b-8e12-072e68450e6f req-bfd5179e-2fdb-42b0-9dfd-7125dfb5c4c3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.869754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5cd56bba-6f8d-445b-8e12-072e68450e6f req-bfd5179e-2fdb-42b0-9dfd-7125dfb5c4c3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.883912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5cd56bba-6f8d-445b-8e12-072e68450e6f req-bfd5179e-2fdb-42b0-9dfd-7125dfb5c4c3 service nova] Creating event network-changed:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:48:49.890091 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5cd56bba-6f8d-445b-8e12-072e68450e6f req-bfd5179e-2fdb-42b0-9dfd-7125dfb5c4c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038173 Jul 19 19:48:49.891172 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 384/792] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:49.897555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Calling method '.version_select at 0x7fb88e2f4ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:50.059142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a5e6130b-0f9e-42ed-b2ef-fb78de21f459 could not be found", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:48:50.060473 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] HTTP exception thrown: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Request method failure captured: Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-floating-ips/a5e6130b-0f9e-42ed-b2ef-fb78de21f459 HTTP/1.1 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqe4-eRxxMpefpueFJq0tpV-20UVI_c4xIkSRg0-ugH0yWPhMJNkzEiJLUsW15DIRR0adH5HhfCpV4lOFxORQfZTJ9J96MzJ_s8SrRrJizwAIX3nf0kng-_jZzRoI29mRNaz_Rd4m6_2fRVuvjStXx3qCekV51NzUhj60_YArMqF7M Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2e122d4d72c04915a92d74cd345821ce Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:48:50.070734 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e122d4d72c04915a92d74cd345821ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2e122d4d72c04915a92d74cd345821ce Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-316318893 Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsNegativeTestJSON-316318893-project Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 938971f6b2674ea2a32bdd4e1e6ab1da Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-316318893-project Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: exception: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459 Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a5e6130b-0f9e-42ed-b2ef-fb78de21f459'} Jul 19 19:48:50.072151 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:48:50.072920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a5e6130b-0f9e-42ed-b2ef-fb78de21f459 could not be found Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81d9e62d-9b07-45cf-acf3-100f0d5b86eb'] Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459. Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:50.074086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459 Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:50.075232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:50.078058 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459 Jul 19 19:48:50.078058 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:50.080536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] Returning 404 to user: Floating IP not found for ID a5e6130b-0f9e-42ed-b2ef-fb78de21f459 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:50.081528 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe6646e7-a0ff-41bb-b6bd-64e731a899fa tempest-FloatingIPsNegativeTestJSON-316318893 tempest-FloatingIPsNegativeTestJSON-316318893-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a5e6130b-0f9e-42ed-b2ef-fb78de21f459" status: 404 len: 111 microversion: 2.1 time: 0.189014 Jul 19 19:48:50.086819 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 385/793] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:49 2022] DELETE /compute/v2.1/os-floating-ips/a5e6130b-0f9e-42ed-b2ef-fb78de21f459 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:50.087662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:50.088691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:50.097010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.097801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.099151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.100032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.761991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:50.777557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e98e798d-f51b-4675-b115-7a6582cc5cdb tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1463 microversion: 2.1 time: 0.693743 Jul 19 19:48:50.790246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Updating instance_info_cache with network_info: [{"id": "a9ec7238-b9f7-415f-9933-0d12e2c06a74", "address": "fa:16:3e:b4:0a:1e", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa9ec7238-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:50.794833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 386/794] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:50 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1463 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:50.802055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:50.802998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:50.812499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Releasing lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:50.813007 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cde2d588-5a33-45e4-a261-30efaf432100 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action" status: 202 len: 0 microversion: 2.1 time: 4.682884 Jul 19 19:48:50.813506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.813636 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 409/795] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:46 2022] POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action => generated 0 bytes in 4684 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:50.814603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.815584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.816300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.021680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Calling method '.version_select at 0x7fb88e3c5e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:51.038176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.038622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.075831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.076749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.100587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4ab5249-4c98-4793-904f-b2e002d87a27 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/a935a5f142994bfa905b6785251e9d52?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539" status: 200 len: 694 microversion: 2.1 time: 0.285919 Jul 19 19:48:51.104767 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 410/796] 10.222.0.33 () {58 vars in 1411 bytes} [Tue Jul 19 19:48:50 2022] GET /compute/v2.1/os-simple-tenant-usage/a935a5f142994bfa905b6785251e9d52?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539 => generated 694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:51.121374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6eef0e3-1dd7-40bc-9e2a-610c448cb5e8 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '.version_select at 0x7fb88e39a820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:51.509743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:51.520830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ce8317d-9a3b-4484-a052-01a07119f876 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.724558 Jul 19 19:48:51.521418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 387/797] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:50 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:51.550818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:51.557619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:51.569667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.570404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.571357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.571989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.018240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:52.026836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad954f09-64d3-482a-8eaf-530f2fc36fd9 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1276 microversion: 2.1 time: 0.499789 Jul 19 19:48:52.027735 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 388/798] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:51 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1276 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:52.039712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '.version_select at 0x7fb88e0d0dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:52.050235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.050967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.068482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.068967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.088244 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c38ad281-9bec-49d3-afcf-fec0940da96f tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/a935a5f142994bfa905b6785251e9d52?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539" status: 200 len: 694 microversion: 2.1 time: 0.059090 Jul 19 19:48:52.089061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 389/799] 10.222.0.33 () {58 vars in 1411 bytes} [Tue Jul 19 19:48:52 2022] GET /compute/v2.1/os-simple-tenant-usage/a935a5f142994bfa905b6785251e9d52?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539 => generated 694 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:52.093566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-589718db-ba4d-4b33-8ed1-8182acf0c540 req-e62b319d-a149-468b-ad43-35fba7c87e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "name": "network-vif-unplugged", "status": "completed", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:52.103320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-589718db-ba4d-4b33-8ed1-8182acf0c540 req-e62b319d-a149-468b-ad43-35fba7c87e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.103320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-589718db-ba4d-4b33-8ed1-8182acf0c540 req-e62b319d-a149-468b-ad43-35fba7c87e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.116298 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-589718db-ba4d-4b33-8ed1-8182acf0c540 req-e62b319d-a149-468b-ad43-35fba7c87e16 service nova] Creating event network-vif-unplugged:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:52.123106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-589718db-ba4d-4b33-8ed1-8182acf0c540 req-e62b319d-a149-468b-ad43-35fba7c87e16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032669 Jul 19 19:48:52.125602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 390/800] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:52.140413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Calling method '.version_select at 0x7fb88deb6b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:52.164099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.164552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.181343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.181793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.216871 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6eef0e3-1dd7-40bc-9e2a-610c448cb5e8 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/a33cc411-7f7b-4d88-a1b2-d178bd1aabd1" status: 200 len: 184 microversion: 2.1 time: 1.110766 Jul 19 19:48:52.217463 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 411/801] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:48:51 2022] GET /compute/v2.1/os-floating-ips/a33cc411-7f7b-4d88-a1b2-d178bd1aabd1 => generated 184 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:52.228841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.26"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:52.255984 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-169c1345-f098-41c9-9200-834d3763d419 tempest-TenantUsagesTestJSON-1556663339 tempest-TenantUsagesTestJSON-1556663339-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539&detailed=1" status: 200 len: 11211 microversion: 2.1 time: 0.125634 Jul 19 19:48:52.257103 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 391/802] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Jul 19 19:48:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A48%3A50.789539&end=2022-07-20T19%3A48%3A50.789539&detailed=1 => generated 11211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:48:52.277960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:52.278655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:52.285003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.286775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.299906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.302523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.341328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:52.517650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:52.527297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.530764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.531407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af7a2ab4-bbca-4006-aa7d-ad59b65eb272 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "DELETE /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 204 len: 0 microversion: 2.1 time: 0.257614 Jul 19 19:48:52.533000 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 392/803] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:52 2022] DELETE /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:48:52.533387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.535059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.549484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:52.550558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:52.570638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.571573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:52.581388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:52.584590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.000382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:53.016309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6253a4c3-a403-4051-915d-9451b5c020e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.481069 Jul 19 19:48:53.018001 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 393/804] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:52 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:53.031072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:53.031831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:53.040398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:53.041128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.042561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:53.043098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.054807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Acquired lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:53.464924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:53.476343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07d7faf5-c155-432a-be5d-efa9b0005e5b tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1469 microversion: 2.1 time: 0.456560 Jul 19 19:48:53.476945 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 394/805] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:53 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:53.496071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1b167587-b913-4afb-b9c3-0f836adc6738 req-a6da3420-979a-482a-872e-b0d4f62cfd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7432f760-6895-4c0e-af5e-59fbe3c814c8", "name": "network-vif-deleted", "tag": "bc569f5b-81fe-4917-9937-1ddd9e087aac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:53.519786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1b167587-b913-4afb-b9c3-0f836adc6738 req-a6da3420-979a-482a-872e-b0d4f62cfd3f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:53.520252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1b167587-b913-4afb-b9c3-0f836adc6738 req-a6da3420-979a-482a-872e-b0d4f62cfd3f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.543866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1b167587-b913-4afb-b9c3-0f836adc6738 req-a6da3420-979a-482a-872e-b0d4f62cfd3f service nova] Creating event network-vif-deleted:bc569f5b-81fe-4917-9937-1ddd9e087aac for instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 on n-h2-843861-3 Jul 19 19:48:53.548794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1b167587-b913-4afb-b9c3-0f836adc6738 req-a6da3420-979a-482a-872e-b0d4f62cfd3f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060723 Jul 19 19:48:53.561157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 395/806] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:53.567545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:53.567638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:53.583401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:53.584689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.607791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:53.608857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:53.953636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:53.962537 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2e34a9d3-5281-46d9-a16a-ae696423545e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.400094 Jul 19 19:48:53.973351 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 396/807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:53 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:54.037894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:54.039935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:54.050832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.052353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.053888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.054544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.707713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:54.742653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c37c184-c66d-47c3-9779-7d086e4509f2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.710961 Jul 19 19:48:54.752590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 397/808] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:54 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:54.771503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:54.776508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:54.783985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.784665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.785599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.787388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.519335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:55.535275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9632a4fc-604b-40b6-85aa-0542c49f1cc1 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1469 microversion: 2.1 time: 0.780864 Jul 19 19:48:55.546069 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 398/809] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:54 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1469 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:55.551245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:55.552246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:55.559159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.560015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.561025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.561650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.612911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:55.986619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.025121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-efe1b917-72f3-4d09-aff0-aae73ff78f81 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.473079 Jul 19 19:48:56.027903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 399/810] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:55 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:56.037915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-acc3e453-b4cc-4e0e-9d42-e64ad353be1c req-c3078be9-be52-40f9-990b-73b24c66edef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b57132-23d1-4cd3-987e-0bf1990145d5", "tag": "8d3b3f6c-647f-41ba-8699-5d6be35c8932"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:56.074259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-acc3e453-b4cc-4e0e-9d42-e64ad353be1c req-c3078be9-be52-40f9-990b-73b24c66edef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.075023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-acc3e453-b4cc-4e0e-9d42-e64ad353be1c req-c3078be9-be52-40f9-990b-73b24c66edef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.103123 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-acc3e453-b4cc-4e0e-9d42-e64ad353be1c req-c3078be9-be52-40f9-990b-73b24c66edef service nova] Creating event network-changed:8d3b3f6c-647f-41ba-8699-5d6be35c8932 for instance 29b57132-23d1-4cd3-987e-0bf1990145d5 on n-h2-843861-3 Jul 19 19:48:56.112320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-acc3e453-b4cc-4e0e-9d42-e64ad353be1c req-c3078be9-be52-40f9-990b-73b24c66edef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082907 Jul 19 19:48:56.115177 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 400/811] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:56.133264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0ad429cc-5826-4335-9ec7-bc1d6ff28f33 req-7f588589-56e6-427d-85f7-c61b65d84feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:56.160329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0ad429cc-5826-4335-9ec7-bc1d6ff28f33 req-7f588589-56e6-427d-85f7-c61b65d84feb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.165247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0ad429cc-5826-4335-9ec7-bc1d6ff28f33 req-7f588589-56e6-427d-85f7-c61b65d84feb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.196926 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0ad429cc-5826-4335-9ec7-bc1d6ff28f33 req-7f588589-56e6-427d-85f7-c61b65d84feb service nova] Creating event network-changed:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:48:56.205421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0ad429cc-5826-4335-9ec7-bc1d6ff28f33 req-7f588589-56e6-427d-85f7-c61b65d84feb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088756 Jul 19 19:48:56.210645 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 401/812] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:56.223389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.224796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.238010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.238466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.239787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.240250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.257672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:56.551260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.562364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c51d87e1-b35d-43b6-8ee1-99d2aada669c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.349836 Jul 19 19:48:56.565435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 402/813] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:56.573026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.573901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.580260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:56.582070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.583435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.584802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.585335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.655772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.658120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.658798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lazy-loading 'fault' on Instance uuid 138a3d94-21a8-4781-8567-e814f670732e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:56.750725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8cd277f71a4852a8402c7841cbee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a935a5f142994bfa905b6785251e9d52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.762738 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-305b16b2-c847-4a0d-878c-b88418f2708c tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 200 len: 1303 microversion: 2.1 time: 0.194318 Jul 19 19:48:56.769912 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 403/814] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:56.858774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Updating instance_info_cache with network_info: [{"id": "a9ec7238-b9f7-415f-9933-0d12e2c06a74", "address": "fa:16:3e:b4:0a:1e", "network": {"id": "f8081125-1f0f-4d89-8040-cb2f528626b5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-525429326-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1daba1b3ce8e4e55aba8c2d684ca6601", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa9ec7238-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:56.868566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:56.888707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Releasing lock "refresh_cache-5aff775e-62bf-47f1-8271-712f28a34bac" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:56.889596 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7400db1f-21e7-4274-a795-16aca372003f tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action" status: 202 len: 0 microversion: 2.1 time: 4.664719 Jul 19 19:48:56.890765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 412/815] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:52 2022] POST /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac/action => generated 0 bytes in 4667 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:56.901857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.902630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.919278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.919732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.920606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.921036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.946772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] HTTP exception thrown: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Request method failure captured: Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 HTTP/1.1 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wpQ0mvRUWz5MG8u7udL8MqofowHwMlSwDRCI3CPSA3YZYPkiFOlq3L7iINKQ3chmzETioEot8i65CBlojBCAOZ921eCupgamQ0RKLdwmUSnhESA5cKfBUETqC_ONeE7zzMV4GQZxbGdCsUN4QfiYYYumKKEuEZntvE8Ew1IL8Qarhs Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:48:56.948639 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 93ce351fde36493eb6ffce973ee2e3c1 Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.950361 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7432f760-6895-4c0e-af5e-59fbe3c814c8'} Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:56.951260 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.952876 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.954427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Returning 404 to user: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:56.954427 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8b3737f-d671-4502-a734-3b45239b08c7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 404 len: 111 microversion: 2.1 time: 0.053468 Jul 19 19:48:56.960072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.960909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 7432f760-6895-4c0e-af5e-59fbe3c814c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.970183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.970888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.971892 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 404/816] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:56 2022] DELETE /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:56.972119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.972744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.997747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] HTTP exception thrown: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Request method failure captured: Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 HTTP/1.1 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wpQ0mvRUWz5MG8u7udL8MqofowHwMlSwDRCI3CPSA3YZYPkiFOlq3L7iINKQ3chmzETioEot8i65CBlojBCAOZ921eCupgamQ0RKLdwmUSnhESA5cKfBUETqC_ONeE7zzMV4GQZxbGdCsUN4QfiYYYumKKEuEZntvE8Ew1IL8Qarhs Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:48:56.999901 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 93ce351fde36493eb6ffce973ee2e3c1 Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:57.001266 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7432f760-6895-4c0e-af5e-59fbe3c814c8'} Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:57.002101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. Jul 19 19:48:57.003299 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.004408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Returning 404 to user: Instance 7432f760-6895-4c0e-af5e-59fbe3c814c8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:57.004408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27842295-94cb-41ba-ab39-bee2cbf340f3 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8" status: 404 len: 111 microversion: 2.1 time: 0.047246 Jul 19 19:48:57.004894 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 413/817] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/7432f760-6895-4c0e-af5e-59fbe3c814c8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:57.011704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-409f96f9-7f27-45ec-91b1-40758f2e1420 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '.version_select at 0x7fb88de798b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.043015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.043628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.050543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.050986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.051760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.052220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.377786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.386822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7578291b-9e09-43e4-9f98-3c98f6fe547e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.347592 Jul 19 19:48:57.387643 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 414/818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:57.521550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-857773f6-4621-426e-a4d2-edd0e884243f tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] Calling method '.version_select at 0x7fb88e114790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.565022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-857773f6-4621-426e-a4d2-edd0e884243f tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] 10.222.0.33 "GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046" status: 200 len: 784 microversion: 2.1 time: 0.176180 Jul 19 19:48:57.565591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 415/819] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046 => generated 784 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:57.578162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-317d6d65-c081-44f4-a0dd-d5548001b02b tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] Calling method '.version_select at 0x7fb88e4b8430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.663906 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-317d6d65-c081-44f4-a0dd-d5548001b02b tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.089556 Jul 19 19:48:57.664562 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 416/820] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/images => generated 871 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:48:57.674974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.675672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.682425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.683014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.683789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.684562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.914133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.921591 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a08a5db-41ca-4b80-9ac0-1fdc4c4c4158 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.252601 Jul 19 19:48:57.922384 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 417/821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.926816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1aaf843a-8c43-445f-9121-144c439e7d16 tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] Calling method '.version_select at 0x7fb88e590a60>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.978946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1aaf843a-8c43-445f-9121-144c439e7d16 tempest-ListImagesTestJSON-1377062485 tempest-ListImagesTestJSON-1377062485-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.055530 Jul 19 19:48:57.979613 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 418/822] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.987948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.987948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] [instance: 138a3d94-21a8-4781-8567-e814f670732e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.993532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.993985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.994956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.995555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.000083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:58.010589 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] HTTP exception thrown: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Request method failure captured: Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e HTTP/1.1 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqNPI0kKGapZ-UmnfdYzSsu11eVVgUPyAC_nrSF5_kkpM7hivuEHrBoAunk5djUAjmTroRg6LRZNRuKa9SNeOheuYWEg7asFAbvEug7QRtX0D7Fp7w8ZYBSfGBKsOSfTBS5XtuTrVdYcRRZTpQtIDdIV-L-rOB12Fxq-F-iLnAQh-s Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a935a5f142994bfa905b6785251e9d52 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TenantUsagesTestJSON-1597235007 Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:48:58.012491 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a935a5f142994bfa905b6785251e9d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a935a5f142994bfa905b6785251e9d52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a935a5f142994bfa905b6785251e9d52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a935a5f142994bfa905b6785251e9d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TenantUsagesTestJSON-1597235007 Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a935a5f142994bfa905b6785251e9d52 Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1597235007 Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TenantUsagesTestJSON-1597235007-project Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fe8cd277f71a4852a8402c7841cbee72 Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TenantUsagesTestJSON-1597235007-project Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. Jul 19 19:48:58.013795 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '138a3d94-21a8-4781-8567-e814f670732e'} Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:58.014658 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. Jul 19 19:48:58.016444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:48:58.018453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] Returning 404 to user: Instance 138a3d94-21a8-4781-8567-e814f670732e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:58.018453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9acb66c0-1040-43fa-8f71-412dde44a997 tempest-TenantUsagesTestJSON-1597235007 tempest-TenantUsagesTestJSON-1597235007-project] 10.222.0.33 "GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e" status: 404 len: 111 microversion: 2.1 time: 0.033475 Jul 19 19:48:58.018453 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 419/823] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/138a3d94-21a8-4781-8567-e814f670732e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:58.024333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-115d5617-190f-4936-bfef-13ed73ff358d req-f343e184-68b4-406e-9e3a-2ea519946679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "name": "network-vif-plugged", "status": "completed", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:58.032824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-115d5617-190f-4936-bfef-13ed73ff358d req-f343e184-68b4-406e-9e3a-2ea519946679 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.033273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-115d5617-190f-4936-bfef-13ed73ff358d req-f343e184-68b4-406e-9e3a-2ea519946679 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.046567 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-115d5617-190f-4936-bfef-13ed73ff358d req-f343e184-68b4-406e-9e3a-2ea519946679 service nova] Creating event network-vif-plugged:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:48:58.052348 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-115d5617-190f-4936-bfef-13ed73ff358d req-f343e184-68b4-406e-9e3a-2ea519946679 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036226 Jul 19 19:48:58.053303 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 420/824] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:58.096188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-409f96f9-7f27-45ec-91b1-40758f2e1420 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a33cc411-7f7b-4d88-a1b2-d178bd1aabd1" status: 202 len: 0 microversion: 2.1 time: 1.088769 Jul 19 19:48:58.097086 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 405/825] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:57 2022] DELETE /compute/v2.1/os-floating-ips/a33cc411-7f7b-4d88-a1b2-d178bd1aabd1 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:48:58.107073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.107669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.115830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.116336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.117115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.117741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.144599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:58.232550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d28ede6c-ac8e-43e2-9851-3d8190448af4 req-fe7e2df7-d6d3-45b1-87ea-de6b1fec0731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138a3d94-21a8-4781-8567-e814f670732e", "name": "network-vif-deleted", "tag": "383982ab-a57a-42d5-9528-10d22cbe4ed7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:58.243020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d28ede6c-ac8e-43e2-9851-3d8190448af4 req-fe7e2df7-d6d3-45b1-87ea-de6b1fec0731 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.243800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d28ede6c-ac8e-43e2-9851-3d8190448af4 req-fe7e2df7-d6d3-45b1-87ea-de6b1fec0731 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.248270 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fb364508-de42-4fb3-a928-aae3e4090dae tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 204 len: 0 microversion: 2.1 time: 0.146551 Jul 19 19:48:58.249543 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 421/826] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:58 2022] DELETE /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:58.256402 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d28ede6c-ac8e-43e2-9851-3d8190448af4 req-fe7e2df7-d6d3-45b1-87ea-de6b1fec0731 service nova] Creating event network-vif-deleted:383982ab-a57a-42d5-9528-10d22cbe4ed7 for instance 138a3d94-21a8-4781-8567-e814f670732e on n-h1-843861-3 Jul 19 19:48:58.260614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.262357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.262625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d28ede6c-ac8e-43e2-9851-3d8190448af4 req-fe7e2df7-d6d3-45b1-87ea-de6b1fec0731 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034625 Jul 19 19:48:58.264052 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 406/827] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:58.272281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.272888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.273711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.276975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.406515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.408352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.417459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.419095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.420686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.421871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.429441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:58.439684 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67de9e2a-14f3-43bc-946f-8a16d034c807 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1525 microversion: 2.1 time: 0.185179 Jul 19 19:48:58.440955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 422/828] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:58.567733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:58.576084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66b297dc-98a7-48a9-a8db-2c908bec9953 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.175375 Jul 19 19:48:58.576664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 407/829] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:58.941677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.942255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.950625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.951082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.952233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.954813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.159109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:59.174238 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-503dc1cd-ffc1-45e9-a718-1e011d7289a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.238707 Jul 19 19:48:59.175211 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 423/830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:59.459553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:59.460909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:59.469579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.470047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.470962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.471413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.598688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:59.599317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:59.607321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.607989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.608618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.609023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.647575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:59.657802 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8a60f38-c528-4032-99df-f7ba1599931e tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1525 microversion: 2.1 time: 0.201317 Jul 19 19:48:59.658276 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 408/831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:59 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1525 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:59.870372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:59.891121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a0ddfdc-dc93-42b2-8ffa-36dc06adad21 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.301113 Jul 19 19:48:59.893168 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 424/832] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:59 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:00.200690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.201239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.236784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.240869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.241802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.242254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.299868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-356c4365-f771-479b-ba77-9f95653df2f1 req-77884151-c468-4928-8047-d06b0de0b778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff775e-62bf-47f1-8271-712f28a34bac", "name": "network-vif-deleted", "tag": "a9ec7238-b9f7-415f-9933-0d12e2c06a74"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:00.312272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-356c4365-f771-479b-ba77-9f95653df2f1 req-77884151-c468-4928-8047-d06b0de0b778 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.312901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-356c4365-f771-479b-ba77-9f95653df2f1 req-77884151-c468-4928-8047-d06b0de0b778 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.326149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-356c4365-f771-479b-ba77-9f95653df2f1 req-77884151-c468-4928-8047-d06b0de0b778 service nova] Creating event network-vif-deleted:a9ec7238-b9f7-415f-9933-0d12e2c06a74 for instance 5aff775e-62bf-47f1-8271-712f28a34bac on n-h1-843861-3 Jul 19 19:49:00.331840 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-356c4365-f771-479b-ba77-9f95653df2f1 req-77884151-c468-4928-8047-d06b0de0b778 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Jul 19 19:49:00.332689 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 425/833] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:00.490447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.522188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49b8b9e4-faf0-4f6f-b36e-07da4bd90586 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1358 microversion: 2.1 time: 0.319832 Jul 19 19:49:00.523540 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 409/834] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.613617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2230b34a-7845-43de-a296-24534ae96241 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.624314 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2230b34a-7845-43de-a296-24534ae96241 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.168322 Jul 19 19:49:00.626014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 426/835] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:00.675480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.676339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.691171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.691762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.692944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.694890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.773106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.774131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.774802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lazy-loading 'fault' on Instance uuid 5aff775e-62bf-47f1-8271-712f28a34bac {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:00.869083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce351fde36493eb6ffce973ee2e3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daba1b3ce8e4e55aba8c2d684ca6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.880684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a59ef5c-1d25-4aa3-b8b4-dabb1ff150ea tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 200 len: 1313 microversion: 2.1 time: 0.209375 Jul 19 19:49:00.881303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 410/836] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.910497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.916035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.928048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.928497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.929717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.930214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.071054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:01.128811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:01.137598 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f65071d-151b-43f4-b6e3-456a39248571 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.232367 Jul 19 19:49:01.138194 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 427/837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:01.319589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1692076246", "imageRef": "4960cfc2-ea8c-46cc-a413-a8accfc581f4", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:01.374590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:01.544776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.546158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.556444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.557188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.558466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.561755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.589186 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] Request method failure captured: Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 143 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqsF535XffIc4LuezYeWYscphQ4VcP5HB23xFZGpZBri-naJ1zMx-_CqwMzljjAkEVf2kVKzBr0mX2-urNHYvdrqV-aXRLcIF1jSrcdw9EMudG_bgKDaoq2gI6xocdEsnG1VaGf6O3pGsaUlSZtac8OQ8dlJh16kfdk_C5Apw6AGL4 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5020be568f614c8dbc3be489df0cd818 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FlavorsV2NegativeTest-1826916906 Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:01.592370 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5020be568f614c8dbc3be489df0cd818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5020be568f614c8dbc3be489df0cd818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5020be568f614c8dbc3be489df0cd818"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5020be568f614c8dbc3be489df0cd818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FlavorsV2NegativeTest-1826916906 Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5020be568f614c8dbc3be489df0cd818 Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1826916906 Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FlavorsV2NegativeTest-1826916906-project Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ce28ffbe2a0e4223aa7472794e60b1e0 Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FlavorsV2NegativeTest-1826916906-project Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1692076246", "imageRef": "4960cfc2-ea8c-46cc-a413-a8accfc581f4", "flavorRef": "452"}} Jul 19 19:49:01.594033 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: exception: Flavor's memory is too small for requested image. Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1692076246', 'imageRef': '4960cfc2-ea8c-46cc-a413-a8accfc581f4', 'flavorRef': '452'}}} Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.594791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.596073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 19 19:49:01.597302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.600440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:01.601421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b86f57a2-e934-4823-8322-69cbc901bda8 tempest-FlavorsV2NegativeTest-1826916906 tempest-FlavorsV2NegativeTest-1826916906-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.286664 Jul 19 19:49:01.602624 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 411/838] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:01 2022] POST /compute/v2.1/servers => generated 93 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:49:01.769509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:01.782903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fc2af7c-22c3-4662-889b-5af3cf696b15 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1541 microversion: 2.1 time: 0.247417 Jul 19 19:49:01.797206 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 428/839] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1541 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:01.801156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.801723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.812404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.812851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.813630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.814063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.898861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.899747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] [instance: 5aff775e-62bf-47f1-8271-712f28a34bac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.916410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.916604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1bfa4743-15f1-4a0d-a910-71a51f12b752 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120028 Jul 19 19:49:01.917028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 412/840] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:01.923448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.923448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.923448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.956189 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] HTTP exception thrown: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Request method failure captured: Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac HTTP/1.1 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wpQ0mvRUWz5MG8u7udL8MqofowHwMlSwDRCI3CPSA3YZYPkiFOlq3L7iINKQ3chmzETioEot8i65CBlojBCAOZ921eCupgamQ0RKLdwmUSnhESA5cKfBUETqC_ONeE7zzMV4GQZxbGdCsUN4QfiYYYumKKEuEZntvE8Ew1IL8Qarhs Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:01.958508 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1daba1b3ce8e4e55aba8c2d684ca6601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1daba1b3ce8e4e55aba8c2d684ca6601 Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003699189 Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 93ce351fde36493eb6ffce973ee2e3c1 Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003699189-project Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. Jul 19 19:49:01.960072 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '5aff775e-62bf-47f1-8271-712f28a34bac'} Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:01.960962 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. Jul 19 19:49:01.962494 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.963737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] Returning 404 to user: Instance 5aff775e-62bf-47f1-8271-712f28a34bac could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:01.963737 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0842f6c4-44de-4db0-a861-dcb3f5399eb7 tempest-FloatingIPsAssociationTestJSON-2003699189 tempest-FloatingIPsAssociationTestJSON-2003699189-project] 10.222.0.33 "GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac" status: 404 len: 111 microversion: 2.1 time: 0.068929 Jul 19 19:49:01.967410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 429/841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/5aff775e-62bf-47f1-8271-712f28a34bac => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:02.155846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:02.156468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:02.165066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.165723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.166696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.167307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.190262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:02.521094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:02.530318 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-973b6b4a-0306-424f-95b8-2fcc126971cf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.379065 Jul 19 19:49:02.531029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 413/842] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:02 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:03.548246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:03.549293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:03.559581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.563962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.565664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.569546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.812325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9df97673-7963-4542-bcc2-037d2edd9c48 req-295c7def-85aa-47df-80b3-0b0fefc468de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:03.829268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9df97673-7963-4542-bcc2-037d2edd9c48 req-295c7def-85aa-47df-80b3-0b0fefc468de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.829710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9df97673-7963-4542-bcc2-037d2edd9c48 req-295c7def-85aa-47df-80b3-0b0fefc468de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.850041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9df97673-7963-4542-bcc2-037d2edd9c48 req-295c7def-85aa-47df-80b3-0b0fefc468de service nova] Creating event network-changed:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:49:03.857559 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9df97673-7963-4542-bcc2-037d2edd9c48 req-295c7def-85aa-47df-80b3-0b0fefc468de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048861 Jul 19 19:49:03.858944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 414/843] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:03.879419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:03.890341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a1f8203-9ac6-4f93-a427-8b2bff627135 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.346272 Jul 19 19:49:03.891693 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 430/844] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:03 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:04.393571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8fc86033-27ba-4475-9d35-773076a9e672 req-177a956a-4636-4ad5-9068-6798ae71640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b57132-23d1-4cd3-987e-0bf1990145d5", "name": "network-vif-plugged", "status": "completed", "tag": "8d3b3f6c-647f-41ba-8699-5d6be35c8932"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:04.414268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8fc86033-27ba-4475-9d35-773076a9e672 req-177a956a-4636-4ad5-9068-6798ae71640a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.415047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8fc86033-27ba-4475-9d35-773076a9e672 req-177a956a-4636-4ad5-9068-6798ae71640a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:04.439950 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8fc86033-27ba-4475-9d35-773076a9e672 req-177a956a-4636-4ad5-9068-6798ae71640a service nova] Creating event network-vif-plugged:8d3b3f6c-647f-41ba-8699-5d6be35c8932 for instance 29b57132-23d1-4cd3-987e-0bf1990145d5 on n-h2-843861-3 Jul 19 19:49:04.445315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8fc86033-27ba-4475-9d35-773076a9e672 req-177a956a-4636-4ad5-9068-6798ae71640a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056787 Jul 19 19:49:04.446761 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 415/845] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:04.909516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:04.911179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:04.918921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.920001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:04.920798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.921498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:05.139046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:05.153299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea135080-1a97-4a73-af2e-d1773d9d3206 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.248864 Jul 19 19:49:05.153912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 431/846] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:04 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:06.171998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:06.172535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:06.184334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.186037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.194098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.194786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.611788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:06.632091 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ceeb5a9-9f5c-4f06-90ed-f7f156687f3b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1316 microversion: 2.1 time: 0.464282 Jul 19 19:49:06.638777 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 416/847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:06 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:07.524517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056a8d22-cd38-41be-99a8-0fb017b1ca95 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88e4bd0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973780654", "description": "tempest-description-284882658"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:07.664779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:07.666220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:07.693858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.694228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.699956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.701485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.072854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-056a8d22-cd38-41be-99a8-0fb017b1ca95 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.721571 Jul 19 19:49:08.074582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 432/848] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:08.087279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57586a15-fcda-4e4b-ac18-47b8d9c46111 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88e4bd9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-517173496", "description": "tempest-description-1708469190"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:08.192057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:08.213376 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49ff686b-61c6-42bc-9df9-e6be6f42e0f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1465 microversion: 2.1 time: 0.556661 Jul 19 19:49:08.230905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 417/849] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:07 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1465 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:08.242679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:08.243692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:08.269113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.272646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.273544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.275429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.738691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fdde6ea6-a14b-4bd8-b9a0-f73499a8ef23 tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1616 microversion: 2.1 time: 0.503098 Jul 19 19:49:08.739926 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 418/850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:08 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1616 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:08.819104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57586a15-fcda-4e4b-ac18-47b8d9c46111 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.737458 Jul 19 19:49:08.819584 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 433/851] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:08.936599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1314178252", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "9394d149-6b0f-4652-ac92-0ca141cad73f"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:08.964205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1971813561", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:08.976006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:09.031475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] validate_networks() for [('9394d149-6b0f-4652-ac92-0ca141cad73f', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:09.040656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:10.642107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:10.643220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:10.643927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:10.644518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:10.645932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:10.672344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.673336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.674374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.677807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.767530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:10.816807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:10.888932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:10.902413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:11.015553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e409f5fd-8148-40ff-b087-3214e921df46 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050586 Jul 19 19:49:11.016653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 434/852] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:11.030317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c912ef3-d2f8-4f78-a22e-eddf94f65cf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:11.030960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c912ef3-d2f8-4f78-a22e-eddf94f65cf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:11.194472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c912ef3-d2f8-4f78-a22e-eddf94f65cf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:11.209962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c912ef3-d2f8-4f78-a22e-eddf94f65cf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1217 microversion: 2.1 time: 0.185633 Jul 19 19:49:11.227793 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 435/853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:11 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:11.251076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:11.251599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:11.252475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:11.253324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:11.253866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:11.266538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:11.267159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:11.268217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:11.269098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:11.301778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Getting quotas for project 8d845c4b74044ec7859074c20b6f5137. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:11.310973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Getting quotas for user 96b0e2a68a664e72bef5d21f7533ff85 and project 8d845c4b74044ec7859074c20b6f5137. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:11.328184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:11.331495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:11.447634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d81a6ff0-5de1-4ce8-a4e6-d3e874f52067 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518541 Jul 19 19:49:11.449030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 419/854] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:49:11.460651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e837b134-b70f-48e8-bcfe-53e4ca60ba76 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:11.464665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e837b134-b70f-48e8-bcfe-53e4ca60ba76 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:11.542658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e837b134-b70f-48e8-bcfe-53e4ca60ba76 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:11.553265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e837b134-b70f-48e8-bcfe-53e4ca60ba76 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1216 microversion: 2.1 time: 0.098510 Jul 19 19:49:11.554487 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 436/855] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:11 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:12.231891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.233754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.247968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.254116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.258270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.259211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.421481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.433633 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cacadcc4-ecf7-4ba7-9afc-f0a5a3c64d78 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1213 microversion: 2.1 time: 0.206713 Jul 19 19:49:12.434560 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 420/856] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:12.573489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.575055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.593706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.594170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.596168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.599356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.740276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.747758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7522c14c-2065-44a6-ae1d-abd6a832c6fb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1220 microversion: 2.1 time: 0.178453 Jul 19 19:49:12.749889 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 437/857] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:13.331901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-386524147", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f99d3c74-93b6-4718-9088-9758ebb4ad6d"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:13.451924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.452626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.458073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] validate_networks() for [('f99d3c74-93b6-4718-9088-9758ebb4ad6d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:13.500992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.501817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.504425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.506774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.787140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:13.796154 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-37c71009-3546-4c36-a70c-3428d66bce82 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1275 microversion: 2.1 time: 0.349637 Jul 19 19:49:13.808138 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 438/858] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:13.824860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.825915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.842571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.843398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.844448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.845100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.072635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:14.075773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:14.100433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d770acb-4a4f-4f8b-b233-2a45335d6d70 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1274 microversion: 2.1 time: 0.290583 Jul 19 19:49:14.122070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 439/859] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:14.602147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:14.602718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:14.603023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:14.603429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:14.603975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:14.625513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.630878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.633663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.634564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.720198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:14.745826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for user fecc799226eb4a39950040a548b1987d and project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:14.778165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:14.785478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:14.831335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:14.832253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:14.850674 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-037b1594-800f-4c8f-8aa4-2b0e4c978b12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770306 Jul 19 19:49:14.851422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.852070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.853020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.853274 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 421/860] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:14.865096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.883440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a4b7801-6645-4ec6-920c-5682849bec2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:14.886397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a4b7801-6645-4ec6-920c-5682849bec2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:15.058313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a4b7801-6645-4ec6-920c-5682849bec2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:15.071691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a4b7801-6645-4ec6-920c-5682849bec2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1207 microversion: 2.1 time: 0.207929 Jul 19 19:49:15.073660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 422/861] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:14 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1207 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:15.105445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:15.123314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:15.124437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:15.129304 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee97be4d-fda6-4278-b11e-ed9b85d4cd98 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1275 microversion: 2.1 time: 0.302239 Jul 19 19:49:15.139654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.141036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.142557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.144050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.144954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 440/862] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:14 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:15.609878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:15.633583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20474a48-09a7-42d2-a66c-b6a5c52b209b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.516557 Jul 19 19:49:15.634706 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 423/863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:15 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:16.093055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:16.093786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:16.109239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.109923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.110942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.112341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.146995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:16.147875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:16.159738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.160240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.161088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.161525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.343490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:16.354167 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f85d96d-5680-446f-9e34-d504bc01aca6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1203 microversion: 2.1 time: 0.264811 Jul 19 19:49:16.357057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 441/864] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:16 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1203 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:16.539118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:16.551532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db5672d8-a6c1-4aab-a965-f8c06e8b979a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.408541 Jul 19 19:49:16.565964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 424/865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:16 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:16.650995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:16.651713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:16.664005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.666347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.667519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.671643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.376849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.378360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.395962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.396439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.397216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.406855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:17.407599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.415690 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73d8bb36-68e9-4cb7-b30f-ca63d6c3f33d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.768435 Jul 19 19:49:17.432732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 442/866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:16 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:17.573255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.573872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.581574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.582024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.582849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.583287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.629106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:17.633012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:17.647562 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-997e4480-021f-465c-aa1f-a4c5e706ebb7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1265 microversion: 2.1 time: 0.278008 Jul 19 19:49:17.666563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 425/867] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:17 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:17.979537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:18.027130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbe6b4d9-52b9-4c26-ad0a-b9ab33509e4f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.437713 Jul 19 19:49:18.032758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 443/868] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:17 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:18.075988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5b694b69-93c5-4c83-b1da-0a5f2fd0b2f7 req-3311c586-dd3b-4b15-9110-5705b9c643de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bdb705-c7c6-41a7-8d69-c5f738b09d96", "tag": "2a1aee42-4208-4e44-b563-9cff67013c45"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:18.094096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5b694b69-93c5-4c83-b1da-0a5f2fd0b2f7 req-3311c586-dd3b-4b15-9110-5705b9c643de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.097971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5b694b69-93c5-4c83-b1da-0a5f2fd0b2f7 req-3311c586-dd3b-4b15-9110-5705b9c643de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.122881 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5b694b69-93c5-4c83-b1da-0a5f2fd0b2f7 req-3311c586-dd3b-4b15-9110-5705b9c643de service nova] Creating event network-changed:2a1aee42-4208-4e44-b563-9cff67013c45 for instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 on n-h2-843861-3 Jul 19 19:49:18.128715 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5b694b69-93c5-4c83-b1da-0a5f2fd0b2f7 req-3311c586-dd3b-4b15-9110-5705b9c643de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058127 Jul 19 19:49:18.130450 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 426/869] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:18.377822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b2f43ce4-97c2-4216-ab60-70bdafdd680b req-70602739-1aa8-4713-acd5-9ddfa7eb537d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb33d4-1db1-416b-ba0c-44ce50a43186", "tag": "3004977b-b9d8-4c94-bfa7-b45ce035bf5f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:18.399599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b2f43ce4-97c2-4216-ab60-70bdafdd680b req-70602739-1aa8-4713-acd5-9ddfa7eb537d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.400075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b2f43ce4-97c2-4216-ab60-70bdafdd680b req-70602739-1aa8-4713-acd5-9ddfa7eb537d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.438834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:18.440214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:18.441427 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b2f43ce4-97c2-4216-ab60-70bdafdd680b req-70602739-1aa8-4713-acd5-9ddfa7eb537d service nova] Creating event network-changed:3004977b-b9d8-4c94-bfa7-b45ce035bf5f for instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 on n-h1-843861-3 Jul 19 19:49:18.453912 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b2f43ce4-97c2-4216-ab60-70bdafdd680b req-70602739-1aa8-4713-acd5-9ddfa7eb537d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078721 Jul 19 19:49:18.456078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.456381 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 444/870] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:18.456915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.465045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.465759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.666551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:18.667256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:18.681252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.681781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.690877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.691732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.304258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.312673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7504b2d8-3ac6-4c49-8acd-be7c4cd36c78 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1265 microversion: 2.1 time: 0.650788 Jul 19 19:49:19.316752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 445/871] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:18 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1265 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:19.331399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:19.342745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:19.355225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.363367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.364598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.365208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.806821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.819727 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6a4e6bb-687b-49ee-92b3-79e9641cad45 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 1.386110 Jul 19 19:49:19.820691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 427/872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:18 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:19.961404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.969504 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9acfe01-c4d7-4848-955d-4399e743aa41 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.642498 Jul 19 19:49:19.981844 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 446/873] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:19 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:20.336456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.337077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:20.360441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.361250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.364915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.368858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.788592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:20.797848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-572855a6-0803-41fc-b965-a8267f9b5aeb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.467763 Jul 19 19:49:20.798447 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 428/874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:20.837403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.838445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:20.848513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:20.850470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.851508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.855023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.855932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.996583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.997392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:21.008750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.009199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.016087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.016639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.102098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:21.112316 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5385994a-afa5-4428-b35a-5edcb9befca0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.278620 Jul 19 19:49:21.122906 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 447/875] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:21.270030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:21.281557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c4c70556-8f6d-4c32-b6f4-0eb71bc0cc48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.295866 Jul 19 19:49:21.282142 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 429/876] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:21.811334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:21.815888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:21.816757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:21.834943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.835646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.836620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.837228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.129585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:22.131394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:22.142965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.152098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.153180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.153777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.524666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:22.537776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f5fd8d9-bc0b-4318-9c07-c8f278eb8e66 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.726999 Jul 19 19:49:22.538394 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 448/877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:21 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:22.557612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:22.558349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:22.583933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.584392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.585202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.585638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.672015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:22.686609 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2d1cfe1-614e-452b-b188-150f102ee5c3 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.560800 Jul 19 19:49:22.697334 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 430/878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:22 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:22.881719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-928167938", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "ab4b83df-5d6c-4af1-a2b5-442cf3efe844"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:23.010165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] validate_networks() for [('ab4b83df-5d6c-4af1-a2b5-442cf3efe844', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:23.302530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:23.320587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97f757aa-5789-451d-9f95-ceef61505937 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.772068 Jul 19 19:49:23.322283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 449/879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:22 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:23.555441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.557610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.569413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.570334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.571373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.572085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.984422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:23.993037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8bc963a-c884-4957-842f-988e879b02ce tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.441993 Jul 19 19:49:23.993913 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 450/880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:24.005384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:24.006086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.013190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.013733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.014603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.015108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.378847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:24.379316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:24.383669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:24.384184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:24.384802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:24.402333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.403101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.405346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.405803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.414262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:24.430726 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63c79c4e-5b0e-49ad-b86a-1c52c86ec126 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.435584 Jul 19 19:49:24.430941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:24.440974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 451/881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:24.441291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for user 5035bdfa56304514a841334c420b1041 and project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:24.445289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a5db8a2d-5f96-4c6b-b63f-115d6f2e8e03 req-3051e4d0-00db-4d3f-94f1-dde4179fe6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a765cdd0-ec1d-471f-af7b-aa75e2ad6bda", "tag": "65f7f273-4751-4dd2-8f1a-888378bd53b4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:24.450033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:24.452339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:24.454971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a5db8a2d-5f96-4c6b-b63f-115d6f2e8e03 req-3051e4d0-00db-4d3f-94f1-dde4179fe6c8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.455581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a5db8a2d-5f96-4c6b-b63f-115d6f2e8e03 req-3051e4d0-00db-4d3f-94f1-dde4179fe6c8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.468326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:24.479434 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a5db8a2d-5f96-4c6b-b63f-115d6f2e8e03 req-3051e4d0-00db-4d3f-94f1-dde4179fe6c8 service nova] Creating event network-changed:65f7f273-4751-4dd2-8f1a-888378bd53b4 for instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda on n-h1-843861-3 Jul 19 19:49:24.485244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a5db8a2d-5f96-4c6b-b63f-115d6f2e8e03 req-3051e4d0-00db-4d3f-94f1-dde4179fe6c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051955 Jul 19 19:49:24.486516 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 452/882] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:24.494874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:24.495847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.506690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.507431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.508432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.509168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.518618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abc94f8f-4660-483f-8939-49e3d407d8f9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748067 Jul 19 19:49:24.519503 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 431/883] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:49:24.529867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d48b2fae-eadb-40a1-9020-498fe707d116 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:24.530507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d48b2fae-eadb-40a1-9020-498fe707d116 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.647072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d48b2fae-eadb-40a1-9020-498fe707d116 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:24.662053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d48b2fae-eadb-40a1-9020-498fe707d116 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1224 microversion: 2.1 time: 0.135984 Jul 19 19:49:24.671883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 432/884] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:24 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:24.785569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:24.796978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98cd22f0-e074-4359-a4a8-61efe8a29c4a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.308940 Jul 19 19:49:24.797804 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 453/885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:24 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:24.852665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4ed9420-b408-433f-9a2f-22a07815a01f"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:24.854951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.863639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.864702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.865841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.866436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.010259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.010867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.018870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.019349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.020170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.020611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.165518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:25.176372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c03ce53-2e6d-4c92-8d1e-080526d1c3fb tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.169703 Jul 19 19:49:25.178327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 454/886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:25 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:25.183703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-59de57f6-d3e4-460e-9825-a5d0a69eb60a req-bc48baff-705b-4ecc-9ae1-02cb951d6387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fb33d4-1db1-416b-ba0c-44ce50a43186", "name": "network-vif-plugged", "status": "completed", "tag": "3004977b-b9d8-4c94-bfa7-b45ce035bf5f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:25.193904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-59de57f6-d3e4-460e-9825-a5d0a69eb60a req-bc48baff-705b-4ecc-9ae1-02cb951d6387 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.194354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-59de57f6-d3e4-460e-9825-a5d0a69eb60a req-bc48baff-705b-4ecc-9ae1-02cb951d6387 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.213482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-59de57f6-d3e4-460e-9825-a5d0a69eb60a req-bc48baff-705b-4ecc-9ae1-02cb951d6387 service nova] Creating event network-vif-plugged:3004977b-b9d8-4c94-bfa7-b45ce035bf5f for instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 on n-h1-843861-3 Jul 19 19:49:25.219228 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-59de57f6-d3e4-460e-9825-a5d0a69eb60a req-bc48baff-705b-4ecc-9ae1-02cb951d6387 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039611 Jul 19 19:49:25.221240 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 455/887] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:25.449675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.450383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.456692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.457144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.457953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.458391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.594467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:25.602944 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cb7fdf4-83f9-4f58-865f-3c11d0c1b743 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.157420 Jul 19 19:49:25.603547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 456/888] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:25 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:25.679223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.679870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.686193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.686646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.687410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.688067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.752824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:25.760744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67f8ba56-57cb-49e2-85f5-a12e7f20ce71 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1228 microversion: 2.1 time: 0.086074 Jul 19 19:49:25.761315 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 457/889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:25 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:25.822068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.822698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.835589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.836823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.837652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.838073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.869601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:26.151290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6dcce3f-4bd7-4522-baaa-70f4144e274c tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "POST /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.303523 Jul 19 19:49:26.156470 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 433/890] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:49:24 2022] POST /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments => generated 194 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:26.195059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:26.195785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:26.205424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.205847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.206835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.207585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.523729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:26.533139 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72568522-8b56-4c50-bcff-f4aeb1e4dacd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.719534 Jul 19 19:49:26.533708 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 458/891] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:25 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:26.621141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:26.622241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:26.632419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.632870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.633657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.634102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.864917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:26.879109 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51ed079f-c869-489f-8827-ebc8a45fedca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.688150 Jul 19 19:49:26.880707 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 434/892] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:26 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:26.887669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:26.889109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:26.897499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.899116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.900300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:26.901884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:26.930323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:26.939014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-862278c5-66de-4b34-8fe4-ae0a7ae67a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1316 microversion: 2.1 time: 0.323267 Jul 19 19:49:26.951343 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 459/893] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:26 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:27.128168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:27.140693 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ddc744c-0a86-4335-b7d4-8d032d123b40 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1282 microversion: 2.1 time: 0.258580 Jul 19 19:49:27.150324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 435/894] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:26 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:27.551553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:27.553987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:27.566478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.567294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:27.569764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.570206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:27.906246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:27.907981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:27.934861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.938253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:27.941214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.941950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:27.967886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:27.977255 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa7571f1-2cfd-442c-a9cd-82bb3d07c7dc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.430606 Jul 19 19:49:27.988951 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 460/895] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:27 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:27.995613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:27.996521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:28.021893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.023014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.024117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.024717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.461029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:28.479132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6ae980f-7122-4e8b-b107-07edf413b58d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.585736 Jul 19 19:49:28.480370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 436/896] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:27 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:28.485168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:28.491097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:28.509889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.510347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.511138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.511562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.635786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:28.650788 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-afe5d1e3-22f3-45e2-893e-6c1fa338e239 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1504 microversion: 2.1 time: 0.660353 Jul 19 19:49:28.656110 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 461/897] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:27 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:28.673114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8d9c0e3c-8c85-478f-a6dc-d6dd4831146a req-382475e8-282f-46c3-9d58-39cb5c708b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bdb705-c7c6-41a7-8d69-c5f738b09d96", "name": "network-vif-plugged", "status": "completed", "tag": "2a1aee42-4208-4e44-b563-9cff67013c45"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:28.682093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d9c0e3c-8c85-478f-a6dc-d6dd4831146a req-382475e8-282f-46c3-9d58-39cb5c708b8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.682545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d9c0e3c-8c85-478f-a6dc-d6dd4831146a req-382475e8-282f-46c3-9d58-39cb5c708b8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.716306 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8d9c0e3c-8c85-478f-a6dc-d6dd4831146a req-382475e8-282f-46c3-9d58-39cb5c708b8a service nova] Creating event network-vif-plugged:2a1aee42-4208-4e44-b563-9cff67013c45 for instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 on n-h2-843861-3 Jul 19 19:49:28.734779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8d9c0e3c-8c85-478f-a6dc-d6dd4831146a req-382475e8-282f-46c3-9d58-39cb5c708b8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065772 Jul 19 19:49:28.735763 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 462/898] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:28.742784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973780654"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:28.743484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:28.756873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.757639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.758650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.760113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.008470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:29.027465 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-835ce5f0-4d16-440e-886e-cde3714c7769 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.545777 Jul 19 19:49:29.028417 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 437/899] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:28 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:29.033412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:29.034294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:29.043448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.044290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.045816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.046350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.078548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Adding security group 804d6d0d-fe77-44d3-8963-c93e87c11735 to port 3004977b-b9d8-4c94-bfa7-b45ce035bf5f Jul 19 19:49:29.503552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:29.511542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7843245-e712-4743-a86f-7f7a41c6cf0e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.481693 Jul 19 19:49:29.512510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 438/900] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:29 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:29.517427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:29.518234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:29.525423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.525955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.526823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.527258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.835525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:29.843854 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2801ab9e-6112-4fe8-b4bd-6199652f1f5a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.329909 Jul 19 19:49:29.854670 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 439/901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:29 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:29.957033 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6b39bc7-ab6f-4275-a938-12785aa115fd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/action" status: 202 len: 0 microversion: 2.1 time: 1.219940 Jul 19 19:49:29.957687 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 463/902] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:28 2022] POST /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/action => generated 0 bytes in 1221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:29.972950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-517173496"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:29.973817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:29.986749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.987550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.989817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-cac94c66-4aa8-4c1f-a2f2-7a2b3de9d826 req-250c308c-38e6-42fa-a9c9-21ce5d8e1442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb33d4-1db1-416b-ba0c-44ce50a43186", "tag": "3004977b-b9d8-4c94-bfa7-b45ce035bf5f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:29.990527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.991137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.013815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cac94c66-4aa8-4c1f-a2f2-7a2b3de9d826 req-250c308c-38e6-42fa-a9c9-21ce5d8e1442 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.014762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cac94c66-4aa8-4c1f-a2f2-7a2b3de9d826 req-250c308c-38e6-42fa-a9c9-21ce5d8e1442 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.042317 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-cac94c66-4aa8-4c1f-a2f2-7a2b3de9d826 req-250c308c-38e6-42fa-a9c9-21ce5d8e1442 service nova] Creating event network-changed:3004977b-b9d8-4c94-bfa7-b45ce035bf5f for instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 on n-h1-843861-3 Jul 19 19:49:30.066240 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-cac94c66-4aa8-4c1f-a2f2-7a2b3de9d826 req-250c308c-38e6-42fa-a9c9-21ce5d8e1442 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080188 Jul 19 19:49:30.079876 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 464/903] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:30.094364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.095389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:30.116817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.117565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.118724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.120458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.527134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.security_group_api [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Adding security group dc2076af-6a24-4d38-b659-f4f11d4b9b58 to port 3004977b-b9d8-4c94-bfa7-b45ce035bf5f Jul 19 19:49:30.740226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:30.748958 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-807499e0-15fe-4c97-af6c-c14c818fea2d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.666919 Jul 19 19:49:30.749725 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 465/904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:30.759668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.759668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:30.762568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.763135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.764149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.764655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.508446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:31.524158 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a50409aa-b0ca-4b20-b0ea-efbe800698ed tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1317 microversion: 2.1 time: 0.773201 Jul 19 19:49:31.525452 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 466/905] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:31.531648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7e41c856-ee93-4d0a-878e-d38a98475086 req-20c64e20-ebdf-4802-94cd-440a78683306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a765cdd0-ec1d-471f-af7b-aa75e2ad6bda", "name": "network-vif-plugged", "status": "completed", "tag": "65f7f273-4751-4dd2-8f1a-888378bd53b4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:31.543645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7e41c856-ee93-4d0a-878e-d38a98475086 req-20c64e20-ebdf-4802-94cd-440a78683306 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.544476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7e41c856-ee93-4d0a-878e-d38a98475086 req-20c64e20-ebdf-4802-94cd-440a78683306 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.560691 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7e41c856-ee93-4d0a-878e-d38a98475086 req-20c64e20-ebdf-4802-94cd-440a78683306 service nova] Creating event network-vif-plugged:65f7f273-4751-4dd2-8f1a-888378bd53b4 for instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda on n-h1-843861-3 Jul 19 19:49:31.566361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7e41c856-ee93-4d0a-878e-d38a98475086 req-20c64e20-ebdf-4802-94cd-440a78683306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038263 Jul 19 19:49:31.568659 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 467/906] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:31.591548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:31.592558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:31.631555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.632278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.633288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.633956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.151339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:32.164968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddf3c5b2-a4cb-47d4-b4fc-71c2013a3662 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.593725 Jul 19 19:49:32.167236 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 468/907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:31 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:32.190701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:32.191549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:32.208616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.210246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.214565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.216420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.231156 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d11e9977-5f59-472f-a7c0-b87b89ba81df tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/action" status: 202 len: 0 microversion: 2.1 time: 2.267592 Jul 19 19:49:32.232466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 440/908] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:29 2022] POST /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/action => generated 0 bytes in 2270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:32.238663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c2aea6dc-67fd-4933-beea-f15f3fe1d226 req-2bdf36bb-2a46-4c4e-9526-ac3cb434e7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ceadae2-7799-44a9-b9da-4897bf77f456", "tag": "3ee1c0d9-e039-4dc2-addd-2c608042de1d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:32.270062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2aea6dc-67fd-4933-beea-f15f3fe1d226 req-2bdf36bb-2a46-4c4e-9526-ac3cb434e7f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.274648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2aea6dc-67fd-4933-beea-f15f3fe1d226 req-2bdf36bb-2a46-4c4e-9526-ac3cb434e7f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.304037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c2aea6dc-67fd-4933-beea-f15f3fe1d226 req-2bdf36bb-2a46-4c4e-9526-ac3cb434e7f2 service nova] Creating event network-changed:3ee1c0d9-e039-4dc2-addd-2c608042de1d for instance 4ceadae2-7799-44a9-b9da-4897bf77f456 on n-h1-843861-3 Jul 19 19:49:32.325774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c2aea6dc-67fd-4933-beea-f15f3fe1d226 req-2bdf36bb-2a46-4c4e-9526-ac3cb434e7f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091499 Jul 19 19:49:32.326397 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 441/909] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:32.338219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:32.338793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:32.359728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.360222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.361008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.361445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.632326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:32.649841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1cfaa56-11b4-4fbc-96e7-4f426d1dab83 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.466325 Jul 19 19:49:32.654626 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed95d6d4-dc62-40f8-a5c0-4712f0209470 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.321196 Jul 19 19:49:32.655225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 442/910] 10.222.0.33 () {58 vars in 1292 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186/os-security-groups => generated 1157 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:32.660684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:32.662413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:32.662588 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 469/911] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:32.675243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.677954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-80f5e1ff-2f4b-4c05-90e9-35a86419bdae tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88e0b6430>, body: {"security_group": {"name": " tempest-securitygroup -354446024 ", "description": "tempest-description-616870466"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:32.682834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.683662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.684146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.914171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:32.923993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22cdbe9d-951f-41f7-8af6-5e6c514a3f8e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1467 microversion: 2.1 time: 0.267476 Jul 19 19:49:32.932897 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 443/912] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:32.942709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:32.943471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:32.943664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-80f5e1ff-2f4b-4c05-90e9-35a86419bdae tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.278617 Jul 19 19:49:32.944643 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 470/913] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:32 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:32.957204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.957692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.958473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.958908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.959103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d478dfdd-8238-41a1-a24f-aa65067a2055 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88e4ca8b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.059166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d478dfdd-8238-41a1-a24f-aa65067a2055 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272" status: 200 len: 222 microversion: 2.1 time: 0.106328 Jul 19 19:49:33.059765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 471/914] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 => generated 222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:33.070112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4fd96ca-7052-432f-8f32-a37da7c5788c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88e4c1280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.146647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:33.154521 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f7a1525-ef64-44e0-8f11-326f6159a3ab tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1618 microversion: 2.1 time: 0.216103 Jul 19 19:49:33.155100 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 444/915] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1618 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:33.182706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.183675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:33.190815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.191401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.192305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.192836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.343344 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4fd96ca-7052-432f-8f32-a37da7c5788c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272" status: 202 len: 0 microversion: 2.1 time: 0.276756 Jul 19 19:49:33.343975 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 472/916] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:49:33 2022] DELETE /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:49:33.349501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1498169357", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:33.389681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:33.397852 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12789f88-ec28-4b2e-bec3-6ad917755117 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1307 microversion: 2.1 time: 0.218977 Jul 19 19:49:33.398417 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 445/917] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:33 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:33.403038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dde0c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.410670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:33.436870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:49:33.437508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group c7e5930a-1374-4dc7-b8ba-264617e80272 not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:49:33.438092 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.438092 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 HTTP/1.1 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:33.446294 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.447941 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c7e5930a-1374-4dc7-b8ba-264617e80272'} Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:33.448965 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:49:33.450458 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.451721 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-15c02d03-8fc1-4385-a622-972131e22e92'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:33.453236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eeb394fe-62fb-4b8b-9fb6-c7230f60dad9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272" status: 404 len: 194 microversion: 2.1 time: 0.048368 Jul 19 19:49:33.454337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 446/918] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:49:33 2022] GET /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:33.459522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6780a45b-d6e4-4642-8552-cbf8bd929b6f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88dd740d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-940889853", "description": "tempest-description-359379195"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:33.735574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:33.736127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:33.736608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:33.737121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:33.737570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:33.747127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.747572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.748418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.748843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.752868 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6780a45b-d6e4-4642-8552-cbf8bd929b6f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.297433 Jul 19 19:49:33.768310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:33.770738 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 447/919] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:33.774330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Getting quotas for user 89c18af32196451a91ded3dcf6471b19 and project 8343d8338a9c4ad19d0dcf58b9766531. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:33.775511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.776141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:33.784164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.784622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.785648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.786768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.791026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:33.794066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:33.797713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:33.844594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4e2b7cb-fd33-4163-9f0f-108a0da1f368 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499268 Jul 19 19:49:33.845258 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 473/920] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:33.850383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fcb2ad7d-0c76-4130-83c7-2cbe73a5ef3f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb8914fcf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2002808713", "description": "tempest-description-915696565"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:33.983282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:33.998267 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-030299b0-e3d8-4b4c-8563-6de2bd42f915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.226385 Jul 19 19:49:33.998858 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 448/921] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:33 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:34.013402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-798719d2-d7a2-4f1d-9eef-0d69a93a32ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.014245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-798719d2-d7a2-4f1d-9eef-0d69a93a32ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:34.089248 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fcb2ad7d-0c76-4130-83c7-2cbe73a5ef3f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.241552 Jul 19 19:49:34.092587 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 474/922] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:34.102163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-798719d2-d7a2-4f1d-9eef-0d69a93a32ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:34.103101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7212262a-6db2-4a5c-bc8e-85599a6af383 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88e4b8670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1949339698", "description": "tempest-description-844207551"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:34.109466 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-798719d2-d7a2-4f1d-9eef-0d69a93a32ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1217 microversion: 2.1 time: 0.100253 Jul 19 19:49:34.119412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 449/923] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:33 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:34.313914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7212262a-6db2-4a5c-bc8e-85599a6af383 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.214633 Jul 19 19:49:34.314823 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 475/924] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:34.328149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2802f0ab-1a77-49d7-a59b-a2cc5263d11c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dd74700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.372961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-50617aa1-5028-4d6d-9ed3-42647d967d3b req-22141296-4f77-4d65-95cb-672cc70981b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb33d4-1db1-416b-ba0c-44ce50a43186", "tag": "3004977b-b9d8-4c94-bfa7-b45ce035bf5f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:34.383675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-50617aa1-5028-4d6d-9ed3-42647d967d3b req-22141296-4f77-4d65-95cb-672cc70981b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.384373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-50617aa1-5028-4d6d-9ed3-42647d967d3b req-22141296-4f77-4d65-95cb-672cc70981b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.396311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-50617aa1-5028-4d6d-9ed3-42647d967d3b req-22141296-4f77-4d65-95cb-672cc70981b6 service nova] Creating event network-changed:3004977b-b9d8-4c94-bfa7-b45ce035bf5f for instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 on n-h1-843861-3 Jul 19 19:49:34.401667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-50617aa1-5028-4d6d-9ed3-42647d967d3b req-22141296-4f77-4d65-95cb-672cc70981b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Jul 19 19:49:34.402279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 476/925] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:34.416454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.417428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:34.421789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:34.427290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.427747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.428973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.429419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.695973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:34.704463 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8b71ca79-d1ec-42a8-af89-8efec519ca1a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1488 microversion: 2.1 time: 0.293530 Jul 19 19:49:34.709169 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 477/926] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:34 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1488 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:34.720463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:34.720996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:34.727467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.727956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.728731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.729162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.744359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2802f0ab-1a77-49d7-a59b-a2cc5263d11c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.422382 Jul 19 19:49:34.745041 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 450/927] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:49:34 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:34.756410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66283bc3-41fb-4f04-8844-77f3d40f4cdd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dd43700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.800774 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ccad8ea6-2e90-4fdb-a73e-e480d39da160 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda/action" status: 202 len: 0 microversion: 2.1 time: 0.083718 Jul 19 19:49:34.803222 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 478/928] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:34 2022] POST /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:49:34.812266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.814621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:34.821618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.822071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.822896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.823329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.308121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:35.317569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ee6c00d-fac1-4881-8541-b9f6c567f4c9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1493 microversion: 2.1 time: 0.509339 Jul 19 19:49:35.318464 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 479/929] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:34 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1493 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:35.324886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:35.325665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:35.331756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.332252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.333596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.334034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.945904 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66283bc3-41fb-4f04-8844-77f3d40f4cdd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b" status: 202 len: 0 microversion: 2.1 time: 1.192986 Jul 19 19:49:35.947085 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 451/930] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:49:34 2022] DELETE /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b => generated 0 bytes in 1195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:49:35.953440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:35.954052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:35.960444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.960892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.961688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.962121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.129556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:36.135109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:36.138631 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e56f63bd-c041-48e2-8ae3-fc035c622fc0 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1275 microversion: 2.1 time: 0.190365 Jul 19 19:49:36.139285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 452/931] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:35 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:36.145829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dd43550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:36.147627 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-985899a3-6fa7-4968-98a8-adf59f423c09 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.828116 Jul 19 19:49:36.156827 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 480/932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:35 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:36.228955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:49:36.229549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:49:36.230089 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.230089 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b HTTP/1.1 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:36.232159 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.233673 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '57e9f26d-8c39-4a35-b437-42e4eda16d3b'} Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.234998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:49:36.236645 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.238495 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-62b63359-3b99-4a4d-88d3-9f5729a2ddb1'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98d173be-6cce-458f-82b3-e2fd7e3953c0 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b" status: 404 len: 194 microversion: 2.1 time: 0.092454 Jul 19 19:49:36.240794 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 453/933] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:49:36 2022] GET /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:36.243846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1910e88-d8e6-45ef-b6f9-fea642e1e5a7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88e1fb1f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:36.334981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:36.335710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:36.342934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.343480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.344368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.344867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.684149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:36.691646 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56dccac8-1c60-4c64-a3db-85432d5282ef tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 200 len: 1473 microversion: 2.1 time: 0.361064 Jul 19 19:49:36.693063 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 454/934] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:36 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:36.708724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1574742813"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:36.709837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:36.715894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.716273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.717042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.717474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.796069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1910e88-d8e6-45ef-b6f9-fea642e1e5a7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c" status: 202 len: 0 microversion: 2.1 time: 0.556701 Jul 19 19:49:36.797514 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 481/935] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:49:36 2022] DELETE /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:36.805953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88e4ca9d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:36.853911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:49:36.854769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group 08e01cbf-8db7-46a8-9d51-cb38c987180c not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:49:36.855710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.855710 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c HTTP/1.1 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:36.861167 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.862695 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '08e01cbf-8db7-46a8-9d51-cb38c987180c'} Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.863625 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:49:36.865579 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.866841 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] Jul 19 19:49:36.868282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:36.869932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:49:36.869932 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1996bc95-e99c-4675-a92e-ea21deec2cb4'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:36.871089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5a9477b-05dc-44d4-b235-d292f3ee9155 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c" status: 404 len: 194 microversion: 2.1 time: 0.069554 Jul 19 19:49:36.875114 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 482/936] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:49:36 2022] GET /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:36.888592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82d1af2d-c163-492a-bd0b-fc8b5ed8d528 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88f95bdc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.048737 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e51430d-4c44-49bc-808d-ec3ab8338be9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda/action" status: 202 len: 0 microversion: 2.1 time: 0.340673 Jul 19 19:49:37.067619 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 455/937] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:36 2022] POST /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 19:49:37.073281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4bcce07-a426-4c36-9d29-97ff4e167593 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dddb700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.159308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4bcce07-a426-4c36-9d29-97ff4e167593 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.089992 Jul 19 19:49:37.164860 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 456/938] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:37.169965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.178438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:37.196463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.196833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.197617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.198063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.445925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82d1af2d-c163-492a-bd0b-fc8b5ed8d528 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b" status: 202 len: 0 microversion: 2.1 time: 0.569361 Jul 19 19:49:37.450201 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 483/939] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:49:36 2022] DELETE /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:37.455547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.456287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:37.465792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.466751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.468639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.469199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.502745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:37.512410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df61ad98-7b4b-4130-b84b-964d68a07ca2 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.345900 Jul 19 19:49:37.522428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 457/940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:37.529522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88de94940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.588234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:49:37.589269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group a60e0508-4e26-4206-b655-746b34378b9b not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:49:37.589935 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.589935 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b HTTP/1.1 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:37.592618 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.594137 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a60e0508-4e26-4206-b655-746b34378b9b'} Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:37.595079 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:49:37.597268 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.599031 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] Jul 19 19:49:37.600426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:37.602521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:49:37.602521 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-a1ce6840-bc56-4072-ad0c-0e0091095f58'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:37.603633 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6b779de-56ef-4f82-97d8-cbffa1c5ec13 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b" status: 404 len: 194 microversion: 2.1 time: 0.078727 Jul 19 19:49:37.604240 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 458/941] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:37.612576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fbc500f-42e1-4d96-8c60-c9313d534b6b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88e3afd30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.827288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:37.835630 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-298ebb62-03eb-45e6-8e4a-5f04c9b01d37 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.384133 Jul 19 19:49:37.837333 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 484/942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:37.841998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-978ca0d9-4bd5-4c2a-bd92-69c117b876c2 req-ef7388a3-d54f-433d-a090-20e831eab03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ceadae2-7799-44a9-b9da-4897bf77f456", "name": "network-vif-plugged", "status": "completed", "tag": "3ee1c0d9-e039-4dc2-addd-2c608042de1d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:37.850343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-978ca0d9-4bd5-4c2a-bd92-69c117b876c2 req-ef7388a3-d54f-433d-a090-20e831eab03b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.851631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-978ca0d9-4bd5-4c2a-bd92-69c117b876c2 req-ef7388a3-d54f-433d-a090-20e831eab03b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.864602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-978ca0d9-4bd5-4c2a-bd92-69c117b876c2 req-ef7388a3-d54f-433d-a090-20e831eab03b service nova] Creating event network-vif-plugged:3ee1c0d9-e039-4dc2-addd-2c608042de1d for instance 4ceadae2-7799-44a9-b9da-4897bf77f456 on n-h1-843861-3 Jul 19 19:49:37.870393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-978ca0d9-4bd5-4c2a-bd92-69c117b876c2 req-ef7388a3-d54f-433d-a090-20e831eab03b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Jul 19 19:49:37.871574 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 485/943] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:38.041286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fbc500f-42e1-4d96-8c60-c9313d534b6b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.432365 Jul 19 19:49:38.041889 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 459/944] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:38.057438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff64a574-45e1-46ad-b580-99a317fe001e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88e19e310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1811733465", "description": "tempest-description-1586379398"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:38.177260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b35c1ac-b628-4f5d-860b-7e921740e9ae tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88de948b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:38.234220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b35c1ac-b628-4f5d-860b-7e921740e9ae tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.064866 Jul 19 19:49:38.239855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 460/945] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:38 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:38.388490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff64a574-45e1-46ad-b580-99a317fe001e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.336098 Jul 19 19:49:38.389322 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 486/946] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:38.401720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-580f0e31-e5db-4303-b985-517beecf2bf9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88de3e310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-81076878", "description": "tempest-description-28133147"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:38.525623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-baec3111-31c7-4a50-b74b-15d73b70df67 req-9ea6b297-29d8-4dbd-998d-0b0f17a48bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e4727d-3243-4693-853a-a37fd86d5360", "tag": "82c46559-063c-43d0-be53-2df8616c3895"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:38.540643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-baec3111-31c7-4a50-b74b-15d73b70df67 req-9ea6b297-29d8-4dbd-998d-0b0f17a48bf9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.541237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-baec3111-31c7-4a50-b74b-15d73b70df67 req-9ea6b297-29d8-4dbd-998d-0b0f17a48bf9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.558107 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-baec3111-31c7-4a50-b74b-15d73b70df67 req-9ea6b297-29d8-4dbd-998d-0b0f17a48bf9 service nova] Creating event network-changed:82c46559-063c-43d0-be53-2df8616c3895 for instance 81e4727d-3243-4693-853a-a37fd86d5360 on n-h1-843861-3 Jul 19 19:49:38.564583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-baec3111-31c7-4a50-b74b-15d73b70df67 req-9ea6b297-29d8-4dbd-998d-0b0f17a48bf9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049286 Jul 19 19:49:38.565436 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 487/947] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:38.572038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:38.572742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:38.582302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.583011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.584077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.584666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.589581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:38.705600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-580f0e31-e5db-4303-b985-517beecf2bf9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.309114 Jul 19 19:49:38.706258 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 461/948] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:49:38 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:38.783840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:38.792131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c0511c1a-23b5-4676-8bc1-e1e7e7604de3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.224473 Jul 19 19:49:38.792707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 488/949] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:38 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:38.816149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1603588308", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "9394d149-6b0f-4652-ac92-0ca141cad73f"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:38.853458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:38.854556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:38.861102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.861630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.862500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.862930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.869870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] validate_networks() for [('9394d149-6b0f-4652-ac92-0ca141cad73f', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:39.072963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:39.080447 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8e2140c-854e-409b-806f-9172653e9871 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1324 microversion: 2.1 time: 0.230945 Jul 19 19:49:39.081605 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 489/950] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:38 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:39.251694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c289983d-8e4b-41df-be8a-3f1335359a2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88f95b3a0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:39.310509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c289983d-8e4b-41df-be8a-3f1335359a2b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.065897 Jul 19 19:49:39.311409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 490/951] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:39 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:39.386230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:39.386912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:39.387674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:39.388109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:39.388514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:39.400322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=25 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:39.403546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.404094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:39.405113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.405566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:39.426299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Getting quotas for project 8d845c4b74044ec7859074c20b6f5137. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:39.433179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Getting quotas for user 96b0e2a68a664e72bef5d21f7533ff85 and project 8d845c4b74044ec7859074c20b6f5137. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:39.447413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:39.449827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:39.495488 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16d04784-cf62-4e0b-9e35-e6270d6b160b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683452 Jul 19 19:49:39.496717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 462/952] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:39.507993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94919525-7f0b-4df4-a94f-556793a99acc tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:39.508604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94919525-7f0b-4df4-a94f-556793a99acc tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:39.566154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-94919525-7f0b-4df4-a94f-556793a99acc tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:39.577286 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94919525-7f0b-4df4-a94f-556793a99acc tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1216 microversion: 2.1 time: 0.074073 Jul 19 19:49:39.584401 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 491/953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:39 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:39.809734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:39.810660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:39.819376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.819847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:39.820613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.821435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:39.999538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.009284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-866f97a8-9490-4507-ba49-70d53f8cbad3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.204223 Jul 19 19:49:40.010300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 463/954] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:39 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.097834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.099022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.106014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.106492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.107266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.107701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.240216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.247897 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-17dd4dcb-92ef-4912-a2b8-c617ddb677fb tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.153843 Jul 19 19:49:40.248418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 492/955] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.264487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.265092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.272394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.272840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.273610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.274043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.323654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac9601e4-ca31-4058-b007-3ac32a18bdc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e455dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.367081 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac9601e4-ca31-4058-b007-3ac32a18bdc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.047202 Jul 19 19:49:40.367664 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 493/956] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:40.407413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.415970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0a06d90-9027-4520-9996-e8f3536687ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.155271 Jul 19 19:49:40.416171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 464/957] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.431617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3bb5e64d-abfa-4bd5-b3c7-3c7079a86b9a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1238807244", "metadata": {"": ""}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3bb5e64d-abfa-4bd5-b3c7-3c7079a86b9a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action HTTP/1.1 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 107 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:40.434616 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1238807244", "metadata": {"": ""}}} Jul 19 19:49:40.436076 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1238807244', 'metadata': {'': ''}}}} Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'': ''} Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:40.436915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.438436 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3bb5e64d-abfa-4bd5-b3c7-3c7079a86b9a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3bb5e64d-abfa-4bd5-b3c7-3c7079a86b9a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action" status: 400 len: 170 microversion: 2.1 time: 0.008296 Jul 19 19:49:40.439733 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 494/958] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Jul 19 19:49:40 2022] POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action => generated 170 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:49:40.445239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.446647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.453184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.453636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.454406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.454844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.592882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.597309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.599029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.600991 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18ec5c76-b0c2-4893-9a05-7c59b4dadc00 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.159540 Jul 19 19:49:40.601574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 465/959] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.607480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.608334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.609575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.610170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.638795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.640208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.650269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.650879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.651765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.652314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.684078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.695320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd49418c-23ed-4f3f-9485-ad7b724e4180 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1276 microversion: 2.1 time: 0.104080 Jul 19 19:49:40.696322 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 495/960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.803411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.811223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3806bbb-6a87-4edb-ab41-942bd8c165b2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.186069 Jul 19 19:49:40.812064 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 466/961] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.828829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48c657da-bb1a-4c9d-bc1c-6c8a15565bfc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-321084129", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48c657da-bb1a-4c9d-bc1c-6c8a15565bfc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action HTTP/1.1 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 618 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:40.831865 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:40.833799 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:49:40.834406 n-d-843861-3 devstack@n-api.service[126008]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-321084129", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 19 19:49:40.834406 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:49:40.834406 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-321084129', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 19:49:40.834789 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:40.835626 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.836972 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:49:40.838001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:40.838472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48c657da-bb1a-4c9d-bc1c-6c8a15565bfc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:40.838472 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48c657da-bb1a-4c9d-bc1c-6c8a15565bfc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action" status: 400 len: 938 microversion: 2.1 time: 0.009309 Jul 19 19:49:40.838472 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 496/962] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Jul 19 19:49:40 2022] POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:49:40.843949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.845052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.852877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.853624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.854691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.855123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.990279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.998238 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5272821b-c406-4736-9460-895ef79fb67c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.159264 Jul 19 19:49:40.998818 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 467/963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.016018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.016676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.024231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.024687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.025473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.025916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.027062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.027197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.033164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.033613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.034374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.034960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.250287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.260411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.264763 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b55e1ed3-29fa-4f7b-89d9-ad302a3233bc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.252837 Jul 19 19:49:41.278129 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 497/964] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.278129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-23e4d5cf-e2ad-4fa7-b23d-6b4d4b519763 req-14d3dd97-eb4a-46fc-9926-9b371cd76a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a765cdd0-ec1d-471f-af7b-aa75e2ad6bda", "name": "network-vif-plugged", "status": "completed", "tag": "65f7f273-4751-4dd2-8f1a-888378bd53b4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:41.284135 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38f62c65-379d-44e3-8d56-85919dce4a0c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.261367 Jul 19 19:49:41.285230 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 468/965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:41.288979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23e4d5cf-e2ad-4fa7-b23d-6b4d4b519763 req-14d3dd97-eb4a-46fc-9926-9b371cd76a62 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.289545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23e4d5cf-e2ad-4fa7-b23d-6b4d4b519763 req-14d3dd97-eb4a-46fc-9926-9b371cd76a62 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.291436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dac680c9-2314-46a9-9122-06082a4a6045 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dac680c9-2314-46a9-9122-06082a4a6045 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action HTTP/1.1 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 285 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:41.294077 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:49:41.295410 n-d-843861-3 devstack@n-api.service[126007]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:49:41.296200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:49:41.296847 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:49:41.298142 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:49:41.298952 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:49:41.298952 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:41.298952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dac680c9-2314-46a9-9122-06082a4a6045 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:41.298952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dac680c9-2314-46a9-9122-06082a4a6045 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action" status: 400 len: 619 microversion: 2.1 time: 0.008456 Jul 19 19:49:41.299258 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 469/966] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Jul 19 19:49:41 2022] POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:49:41.305111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.305993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.313307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-23e4d5cf-e2ad-4fa7-b23d-6b4d4b519763 req-14d3dd97-eb4a-46fc-9926-9b371cd76a62 service nova] Creating event network-vif-plugged:65f7f273-4751-4dd2-8f1a-888378bd53b4 for instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda on n-h1-843861-3 Jul 19 19:49:41.323327 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-23e4d5cf-e2ad-4fa7-b23d-6b4d4b519763 req-14d3dd97-eb4a-46fc-9926-9b371cd76a62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055744 Jul 19 19:49:41.324276 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 498/967] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:41.334164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.337249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.338055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.338497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.381753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-33044a2b-3508-40a6-9717-f3e96defd69a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e3daee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.428780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-33044a2b-3508-40a6-9717-f3e96defd69a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.051562 Jul 19 19:49:41.429475 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 499/968] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:41.498890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.508257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55003fc8-e082-4cef-8614-20ec28e97d23 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.206954 Jul 19 19:49:41.509386 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 470/969] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.527988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.528735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.535463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.535956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.537085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.537683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.713745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.714913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.717714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.722578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.723756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.724719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.725343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.726854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e96ab885-1eaa-4df8-85d9-d90635e6212c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.203004 Jul 19 19:49:41.730564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 500/970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.745695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1534506882"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:41.747654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.754231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.755366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.756371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.757484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.901660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.915415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4aa22b0-129e-4b71-9f4f-50d6508696ab tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.205725 Jul 19 19:49:41.927404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 471/971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:42.095710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29bbc955-0009-4dd9-9b04-1323e2c2996c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action" status: 202 len: 0 microversion: 2.1 time: 0.353437 Jul 19 19:49:42.096766 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 501/972] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:41 2022] POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:49:42.114476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1606903166"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:42.115569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:42.132354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.132991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.134319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.134773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.174559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:42.178896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Cannot 'createImage' instance 4ceadae2-7799-44a9-b9da-4897bf77f456 while it is in task_state image_snapshot_pending Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action HTTP/1.1 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 85 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:42.182538 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1606903166"}} Jul 19 19:49:42.184207 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'createImage' instance 4ceadae2-7799-44a9-b9da-4897bf77f456 while it is in task_state image_snapshot_pending Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1606903166'}}} Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:42.185182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4ceadae2-7799-44a9-b9da-4897bf77f456 while it is in task_state image_snapshot_pending Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4ceadae2-7799-44a9-b9da-4897bf77f456 while it is in task_state image_snapshot_pending Jul 19 19:49:42.186725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:42.188201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 409 to user: Cannot 'createImage' instance 4ceadae2-7799-44a9-b9da-4897bf77f456 while it is in task_state image_snapshot_pending {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:42.188201 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c53ed2fb-5a52-40ad-b8e5-8b8b997dc008 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action" status: 409 len: 167 microversion: 2.1 time: 0.081375 Jul 19 19:49:42.188379 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 472/973] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:42 2022] POST /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456/action => generated 167 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:49:42.195315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01c0b6f5-4f8d-4473-b984-ad10ff346b5d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88e3da040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.303801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.304822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:42.329326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.330145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.332355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.335272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.366378 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01c0b6f5-4f8d-4473-b984-ad10ff346b5d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/images/9efeedba-8529-4feb-b882-60dc1eb4f5a7" status: 204 len: 0 microversion: 2.1 time: 0.176763 Jul 19 19:49:42.367125 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 502/974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:42 2022] DELETE /compute/v2.1/images/9efeedba-8529-4feb-b882-60dc1eb4f5a7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:42.381139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.382528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:42.419890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.422440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.424761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.427262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.811243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:42.828220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b8c7563-e677-423d-852a-98fe6e68b177 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.530887 Jul 19 19:49:42.828939 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 473/975] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:42.834371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a37e8f86-8927-40e8-9656-036f22163756 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e2f4310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.848679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:42.867997 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cce1a312-9d8b-4a9f-afc6-cb6bbc504e65 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1533 microversion: 2.1 time: 0.490748 Jul 19 19:49:42.869164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 503/976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1533 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:42.873863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9c2be26c-1fec-48af-a025-e1b760c6489b req-168a9e54-48d7-429c-93db-c0274154696a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f096ca-59e0-410f-9fb7-1f5fd185af37", "tag": "fc639db7-4f25-4846-9a8b-25345dcf14c3"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:42.889345 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a37e8f86-8927-40e8-9656-036f22163756 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.059323 Jul 19 19:49:42.892593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9c2be26c-1fec-48af-a025-e1b760c6489b req-168a9e54-48d7-429c-93db-c0274154696a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.893045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9c2be26c-1fec-48af-a025-e1b760c6489b req-168a9e54-48d7-429c-93db-c0274154696a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.902514 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 474/977] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:42.910317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.911517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:42.922632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.923626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.924807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.925413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.926818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9c2be26c-1fec-48af-a025-e1b760c6489b req-168a9e54-48d7-429c-93db-c0274154696a service nova] Creating event network-changed:fc639db7-4f25-4846-9a8b-25345dcf14c3 for instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 on n-h2-843861-3 Jul 19 19:49:42.935213 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9c2be26c-1fec-48af-a025-e1b760c6489b req-168a9e54-48d7-429c-93db-c0274154696a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064329 Jul 19 19:49:42.936188 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 504/978] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:42.954488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.955709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:42.965338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.965980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.967014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.967665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.983896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19bc90ce-975a-4133-b8b3-b84447abc7fb tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080172 Jul 19 19:49:42.989987 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 475/979] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:42.996467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.997498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:43.021296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.021709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.023178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.024284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.167470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:43.175959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-404a00a2-f784-4443-a399-f4fc522f3209 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.238381 Jul 19 19:49:43.177407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 505/980] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:43.252552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lazy-loading 'services' on Instance uuid 6ed09279-8d38-45cf-a366-26e46bf4eaf1 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:43.393781 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea8632fa-eaaf-421d-b414-4c70993504e1 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments/a4ed9420-b408-433f-9a2f-22a07815a01f" status: 202 len: 0 microversion: 2.1 time: 0.401637 Jul 19 19:49:43.394753 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 476/981] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 19:49:42 2022] DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments/a4ed9420-b408-433f-9a2f-22a07815a01f => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:43.846201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:43.846919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:43.851415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:43.856918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.857446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.858409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.858843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.886114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:43.888343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:43.896728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.898129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.899302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.899962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.077587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.086876 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b71046f9-43be-4f89-8d3d-7e2a83003961 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.244700 Jul 19 19:49:44.087467 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 506/982] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:43 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:44.092316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56fa5596-6ad9-4cd5-ab3a-468b82a80ef6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e6d2280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:44.117305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.132731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-167121b7-c008-44a8-ad90-5c19249d57c2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1533 microversion: 2.1 time: 0.250622 Jul 19 19:49:44.133476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 477/983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:43 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1533 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:44.150749 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56fa5596-6ad9-4cd5-ab3a-468b82a80ef6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.061987 Jul 19 19:49:44.151345 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 507/984] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:44 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:44.193631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:44.196597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:44.206158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:44.206844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.208407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:44.209032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.364071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.372413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3d8eb63-6e34-4e88-81c6-4c0b11f399b9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.182929 Jul 19 19:49:44.373535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 478/985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:44 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:45.104777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.106027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.115363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.116146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.117353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.117937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.150117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.150852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.165046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.166245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.168965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.169565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.658191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:45.671767 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ff4eb05-508d-4314-a3cf-e595f83a2489 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1539 microversion: 2.1 time: 0.525355 Jul 19 19:49:45.671931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:45.684220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 479/986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1539 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:45.687671 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-466ac92b-8ebf-4a20-8e24-7004a6dc96d8 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.586448 Jul 19 19:49:45.691175 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 508/987] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:45.698440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.700060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.701587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aeccf95a-76ef-4db7-80f4-2897aacc8b9f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88ddc1f70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.719541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.721870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.723225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.725571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.777106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aeccf95a-76ef-4db7-80f4-2897aacc8b9f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.091361 Jul 19 19:49:45.778527 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 480/988] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:46.027142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:46.037319 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93e62b49-bcca-4932-9f70-d59f88521a8c tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.344331 Jul 19 19:49:46.039837 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 509/989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:46.693314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:46.693952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:46.708652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.710170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:46.711216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:46.724571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.725415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.725853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.728974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.731764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.733200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.733960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.072961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:47.084303 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4eb8b6c0-235f-4de4-943f-f00831bd47db tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.379268 Jul 19 19:49:47.086091 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 510/990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:46 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:47.099543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5ad2bfcb-1535-469e-88ad-3d31fe21bd16 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e379dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.100736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:47.121511 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c7db0ac6-6e2c-4f0c-b1db-7f4eeceadc32 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1539 microversion: 2.1 time: 0.435775 Jul 19 19:49:47.125121 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 481/991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:46 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1539 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:47.136882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.137770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:47.149294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.149748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.150526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.154084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.181758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5ad2bfcb-1535-469e-88ad-3d31fe21bd16 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.094227 Jul 19 19:49:47.183123 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 511/992] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:47 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:47.409762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:47.422106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e16afe3c-40c6-40ad-9097-d945e5efd96e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.295303 Jul 19 19:49:47.433659 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 482/993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:47 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.009819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-57422454-f246-41f8-bc52-66083d52f23f req-755b1dd6-753e-45c2-af98-f7932213878b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ceadae2-7799-44a9-b9da-4897bf77f456", "name": "network-vif-plugged", "status": "completed", "tag": "3ee1c0d9-e039-4dc2-addd-2c608042de1d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:48.018900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-57422454-f246-41f8-bc52-66083d52f23f req-755b1dd6-753e-45c2-af98-f7932213878b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.019351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-57422454-f246-41f8-bc52-66083d52f23f req-755b1dd6-753e-45c2-af98-f7932213878b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.032049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-57422454-f246-41f8-bc52-66083d52f23f req-755b1dd6-753e-45c2-af98-f7932213878b service nova] Creating event network-vif-plugged:3ee1c0d9-e039-4dc2-addd-2c608042de1d for instance 4ceadae2-7799-44a9-b9da-4897bf77f456 on n-h1-843861-3 Jul 19 19:49:48.037935 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-57422454-f246-41f8-bc52-66083d52f23f req-755b1dd6-753e-45c2-af98-f7932213878b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Jul 19 19:49:48.038545 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 512/994] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:48.102781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.103380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.128894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.129731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.130660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.131371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.140980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.141681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.158096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.159359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.162500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.162944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.442008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.453792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5428c68-9a5f-4762-908d-9112dbe7b5be tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.355318 Jul 19 19:49:48.463132 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 483/995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.463132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9764515-4360-44f0-a8dd-0108fabc00a5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dc97790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.487177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.500195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c0bc92b-c086-4975-8d59-fa358e315fa3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1521 microversion: 2.1 time: 0.362933 Jul 19 19:49:48.501207 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 513/996] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.506758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.507367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.516261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.516715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.517882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.518898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.532872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9764515-4360-44f0-a8dd-0108fabc00a5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.077060 Jul 19 19:49:48.534175 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 484/997] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.551963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:48.556892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.558554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.573001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:48.575536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.576387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.577392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.578037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.615767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:48.752514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.766451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5a94c8c-e6e3-404a-8405-c57c6f54e493 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.263452 Jul 19 19:49:48.773684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 514/998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.785072 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c27ad00-0e53-4df3-b83f-e77270222fec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 204 len: 0 microversion: 2.1 time: 0.249310 Jul 19 19:49:48.786397 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 485/999] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:48 2022] DELETE /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:48.794471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.795008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.801313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.801800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.803145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.803586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.972503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.981892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23734032-5c19-4fe7-8c6f-7c7f8fbcc915 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1527 microversion: 2.1 time: 0.191244 Jul 19 19:49:48.991903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 515/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1527 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:49.473637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:49.475277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:49.479196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:49.483935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:49.512120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:49.513220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:49.516652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:49.517416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:49.547756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d3f988c-4d4f-442b-8227-63a81f029029 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e199dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:49.572900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:49.624108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d3f988c-4d4f-442b-8227-63a81f029029 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.080549 Jul 19 19:49:49.630735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 516/1001] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:49 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:49.737562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:49.748021 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f59fe0f4-6085-4ab8-8efe-bf16430a04da tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.280344 Jul 19 19:49:49.749322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 486/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:49 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:49.784872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:49.786771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:49.798618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:49.799271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:49.800225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:49.800767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:49.972929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:49.992878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92056100-df5f-4968-b939-593280d337cd tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.204218 Jul 19 19:49:49.992878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 517/1003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:49 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:50.000347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:50.001290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:50.011522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:50.011522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:50.011522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:50.012007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:50.065943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e1ed8c7d-4bfb-4441-9bc1-83e464af2f1e req-12d2a1bc-d5e4-4b01-a81c-f03169bd59f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e4727d-3243-4693-853a-a37fd86d5360", "name": "network-vif-plugged", "status": "completed", "tag": "82c46559-063c-43d0-be53-2df8616c3895"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:50.075163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e1ed8c7d-4bfb-4441-9bc1-83e464af2f1e req-12d2a1bc-d5e4-4b01-a81c-f03169bd59f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:50.075613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e1ed8c7d-4bfb-4441-9bc1-83e464af2f1e req-12d2a1bc-d5e4-4b01-a81c-f03169bd59f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:50.088906 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e1ed8c7d-4bfb-4441-9bc1-83e464af2f1e req-12d2a1bc-d5e4-4b01-a81c-f03169bd59f0 service nova] Creating event network-vif-plugged:82c46559-063c-43d0-be53-2df8616c3895 for instance 81e4727d-3243-4693-853a-a37fd86d5360 on n-h1-843861-3 Jul 19 19:49:50.094072 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e1ed8c7d-4bfb-4441-9bc1-83e464af2f1e req-12d2a1bc-d5e4-4b01-a81c-f03169bd59f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jul 19 19:49:50.094821 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 518/1004] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:50.193088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:50.202602 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a67e32ca-ecbd-49d5-8632-54d66ffe6d6f tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1527 microversion: 2.1 time: 0.205967 Jul 19 19:49:50.203705 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 487/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:49 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1527 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:50.639643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d25d434-4737-4604-a4af-1729dee0e2e4 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e6d2ca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:50.698489 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d25d434-4737-4604-a4af-1729dee0e2e4 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.063715 Jul 19 19:49:50.705783 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 519/1006] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:50 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:50.769225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:50.769853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:50.780643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:50.781511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:50.782634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:50.784154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.002992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.003888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.020743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.021239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.023041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.023508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.102711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:51.127212 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9344074b-b83c-48a7-9e63-f84a115b0d74 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.361955 Jul 19 19:49:51.128037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 488/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:50 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:51.133485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.134665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.144350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.145064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.146027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.147108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.193910 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb8b322f-fab2-483d-8213-e490b6f680be tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064456 Jul 19 19:49:51.194713 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 489/1008] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:49:51 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:49:51.221336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.226920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.239421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.240273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.241604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.241604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.245755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:51.272675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:51.281363 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e04782e-d565-416b-af18-cc3852528e34 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.282793 Jul 19 19:49:51.283382 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 520/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:50 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:51.301750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.302787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.312516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.313689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.316408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.318021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.371992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c89ba3a3-9abd-4e58-91ea-519b3b081399 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075646 Jul 19 19:49:51.372896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 521/1010] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:49:51 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:49:51.463472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.464247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.472257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.472684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.473645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.474227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.512073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:51.577771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:51.588187 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b539bd2d-6be0-46e9-92ab-c8384191d20d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1527 microversion: 2.1 time: 0.370744 Jul 19 19:49:51.589883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 490/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:51 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:51.626192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fca6823a-d1d7-4fbd-9981-321d92546a40 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 204 len: 0 microversion: 2.1 time: 0.166346 Jul 19 19:49:51.632985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 522/1012] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:51 2022] DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:51.639942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.640847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:51.650901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.651377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.652351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:51.652795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:51.719708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c50646a4-a95e-454e-a2e1-09629cce657f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e3dae50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:51.791584 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c50646a4-a95e-454e-a2e1-09629cce657f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.082034 Jul 19 19:49:51.798732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 523/1013] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:51 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:51.886120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:51.895638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86a5afcb-e63e-47af-9bd1-d601163a875f tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1681 microversion: 2.1 time: 0.260109 Jul 19 19:49:51.902748 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 491/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:51 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:52.087428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-367dc321-5c94-46fc-a2ac-741384f78500 req-a2deb10a-c329-4706-89eb-0b0f843e2758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ceadae2-7799-44a9-b9da-4897bf77f456", "name": "network-vif-deleted", "tag": "3ee1c0d9-e039-4dc2-addd-2c608042de1d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:52.100176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-367dc321-5c94-46fc-a2ac-741384f78500 req-a2deb10a-c329-4706-89eb-0b0f843e2758 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.100636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-367dc321-5c94-46fc-a2ac-741384f78500 req-a2deb10a-c329-4706-89eb-0b0f843e2758 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.109653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1e31525d-2408-4016-8a14-20395149eabd req-d5124677-520f-422e-adc2-283256de900d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f096ca-59e0-410f-9fb7-1f5fd185af37", "name": "network-vif-plugged", "status": "completed", "tag": "fc639db7-4f25-4846-9a8b-25345dcf14c3"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:52.112128 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-367dc321-5c94-46fc-a2ac-741384f78500 req-a2deb10a-c329-4706-89eb-0b0f843e2758 service nova] Creating event network-vif-deleted:3ee1c0d9-e039-4dc2-addd-2c608042de1d for instance 4ceadae2-7799-44a9-b9da-4897bf77f456 on n-h1-843861-3 Jul 19 19:49:52.117924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-367dc321-5c94-46fc-a2ac-741384f78500 req-a2deb10a-c329-4706-89eb-0b0f843e2758 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Jul 19 19:49:52.118885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 524/1015] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:52.130542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1e31525d-2408-4016-8a14-20395149eabd req-d5124677-520f-422e-adc2-283256de900d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.130992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1e31525d-2408-4016-8a14-20395149eabd req-d5124677-520f-422e-adc2-283256de900d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.143978 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1e31525d-2408-4016-8a14-20395149eabd req-d5124677-520f-422e-adc2-283256de900d service nova] Creating event network-vif-plugged:fc639db7-4f25-4846-9a8b-25345dcf14c3 for instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 on n-h2-843861-3 Jul 19 19:49:52.150035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1e31525d-2408-4016-8a14-20395149eabd req-d5124677-520f-422e-adc2-283256de900d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044107 Jul 19 19:49:52.150924 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 492/1016] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:52.157088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.157812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:52.165788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.166251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.167755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.168902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.300721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.301751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:52.315243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.315782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.317255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.320670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.377694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:52.394050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-55d236c0-04c2-4ae9-92d7-afbbb4e34005 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.244448 Jul 19 19:49:52.395509 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 525/1017] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:52.495868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:52.503701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5166e82f-1979-42d2-83d5-c03ad2283ef4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.207273 Jul 19 19:49:52.504619 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 493/1018] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:52.606096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.607001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:52.615004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.615488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.616387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.616835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.683091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:52.691348 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d480f4e2-309a-445b-a4db-b92ed04575fc tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1485 microversion: 2.1 time: 0.089096 Jul 19 19:49:52.692735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 526/1019] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1485 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:52.805427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f8ebdb0-6be7-4977-ac41-119a31aabad8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dcbbd30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.851948 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f8ebdb0-6be7-4977-ac41-119a31aabad8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.050876 Jul 19 19:49:52.853002 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 494/1020] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:52.930154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.931390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:52.942246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.942702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.943515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.943953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.100563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.108285 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-301873d0-cf9c-4735-af54-1cf2f2921d59 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1681 microversion: 2.1 time: 0.190059 Jul 19 19:49:53.117903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 527/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:53.411478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.412538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.419960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.420407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.421213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.421793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.521201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.521863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.528566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.529027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.529823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.530261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.563660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.571708 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fe0d8a4-3902-485d-9b74-8d510ba93aca tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1317 microversion: 2.1 time: 0.164797 Jul 19 19:49:53.572342 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 495/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:53.693042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.700979 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c792fdc0-d96e-4aa2-abf8-d8e8193e92f6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1316 microversion: 2.1 time: 0.183859 Jul 19 19:49:53.719179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.719388 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 528/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:53.720367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.728168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.728831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.729692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.730227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.801060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.810472 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-114441f1-cbea-47e4-b2d2-31ae1803810e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 200 len: 1485 microversion: 2.1 time: 0.095396 Jul 19 19:49:53.811572 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 496/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 1485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:53.865791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8fdd65fb-d409-4762-b79f-7fb831e36040 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e5908b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.936099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8fdd65fb-d409-4762-b79f-7fb831e36040 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1412 microversion: 2.1 time: 0.070438 Jul 19 19:49:53.941878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 529/1025] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.125255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.126058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.133537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.133986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.134759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.135563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.304555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:54.312597 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a95d7af-01a9-44de-b406-b45e7ff8b066 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1681 microversion: 2.1 time: 0.191476 Jul 19 19:49:54.313174 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 497/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.592049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.592803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.599951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.600404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.601175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.601613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.726341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.726869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.732942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.733391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.734151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.734582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.955797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:54.965111 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48e18852-5cfd-405d-a612-81d5dec1809e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1467 microversion: 2.1 time: 0.378180 Jul 19 19:49:54.965733 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 530/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1467 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.971339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.972480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.979239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.980144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.980972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.981409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.995625 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 HTTP/1.1 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:54.997305 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:49:54.998627 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456'} Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:54.999394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:49:55.000846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:55.001947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:55.001947 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a036a16d-8fdc-4697-a6e6-5f7eb3529e4b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 404 len: 111 microversion: 2.1 time: 0.032049 Jul 19 19:49:55.001947 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 531/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:55.003592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a60c89a6-38d0-44eb-a17e-d030d523e6b9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e379160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:55.020037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:55.028948 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e20cd459-4feb-46da-9a79-404f6535388b tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1503 microversion: 2.1 time: 0.306713 Jul 19 19:49:55.030004 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 498/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:55.037525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:55.038585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:55.047117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.047328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a60c89a6-38d0-44eb-a17e-d030d523e6b9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1421 microversion: 2.1 time: 0.047126 Jul 19 19:49:55.048124 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 532/1030] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1421 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:55.048358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.052384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.053754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e06776df-07c7-4f83-9f28-568ae5f02d84 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'create', calling method: .version_select at 0x7fb88dfae550>, body: {"keypair": {"name": "tempest-keypair-551961537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU333UgBuoj3gbkC5jItXFYw3k06I/uCOYul0CKWoVt3oXjHXOW+2LoHQtb3wsT1z/OveR50GY+S/iqfd0t6t88Au1Sb2hCRjqNKX0aWxptHCTKuRq/AV26CMj60sakCQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:55.054886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.071949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e06776df-07c7-4f83-9f28-568ae5f02d84 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for project e1136959b10a4310a7b0803d010d8501. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:55.077173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e06776df-07c7-4f83-9f28-568ae5f02d84 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for user 5035bdfa56304514a841334c420b1041 and project e1136959b10a4310a7b0803d010d8501. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:55.079614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:55.104786 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e06776df-07c7-4f83-9f28-568ae5f02d84 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055297 Jul 19 19:49:55.105760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 533/1031] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:49:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:55.111897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1811733465"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:55.112253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:55.119673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.120310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.121116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.121553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.365087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2d18849-b250-4097-a890-9b1e2bd9469c tempest-ServersOnMultiNodesTest-261409294 tempest-ServersOnMultiNodesTest-261409294-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1618 microversion: 2.1 time: 0.333438 Jul 19 19:49:55.365749 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 499/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:55 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1618 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:55.370799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8c15151-ad3c-4efb-b5f9-eb2ad33c7f60 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dcbba60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:55.436599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8c15151-ad3c-4efb-b5f9-eb2ad33c7f60 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 200 len: 1421 microversion: 2.1 time: 0.069576 Jul 19 19:49:55.437601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 500/1033] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:49:55 2022] GET /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:55.442553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:55.443304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:55.446845 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Adding security group defbaaef-a0c2-435d-9c7f-7203e5aad368 to port fc639db7-4f25-4846-9a8b-25345dcf14c3 Jul 19 19:49:55.451603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.452250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.453546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.454916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.582200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:55.591018 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5db45d6-64ec-4e0d-adc7-df4bfdbb6e01 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1614 microversion: 2.1 time: 0.152232 Jul 19 19:49:55.601424 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 501/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:55 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:55.606758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:55.607513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:55.614179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.614980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.615964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.616552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.649216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:55.744645 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-accbf74c-98be-41fa-ad81-e4dd0e66b963 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 204 len: 0 microversion: 2.1 time: 0.141602 Jul 19 19:49:55.745352 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 502/1035] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:55 2022] DELETE /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:55.758451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5f1872ff-87e7-44cd-b14d-4631ab102720 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e3af550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.299953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5f1872ff-87e7-44cd-b14d-4631ab102720 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 204 len: 0 microversion: 2.1 time: 0.553402 Jul 19 19:49:56.305069 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 503/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:55 2022] DELETE /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:56.312227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.313240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:56.322315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.322777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.323772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.324630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.446566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbddb164-57c7-4d1f-bd7d-156b8a0fef16 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action" status: 202 len: 0 microversion: 2.1 time: 1.339573 Jul 19 19:49:56.448269 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 534/1037] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:55 2022] POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action => generated 0 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:56.453244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.453883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:56.469756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.470847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.471293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.472352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.530477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:56.603126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:56.612199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45666f05-4a6b-4fb8-9147-253ee611d563 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1473 microversion: 2.1 time: 0.305511 Jul 19 19:49:56.613134 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 504/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:56 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:56.627490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-afa793e9-94f0-4695-ad3a-7eb3c034ec19 req-360ad0f0-776b-44ca-96eb-e57b1211f984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed09279-8d38-45cf-a366-26e46bf4eaf1", "name": "network-vif-deleted", "tag": "1297fa33-cf14-4564-b2a4-57fca8cda87f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:56.649641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-afa793e9-94f0-4695-ad3a-7eb3c034ec19 req-360ad0f0-776b-44ca-96eb-e57b1211f984 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.651672 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8953175-7766-4b7b-a79c-c9e085ca9003 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 204 len: 0 microversion: 2.1 time: 0.201288 Jul 19 19:49:56.652884 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 535/1039] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:56 2022] DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:56.659202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.660057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:56.665153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-afa793e9-94f0-4695-ad3a-7eb3c034ec19 req-360ad0f0-776b-44ca-96eb-e57b1211f984 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.684852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.685886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.687147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.687757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.693454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:56.702037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-afa793e9-94f0-4695-ad3a-7eb3c034ec19 req-360ad0f0-776b-44ca-96eb-e57b1211f984 service nova] Creating event network-vif-deleted:1297fa33-cf14-4564-b2a4-57fca8cda87f for instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 on n-h1-843861-3 Jul 19 19:49:56.711175 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-afa793e9-94f0-4695-ad3a-7eb3c034ec19 req-360ad0f0-776b-44ca-96eb-e57b1211f984 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086826 Jul 19 19:49:56.717053 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 505/1040] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:56.727273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dc598b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.747489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:56.871215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2887243e-bd65-478a-a5ae-455f1b6c6a1e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 204 len: 0 microversion: 2.1 time: 0.216706 Jul 19 19:49:56.872953 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 536/1041] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:56 2022] DELETE /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:56.878020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.878661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:56.886315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.886943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.888023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.888463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.957995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use.", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:49:56.959504 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.959504 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368 HTTP/1.1 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:49:56.962187 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: exception: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.964323 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'defbaaef-a0c2-435d-9c7f-7203e5aad368'} Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:56.965582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.967112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:56.968553 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] Jul 19 19:49:56.970054 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:49:56.972363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 400 to user: Security Group defbaaef-a0c2-435d-9c7f-7203e5aad368 in use. Jul 19 19:49:56.972363 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-bbe682e5-5ac5-4526-aa41-ebd44149e839'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:56.973711 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c41d1ccd-d2fc-4765-a8c9-03b8b600f5b7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368" status: 400 len: 185 microversion: 2.1 time: 0.254737 Jul 19 19:49:56.975340 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 506/1042] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:49:56 2022] DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368 => generated 185 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:49:56.982830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-862313110", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:57.007992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:57.018308 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f5e3ea5-74b5-4697-8c9a-f89bd777cffd tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1614 microversion: 2.1 time: 0.144310 Jul 19 19:49:57.019146 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 537/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:56 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:57.034037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1892315378", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "2119075084", "adminPass": "***", "networks": [{"uuid": "d1d09029-5226-4025-a604-8d40681eadd9"}], "security_groups": [{"name": "tempest-securitygroup--61775886"}], "key_name": "tempest-keypair-1204217529", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:57.044371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] validate_networks() for [('ab4b83df-5d6c-4af1-a2b5-442cf3efe844', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:57.194747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] validate_networks() for [('d1d09029-5226-4025-a604-8d40681eadd9', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:57.677549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:57.678087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:57.678877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:57.679718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:57.680277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:57.690285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.690816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.691687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.692897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.710800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:57.716360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for user 5035bdfa56304514a841334c420b1041 and project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:57.729554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:57.732083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:57.781862 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f8550aac-6f4d-4a6e-a9c2-d38ea0e72e94 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.804977 Jul 19 19:49:57.788660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 507/1044] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:57.790848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:57.791340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:57.791892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:57.792371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:57.792894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:57.795034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1004432971", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f99d3c74-93b6-4718-9088-9758ebb4ad6d"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:57.804245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.804772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.805629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.806061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.826866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:57.833843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Getting quotas for user 0ec0c5c154014ebcb2640ed9e91474ee and project 2622c76e97384d70bfc9cd9e5c64c031. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:57.852967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:57.856007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:57.858595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] validate_networks() for [('f99d3c74-93b6-4718-9088-9758ebb4ad6d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:57.955042 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9ceba36-642f-4669-939f-9984de269dd1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.932609 Jul 19 19:49:57.959032 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 538/1045] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:57.975579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:57.978360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:57.988656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.989134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.989986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.990419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.155754 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1fb63d2d-8e26-44c0-85f2-5cec29c41bfe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action" status: 202 len: 0 microversion: 2.1 time: 0.195652 Jul 19 19:49:58.157088 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 539/1046] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:57 2022] POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:58.167289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.169251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.180030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.180633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.181385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.182490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.508236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:58.516853 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7871d1a-2f4f-42a3-b488-9ac34a214fee tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1473 microversion: 2.1 time: 0.357507 Jul 19 19:49:58.517780 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 540/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:58.523732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.524577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.525897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:58.526313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:58.527006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:58.527427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:58.527861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:58.532878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.533523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.534484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.535085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.539561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.541666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.542557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.543006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.564160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:58.569784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for user fecc799226eb4a39950040a548b1987d and project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:58.584954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:58.587201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:58.634728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:58.643332 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-956b40f4-a727-4ea6-8263-b38d4d76af35 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1228 microversion: 2.1 time: 0.124105 Jul 19 19:49:58.644225 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 541/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:58.649250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1945fb6d-74c1-4fa3-81eb-2aa7718287e0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.649860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1945fb6d-74c1-4fa3-81eb-2aa7718287e0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.665760 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abc4a76d-6e4c-46d3-b302-ec2d4c81602b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875694 Jul 19 19:49:58.671124 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 508/1049] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:58.675986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f2a4e1f1-262a-447b-aa0c-d3e50067be45 req-3c1adf39-e8a5-4a9c-98c3-ca34f835953c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a765cdd0-ec1d-471f-af7b-aa75e2ad6bda", "name": "network-vif-unplugged", "status": "completed", "tag": "65f7f273-4751-4dd2-8f1a-888378bd53b4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:58.686595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f2a4e1f1-262a-447b-aa0c-d3e50067be45 req-3c1adf39-e8a5-4a9c-98c3-ca34f835953c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.687559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f2a4e1f1-262a-447b-aa0c-d3e50067be45 req-3c1adf39-e8a5-4a9c-98c3-ca34f835953c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.701701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f2a4e1f1-262a-447b-aa0c-d3e50067be45 req-3c1adf39-e8a5-4a9c-98c3-ca34f835953c service nova] Creating event network-vif-unplugged:65f7f273-4751-4dd2-8f1a-888378bd53b4 for instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda on n-h1-843861-3 Jul 19 19:49:58.709568 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f2a4e1f1-262a-447b-aa0c-d3e50067be45 req-3c1adf39-e8a5-4a9c-98c3-ca34f835953c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034716 Jul 19 19:49:58.710531 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 509/1050] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:58.718867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.720475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.739923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.740678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.741880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.742692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.743222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1945fb6d-74c1-4fa3-81eb-2aa7718287e0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:58.750261 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1945fb6d-74c1-4fa3-81eb-2aa7718287e0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1265 microversion: 2.1 time: 0.104594 Jul 19 19:49:58.751002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 542/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:58.755598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.756584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.763101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.763843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.764688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.765199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.778523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.778660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.779106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lazy-loading 'fault' on Instance uuid 6ed09279-8d38-45cf-a366-26e46bf4eaf1 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:58.848003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5388effbf8a4448e9922d65b33d5e35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc76d55bfad4286830d598a8c47d0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:58.867828 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9afa65b6-dc66-4fc0-af25-6d6f6ffe81bf tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 200 len: 1330 microversion: 2.1 time: 0.155876 Jul 19 19:49:58.880209 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 510/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 1330 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:58.886148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b25190a-045f-4793-a72e-75295e1d5ab5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.886148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b25190a-045f-4793-a72e-75295e1d5ab5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.991121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b25190a-045f-4793-a72e-75295e1d5ab5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.015322 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b25190a-045f-4793-a72e-75295e1d5ab5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1208 microversion: 2.1 time: 0.133856 Jul 19 19:49:59.016057 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 511/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:59.031401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e12cf622-4029-427e-9e7c-0aa3b0f728df req-1febee94-345e-4b93-b974-a482b97ed9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f096ca-59e0-410f-9fb7-1f5fd185af37", "tag": "fc639db7-4f25-4846-9a8b-25345dcf14c3"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:59.043534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.055152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e12cf622-4029-427e-9e7c-0aa3b0f728df req-1febee94-345e-4b93-b974-a482b97ed9db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.056025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e12cf622-4029-427e-9e7c-0aa3b0f728df req-1febee94-345e-4b93-b974-a482b97ed9db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.062885 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8298ac85-a734-4e4c-800b-792cc771ca89 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1574 microversion: 2.1 time: 0.310764 Jul 19 19:49:59.064892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 543/1054] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1574 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:59.074882 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e12cf622-4029-427e-9e7c-0aa3b0f728df req-1febee94-345e-4b93-b974-a482b97ed9db service nova] Creating event network-changed:fc639db7-4f25-4846-9a8b-25345dcf14c3 for instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 on n-h2-843861-3 Jul 19 19:49:59.084136 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e12cf622-4029-427e-9e7c-0aa3b0f728df req-1febee94-345e-4b93-b974-a482b97ed9db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055426 Jul 19 19:49:59.086297 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 512/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:59.534451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.535205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.541857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.542386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.543159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.543680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.662266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.668843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.680806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.681715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.682793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.683904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.841477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.844374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:59.851618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5342d8c-8b56-4952-9db6-eeaa5a818697 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1276 microversion: 2.1 time: 0.194139 Jul 19 19:49:59.852264 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 513/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:59.857537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.858142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.867022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.867469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.868261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.868826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.902178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.911277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-14f14a48-602a-4f73-9c98-ea3062be8bf5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1473 microversion: 2.1 time: 0.380688 Jul 19 19:49:59.912047 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 544/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1473 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:59.920423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.921091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.927970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.928429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.929204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.929645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.943663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] HTTP exception thrown: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Request method failure captured: Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 HTTP/1.1 Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wpHTmfo_0VhQD1oEeSe4f4Qq8D_chWZFpuNKGF1hHoFFNdiUy6_wlEtuByg36HrMFQbt-7q6kvyzbS4IUj_b-DywXMB6DrI_vUM_SyOKE3TAt2OIzf-TlUACGnjUtYvR04jPoCtNSouMIo8t1GhJN3be7OVf4G6ZXerPyznZZWxk1M Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:49:59.945336 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5388effbf8a4448e9922d65b33d5e35c Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:49:59.946915 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6ed09279-8d38-45cf-a366-26e46bf4eaf1'} Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:59.952352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:49:59.954006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:49:59.955415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Returning 404 to user: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:59.955415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-173c39cd-0776-4748-ba03-26ec788dfd78 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 404 len: 111 microversion: 2.1 time: 0.033579 Jul 19 19:49:59.955415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 545/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:59.956272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0543944-6281-460a-8ba3-04ace727f2ca tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '.version_select at 0x7fb88e379af0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.971481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.976612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0543944-6281-460a-8ba3-04ace727f2ca tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-728376678" status: 202 len: 0 microversion: 2.1 time: 0.024845 Jul 19 19:49:59.977396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 546/1059] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 19:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-728376678 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:49:59.983543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c276920f-e63c-45b3-bf1b-db632d8e2484 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1317 microversion: 2.1 time: 0.129301 Jul 19 19:49:59.985005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 514/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1317 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:00.033862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.034549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:00.047026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.048604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.049664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.053820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.105964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.106613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:00.136854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.142330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.144455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.146417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.269238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:00.279928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-327dc311-c33f-4d53-9dc5-00fb0675468f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1204 microversion: 2.1 time: 0.249895 Jul 19 19:50:00.286254 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 547/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:00 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1204 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:00.870049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.871037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:00.874594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:00.883042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.890575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.892804 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a983cc2-cd25-4544-9e21-1d532ff2867f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1574 microversion: 2.1 time: 0.807163 Jul 19 19:50:00.895389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.896307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 515/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:00 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1574 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:00.896451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.930701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.931453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:00.942788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.944273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.945810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.952578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.993951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:01.001290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.002088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.002955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lazy-loading 'fault' on Instance uuid 81e4727d-3243-4693-853a-a37fd86d5360 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:01.509518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.518507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8f511c7-caf5-425f-8b31-89f4aab30f97 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1282 microversion: 2.1 time: 0.652379 Jul 19 19:50:01.519103 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 548/1063] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:00 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1282 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:01.529799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:01.531074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:01.538951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.539413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.540234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.540674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.607717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.616944 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4575dafb-c274-41cd-a072-82c861cba3e4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 200 len: 1307 microversion: 2.1 time: 0.690794 Jul 19 19:50:01.617789 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 516/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:00 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:01.625478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:01.628271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:01.636412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.636858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.637646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.638535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.767550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.784184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-178bc571-3488-4bcd-9f3d-cba629c762d1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1323 microversion: 2.1 time: 0.263796 Jul 19 19:50:01.785495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 549/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:01 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:01.791906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e4727d-3243-4693-853a-a37fd86d5360", "name": "network-vif-deleted", "tag": "82c46559-063c-43d0-be53-2df8616c3895"}, {"server_uuid": "a765cdd0-ec1d-471f-af7b-aa75e2ad6bda", "name": "network-vif-deleted", "tag": "65f7f273-4751-4dd2-8f1a-888378bd53b4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:01.819838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.822421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.846038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] Creating event network-vif-deleted:82c46559-063c-43d0-be53-2df8616c3895 for instance 81e4727d-3243-4693-853a-a37fd86d5360 on n-h1-843861-3 Jul 19 19:50:01.851078 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] Creating event network-vif-deleted:65f7f273-4751-4dd2-8f1a-888378bd53b4 for instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda on n-h1-843861-3 Jul 19 19:50:01.866000 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4032f1a0-2bf0-477a-b984-0266f4d0d9c3 req-9a961cb2-5e5a-4999-b2d8-da0833b5cc09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078569 Jul 19 19:50:01.866877 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 550/1066] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:01.870160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.882534 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae1e6112-62d6-4404-97e7-295ef4742a41 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1268 microversion: 2.1 time: 0.263195 Jul 19 19:50:01.884520 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 517/1067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:01 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1268 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:01.912444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:01.913276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:01.922802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.923473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.924465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.925570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.422246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3b7e7542-4f00-49fe-a9f5-c152e7457a5c req-d550e4ff-b5ed-434b-8959-48f0b903d93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb6c658-ec3b-46d8-8086-220f79a5399f", "tag": "6c0057cb-3247-4523-98f2-a1eee1ca6fb4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:02.433779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b7e7542-4f00-49fe-a9f5-c152e7457a5c req-d550e4ff-b5ed-434b-8959-48f0b903d93c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.435073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b7e7542-4f00-49fe-a9f5-c152e7457a5c req-d550e4ff-b5ed-434b-8959-48f0b903d93c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.450287 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3b7e7542-4f00-49fe-a9f5-c152e7457a5c req-d550e4ff-b5ed-434b-8959-48f0b903d93c service nova] Creating event network-changed:6c0057cb-3247-4523-98f2-a1eee1ca6fb4 for instance deb6c658-ec3b-46d8-8086-220f79a5399f on n-h2-843861-3 Jul 19 19:50:02.455425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3b7e7542-4f00-49fe-a9f5-c152e7457a5c req-d550e4ff-b5ed-434b-8959-48f0b903d93c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041684 Jul 19 19:50:02.456783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 518/1068] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:02.536863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.537562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.544613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.545356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.546137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.546818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.602810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:02.618961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f325895-9f5e-4781-85f7-fa9a4b52ee64 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1572 microversion: 2.1 time: 0.709922 Jul 19 19:50:02.620509 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 551/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:01 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1572 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.640136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-81076878"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:02.640987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.649701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.650180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.650992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.651462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.312567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:03.330853 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dedb916d-d2a2-40f8-891c-8cf45a093139 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.794289 Jul 19 19:50:03.331508 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 519/1070] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:03.349369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:03.350203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 81e4727d-3243-4693-853a-a37fd86d5360] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:03.377460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.378101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.382754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.384071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.390069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Adding security group 43ceaa10-ff80-438d-952b-e340f2294839 to port fc639db7-4f25-4846-9a8b-25345dcf14c3 Jul 19 19:50:03.409850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 HTTP/1.1 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:03.412134 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. Jul 19 19:50:03.413792 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '81e4727d-3243-4693-853a-a37fd86d5360'} Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:03.414723 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. Jul 19 19:50:03.416517 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:03.431702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 81e4727d-3243-4693-853a-a37fd86d5360 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:03.433108 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1d2f0106-7562-4bdf-886c-65e1b27f7deb tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360" status: 404 len: 111 microversion: 2.1 time: 0.097941 Jul 19 19:50:03.435786 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 520/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:03 2022] GET /compute/v2.1/servers/81e4727d-3243-4693-853a-a37fd86d5360 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:03.445003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:03.446061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:03.458708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.459005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.461138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.462556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.674539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:03.682703 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4538103b-4001-4b5d-a121-13676864f2f3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1323 microversion: 2.1 time: 0.245577 Jul 19 19:50:03.693975 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 521/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:03 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:03.699572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:03.700501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:03.709174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.709849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.711287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.711859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.165649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:04.174123 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9148d95-991e-4cd8-a9df-c0bdafaccd1b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1266 microversion: 2.1 time: 0.478737 Jul 19 19:50:04.174959 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 522/1073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:03 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1266 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:04.180304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.181063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.189646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.190222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.191090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.191627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.223909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:04.318355 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e93e576c-1885-4dd9-b15a-97e1d0e6f3e5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 204 len: 0 microversion: 2.1 time: 0.141865 Jul 19 19:50:04.319028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 523/1074] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:04 2022] DELETE /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:04.327021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.327794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.334751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.335262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.336272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.336764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.837412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:04.851517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0a6a97f-6814-4797-88a8-535abab07b2e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 0.528368 Jul 19 19:50:04.853941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 524/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:04 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:04.860390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.861381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.875446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.876536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.878545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.879310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.350093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1d2d52e-b599-4616-9b69-6f2997a765f2 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action" status: 202 len: 0 microversion: 2.1 time: 2.717084 Jul 19 19:50:05.352714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 552/1076] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:02 2022] POST /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37/action => generated 0 bytes in 2720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:05.357670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a33293b4-9884-41b7-a7c8-7a689f4e04fc req-5a2e2c72-4541-4894-9128-1cae2afecfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d6ae0e-2945-4327-acef-5be53b8d649e", "name": "network-vif-deleted", "tag": "78fdbece-5f32-4a6c-9006-5bb3bceb65d0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:05.359119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.367950 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e586062d-b646-4a43-902d-266132606187 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.512215 Jul 19 19:50:05.371698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 525/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:04 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:05.378143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a33293b4-9884-41b7-a7c8-7a689f4e04fc req-5a2e2c72-4541-4894-9128-1cae2afecfa5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.378589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a33293b4-9884-41b7-a7c8-7a689f4e04fc req-5a2e2c72-4541-4894-9128-1cae2afecfa5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.393721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.396366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.412603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a33293b4-9884-41b7-a7c8-7a689f4e04fc req-5a2e2c72-4541-4894-9128-1cae2afecfa5 service nova] Creating event network-vif-deleted:78fdbece-5f32-4a6c-9006-5bb3bceb65d0 for instance 93d6ae0e-2945-4327-acef-5be53b8d649e on n-h2-843861-3 Jul 19 19:50:05.419324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.419572 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a33293b4-9884-41b7-a7c8-7a689f4e04fc req-5a2e2c72-4541-4894-9128-1cae2afecfa5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065535 Jul 19 19:50:05.420200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.420480 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 553/1078] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:05.421360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.422109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.445329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.446061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.472224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.478305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.479483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.480213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.741938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.754169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a0d5b93-5308-4252-9a97-84381c491655 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.381071 Jul 19 19:50:05.768223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 526/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:05 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:05.783782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.785997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dc979d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.792565 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6bb2570e-1939-4922-89e1-a9f49698a31c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.370876 Jul 19 19:50:05.793264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 554/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:05 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:05.870521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.871860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.878937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.880296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.881303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.882203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.893521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:05.914993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use.", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:05.915687 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.915687 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839 HTTP/1.1 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:05.918595 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: exception: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.920225 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '43ceaa10-ff80-438d-952b-e340f2294839'} Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:05.921082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.922237 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:05.923418 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 400 to user: Security Group 43ceaa10-ff80-438d-952b-e340f2294839 in use. Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-7e798c73-98ab-4a65-98a8-60450f836129'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc3886d8-92b7-4f7d-bf87-284e381a10c4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839" status: 400 len: 185 microversion: 2.1 time: 0.149841 Jul 19 19:50:05.927080 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 527/1081] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:05 2022] DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839 => generated 185 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:50:05.930006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.930335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.948968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.949602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.950605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.951057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.011030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:06.151832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59321687-2e69-418e-9cb1-d27849ab7f8f tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 204 len: 0 microversion: 2.1 time: 0.227042 Jul 19 19:50:06.152728 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 528/1082] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:05 2022] DELETE /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:50:06.160263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.174563 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96ff5a95-9dc1-4b74-8ff0-7de963842ac4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 0.307796 Jul 19 19:50:06.176947 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 555/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:05 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:06.179088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.180010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.186903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.187973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.188950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.189576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.216909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:06.388792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.390046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.395797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.398276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.399118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.400131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.400731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.404160 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83a7dc71-0741-4c2f-8337-3d43ffc0b884 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1645 microversion: 2.1 time: 0.234695 Jul 19 19:50:06.409938 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 529/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1645 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:06.548500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.556335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e25d53ae-6b10-4849-b5db-f2c27ca798ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.171745 Jul 19 19:50:06.557074 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 556/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:06.774338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.774945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.782678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.783140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.783942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.784379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.810403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.811016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.818210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.818653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.819420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.819873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.982264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.992347 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ff64dc3-19c7-4465-8615-40d3adb6399c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.222171 Jul 19 19:50:06.993078 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 530/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:07.009321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.019370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78eb29c8-4c83-4424-820c-e77614d4e7f2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.212920 Jul 19 19:50:07.020790 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 557/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:07.192978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.193730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.200311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.200757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.201547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.202027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.320335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.321054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.329952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.332637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.333926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.334482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.365747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] HTTP exception thrown: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.366489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Request method failure captured: Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 HTTP/1.1 Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wpHTmfo_0VhQD1oEeSe4f4Qq8D_chWZFpuNKGF1hHoFFNdiUy6_wlEtuByg36HrMFQbt-7q6kvyzbS4IUj_b-DywXMB6DrI_vUM_SyOKE3TAt2OIzf-TlUACGnjUtYvR04jPoCtNSouMIo8t1GhJN3be7OVf4G6ZXerPyznZZWxk1M Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:07.372116 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5388effbf8a4448e9922d65b33d5e35c Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.373534 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6ed09279-8d38-45cf-a366-26e46bf4eaf1'} Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:07.374291 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.375470 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.377835 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eff2d42c-e46a-4517-a2d2-149af3fbfca3 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 0.187829 Jul 19 19:50:07.377835 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 531/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:07 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:07.380914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Returning 404 to user: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:07.381973 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f20608fe-893c-4383-ba64-a32207b9a565 tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 404 len: 111 microversion: 2.1 time: 0.074280 Jul 19 19:50:07.382742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 558/1089] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:07 2022] DELETE /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:07.392306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.393013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] [instance: 6ed09279-8d38-45cf-a366-26e46bf4eaf1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.399273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.400316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.400823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.401327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.419392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] HTTP exception thrown: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Request method failure captured: Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 HTTP/1.1 Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wpHTmfo_0VhQD1oEeSe4f4Qq8D_chWZFpuNKGF1hHoFFNdiUy6_wlEtuByg36HrMFQbt-7q6kvyzbS4IUj_b-DywXMB6DrI_vUM_SyOKE3TAt2OIzf-TlUACGnjUtYvR04jPoCtNSouMIo8t1GhJN3be7OVf4G6ZXerPyznZZWxk1M Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:07.421163 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdc76d55bfad4286830d598a8c47d0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: cdc76d55bfad4286830d598a8c47d0fe Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1386208816 Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5388effbf8a4448e9922d65b33d5e35c Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1386208816-project Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.422593 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '6ed09279-8d38-45cf-a366-26e46bf4eaf1'} Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:07.423433 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. Jul 19 19:50:07.424725 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:07.425799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] Returning 404 to user: Instance 6ed09279-8d38-45cf-a366-26e46bf4eaf1 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:07.425885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.426858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74a2399c-49de-4642-973f-3f5dc8f969af tempest-AttachSCSIVolumeTestJSON-1386208816 tempest-AttachSCSIVolumeTestJSON-1386208816-project] 10.222.0.33 "GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1" status: 404 len: 111 microversion: 2.1 time: 0.035485 Jul 19 19:50:07.426983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.427070 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 532/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:07 2022] GET /compute/v2.1/servers/6ed09279-8d38-45cf-a366-26e46bf4eaf1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:50:07.434397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.434707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.435483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.435965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.448379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f72ba129-128d-4b5f-8525-4b787f0f1475 req-74b51f64-c783-4994-b4cd-517b83d44888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f096ca-59e0-410f-9fb7-1f5fd185af37", "tag": "fc639db7-4f25-4846-9a8b-25345dcf14c3"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:07.456979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f72ba129-128d-4b5f-8525-4b787f0f1475 req-74b51f64-c783-4994-b4cd-517b83d44888 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.457523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f72ba129-128d-4b5f-8525-4b787f0f1475 req-74b51f64-c783-4994-b4cd-517b83d44888 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.469084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f72ba129-128d-4b5f-8525-4b787f0f1475 req-74b51f64-c783-4994-b4cd-517b83d44888 service nova] Creating event network-changed:fc639db7-4f25-4846-9a8b-25345dcf14c3 for instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 on n-h2-843861-3 Jul 19 19:50:07.474375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f72ba129-128d-4b5f-8525-4b787f0f1475 req-74b51f64-c783-4994-b4cd-517b83d44888 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030298 Jul 19 19:50:07.475067 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 533/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:07.576364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.578036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.587270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.588046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.589141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.590087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.618841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.632302 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c3feaf60-498c-40e0-af7b-51ad8573244d tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1645 microversion: 2.1 time: 0.213888 Jul 19 19:50:07.642150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 559/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:07 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1645 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:07.740895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.748749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-808eda48-b5b8-46a4-b806-86860792bee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.178122 Jul 19 19:50:07.749527 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 534/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:07 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:08.009249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.009865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.015639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:08.018058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.018505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.019332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.020592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.037646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.038257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.046477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.046848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.047619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.052584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.304061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.310412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.319068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14a73263-1cd7-4536-a89b-404616bd28de tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.286839 Jul 19 19:50:08.319262 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16a50f2c-34c2-44cd-a76b-f13db91c7287 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.313716 Jul 19 19:50:08.319656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 535/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:08.328696 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 560/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:08.394431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.395628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.403496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.404151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.404938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.405389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.555457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:08.586379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.594901 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1b5791b5-caaf-4960-9b63-d9019f6d930d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 0.204811 Jul 19 19:50:08.604675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 536/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:08.650452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.651720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.657987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.658658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.659611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.660113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.748663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:08.766318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.767017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.774412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.774870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.775870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.776505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.820193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.828401 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa6f39e3-bad3-4a23-a6c8-d73e5ba359fe tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1645 microversion: 2.1 time: 0.181193 Jul 19 19:50:08.836273 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 561/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1645 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:08.937011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.945693 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a94a0741-32df-41ee-aab8-bed3bf7facb2 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.183596 Jul 19 19:50:08.955587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 537/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:09.336900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.337697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.338159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.339492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.344462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=14 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:09.349177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.349914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.350685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.351066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.351364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.351938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.354506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.355376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.843429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.851201 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71019eb4-e8ce-4f85-923c-2b149d29b785 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.518535 Jul 19 19:50:09.851881 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 562/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:09.865712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.866326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.872304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.872699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.873465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.873896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.887278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.896256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-95de319b-bcce-4214-9e4c-283dce47c0f9 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.563513 Jul 19 19:50:09.904041 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 538/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:09.904041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.904041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.908715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.909174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.909951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.910391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.650242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.658511 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eece7f46-408a-4169-9096-1715b98adfe4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 0.796318 Jul 19 19:50:10.660523 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 563/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:10.673641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:10.674364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:10.687516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.688006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.689218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.689953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.717669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.727046 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae55e68d-d19b-4f1e-8023-1da0a246ba87 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1645 microversion: 2.1 time: 0.828745 Jul 19 19:50:10.729732 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 539/1102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1645 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:10.881372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:10.883133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:10.892960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.895466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.896846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.897602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.258685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.266596 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-058508ac-02f9-4ebd-876a-af3a957a4269 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.604436 Jul 19 19:50:11.267183 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 564/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:10 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:11.271882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.272494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.274395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:11.279837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.280320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.281104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.281537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.378246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.385861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-330fe7ac-a365-4630-8456-468d1cc36dc7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.521399 Jul 19 19:50:11.386660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 540/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:10 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:11.400490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-70b8e03f-f259-45be-a93b-77ed0950c83c req-bd8e6920-f3e0-47a1-8427-8ac2c0583003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb6c658-ec3b-46d8-8086-220f79a5399f", "name": "network-vif-plugged", "status": "completed", "tag": "6c0057cb-3247-4523-98f2-a1eee1ca6fb4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:11.408662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-70b8e03f-f259-45be-a93b-77ed0950c83c req-bd8e6920-f3e0-47a1-8427-8ac2c0583003 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.409102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-70b8e03f-f259-45be-a93b-77ed0950c83c req-bd8e6920-f3e0-47a1-8427-8ac2c0583003 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.420606 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-70b8e03f-f259-45be-a93b-77ed0950c83c req-bd8e6920-f3e0-47a1-8427-8ac2c0583003 service nova] Creating event network-vif-plugged:6c0057cb-3247-4523-98f2-a1eee1ca6fb4 for instance deb6c658-ec3b-46d8-8086-220f79a5399f on n-h2-843861-3 Jul 19 19:50:11.425819 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-70b8e03f-f259-45be-a93b-77ed0950c83c req-bd8e6920-f3e0-47a1-8427-8ac2c0583003 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028709 Jul 19 19:50:11.426004 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 541/1105] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:11.675042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.675735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.682050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.682807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.683575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.684043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.872667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.917055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72374f7c-66a8-4549-ab69-78ac60f2608b tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.648362 Jul 19 19:50:11.943467 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 565/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:11.966407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.969337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.989622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.991041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.995084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.998037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.770710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.795018 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a839c6b-27d5-4c31-8933-affffae6d53e tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1473 microversion: 2.1 time: 1.123057 Jul 19 19:50:12.796930 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 542/1107] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1473 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:12.804134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-33c9eea0-1a79-415d-aa4e-72384982f9ff req-fbd98bcd-0890-41fd-9cf4-4485eadd239c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c18696-65b2-4b9f-8692-d1fa7c2e5897", "tag": "351efc05-b53e-4c94-986a-8bac70939ff1"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:12.815171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-33c9eea0-1a79-415d-aa4e-72384982f9ff req-fbd98bcd-0890-41fd-9cf4-4485eadd239c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.816047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-33c9eea0-1a79-415d-aa4e-72384982f9ff req-fbd98bcd-0890-41fd-9cf4-4485eadd239c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.839121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-33c9eea0-1a79-415d-aa4e-72384982f9ff req-fbd98bcd-0890-41fd-9cf4-4485eadd239c service nova] Creating event network-changed:351efc05-b53e-4c94-986a-8bac70939ff1 for instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 on n-h2-843861-3 Jul 19 19:50:12.846027 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-33c9eea0-1a79-415d-aa4e-72384982f9ff req-fbd98bcd-0890-41fd-9cf4-4485eadd239c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047524 Jul 19 19:50:12.848568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 543/1108] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:12.855375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:12.860229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:12.880594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.881739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.883166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.885125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.921315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.938815 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b5b5ac91-bdfa-4080-9d96-bd35fe4dfc12 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1645 microversion: 2.1 time: 0.993007 Jul 19 19:50:12.941758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 566/1109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1645 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:12.957273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:12.958135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:12.979677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.980208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.981454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.981889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.711826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:13.719234 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-705b51e5-fec9-4cc5-9a30-a5f741a740c6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1324 microversion: 2.1 time: 0.869282 Jul 19 19:50:13.719834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 544/1110] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:12 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1324 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:13.724742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e037e399-adaf-4f02-93b8-95b4b09690f6 req-d580fee2-fe63-4241-a6e6-1880850d65d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bdb705-c7c6-41a7-8d69-c5f738b09d96", "name": "network-vif-deleted", "tag": "2a1aee42-4208-4e44-b563-9cff67013c45"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:13.732408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e037e399-adaf-4f02-93b8-95b4b09690f6 req-d580fee2-fe63-4241-a6e6-1880850d65d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.732849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e037e399-adaf-4f02-93b8-95b4b09690f6 req-d580fee2-fe63-4241-a6e6-1880850d65d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.741310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:13.744464 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e037e399-adaf-4f02-93b8-95b4b09690f6 req-d580fee2-fe63-4241-a6e6-1880850d65d4 service nova] Creating event network-vif-deleted:2a1aee42-4208-4e44-b563-9cff67013c45 for instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 on n-h2-843861-3 Jul 19 19:50:13.749199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e037e399-adaf-4f02-93b8-95b4b09690f6 req-d580fee2-fe63-4241-a6e6-1880850d65d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028157 Jul 19 19:50:13.750133 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 545/1111] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:13.751209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41d1dbea-75ad-46eb-a26f-1438e23b5dba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.807381 Jul 19 19:50:13.752595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 567/1112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:12 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:13.767068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:13.767068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:13.772199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.773333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.774290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.774885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.820423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:13.821068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:13.839726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.842912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.844670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.845813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.900020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:13.900474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:13.901492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lazy-loading 'fault' on Instance uuid 48bdb705-c7c6-41a7-8d69-c5f738b09d96 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:14.213845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:14.228903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fad6371-0f2d-4928-aa63-7d13af26f21b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 200 len: 1307 microversion: 2.1 time: 0.416903 Jul 19 19:50:14.230465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 568/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:13 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:14.236815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:14.237967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:14.248216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.249327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.250649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.251314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.407201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:14.420266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e47ab8e-743a-4d8d-ada7-f0888bd2af50 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 200 len: 1301 microversion: 2.1 time: 0.187729 Jul 19 19:50:14.423662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 569/1114] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:14 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:14.463028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:14.473879 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c2acb9f-ee1c-46d0-a71b-aede1b63eb42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.720018 Jul 19 19:50:14.475378 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 546/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:13 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:14.737001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:14.737614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:14.744260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.744694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.745639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.746075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.768649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:14.769462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:14.777882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.778791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.779435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.780281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.233733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.242980 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a53ce1e-072e-4c3d-b7e4-16a2e6fbdd31 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1522 microversion: 2.1 time: 0.509863 Jul 19 19:50:15.243583 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 570/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:14 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:15.248349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f969122-53c1-4308-8cfb-dce1a81752aa", "tag": "cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06"}, {"server_uuid": "d5f096ca-59e0-410f-9fb7-1f5fd185af37", "name": "network-vif-deleted", "tag": "fc639db7-4f25-4846-9a8b-25345dcf14c3"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:15.254977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.265407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.266079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.268140 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b366e73e-e67b-4797-8c55-501a4318ec13 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.504696 Jul 19 19:50:15.269144 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 547/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:14 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:15.275139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.276227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 48bdb705-c7c6-41a7-8d69-c5f738b09d96] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.282004 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] Creating event network-changed:cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06 for instance 5f969122-53c1-4308-8cfb-dce1a81752aa on n-h2-843861-3 Jul 19 19:50:15.282925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] Creating event network-vif-deleted:fc639db7-4f25-4846-9a8b-25345dcf14c3 for instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 on n-h2-843861-3 Jul 19 19:50:15.284100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.284652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.285681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.286358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.295093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6462ac7d-2be3-4960-8df8-7a5541ee33a8 req-653d3a9f-864f-4efd-8ef7-1f50d9e2fb02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049526 Jul 19 19:50:15.297155 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 571/1118] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:15.304307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.305458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.306787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 HTTP/1.1 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:15.308827 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. Jul 19 19:50:15.310293 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '48bdb705-c7c6-41a7-8d69-c5f738b09d96'} Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:15.311095 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. Jul 19 19:50:15.314488 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.319020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.319020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.319020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.319304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.320700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 48bdb705-c7c6-41a7-8d69-c5f738b09d96 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:15.321728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26966ef3-c403-4ccd-90c8-d135232acdd1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96" status: 404 len: 111 microversion: 2.1 time: 0.051537 Jul 19 19:50:15.325573 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 548/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/48bdb705-c7c6-41a7-8d69-c5f738b09d96 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:15.332452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.333191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.341077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.341719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.342686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.343997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.372100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:15.375821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:15.458717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05182206-0534-4018-954f-2ac73733239b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 204 len: 0 microversion: 2.1 time: 0.130963 Jul 19 19:50:15.459223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 549/1120] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:15 2022] DELETE /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:15.464398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.465092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.473462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.474041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.475050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.475544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.490178 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 HTTP/1.1 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:15.491984 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:15.493677 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd5f096ca-59e0-410f-9fb7-1f5fd185af37'} Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:15.497680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:15.499426 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:15.500860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:15.500860 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef758f8c-a64b-464d-8f06-6b8c5c41ceb6 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 404 len: 111 microversion: 2.1 time: 0.032949 Jul 19 19:50:15.500860 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 550/1121] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:15.500860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.500860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.506000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.506420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.507179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.507603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.763362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.765806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:15.772965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aefbde08-5d25-4105-929d-c8bb8ab72abd tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1522 microversion: 2.1 time: 0.473658 Jul 19 19:50:15.773555 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 572/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:15.778635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.779241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.785310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.786376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.787296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.787727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.805511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.813782 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd43f339-4473-4114-a107-748c937f2b1f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.318628 Jul 19 19:50:15.814358 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 551/1123] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:15.819658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-253863be-e11c-415d-9692-27304f1fba20 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88ddc1700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.396106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.404202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-008f0387-a485-4bdd-b75a-7b6cbd8e165e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.629644 Jul 19 19:50:16.404774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 573/1124] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:16.418994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1308411427"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:16.420062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:16.426311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.426765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.427530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.427988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.604964 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-253863be-e11c-415d-9692-27304f1fba20 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368" status: 202 len: 0 microversion: 2.1 time: 0.788802 Jul 19 19:50:16.605618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 552/1125] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:15 2022] DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368 => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:16.615288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.615953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:16.628065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.629796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.631196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.632118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.739834 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd3951a9-a6cd-4a90-af02-10ae74b0f326 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f/action" status: 202 len: 0 microversion: 2.1 time: 0.324380 Jul 19 19:50:16.744013 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 574/1126] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:16 2022] POST /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:50:16.751279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2523617-fbea-4e02-a4e5-3af99f89a024 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dfae820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.855522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.863233 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-71260c7d-5536-4969-bc1a-d5bd4f5b4616 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.256443 Jul 19 19:50:16.873656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 553/1127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:16 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:16.873656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e320c5d2-e73d-4ee4-b2a2-6b9ee2799c9e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88dddb8b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.998550 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e320c5d2-e73d-4ee4-b2a2-6b9ee2799c9e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47" status: 204 len: 0 microversion: 2.1 time: 0.133563 Jul 19 19:50:16.999418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 554/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:16 2022] DELETE /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:17.005017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.006355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.021632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.022114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.023284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.023723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.221404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2523617-fbea-4e02-a4e5-3af99f89a024 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839" status: 202 len: 0 microversion: 2.1 time: 0.475262 Jul 19 19:50:17.222116 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 575/1129] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:16 2022] DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:17.227311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.228076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.245111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.245662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.246335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.246767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.307259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:17.321628 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a42693fb-7b0a-4f05-8e65-af80577a8e63 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 2344 microversion: 2.25 time: 0.320878 Jul 19 19:50:17.322202 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 555/1130] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:16 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 2344 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:17.326651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c81b503-3542-4d72-b744-fbd33c91b134 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88dbe9af0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.348288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4c81b503-3542-4d72-b744-fbd33c91b134 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Image not found. Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c81b503-3542-4d72-b744-fbd33c91b134 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47 HTTP/1.1 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:17.366164 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ba98ee58-5b94-45f2-be51-61dd392b4e47'} Jul 19 19:50:17.367795 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:17.368797 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ba98ee58-5b94-45f2-be51-61dd392b4e47 Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:17.370062 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba98ee58-5b94-45f2-be51-61dd392b4e47 could not be found. Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:17.371667 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.373035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c81b503-3542-4d72-b744-fbd33c91b134 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:17.374205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c81b503-3542-4d72-b744-fbd33c91b134 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47" status: 404 len: 62 microversion: 2.1 time: 0.044535 Jul 19 19:50:17.374205 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 556/1131] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:50:17.381214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a279b841-641e-456d-9c57-0a7581d60808 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'create', calling method: .version_select at 0x7fb88dbfa670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1699019909", "description": "tempest-description-735876182"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:17.508610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:17.516648 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-292703c2-7670-499a-8c84-2e1653dd0a4d tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.293533 Jul 19 19:50:17.517233 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 576/1132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:17.522090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.523470 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:50:17.523470 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:50:17.524720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.525168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.525966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.526404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.549927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2f0c103-f62b-42d8-ae07-8f7e160a7905 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.031658 Jul 19 19:50:17.550549 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 577/1133] 10.222.0.33 () {60 vars in 1216 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:50:17.555088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.555711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.562137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.562592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.563365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.563823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.771041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a279b841-641e-456d-9c57-0a7581d60808 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.400298 Jul 19 19:50:17.771791 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 557/1134] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 19:50:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:17.779282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.780210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.789769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.790329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.791293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.791858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.877866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:17.888492 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9324c1d-27dc-46b7-89d8-60953ae7c16a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1542 microversion: 2.1 time: 0.336565 Jul 19 19:50:17.889216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 578/1135] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:17.894296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba0896a7-8b4d-4e2e-9ad3-a309d40b344e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Action: 'update', calling method: .version_select at 0x7fb88df6d940>, body: {"security_group": {"name": "tempest-sg-hth-1023609918", "description": "tempest-description-hth-860007342"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:18.064446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:18.070780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0dd493af-0a32-4a78-a231-21dc48ecfd7d tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.297320 Jul 19 19:50:18.071583 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 558/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:18.088405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.089083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:18.101311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.101772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.102549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.102984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.472038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba0896a7-8b4d-4e2e-9ad3-a309d40b344e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7" status: 200 len: 217 microversion: 2.1 time: 0.581374 Jul 19 19:50:18.473898 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 579/1137] 10.222.0.33 () {60 vars in 1289 bytes} [Tue Jul 19 19:50:17 2022] PUT /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7 => generated 217 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:18.485505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53496cdd-1165-421c-a1b9-4d559a6de54e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df6daf0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.613056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:18.621950 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e01fadd1-ee2a-405d-b68d-d1ab9cb44672 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.540110 Jul 19 19:50:18.624611 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 559/1138] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:18 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:18.631493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.637444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:18.673516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.679502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.680412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.681055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.714413 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53496cdd-1165-421c-a1b9-4d559a6de54e tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7" status: 200 len: 217 microversion: 2.1 time: 0.232866 Jul 19 19:50:18.715006 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 580/1139] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:50:18 2022] GET /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7 => generated 217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:18.727150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aff3b3fe-354e-4fb2-abf7-fecbf4f6f375 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df76700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.980611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:18.990764 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-69a179fe-b4c8-44d0-83c4-259a84f36688 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.363731 Jul 19 19:50:18.991362 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 560/1140] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:18 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:18.996039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.996656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.007944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.008518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.009419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.010023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.165089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aff3b3fe-354e-4fb2-abf7-fecbf4f6f375 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7" status: 202 len: 0 microversion: 2.1 time: 0.439164 Jul 19 19:50:19.177311 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 581/1141] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:18 2022] DELETE /compute/v2.1/os-security-groups/a68d3090-3a0f-48dd-bbfa-be4ac7fab6a7 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:50:19.198166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.198803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.219561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.224574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.225709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.228003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.323989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.341219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ea9bbfa-520f-44a8-b529-b15c1309fc5a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1534 microversion: 2.1 time: 0.348739 Jul 19 19:50:19.351459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 561/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:18 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1534 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:19.351459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.351873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.354107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:19.375083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.375953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.382037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.382814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.411248 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 HTTP/1.1 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:19.412853 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.414269 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd5f096ca-59e0-410f-9fb7-1f5fd185af37'} Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.415093 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.416603 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.418275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.418275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9dca8f66-212d-4c51-8b9d-45a9ad7288f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 404 len: 111 microversion: 2.1 time: 0.071006 Jul 19 19:50:19.418275 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 562/1143] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:19.426816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.427524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: d5f096ca-59e0-410f-9fb7-1f5fd185af37] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.434021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.435379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.436393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.437040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.454951 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 HTTP/1.1 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:19.456507 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.458084 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd5f096ca-59e0-410f-9fb7-1f5fd185af37'} Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.458909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. Jul 19 19:50:19.461182 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.462489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Instance d5f096ca-59e0-410f-9fb7-1f5fd185af37 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.462489 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a64f8647-06a2-4647-887e-f43e115eb708 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37" status: 404 len: 111 microversion: 2.1 time: 0.037730 Jul 19 19:50:19.462489 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 563/1144] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:19 2022] GET /compute/v2.1/servers/d5f096ca-59e0-410f-9fb7-1f5fd185af37 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:19.467476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dbfad30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.511246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.516811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.517566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group 43ceaa10-ff80-438d-952b-e340f2294839 not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.518679 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.518679 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839 HTTP/1.1 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:19.521066 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.522662 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '43ceaa10-ff80-438d-952b-e340f2294839'} Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.523619 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.524862 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.525997 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group 43ceaa10-ff80-438d-952b-e340f2294839 does not exist Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-68ada4ee-39a0-4d94-a395-6f565ec9fe46'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c2f646a-494f-4235-a720-f6eb95e19bb4 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839" status: 404 len: 194 microversion: 2.1 time: 0.058850 Jul 19 19:50:19.527362 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 564/1145] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/43ceaa10-ff80-438d-952b-e340f2294839 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:19.530080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3b84434a-187f-4929-87d8-95bcb1fe52fd tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.344530 Jul 19 19:50:19.531158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 582/1146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:19 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:19.534330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dde0c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.581484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.582184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group defbaaef-a0c2-435d-9c7f-7203e5aad368 not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.582995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.582995 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368 HTTP/1.1 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:19.586360 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.588141 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'defbaaef-a0c2-435d-9c7f-7203e5aad368'} Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.589267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.591168 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.592954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group defbaaef-a0c2-435d-9c7f-7203e5aad368 does not exist Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-cb94f01e-c6f6-4ca2-8c26-c7f99831d87b'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.594380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fc39a16-0273-4936-ae74-dc3d22bf3fb7 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368" status: 404 len: 194 microversion: 2.1 time: 0.063086 Jul 19 19:50:19.604364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df6dee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.608831 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 565/1147] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/defbaaef-a0c2-435d-9c7f-7203e5aad368 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:19.636384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.636994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group a60e0508-4e26-4206-b655-746b34378b9b not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.637782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.637782 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b HTTP/1.1 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:19.640295 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.641850 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a60e0508-4e26-4206-b655-746b34378b9b'} Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.643173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.644613 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.645969 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] Jul 19 19:50:19.647406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.647865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.647865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.650972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group a60e0508-4e26-4206-b655-746b34378b9b does not exist Jul 19 19:50:19.650972 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-eaa681ff-a536-4e12-bfa8-b431cbb4618a'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.652193 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-177a4bbb-ce94-4a0c-91e2-e2a593cd87f1 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b" status: 404 len: 194 microversion: 2.1 time: 0.054178 Jul 19 19:50:19.653354 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 583/1148] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/a60e0508-4e26-4206-b655-746b34378b9b => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:19.657292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.657761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.658515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.658946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.661752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df6d160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.701427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.702008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group 08e01cbf-8db7-46a8-9d51-cb38c987180c not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.703582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.703582 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c HTTP/1.1 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:19.705458 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.707044 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '08e01cbf-8db7-46a8-9d51-cb38c987180c'} Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.708055 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.709676 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.710984 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group 08e01cbf-8db7-46a8-9d51-cb38c987180c does not exist Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-1a98bce0-bf9b-46b0-9086-fb0053798456'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.712490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-949ca563-6b05-45f2-9807-87d895b7e3bb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c" status: 404 len: 194 microversion: 2.1 time: 0.053026 Jul 19 19:50:19.713573 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 584/1149] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/08e01cbf-8db7-46a8-9d51-cb38c987180c => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:50:19.718997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df6d5e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.781099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.781778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.782466 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.782466 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b HTTP/1.1 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:19.784466 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.786342 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '57e9f26d-8c39-4a35-b437-42e4eda16d3b'} Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.787240 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.789275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.790492 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group 57e9f26d-8c39-4a35-b437-42e4eda16d3b does not exist Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-43f7d9fd-cdf3-4dbd-9211-f337eb9f48ff'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b502882c-199e-4f46-8be0-da960f2df3e9 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b" status: 404 len: 194 microversion: 2.1 time: 0.071552 Jul 19 19:50:19.791871 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 585/1150] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/57e9f26d-8c39-4a35-b437-42e4eda16d3b => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:50:19.796736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df76550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.852751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:19.853340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Neutron security group c7e5930a-1374-4dc7-b8ba-264617e80272 not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:50:19.853859 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.853859 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 HTTP/1.1 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:19.856710 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.858071 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c7e5930a-1374-4dc7-b8ba-264617e80272'} Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.858910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:50:19.860200 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.863300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Security group c7e5930a-1374-4dc7-b8ba-264617e80272 does not exist Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-7e8b34fa-0a1d-481d-8b8e-678413a2daa1'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f673920-274d-4fd1-8566-15b189bf2006 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272" status: 404 len: 194 microversion: 2.1 time: 0.065352 Jul 19 19:50:19.865523 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 586/1151] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/os-security-groups/c7e5930a-1374-4dc7-b8ba-264617e80272 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:50:19.870697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.871248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.879157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.879642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.880461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.880897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.912718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:19.916565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.938909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-97ea8f18-73dc-4c4a-b5bc-849a1c4da983 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.290567 Jul 19 19:50:19.964312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 566/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:19 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:20.009649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.010467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.015517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4528c936-8535-47b6-bdaa-714e10e62587 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 204 len: 0 microversion: 2.1 time: 0.149019 Jul 19 19:50:20.023256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 587/1153] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:19 2022] DELETE /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:20.028144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.028607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.029393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.029979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.036269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.037843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.048742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.049888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.052064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.053033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.346598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.356265 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-442c9348-8666-4ca6-ba3a-546a05c25733 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.350665 Jul 19 19:50:20.357476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 567/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:20.363486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f12559-3e88-49ec-98eb-b2e854bf202e", "device": "/dev/xvdb"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:20.365374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.371479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.371963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.372781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.373147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.439899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.449254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15d845da-c40d-4995-bdf3-d2c8ce48fe15 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1647 microversion: 2.1 time: 0.421519 Jul 19 19:50:20.462153 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 588/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1647 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:20.470792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.471618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.478527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.479264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.480322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.480992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.712366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.720020 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-327d1dfa-4843-49a9-9f6d-26c6909b74d5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1534 microversion: 2.1 time: 0.255597 Jul 19 19:50:20.720911 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 589/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1534 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:20.725579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.726191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.732275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.732742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.733518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.733954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.908469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.916984 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-931224ad-105e-4142-af3d-b19ebc325e18 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.194898 Jul 19 19:50:20.917564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 590/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:20.955906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.956520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.962472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.962940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.963708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.964164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.158612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:21.167919 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87d1f9cb-4181-4d31-8014-3f985962fe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.215984 Jul 19 19:50:21.168990 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 591/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:21.373327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:21.373938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:21.380987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.381437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.382200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.382748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.595016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:21.604316 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e4fc6dd-d8d9-4f9a-99ce-f939733f8dcc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.234899 Jul 19 19:50:21.605471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 592/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:21 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:21.616690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:21.617319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:21.623523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.624227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.625006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.625442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.370136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0e2a68a664e72bef5d21f7533ff85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d845c4b74044ec7859074c20b6f5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.378554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7222df65-c94d-4682-a919-2e9feafbabbb tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 200 len: 1647 microversion: 2.1 time: 0.771740 Jul 19 19:50:22.389011 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 593/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:21 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 1647 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:22.393810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:22.394618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:22.401313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.401765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.402526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.403128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.733120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.742320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4deea78-ac06-45c3-a163-a33f2974c627 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1534 microversion: 2.1 time: 0.352132 Jul 19 19:50:22.745614 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 594/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:22 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1534 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:22.756969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:22.757935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:22.764444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.765154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.766127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.766565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.771104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:23.007643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:23.020422 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bfcbaead-4bb9-4c87-a0a2-74dc82da9b1e tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.272897 Jul 19 19:50:23.031982 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 595/1162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:22 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:23.038202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:23.039037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:23.048655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.049792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.050821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.051526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.315018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:23.331073 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9663a976-47b1-40aa-b432-32660e0cc7dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.297588 Jul 19 19:50:23.331678 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 596/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:23 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:23.342453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e2c611da-9910-4ec8-a7f7-bcdd32d72ba2 req-de1cee3d-f5ff-4ea7-9431-cc0e43148f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18696-65b2-4b9f-8692-d1fa7c2e5897", "name": "network-vif-plugged", "status": "completed", "tag": "351efc05-b53e-4c94-986a-8bac70939ff1"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:23.354318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e2c611da-9910-4ec8-a7f7-bcdd32d72ba2 req-de1cee3d-f5ff-4ea7-9431-cc0e43148f8b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.354763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e2c611da-9910-4ec8-a7f7-bcdd32d72ba2 req-de1cee3d-f5ff-4ea7-9431-cc0e43148f8b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.367334 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e2c611da-9910-4ec8-a7f7-bcdd32d72ba2 req-de1cee3d-f5ff-4ea7-9431-cc0e43148f8b service nova] Creating event network-vif-plugged:351efc05-b53e-4c94-986a-8bac70939ff1 for instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 on n-h2-843861-3 Jul 19 19:50:23.372636 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e2c611da-9910-4ec8-a7f7-bcdd32d72ba2 req-de1cee3d-f5ff-4ea7-9431-cc0e43148f8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035944 Jul 19 19:50:23.375997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 597/1164] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:23.382905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:23.384106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:23.391832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.392518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.393494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.394160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.600342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:23.611581 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1f95253f-82cb-4705-b027-8cb0c88e6301 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.233407 Jul 19 19:50:23.621168 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 598/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:23 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:23.621168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-23a10e45-e290-4143-ac81-4dcdcb8b2787 req-14fce6c7-4423-4a5d-9073-247398c5da82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fb33d4-1db1-416b-ba0c-44ce50a43186", "name": "network-vif-deleted", "tag": "3004977b-b9d8-4c94-bfa7-b45ce035bf5f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:23.625946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23a10e45-e290-4143-ac81-4dcdcb8b2787 req-14fce6c7-4423-4a5d-9073-247398c5da82 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.626531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23a10e45-e290-4143-ac81-4dcdcb8b2787 req-14fce6c7-4423-4a5d-9073-247398c5da82 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.640868 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-23a10e45-e290-4143-ac81-4dcdcb8b2787 req-14fce6c7-4423-4a5d-9073-247398c5da82 service nova] Creating event network-vif-deleted:3004977b-b9d8-4c94-bfa7-b45ce035bf5f for instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 on n-h1-843861-3 Jul 19 19:50:23.647678 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-23a10e45-e290-4143-ac81-4dcdcb8b2787 req-14fce6c7-4423-4a5d-9073-247398c5da82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Jul 19 19:50:23.648562 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 599/1166] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:23.654010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:23.655087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] [instance: 91fb33d4-1db1-416b-ba0c-44ce50a43186] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:23.661619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.662456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.663729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:23.664366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:23.694818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] HTTP exception thrown: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Request method failure captured: Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 HTTP/1.1 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wqzBMrtW_8E8HN-TRfpuZaXBlen_NRH4ii-FzAOgay9k-As-ZryGZoF9ktWrIwMrDSWnAMVcOE6wRDujb-47lJMkzrSnQzGdZ89lqbW78naIQQBYxf0m51SUGFPVPsNl3Oik1N3D9AweitGa4edkGIRyKSZVf0JShIKT3-ffDtX0KQ Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:23.696897 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d845c4b74044ec7859074c20b6f5137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8d845c4b74044ec7859074c20b6f5137 Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2142819664 Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 96b0e2a68a664e72bef5d21f7533ff85 Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsTestJSON-2142819664-project Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. Jul 19 19:50:23.698566 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '91fb33d4-1db1-416b-ba0c-44ce50a43186'} Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:23.699478 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. Jul 19 19:50:23.701003 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:23.702278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Returning 404 to user: Instance 91fb33d4-1db1-416b-ba0c-44ce50a43186 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:23.702278 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d192920b-821a-46c7-928a-c211cc85b600 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186" status: 404 len: 111 microversion: 2.1 time: 0.048354 Jul 19 19:50:23.702278 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 600/1167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:23 2022] GET /compute/v2.1/servers/91fb33d4-1db1-416b-ba0c-44ce50a43186 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:23.707788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a5e5160-1365-45fd-9896-30b9b11edd79 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88df76c10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.344117 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a5e5160-1365-45fd-9896-30b9b11edd79 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/dc2076af-6a24-4d38-b659-f4f11d4b9b58" status: 202 len: 0 microversion: 2.1 time: 0.639528 Jul 19 19:50:24.348644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 601/1168] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:23 2022] DELETE /compute/v2.1/os-security-groups/dc2076af-6a24-4d38-b659-f4f11d4b9b58 => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:24.353162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.353786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:24.390990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.391545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.396013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.397677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.813418 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0433f93a-9a99-49ea-a953-510497a1a258 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 4.454237 Jul 19 19:50:24.814239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 568/1169] 10.222.0.33 () {62 vars in 1363 bytes} [Tue Jul 19 19:50:20 2022] POST /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 194 bytes in 4456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:50:24.822435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.824466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:24.836192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.836862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.838383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.839172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.985070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:24.993735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4dba66ea-423d-4894-af9e-6ed34f2b14f3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1534 microversion: 2.1 time: 0.647598 Jul 19 19:50:24.994443 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 602/1170] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1534 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:24.999419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:25.000168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:25.006568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.007133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.008009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.008441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.186476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.195599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d99c3c25-efa6-4898-b52f-a72746e00d45 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.379324 Jul 19 19:50:25.206393 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 569/1171] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:25.237938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d59b580-3e85-4f84-99ab-5f112eb8ee59 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] Calling method '.version_select at 0x7fb88dde0c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:25.300742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.310845 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4775126b-dec5-49be-89db-2ed1393dc623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.314903 Jul 19 19:50:25.311714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 603/1172] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:25.325715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:25.326579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:25.340242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.340931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.342786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.343426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.690582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.700673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4400df6-523e-478f-9497-a5a527f8d8f5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.378711 Jul 19 19:50:25.702086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 604/1173] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:25 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:25.819472 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d59b580-3e85-4f84-99ab-5f112eb8ee59 tempest-SecurityGroupsTestJSON-2142819664 tempest-SecurityGroupsTestJSON-2142819664-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/804d6d0d-fe77-44d3-8963-c93e87c11735" status: 202 len: 0 microversion: 2.1 time: 0.611478 Jul 19 19:50:25.820865 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 570/1174] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:50:25 2022] DELETE /compute/v2.1/os-security-groups/804d6d0d-fe77-44d3-8963-c93e87c11735 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:26.010693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.011319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.018761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.019508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.021069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.021673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.231781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.232681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.249362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.249818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.251118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.251721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.718490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:26.728791 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18ffcdf2-c9a4-411c-9f88-80f51fc3e5ec tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1534 microversion: 2.1 time: 0.721770 Jul 19 19:50:26.729591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 605/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1534 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:26.735665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.736716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.746650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.747503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.748657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.749742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.767302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:26.795102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-072951a7-126f-4be9-a95f-474708e2375a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.585137 Jul 19 19:50:26.796234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 571/1176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:26.802299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.803752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.815394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.816242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.817973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.818662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.824366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:27.166855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:27.178260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9409d4bb-c56a-40eb-a0e0-1a39227ae172 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1471 microversion: 2.1 time: 0.380742 Jul 19 19:50:27.181281 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 572/1177] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:27.257378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:27.266245 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cc3d1d5-fff1-46e6-81cb-af1b439c615c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1308 microversion: 2.1 time: 0.535433 Jul 19 19:50:27.277081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 606/1178] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:27.444254 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 19:50:27.444525 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 19:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 19:50:27.746815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:27.748109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:27.765664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.766702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:27.768507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.769367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:27.783571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:27.790548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-22fdc930-ecb0-4713-b103-778194c73191 req-da5ed6e5-f8fe-4cbd-a441-0059b6656036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b57132-23d1-4cd3-987e-0bf1990145d5", "name": "network-vif-deleted", "tag": "8d3b3f6c-647f-41ba-8699-5d6be35c8932"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:27.813907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-22fdc930-ecb0-4713-b103-778194c73191 req-da5ed6e5-f8fe-4cbd-a441-0059b6656036 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.815384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-22fdc930-ecb0-4713-b103-778194c73191 req-da5ed6e5-f8fe-4cbd-a441-0059b6656036 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:27.865494 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-22fdc930-ecb0-4713-b103-778194c73191 req-da5ed6e5-f8fe-4cbd-a441-0059b6656036 service nova] Creating event network-vif-deleted:8d3b3f6c-647f-41ba-8699-5d6be35c8932 for instance 29b57132-23d1-4cd3-987e-0bf1990145d5 on n-h2-843861-3 Jul 19 19:50:27.876049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-22fdc930-ecb0-4713-b103-778194c73191 req-da5ed6e5-f8fe-4cbd-a441-0059b6656036 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093038 Jul 19 19:50:27.877343 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 607/1179] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:27.885124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:27.886225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:27.893945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.894674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:27.896509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.897174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.655221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:28.667864 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6b16bda-14c0-4600-81a5-73b48b636cc6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1540 microversion: 2.1 time: 0.925097 Jul 19 19:50:28.669049 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 573/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:27 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1540 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:28.672428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:28.682762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:28.683777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:28.695890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.699146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.700308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.704237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.732428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-49376c56-7f4a-4f0b-be4e-6c701bc431b6 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.853564 Jul 19 19:50:28.747775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 608/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:27 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:28.772498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:28.773545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:28.793078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.793809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.798735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.799196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.804350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.804948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.806594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lazy-loading 'fault' on Instance uuid 29b57132-23d1-4cd3-987e-0bf1990145d5 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:29.291364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:29.300214 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-85801b0a-18ce-4aba-bc62-3ed9db53d7bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1488 microversion: 2.1 time: 0.547276 Jul 19 19:50:29.318917 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 609/1182] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:28 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1488 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:29.329849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-235adf91-b0c7-45e8-9765-c2c0fbde4f76 req-33be1f0f-5116-4d6b-b05a-e442f58dc845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f969122-53c1-4308-8cfb-dce1a81752aa", "name": "network-vif-plugged", "status": "completed", "tag": "cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:29.354677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-235adf91-b0c7-45e8-9765-c2c0fbde4f76 req-33be1f0f-5116-4d6b-b05a-e442f58dc845 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.355640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-235adf91-b0c7-45e8-9765-c2c0fbde4f76 req-33be1f0f-5116-4d6b-b05a-e442f58dc845 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.377573 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-235adf91-b0c7-45e8-9765-c2c0fbde4f76 req-33be1f0f-5116-4d6b-b05a-e442f58dc845 service nova] Creating event network-vif-plugged:cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06 for instance 5f969122-53c1-4308-8cfb-dce1a81752aa on n-h2-843861-3 Jul 19 19:50:29.381958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:29.389517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65801a4b-7537-493b-822c-9f5f8e619b9c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 200 len: 1306 microversion: 2.1 time: 0.719297 Jul 19 19:50:29.393627 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 574/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:28 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 1306 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:29.400249 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-235adf91-b0c7-45e8-9765-c2c0fbde4f76 req-33be1f0f-5116-4d6b-b05a-e442f58dc845 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079778 Jul 19 19:50:29.401338 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 610/1184] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:29.402443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c91afbfa-29bf-462c-82a0-e0276f5dabb8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:29.408888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c91afbfa-29bf-462c-82a0-e0276f5dabb8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.409757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c91afbfa-29bf-462c-82a0-e0276f5dabb8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.486538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c91afbfa-29bf-462c-82a0-e0276f5dabb8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:50:29.566698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c91afbfa-29bf-462c-82a0-e0276f5dabb8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897/action" status: 202 len: 0 microversion: 2.1 time: 0.170499 Jul 19 19:50:29.568492 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 575/1185] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:29 2022] POST /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:29.577292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:29.578360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:29.589042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.592260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.594660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.595403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.689900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:29.694496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:29.720580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.727220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.728949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.730571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.953578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:29.965367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d60dc4d-a88e-4563-a3ba-0cf6ca814236 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.392191 Jul 19 19:50:29.968174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 611/1186] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:29 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:29.976095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:29.981986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:29.993413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.996908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.001362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.002364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.007205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:30.021503 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2cd2de80-9d2a-4bab-9aca-8de65ac1597d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1540 microversion: 2.1 time: 0.335775 Jul 19 19:50:30.022650 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 576/1187] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:29 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1540 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:30.358631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:30.371748 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8267f05-734d-440a-90c6-bd3a2067a7da tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.402325 Jul 19 19:50:30.372632 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 612/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:29 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:30.409869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:30.411191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 29b57132-23d1-4cd3-987e-0bf1990145d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:30.424433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.425380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.427047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.429338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.471999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 HTTP/1.1 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:30.473743 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. Jul 19 19:50:30.475463 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '29b57132-23d1-4cd3-987e-0bf1990145d5'} Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:30.476480 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. Jul 19 19:50:30.478073 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:30.481713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 29b57132-23d1-4cd3-987e-0bf1990145d5 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:30.482809 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e46daca3-6fec-4b76-bcc8-4db6d16732bd tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5" status: 404 len: 111 microversion: 2.1 time: 0.076749 Jul 19 19:50:30.493592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:30.494295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:30.497608 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 577/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:30 2022] GET /compute/v2.1/servers/29b57132-23d1-4cd3-987e-0bf1990145d5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:30.501196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.501927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.508064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.508739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.540723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:30.659656 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b869fac3-d209-4324-9ee8-2c6f77361a80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 204 len: 0 microversion: 2.1 time: 0.171028 Jul 19 19:50:30.680760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:30.681275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:30.685418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 613/1190] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:30 2022] DELETE /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:30.690665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.691681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.693847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.694481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.795787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:30.960671 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da931c01-edc6-4bc5-90fa-8825b67402c7 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 204 len: 0 microversion: 2.1 time: 0.293914 Jul 19 19:50:30.971985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:30.972876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:30.983903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 578/1191] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:30 2022] DELETE /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:30.996005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.999682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.001281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.002046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.010115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.010835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.027003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.027452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.028865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.029470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.032945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:31.510689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.523798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6794164e-554d-4063-bc43-5caa02c8eae6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1474 microversion: 2.1 time: 0.557263 Jul 19 19:50:31.531053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 614/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:30 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:31.547121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.549896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.565882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.572260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.573292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.573846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.579591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.592197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c04aa4b9-a9bd-4cc4-919c-ef98e8595165 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.606495 Jul 19 19:50:31.593383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 579/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:30 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:31.599028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.599898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.606973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.607671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.608832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.609493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.951334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.961275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d9f08ab-b65f-410e-8887-b75464b9a5e5 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1389 microversion: 2.1 time: 0.366626 Jul 19 19:50:31.965563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 580/1194] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:31 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1389 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:31.995237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:32.007508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4a74793-08ac-449e-ab38-c5d6944b60e5 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1540 microversion: 2.1 time: 0.475234 Jul 19 19:50:32.018821 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 615/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:31 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1540 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:32.559761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:32.560736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:32.589543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.592933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.593939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.613246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:32.613914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:32.617818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:32.620437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.626802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.641018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.642217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.642807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.334179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.346959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56df1f2b-70fb-480f-ace8-0aca9860ac82 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.740716 Jul 19 19:50:33.347792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 616/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:32 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:33.353655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:33.354262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:33.373772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.374220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.374995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.375384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.375960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.390491 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78fb3cf9-a117-4ee0-b396-d2614ed4582c tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1474 microversion: 2.1 time: 0.845470 Jul 19 19:50:33.391710 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 581/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:32 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1474 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:33.410426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:33.420161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:33.451671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.453792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.457237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.459581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.830020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.846882 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73d94e35-e745-4fca-9c6e-ebdf83f6ebc1 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1589 microversion: 2.1 time: 0.496702 Jul 19 19:50:33.851165 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 617/1198] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1589 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:33.893892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.904035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38d9251a-2f28-4211-b861-2fd1c6aca6ea tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1540 microversion: 2.1 time: 0.510267 Jul 19 19:50:33.904621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 582/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1540 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:33.915007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e3198c42-a3c2-4a45-96ce-f052a957a95d req-dd9f8dc4-5b3a-482b-b643-c5b1d070d20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3", "name": "network-vif-deleted", "tag": "74ece4f1-e135-46b9-9e8e-c08313305083"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:33.933967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e3198c42-a3c2-4a45-96ce-f052a957a95d req-dd9f8dc4-5b3a-482b-b643-c5b1d070d20e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.935036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e3198c42-a3c2-4a45-96ce-f052a957a95d req-dd9f8dc4-5b3a-482b-b643-c5b1d070d20e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.953767 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e3198c42-a3c2-4a45-96ce-f052a957a95d req-dd9f8dc4-5b3a-482b-b643-c5b1d070d20e service nova] Creating event network-vif-deleted:74ece4f1-e135-46b9-9e8e-c08313305083 for instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 on n-h1-843861-3 Jul 19 19:50:33.963978 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e3198c42-a3c2-4a45-96ce-f052a957a95d req-dd9f8dc4-5b3a-482b-b643-c5b1d070d20e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058147 Jul 19 19:50:33.968876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 583/1200] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:33.982299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:33.983259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:33.995077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.998837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.999449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.010712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.268045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] Calling method '.version_select at 0x7fb88dfc7ca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.411933 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-216fa39f-62a3-4e17-92c6-52512fcebf3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.441531 Jul 19 19:50:34.414388 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 584/1201] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa/os-interface => generated 285 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:34.416144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8beded86-b240-42e9-adae-583c07ef58e8 could not be found", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:50:34.416830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] HTTP exception thrown: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] Request method failure captured: Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-floating-ips/8beded86-b240-42e9-adae-583c07ef58e8 HTTP/1.1 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wsJEyxPGQSeSPkLLLN6Kyy2N1pUo_6B-obcalKGLPZC-ijU9LsLJCeKlQ5fTBrndvF1o31qIjRYcFJhLscDSFURcGXVvtMd1lhjDt2vuI-ve20LcQfYmiXgUklUk6F7j0JpJgfnjwsOoLWtEW8KeGkl-fU2n-pu705O95t6yczLXwY Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 355b7773ca094ec59868f122d2ee85d3 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-341650129 Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:34.419278 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355b7773ca094ec59868f122d2ee85d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/355b7773ca094ec59868f122d2ee85d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/355b7773ca094ec59868f122d2ee85d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_355b7773ca094ec59868f122d2ee85d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-341650129 Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 355b7773ca094ec59868f122d2ee85d3 Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-341650129 Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-341650129-project Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fac10d5b80fb475c881a4c34c47dc264 Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-341650129-project Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: exception: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8 Jul 19 19:50:34.420941 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8beded86-b240-42e9-adae-583c07ef58e8'} Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:34.421888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8beded86-b240-42e9-adae-583c07ef58e8 could not be found Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed0e6fae-321a-4b50-b18a-3cfe964060e6'] Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8. Jul 19 19:50:34.423454 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8 Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:34.424695 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8 Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] Returning 404 to user: Floating IP not found for ID 8beded86-b240-42e9-adae-583c07ef58e8 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24a437ea-5dcf-4109-9546-38041b17f471 tempest-FloatingIPDetailsNegativeTestJSON-341650129 tempest-FloatingIPDetailsNegativeTestJSON-341650129-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/8beded86-b240-42e9-adae-583c07ef58e8" status: 404 len: 111 microversion: 2.1 time: 0.567492 Jul 19 19:50:34.426045 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 618/1202] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/os-floating-ips/8beded86-b240-42e9-adae-583c07ef58e8 => generated 111 bytes in 569 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:34.430544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.431159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:34.433979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.434712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:34.447002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.452257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.453088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.453244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.453757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.453908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.455087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.455748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.049524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.066347 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-895be0e8-d779-4178-82db-37ed334b75bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.649561 Jul 19 19:50:35.069262 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 585/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:34 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:35.081420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7e4f511c-bc7c-469e-aa07-69168c13d364 req-f125954c-1e10-4640-92cd-071ec3d2fc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb6c658-ec3b-46d8-8086-220f79a5399f", "name": "network-vif-plugged", "status": "completed", "tag": "6c0057cb-3247-4523-98f2-a1eee1ca6fb4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:35.104823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7e4f511c-bc7c-469e-aa07-69168c13d364 req-f125954c-1e10-4640-92cd-071ec3d2fc6a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.108443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7e4f511c-bc7c-469e-aa07-69168c13d364 req-f125954c-1e10-4640-92cd-071ec3d2fc6a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.158804 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7e4f511c-bc7c-469e-aa07-69168c13d364 req-f125954c-1e10-4640-92cd-071ec3d2fc6a service nova] Creating event network-vif-plugged:6c0057cb-3247-4523-98f2-a1eee1ca6fb4 for instance deb6c658-ec3b-46d8-8086-220f79a5399f on n-h2-843861-3 Jul 19 19:50:35.168495 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7e4f511c-bc7c-469e-aa07-69168c13d364 req-f125954c-1e10-4640-92cd-071ec3d2fc6a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095944 Jul 19 19:50:35.169737 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 586/1204] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:35.178206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:35.179156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:35.187637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.188321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.189410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.190007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.607506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.623022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3b6e4fda-b650-4f60-8086-20e52cc75b71 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1474 microversion: 2.1 time: 1.200521 Jul 19 19:50:35.623968 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 619/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:34 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1474 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:36.004651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.016662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6061a920-6d18-46ab-9003-195d961d8b42 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1535 microversion: 2.1 time: 0.844343 Jul 19 19:50:36.017303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 587/1206] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:35 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1535 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:36.086358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.086986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.096336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.096804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.097595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.098762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.260670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e272cf8f-4b5b-47f8-a52f-2d288f78bbf7 req-d1866cc6-d8a0-4bb5-a143-b9978125d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d7f6c4-be10-45cb-9e6a-adbd7f1066c4", "name": "network-vif-deleted", "tag": "855e56f4-5f45-4009-be1c-e1a31de4869c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:36.269463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e272cf8f-4b5b-47f8-a52f-2d288f78bbf7 req-d1866cc6-d8a0-4bb5-a143-b9978125d6f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.270233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e272cf8f-4b5b-47f8-a52f-2d288f78bbf7 req-d1866cc6-d8a0-4bb5-a143-b9978125d6f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.275355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:36.285125 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e272cf8f-4b5b-47f8-a52f-2d288f78bbf7 req-d1866cc6-d8a0-4bb5-a143-b9978125d6f4 service nova] Creating event network-vif-deleted:855e56f4-5f45-4009-be1c-e1a31de4869c for instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 on n-h2-843861-3 Jul 19 19:50:36.291524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e272cf8f-4b5b-47f8-a52f-2d288f78bbf7 req-d1866cc6-d8a0-4bb5-a143-b9978125d6f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034493 Jul 19 19:50:36.295923 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 588/1207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:50:36.645530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.646691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.655722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.656766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.657400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.658057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.746804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.754585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.755773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.756266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lazy-loading 'fault' on Instance uuid 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:36.761339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1364864-7799-4019-920b-980a3ddf6d45 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.680202 Jul 19 19:50:36.766346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 620/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:36 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:36.867593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.876479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b145868-5da6-4069-b1d8-c2c1adf6dfbc tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 200 len: 1308 microversion: 2.1 time: 0.238760 Jul 19 19:50:36.879869 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 589/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:36 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:37.035150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.041211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.050205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.051259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.052788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.053390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.655971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.671167 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b58b7334-17e3-4a21-a1ec-82ce9efeef6b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1522 microversion: 2.1 time: 0.639978 Jul 19 19:50:37.672069 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 621/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:37.697170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.697745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.705135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.705746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.706763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.707649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.739734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:37.783488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.784756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.799350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.800987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.802373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.805384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.858217 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca9df722-1e88-4608-a374-1000fae91eb1 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 204 len: 0 microversion: 2.1 time: 0.167126 Jul 19 19:50:37.864490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 590/1211] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:37 2022] DELETE /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:37.876393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.877107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.895378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.900556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.901704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.902382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.295384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:38.307448 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f6bcdf9-5aac-4b64-aea8-326ca2fe28bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.527591 Jul 19 19:50:38.317529 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 622/1212] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:38.322678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.323287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.329426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.329874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.330640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.331073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.348264 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 HTTP/1.1 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:38.350641 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. Jul 19 19:50:38.352404 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '57d7f6c4-be10-45cb-9e6a-adbd7f1066c4'} Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:38.353302 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. Jul 19 19:50:38.354826 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.357566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:38.360084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2df6c4ac-886a-405f-a358-34818a12b612 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4" status: 404 len: 111 microversion: 2.1 time: 0.039911 Jul 19 19:50:38.361301 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 623/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:38 2022] GET /compute/v2.1/servers/57d7f6c4-be10-45cb-9e6a-adbd7f1066c4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:38.406698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:38.418930 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b7103d1-0bbf-4375-bb6b-e6db36519bb9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 0.550485 Jul 19 19:50:38.419876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 591/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:38.426347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.427128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.440629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.452044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.453000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.453502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.454363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1410589508", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f277605d-9160-4105-970c-a1fc9db28d1e"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:38.484396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 HTTP/1.1 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:38.486298 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. Jul 19 19:50:38.488107 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3'} Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:38.489037 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. Jul 19 19:50:38.490290 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:38.492565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:38.493659 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-720fe74a-2d84-486f-b59d-c847bdc8e19f tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3" status: 404 len: 111 microversion: 2.1 time: 0.072850 Jul 19 19:50:38.494447 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 592/1215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:38 2022] GET /compute/v2.1/servers/f9daf7cc-45a8-4e72-ab46-5d8d1f6637b3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:38.514746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a6c0027-8eb1-40f7-8e1b-592fc9f999e1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.550517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] validate_networks() for [('f277605d-9160-4105-970c-a1fc9db28d1e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:38.584070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a6c0027-8eb1-40f7-8e1b-592fc9f999e1 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d98a12ee-897b-491a-b996-28bfa8fc06e7" status: 204 len: 0 microversion: 2.1 time: 0.078362 Jul 19 19:50:38.585015 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 593/1216] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 19:50:38 2022] DELETE /compute/v2.1/os-server-groups/d98a12ee-897b-491a-b996-28bfa8fc06e7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:38.593587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.594489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.602581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.603147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.604029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.604529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.638122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:38.818215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26eec380-8ede-4e27-b579-8540baa1ecc5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 204 len: 0 microversion: 2.1 time: 0.216794 Jul 19 19:50:38.820977 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 594/1217] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:38 2022] DELETE /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:50:38.840139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.841389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.854168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.856374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.857938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.858598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.256697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:39.281345 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cabfdf9f-2533-47b4-9809-1136470159e2 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1589 microversion: 2.1 time: 0.458086 Jul 19 19:50:39.282318 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 595/1218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:38 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1589 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:39.288354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-96b2642b-9031-4a75-9145-d27d1a5c928a req-8abce9b9-63b5-4939-a377-5585096f50d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f969122-53c1-4308-8cfb-dce1a81752aa", "tag": "cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:39.303708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-96b2642b-9031-4a75-9145-d27d1a5c928a req-8abce9b9-63b5-4939-a377-5585096f50d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.304209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-96b2642b-9031-4a75-9145-d27d1a5c928a req-8abce9b9-63b5-4939-a377-5585096f50d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.318547 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-96b2642b-9031-4a75-9145-d27d1a5c928a req-8abce9b9-63b5-4939-a377-5585096f50d4 service nova] Creating event network-changed:cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06 for instance 5f969122-53c1-4308-8cfb-dce1a81752aa on n-h2-843861-3 Jul 19 19:50:39.325529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-96b2642b-9031-4a75-9145-d27d1a5c928a req-8abce9b9-63b5-4939-a377-5585096f50d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041454 Jul 19 19:50:39.326618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 596/1219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:39.332820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:39.333618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:39.344434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.345057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.345997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.346565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.381692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:39.505563 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f5ba72b-93be-4321-a933-eada344cfad6 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 204 len: 0 microversion: 2.1 time: 0.176781 Jul 19 19:50:39.506806 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 597/1220] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:39 2022] DELETE /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:39.515565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:39.516522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:39.520226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:39.526958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.527691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.529036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.529634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.565086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:39.565601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:39.566019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:39.567369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:39.567875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:39.582154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.583066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.592679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.593914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.621977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:39.631332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for user 15e70c76f9914eb3a2c0a2e067dfb1b6 and project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:39.647497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:39.652128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:39.717345 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-338c88ae-e2f3-49f7-b569-5a1df551fac1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351573 Jul 19 19:50:39.718825 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 624/1221] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:39.731515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:39.732791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:39.745999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.746977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.748074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.748823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.810450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:39.823081 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e662bfe0-2c06-44bd-b447-aaa6e83eb344 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.314363 Jul 19 19:50:39.824018 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 598/1222] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:39 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:39.830581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:39.831285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:39.846273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.846710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.847508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.848550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.220083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.243395 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd52e54c-1f18-4ea6-b67f-713ee569090b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 0.521967 Jul 19 19:50:40.243543 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 625/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:39 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:40.263437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-678764091", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f277605d-9160-4105-970c-a1fc9db28d1e"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:40.271673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.290332 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa36e565-d6fa-4db0-be28-6b47f5e4177b tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1473 microversion: 2.1 time: 0.455065 Jul 19 19:50:40.301636 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 599/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:39 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1473 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:40.375010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] validate_networks() for [('f277605d-9160-4105-970c-a1fc9db28d1e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:40.840405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:40.841558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:40.855935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.861008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.862033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.862626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.006768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:41.009398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:41.011404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:41.012682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:41.013408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:41.031697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.032470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.033490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.034078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.059676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:41.066948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for user 15e70c76f9914eb3a2c0a2e067dfb1b6 and project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:41.089400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:41.093338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:41.133672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:41.142398 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8cc15f5-06ce-4ce7-84b5-ca3fc60e7f0a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.306165 Jul 19 19:50:41.143285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 600/1225] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:40 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:41.148546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c82daeac-464e-430d-a91a-3184ebdee6e3 req-6adb9144-4107-42b2-81f0-8932d6bd9ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb6c658-ec3b-46d8-8086-220f79a5399f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c0057cb-3247-4523-98f2-a1eee1ca6fb4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:41.157939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c82daeac-464e-430d-a91a-3184ebdee6e3 req-6adb9144-4107-42b2-81f0-8932d6bd9ca2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.158907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c82daeac-464e-430d-a91a-3184ebdee6e3 req-6adb9144-4107-42b2-81f0-8932d6bd9ca2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.173658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c82daeac-464e-430d-a91a-3184ebdee6e3 req-6adb9144-4107-42b2-81f0-8932d6bd9ca2 service nova] Creating event network-vif-unplugged:6c0057cb-3247-4523-98f2-a1eee1ca6fb4 for instance deb6c658-ec3b-46d8-8086-220f79a5399f on n-h2-843861-3 Jul 19 19:50:41.181447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c82daeac-464e-430d-a91a-3184ebdee6e3 req-6adb9144-4107-42b2-81f0-8932d6bd9ca2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036689 Jul 19 19:50:41.182771 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 601/1226] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:41.197729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1000b63-5465-400a-9451-1484343df9a9 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950381 Jul 19 19:50:41.198544 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 626/1227] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:41.260585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:41.261482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:41.282497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.284460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.286939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.292985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.297699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1085992160", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "451", "networks": [{"uuid": "f277605d-9160-4105-970c-a1fc9db28d1e"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:41.419722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] validate_networks() for [('f277605d-9160-4105-970c-a1fc9db28d1e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:42.170533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:42.185096 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87bc7069-0a95-4781-a453-15452a27b911 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 0.928915 Jul 19 19:50:42.185697 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 602/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:41 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:42.216454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:42.217118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:42.224538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.225238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.226231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.226861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.265474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:42.583998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:42.592522 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb5f9c96-3285-4d02-9090-c01497004f17 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1473 microversion: 2.1 time: 0.390882 Jul 19 19:50:42.593111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 603/1229] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:42 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1473 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:42.597609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:42.598317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:42.605031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.605693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.606466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.607074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.826815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:42.827777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:42.829157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:42.829703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:42.830345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:42.842837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.843381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.844301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.846580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.867483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:42.873500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Getting quotas for user 15e70c76f9914eb3a2c0a2e067dfb1b6 and project 332379ea56cd49c6b5faf3f19674d175. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:42.880899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:42.889852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:42.892952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:42.896376 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-50177b07-fdc5-48d8-8586-a0d9c8ca78fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.301175 Jul 19 19:50:42.897088 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 604/1230] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:42 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:42.952827 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15451d6c-640c-466f-b6c3-e8e84803ea2d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659594 Jul 19 19:50:42.954312 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 627/1231] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:42.964401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0f3939d-b520-44d2-b729-46f051b684ea tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:42.965015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0f3939d-b520-44d2-b729-46f051b684ea tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.054542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0f3939d-b520-44d2-b729-46f051b684ea tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.070624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0f3939d-b520-44d2-b729-46f051b684ea tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1221 microversion: 2.1 time: 0.109669 Jul 19 19:50:43.071522 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 605/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:42 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:43.210924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:43.212917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.231452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.233459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.235924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.237018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.465599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.477301 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-edd79e9c-4fa5-42d9-a9cb-98a1de7b4ec8 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 0.275165 Jul 19 19:50:43.478458 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 628/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:43 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:43.609910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:43.611113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.617979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.619163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.620393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.621400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.915585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:43.916936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.945830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.946407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.947291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.947955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.057761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:44.069565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2101f10e-1b03-4229-921e-7165a2a62d18 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1473 microversion: 2.1 time: 0.463928 Jul 19 19:50:44.070343 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 606/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:43 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1473 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:44.089878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:44.090906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:44.097013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.097460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.098289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.098720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.227099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:44.236661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfd43613-bed2-48d6-bb09-41b8e024e02d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1225 microversion: 2.1 time: 0.152383 Jul 19 19:50:44.237400 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 607/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:44 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:44.324625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:44.332517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f3a73daf-3a54-4111-aa5a-c3ee26f78c87 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.422373 Jul 19 19:50:44.333096 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 629/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:43 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:44.456492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c187c1c6-3e5d-4167-b324-89e03c532c43 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88db01670>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:44.495981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:44.497136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:44.509817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c187c1c6-3e5d-4167-b324-89e03c532c43 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a" status: 200 len: 637 microversion: 2.1 time: 0.057103 Jul 19 19:50:44.511251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.511715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.512538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.512974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.519276 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 608/1237] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:44 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a => generated 637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:44.532268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfae1cfa-48a6-4067-87d2-03d577492f0b tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88db014c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:44.589743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dfae1cfa-48a6-4067-87d2-03d577492f0b tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:44.595613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dfae1cfa-48a6-4067-87d2-03d577492f0b tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:44.761375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:44.789372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f96ebf3-de02-4af1-97c0-c0bd3848723d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 0.297572 Jul 19 19:50:44.790061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 630/1238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:44 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:44.954280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfae1cfa-48a6-4067-87d2-03d577492f0b tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.427118 Jul 19 19:50:44.955498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0b553acf-b16d-4453-bc57-3890545508d9 req-b30da06c-ea69-49bb-84c5-896a8e877869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5222c8a3-7937-441a-b90d-8def0acc785c", "tag": "da801c05-53f6-4494-be84-b8bf1c5842a8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:44.956210 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 609/1239] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:44 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:50:44.965338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b553acf-b16d-4453-bc57-3890545508d9 req-b30da06c-ea69-49bb-84c5-896a8e877869 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.965786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b553acf-b16d-4453-bc57-3890545508d9 req-b30da06c-ea69-49bb-84c5-896a8e877869 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.966037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-297635bc-87fc-47c5-9df6-a6189fef9025 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88db62ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:44.978008 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0b553acf-b16d-4453-bc57-3890545508d9 req-b30da06c-ea69-49bb-84c5-896a8e877869 service nova] Creating event network-changed:da801c05-53f6-4494-be84-b8bf1c5842a8 for instance 5222c8a3-7937-441a-b90d-8def0acc785c on n-h1-843861-3 Jul 19 19:50:44.983044 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0b553acf-b16d-4453-bc57-3890545508d9 req-b30da06c-ea69-49bb-84c5-896a8e877869 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190823 Jul 19 19:50:44.983977 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 631/1240] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:45.088080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.089212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.096140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.096889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.097879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.099062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.310539 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-297635bc-87fc-47c5-9df6-a6189fef9025 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "DELETE /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.348867 Jul 19 19:50:45.311393 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 610/1241] 10.222.0.33 () {58 vars in 1295 bytes} [Tue Jul 19 19:50:44 2022] DELETE /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_version => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:45.313507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.316025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.316824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.322448 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-462b0f4e-d4b6-40cf-99f3-4e9c5486ac80 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1473 microversion: 2.1 time: 0.239586 Jul 19 19:50:45.323039 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 632/1242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1473 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:45.323510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.324249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.325231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.325835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.327735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-645f6509-7fad-4cbc-ab84-87fd52f1c6db tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88df764c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.374068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-645f6509-7fad-4cbc-ab84-87fd52f1c6db tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.049967 Jul 19 19:50:45.374660 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 633/1243] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 37 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:45.379440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.379908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.386293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.386744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.387542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.388008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.405329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.413428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b2ac75e-a54b-4d7b-b479-4c8726aded7f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1225 microversion: 2.1 time: 0.101282 Jul 19 19:50:45.413998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 611/1244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:45.418527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d48ac49c-24dd-482d-a74a-629367baa671 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88db75af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:45.465798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d48ac49c-24dd-482d-a74a-629367baa671 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:45.472819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d48ac49c-24dd-482d-a74a-629367baa671 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:45.525239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.533257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9bf48bb2-8d5c-4e6f-94e5-ec84ba56393a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.157618 Jul 19 19:50:45.533915 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 634/1245] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:45.806555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.807186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.816504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.817510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.818297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.818751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.839718 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d48ac49c-24dd-482d-a74a-629367baa671 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.424655 Jul 19 19:50:45.840547 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 612/1246] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:45 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:45.849522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76d5609c-572f-49f8-aa4b-aa88a3135de6 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88dacb700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.912370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76d5609c-572f-49f8-aa4b-aa88a3135de6 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.066592 Jul 19 19:50:45.913110 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 613/1247] 10.222.0.33 () {58 vars in 1289 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_distro => generated 33 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:50:45.924452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-441c66d0-a4df-4458-bb9a-f30a3f98e3e5 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88dc0b940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:45.986146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-441c66d0-a4df-4458-bb9a-f30a3f98e3e5 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:45.992973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-441c66d0-a4df-4458-bb9a-f30a3f98e3e5 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:46.322301 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-441c66d0-a4df-4458-bb9a-f30a3f98e3e5 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.401997 Jul 19 19:50:46.323135 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 614/1248] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:45 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:50:46.332037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-405e54b1-5fe6-4882-bccd-bc99a9d59fc9 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88db75c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.375186 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-405e54b1-5fe6-4882-bccd-bc99a9d59fc9 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.046861 Jul 19 19:50:46.375773 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 615/1249] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:46 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:46.382065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.382702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:46.390004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.390465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.391379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.391956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.068157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.083012 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1effde43-4584-48a2-9e64-a49aae2e9552 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1528 microversion: 2.1 time: 1.278276 Jul 19 19:50:47.084108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 635/1250] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1528 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:47.092969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c498d8a-1106-401b-829b-9a9d464aef86 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88e19e280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:47.157687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6c498d8a-1106-401b-829b-9a9d464aef86 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:47.163496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6c498d8a-1106-401b-829b-9a9d464aef86 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:47.435202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c498d8a-1106-401b-829b-9a9d464aef86 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.349081 Jul 19 19:50:47.435957 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 636/1251] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:47 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:47.441039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.441641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.449846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.450342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.451328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.451758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.456549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.468674 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7ceef7f-3601-40d0-b9e2-7d863ca381fa tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1473 microversion: 2.1 time: 1.091345 Jul 19 19:50:47.469747 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 616/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:46 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1473 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.477108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.479051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.487453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.487850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.488456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:47.491952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.492601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.690465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.700142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3671eac8-d5b9-4b4c-ae91-51760b518d03 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1279 microversion: 2.1 time: 0.262696 Jul 19 19:50:47.710563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 637/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1279 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.715749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a829f289-6395-483c-929e-8f98988b91ac req-b1566c17-1703-4375-964c-a34e7505e133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c7731d-87f2-4128-ad1e-c010c4a4b481", "name": "network-vif-unplugged", "status": "completed", "tag": "b4b488f4-5ec8-4227-b7ea-edd7825ce90b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:47.726317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a829f289-6395-483c-929e-8f98988b91ac req-b1566c17-1703-4375-964c-a34e7505e133 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.727060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a829f289-6395-483c-929e-8f98988b91ac req-b1566c17-1703-4375-964c-a34e7505e133 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.738639 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a829f289-6395-483c-929e-8f98988b91ac req-b1566c17-1703-4375-964c-a34e7505e133 service nova] Creating event network-vif-unplugged:b4b488f4-5ec8-4227-b7ea-edd7825ce90b for instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 on n-h2-843861-3 Jul 19 19:50:47.744009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a829f289-6395-483c-929e-8f98988b91ac req-b1566c17-1703-4375-964c-a34e7505e133 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031867 Jul 19 19:50:47.745008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 638/1254] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:47.750704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.751369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.758676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.759216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.760025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.760624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.118195 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-855d197b-1182-4999-bf55-392a19dd4cdf tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1811 microversion: 2.1 time: 0.646276 Jul 19 19:50:48.119144 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 617/1255] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1811 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:48.125800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.127868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:48.139339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.140116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.142653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.143333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.804796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:48.831010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:48.841954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c120655b-fd60-4b92-8a04-0c890ceaad9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 1.095663 Jul 19 19:50:48.844100 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 639/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:48.845379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7872de3e-02b0-4b3a-a9ce-d60e42de3feb tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 2422 microversion: 2.25 time: 0.722068 Jul 19 19:50:48.856030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 618/1257] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 2422 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:48.857561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-885b6fd2-38fc-4ae7-9a31-59e314595c06 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88df35310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:48.878683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.882884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:48.918265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.919576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.921717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.922588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.948449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-885b6fd2-38fc-4ae7-9a31-59e314595c06 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:48.959004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-885b6fd2-38fc-4ae7-9a31-59e314595c06 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:48.977708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.979156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.980253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lazy-loading 'fault' on Instance uuid deb6c658-ec3b-46d8-8086-220f79a5399f {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:49.093016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.101214 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fa2987e-b94b-4f84-ac3d-d01ffefc3707 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 200 len: 1314 microversion: 2.1 time: 0.243710 Jul 19 19:50:49.119616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 619/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:49.124445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.125860 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:50:49.125860 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:50:49.127078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.141560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.142806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.144374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.213987 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b92f1f0a-01cd-4568-a4e0-d87e7059abc5 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093147 Jul 19 19:50:49.216693 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 620/1259] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:49.238214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.238982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:49.248067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.260184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.261235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.261820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.326534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.327429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.329977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lazy-loading 'fault' on Instance uuid 61c2af52-06ad-4c61-9baa-26435425e7ea {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:49.433116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.450155 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4da7b15e-9dcc-4fc4-8e7a-2b3b90e43379 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 200 len: 1309 microversion: 2.1 time: 0.217989 Jul 19 19:50:49.452448 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 621/1260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:49.469654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ffe94dc1-04f3-4508-94df-9a229b3c1e35 req-2990fb80-f2e1-4b9a-9d80-3408f801825e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb6c658-ec3b-46d8-8086-220f79a5399f", "name": "network-vif-deleted", "tag": "6c0057cb-3247-4523-98f2-a1eee1ca6fb4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:49.495387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ffe94dc1-04f3-4508-94df-9a229b3c1e35 req-2990fb80-f2e1-4b9a-9d80-3408f801825e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.495913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ffe94dc1-04f3-4508-94df-9a229b3c1e35 req-2990fb80-f2e1-4b9a-9d80-3408f801825e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.539116 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ffe94dc1-04f3-4508-94df-9a229b3c1e35 req-2990fb80-f2e1-4b9a-9d80-3408f801825e service nova] Creating event network-vif-deleted:6c0057cb-3247-4523-98f2-a1eee1ca6fb4 for instance deb6c658-ec3b-46d8-8086-220f79a5399f on n-h2-843861-3 Jul 19 19:50:49.552290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ffe94dc1-04f3-4508-94df-9a229b3c1e35 req-2990fb80-f2e1-4b9a-9d80-3408f801825e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094489 Jul 19 19:50:49.553702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 622/1261] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:49.580404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.581183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:49.599427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.600182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.606076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.606720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.660068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-885b6fd2-38fc-4ae7-9a31-59e314595c06 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.814537 Jul 19 19:50:49.661572 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 640/1262] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:48 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 64 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:49.667409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843861-3", "block_migration": "auto"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:49.670263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:49.673648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:49.690788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.692516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.718317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.718952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.841525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'flavor' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:49.872494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Going to try to live migrate instance to n-h1-843861-3 {{(pid=126008) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:50:49.976619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.986268 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ff06ea4-9966-4579-8bc8-a3e86d612f23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.420075 Jul 19 19:50:49.996964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 623/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:50.023482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ea1fc24-bb1e-4567-b213-fd7f2391cf8c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88db6d9d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.113090 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ea1fc24-bb1e-4567-b213-fd7f2391cf8c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.113545 Jul 19 19:50:50.114803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 624/1264] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 64 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:50.129419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-db305519-f74b-43b3-9bc7-dbaac34094d3 req-d7141a09-ecf4-4cae-b8e6-873227bd1048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c2af52-06ad-4c61-9baa-26435425e7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6e4636-7355-4b5b-a523-d95a7fc2eb79"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:50.141527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-db305519-f74b-43b3-9bc7-dbaac34094d3 req-d7141a09-ecf4-4cae-b8e6-873227bd1048 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.142461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-db305519-f74b-43b3-9bc7-dbaac34094d3 req-d7141a09-ecf4-4cae-b8e6-873227bd1048 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.161525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-db305519-f74b-43b3-9bc7-dbaac34094d3 req-d7141a09-ecf4-4cae-b8e6-873227bd1048 service nova] Creating event network-vif-unplugged:5f6e4636-7355-4b5b-a523-d95a7fc2eb79 for instance 61c2af52-06ad-4c61-9baa-26435425e7ea on n-h2-843861-3 Jul 19 19:50:50.169701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-db305519-f74b-43b3-9bc7-dbaac34094d3 req-d7141a09-ecf4-4cae-b8e6-873227bd1048 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046160 Jul 19 19:50:50.172196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 625/1265] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:50.182686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.183386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.192418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.192875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.194750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.196311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.452537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:50.462798 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9230200f-a403-4e83-b7a4-239eb45fec01 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.288103 Jul 19 19:50:50.476603 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 626/1266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:50.482550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.483541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.491085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.491975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.493026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.493767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.530023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f HTTP/1.1 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:50.533702 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:50:50.535336 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'deb6c658-ec3b-46d8-8086-220f79a5399f'} Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:50.537077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:50:50.538555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.540900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:50.543182 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c60b26c4-51b0-4a62-bc2d-d6bb6cb8198c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 404 len: 111 microversion: 2.1 time: 0.065233 Jul 19 19:50:50.547473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 627/1267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:50.560663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2a6261a-0bb1-4cc3-a2b8-c5a32fb3693f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88dad5550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:50.669539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c2a6261a-0bb1-4cc3-a2b8-c5a32fb3693f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:50.685819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c2a6261a-0bb1-4cc3-a2b8-c5a32fb3693f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:51.293100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2a6261a-0bb1-4cc3-a2b8-c5a32fb3693f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.743341 Jul 19 19:50:51.293767 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 628/1268] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:50 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:51.302127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:51.302734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 61c2af52-06ad-4c61-9baa-26435425e7ea] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:51.313212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:51.314578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.316105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:51.316828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.335661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea HTTP/1.1 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:51.337495 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. Jul 19 19:50:51.338945 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '61c2af52-06ad-4c61-9baa-26435425e7ea'} Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:51.339831 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. Jul 19 19:50:51.341522 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:51.343564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 61c2af52-06ad-4c61-9baa-26435425e7ea could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:51.344647 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb6c60c7-a538-4a75-8497-879ff448c243 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea" status: 404 len: 111 microversion: 2.1 time: 0.049717 Jul 19 19:50:51.345380 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 629/1269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:51 2022] GET /compute/v2.1/servers/61c2af52-06ad-4c61-9baa-26435425e7ea => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:51.351293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2f1c2995-9e28-40a1-9a17-b394633ae95f req-be9808c8-f280-486e-b76c-cf437e148058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc4f06a1-6e7a-45dc-93b3-21eb58d3038c", "tag": "8627d63a-11ab-4d71-9178-4b3d01b1773d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:51.359737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2f1c2995-9e28-40a1-9a17-b394633ae95f req-be9808c8-f280-486e-b76c-cf437e148058 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:51.360286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2f1c2995-9e28-40a1-9a17-b394633ae95f req-be9808c8-f280-486e-b76c-cf437e148058 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.377888 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2f1c2995-9e28-40a1-9a17-b394633ae95f req-be9808c8-f280-486e-b76c-cf437e148058 service nova] Creating event network-changed:8627d63a-11ab-4d71-9178-4b3d01b1773d for instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c on n-h2-843861-3 Jul 19 19:50:51.390221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2f1c2995-9e28-40a1-9a17-b394633ae95f req-be9808c8-f280-486e-b76c-cf437e148058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039666 Jul 19 19:50:51.391065 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 630/1270] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:51.399667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1800113462", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:51.526090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] validate_networks() for [('ab4b83df-5d6c-4af1-a2b5-442cf3efe844', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:52.347525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e0f382e-c819-48a8-8de2-2d4b5a7ac1cc tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/action" status: 202 len: 0 microversion: 2.25 time: 2.684671 Jul 19 19:50:52.348563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 641/1271] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:50:49 2022] POST /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/action => generated 0 bytes in 2686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:52.359409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.360072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.368611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.369093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.369861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.370291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.458152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:52.458666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:52.459043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:52.459455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:52.459960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:52.469080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.469528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.470344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.470781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.487641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:52.493488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Getting quotas for user 5035bdfa56304514a841334c420b1041 and project e1136959b10a4310a7b0803d010d8501. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:52.506722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:52.509119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:52.516784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.520708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:52.524675 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b57876bd-b446-47ce-b63d-5cc4627c97e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.169108 Jul 19 19:50:52.525253 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 642/1272] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:52.529813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f081a5d-ef01-46af-b70d-a91b8b252d3c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update', calling method: .version_select at 0x7fb88df90ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:52.557999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b09a7497-8a9b-41c6-844c-386630b8572d tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.165182 Jul 19 19:50:52.558653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 631/1273] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:52.563153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.563760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: 54c7731d-87f2-4128-ad1e-c010c4a4b481] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.570734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.571184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.571970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.572400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.587860 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 HTTP/1.1 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:52.589584 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. Jul 19 19:50:52.591108 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '54c7731d-87f2-4128-ad1e-c010c4a4b481'} Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:52.592163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. Jul 19 19:50:52.593440 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.597799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:52.597799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20acb2d4-2993-4f60-b710-16654cad44d4 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481" status: 404 len: 111 microversion: 2.1 time: 0.031398 Jul 19 19:50:52.597799 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 632/1274] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/54c7731d-87f2-4128-ad1e-c010c4a4b481 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:52.597799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.597799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.601234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5f081a5d-ef01-46af-b70d-a91b8b252d3c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:52.603710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.604178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.604943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.605374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.607409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5f081a5d-ef01-46af-b70d-a91b8b252d3c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:52.760929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.769263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d920154c-84c2-41dd-b5e5-0561c86c30fe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.176817 Jul 19 19:50:52.770375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 633/1275] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:52.775626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c2af52-06ad-4c61-9baa-26435425e7ea", "name": "network-vif-deleted", "tag": "5f6e4636-7355-4b5b-a523-d95a7fc2eb79"}, {"server_uuid": "54c7731d-87f2-4128-ad1e-c010c4a4b481", "name": "network-vif-deleted", "tag": "b4b488f4-5ec8-4227-b7ea-edd7825ce90b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:52.785952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.786704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.791001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:52.801093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] Creating event network-vif-deleted:5f6e4636-7355-4b5b-a523-d95a7fc2eb79 for instance 61c2af52-06ad-4c61-9baa-26435425e7ea on n-h2-843861-3 Jul 19 19:50:52.802104 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] Creating event network-vif-deleted:b4b488f4-5ec8-4227-b7ea-edd7825ce90b for instance 54c7731d-87f2-4128-ad1e-c010c4a4b481 on n-h2-843861-3 Jul 19 19:50:52.810650 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ddc3eaf5-27f1-4089-915c-2e3b1fe69058 req-5d33f0b3-0073-4ef2-94cf-83be9960d1a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038042 Jul 19 19:50:52.811517 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 634/1276] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:52.820150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10b92fb4-8a74-457d-be99-c9ec5acb1428", "device": "/dev/xvdb"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:52.821438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.828235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.828760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.829588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.830087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.859476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:52.948498 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f081a5d-ef01-46af-b70d-a91b8b252d3c tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.422184 Jul 19 19:50:52.949108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 643/1277] 10.222.0.33 () {60 vars in 1312 bytes} [Tue Jul 19 19:50:52 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata/os_version => generated 31 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:53.012220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6d641d25-9d0e-417b-99c7-1074980aa5ec req-e674b4f2-edf9-4913-972b-77638cbd2bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5222c8a3-7937-441a-b90d-8def0acc785c", "name": "network-vif-plugged", "status": "completed", "tag": "da801c05-53f6-4494-be84-b8bf1c5842a8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:53.022114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6d641d25-9d0e-417b-99c7-1074980aa5ec req-e674b4f2-edf9-4913-972b-77638cbd2bef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.022564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6d641d25-9d0e-417b-99c7-1074980aa5ec req-e674b4f2-edf9-4913-972b-77638cbd2bef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.033795 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6d641d25-9d0e-417b-99c7-1074980aa5ec req-e674b4f2-edf9-4913-972b-77638cbd2bef service nova] Creating event network-vif-plugged:da801c05-53f6-4494-be84-b8bf1c5842a8 for instance 5222c8a3-7937-441a-b90d-8def0acc785c on n-h1-843861-3 Jul 19 19:50:53.039114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6d641d25-9d0e-417b-99c7-1074980aa5ec req-e674b4f2-edf9-4913-972b-77638cbd2bef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088594 Jul 19 19:50:53.039722 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 644/1278] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:53.047489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.048757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.056202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.056638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.057439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.058006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.273070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.281691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.283275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.284713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d7c0b61-92ce-4d64-b024-9dd071dca3e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.241217 Jul 19 19:50:53.285317 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 645/1279] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:53.292015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.292015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.297454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.297894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.298644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.299070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.368016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.375979 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f8b9f5bc-314e-49a2-a97a-32c1edce7d2e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1277 microversion: 2.1 time: 0.089044 Jul 19 19:50:53.376529 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 646/1280] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:53.382503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ce7350e-cbde-4d45-a821-ca683cc7d380 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.416246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ce7350e-cbde-4d45-a821-ca683cc7d380 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/68bf49ec-613e-4e88-a36d-874fd7e73dbd" status: 204 len: 0 microversion: 2.1 time: 0.038626 Jul 19 19:50:53.416848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 647/1281] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 19:50:53 2022] DELETE /compute/v2.1/os-server-groups/68bf49ec-613e-4e88-a36d-874fd7e73dbd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:53.421602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a76f377-a2c8-4835-a0e4-a3373c99190f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88df6b5e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.463912 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a76f377-a2c8-4835-a0e4-a3373c99190f tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.045895 Jul 19 19:50:53.464491 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 648/1282] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 58 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:53.468822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2523686a-5603-42a4-8798-d6aee63006ea req-1e1ee5bc-827b-4729-91c1-44871caf2b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c18486-030f-459d-bf20-bf89ef020566", "tag": "c52df97a-8af6-4359-b98b-7027d3c4e52c"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:53.477184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2523686a-5603-42a4-8798-d6aee63006ea req-1e1ee5bc-827b-4729-91c1-44871caf2b37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.477622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2523686a-5603-42a4-8798-d6aee63006ea req-1e1ee5bc-827b-4729-91c1-44871caf2b37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.488122 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2523686a-5603-42a4-8798-d6aee63006ea req-1e1ee5bc-827b-4729-91c1-44871caf2b37 service nova] Creating event network-changed:c52df97a-8af6-4359-b98b-7027d3c4e52c for instance 90c18486-030f-459d-bf20-bf89ef020566 on n-h2-843861-3 Jul 19 19:50:53.492678 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2523686a-5603-42a4-8798-d6aee63006ea req-1e1ee5bc-827b-4729-91c1-44871caf2b37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027125 Jul 19 19:50:53.493331 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 649/1283] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:53.498147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.498709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.505224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.505665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.506408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.506833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.531601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:53.606198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b87549f-3e5a-42ea-b1d5-c64dd96e78bf tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 204 len: 0 microversion: 2.1 time: 0.111440 Jul 19 19:50:53.606786 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 650/1284] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:53 2022] DELETE /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:53.611707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-770ee67a-0f80-4615-9f53-b73082d54207 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'update_all', calling method: .version_select at 0x7fb88df46820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:53.660877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-770ee67a-0f80-4615-9f53-b73082d54207 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:53.666561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-770ee67a-0f80-4615-9f53-b73082d54207 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:53.973454 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-770ee67a-0f80-4615-9f53-b73082d54207 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.365483 Jul 19 19:50:53.974041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 651/1285] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:53 2022] PUT /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 61 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:53.978757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.979477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.985574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.986041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.987272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.987965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.116597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.124078 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19836c3f-a84e-4fe1-a583-9fbcc95e4484 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.148979 Jul 19 19:50:54.124590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 652/1286] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:54.129032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:54.130153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.135824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.136287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.137223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.137657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.272347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.280026 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-774d46fb-b3d1-42ed-a4af-876b061a86ec tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1472 microversion: 2.1 time: 0.154466 Jul 19 19:50:54.280814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 653/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:54 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:54.285931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:54.286526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.293016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.293468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.294226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.294654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.456026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.465792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-511adb54-7312-4830-9346-5a76d23552ca tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1498 microversion: 2.1 time: 0.183978 Jul 19 19:50:54.466784 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 654/1288] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:54 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:54.473107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2eda41b3-8b42-4fd7-a714-f8410473e95e tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Action: 'create', calling method: .version_select at 0x7fb88df9e8b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:54.537584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2eda41b3-8b42-4fd7-a714-f8410473e95e tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:54.543973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2eda41b3-8b42-4fd7-a714-f8410473e95e tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Getting quotas for user b7513ec4b6f04fd191a3b6706fea47ce and project ef92f4dfa74f447b888ea3d635966ccd. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:54.549944 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce7cb940-dc02-4bf1-96f8-504aa9d2f5a2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.736758 Jul 19 19:50:54.556469 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 635/1289] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:50:52 2022] POST /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 194 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:54.562689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:54.563472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.585674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.587529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.589684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.591052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.817792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.847825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.849490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.852557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fea5eb8a-f0c7-4cdf-bda9-a85508e5acdd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.294604 Jul 19 19:50:54.863290 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 636/1290] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:54 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:54.864056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:54.864684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.879713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.880138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.880930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.881570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.962298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.971501 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-778467dc-793e-4afd-ade1-1d375a5a2b93 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1285 microversion: 2.1 time: 0.115334 Jul 19 19:50:54.972131 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 637/1291] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:54 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:55.013620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2eda41b3-8b42-4fd7-a714-f8410473e95e tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "POST /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.545382 Jul 19 19:50:55.014473 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 655/1292] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Jul 19 19:50:54 2022] POST /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 85 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:55.024137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c83ecab-a43e-4c30-922a-c4e9c9710dc6 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] Calling method '.version_select at 0x7fb88db75160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.083390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c83ecab-a43e-4c30-922a-c4e9c9710dc6 tempest-ImagesMetadataTestJSON-1361914740 tempest-ImagesMetadataTestJSON-1361914740-project] 10.222.0.33 "GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.062877 Jul 19 19:50:55.084177 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 638/1293] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/images/5c48315c-e021-4e07-9f8a-3d6f1007488a/metadata => generated 85 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:50:55.143385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.144340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.159593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.160505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.161419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.164605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.297043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.297855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.331704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.334565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.337479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.338157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.729275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.742459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aedcfe9b-e188-41ca-a522-e971862c131a tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1472 microversion: 2.1 time: 0.449734 Jul 19 19:50:55.743572 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 639/1294] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:55.748585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.749759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.757947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.758805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.760187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.760821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.947400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.956141 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d02128e-c12e-4162-87dd-5da0484dbfc3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.818433 Jul 19 19:50:55.957008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 656/1295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:55.972363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.974428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.984084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.984767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.988165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.988960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.313489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:56.327757 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3587a269-41c2-4c97-9346-dbae136d0f96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 200 len: 1475 microversion: 2.1 time: 0.582478 Jul 19 19:50:56.329310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 640/1296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:56.334778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:56.336433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:56.347725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.348779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.349733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.350166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.446848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:56.462200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:56.464184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:56.465676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-645d17ae-a12a-4318-8e96-47f8547ac92b tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.497988 Jul 19 19:50:56.466604 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 657/1297] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:56.472137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-876204532"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:56.473449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:56.480056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.480809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.482007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.482716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.500889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:56.542002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:56.562868 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34ea54d1-258e-4de4-8345-527c577c582e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1283 microversion: 2.1 time: 0.231288 Jul 19 19:50:56.563658 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 641/1298] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:56 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:56.760581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:56.761234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:56.777825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.778570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.779365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.779795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.929529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-17eb8ba4-d1cd-497c-85e5-492e91128bda tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897/action" status: 202 len: 0 microversion: 2.1 time: 0.461409 Jul 19 19:50:56.942482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 658/1299] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:56 2022] POST /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:50:56.962167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74ac0284-1f8f-4e79-8ce0-f43345657623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88def21f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.059617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74ac0284-1f8f-4e79-8ce0-f43345657623 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.105003 Jul 19 19:50:57.069800 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 659/1300] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:56 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:57.074941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.077838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:57.087313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.088136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.090419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.091032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.302521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c18af32196451a91ded3dcf6471b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8343d8338a9c4ad19d0dcf58b9766531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.314912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62039fb1-3bf4-41de-9015-c5d61f01e8b5 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 200 len: 1472 microversion: 2.1 time: 0.558062 Jul 19 19:50:57.328592 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 642/1301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:56 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 1472 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:57.342720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-388c8969-8fb3-4a54-99e9-eda96474eb61 req-4107df4f-1257-4ac2-b066-fab8487ff199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4f06a1-6e7a-45dc-93b3-21eb58d3038c", "name": "network-vif-plugged", "status": "completed", "tag": "8627d63a-11ab-4d71-9178-4b3d01b1773d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:57.356042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-388c8969-8fb3-4a54-99e9-eda96474eb61 req-4107df4f-1257-4ac2-b066-fab8487ff199 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.356495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-388c8969-8fb3-4a54-99e9-eda96474eb61 req-4107df4f-1257-4ac2-b066-fab8487ff199 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.367983 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-388c8969-8fb3-4a54-99e9-eda96474eb61 req-4107df4f-1257-4ac2-b066-fab8487ff199 service nova] Creating event network-vif-plugged:8627d63a-11ab-4d71-9178-4b3d01b1773d for instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c on n-h2-843861-3 Jul 19 19:50:57.372892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-388c8969-8fb3-4a54-99e9-eda96474eb61 req-4107df4f-1257-4ac2-b066-fab8487ff199 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042863 Jul 19 19:50:57.373680 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 643/1302] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:57.530061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dccae9f-993a-4aa8-b008-a5694d633045 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Calling method '.version_select at 0x7fb88dac1c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.538258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.548084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fef1a76a-2d4e-405a-89a9-274e0731b40c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.476933 Jul 19 19:50:57.548673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 660/1303] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:57 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:57.561933 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8dccae9f-993a-4aa8-b008-a5694d633045 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:57.563332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3bbe6e8e-b116-461d-bd06-d3bc46ecc651 req-6499e8a7-8505-4845-a2d7-1ac1a40a3776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0", "name": "network-vif-deleted", "tag": "89a962ec-3c9e-415f-9539-83f6c18d57e6"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dccae9f-993a-4aa8-b008-a5694d633045 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/images/b5d2b38a-8e93-4d45-922e-45d326785754/metadata/os_distro HTTP/1.1 Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:57.570818 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'image_id': 'b5d2b38a-8e93-4d45-922e-45d326785754', 'id': 'os_distro'} Jul 19 19:50:57.572723 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:57.573887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b5d2b38a-8e93-4d45-922e-45d326785754 Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:57.578880 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5d2b38a-8e93-4d45-922e-45d326785754 could not be found. Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:57.580500 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:57.581971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dccae9f-993a-4aa8-b008-a5694d633045 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:57.585023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8dccae9f-993a-4aa8-b008-a5694d633045 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "DELETE /compute/v2.1/images/b5d2b38a-8e93-4d45-922e-45d326785754/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.197526 Jul 19 19:50:57.585023 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 644/1304] 10.222.0.33 () {58 vars in 1292 bytes} [Tue Jul 19 19:50:57 2022] DELETE /compute/v2.1/images/b5d2b38a-8e93-4d45-922e-45d326785754/metadata/os_distro => generated 62 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:50:57.589486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.591367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:57.593369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3bbe6e8e-b116-461d-bd06-d3bc46ecc651 req-6499e8a7-8505-4845-a2d7-1ac1a40a3776 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.593867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3bbe6e8e-b116-461d-bd06-d3bc46ecc651 req-6499e8a7-8505-4845-a2d7-1ac1a40a3776 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.614897 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3bbe6e8e-b116-461d-bd06-d3bc46ecc651 req-6499e8a7-8505-4845-a2d7-1ac1a40a3776 service nova] Creating event network-vif-deleted:89a962ec-3c9e-415f-9539-83f6c18d57e6 for instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 on n-h1-843861-3 Jul 19 19:50:57.617117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.620421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.622606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.624425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.626715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3bbe6e8e-b116-461d-bd06-d3bc46ecc651 req-6499e8a7-8505-4845-a2d7-1ac1a40a3776 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074445 Jul 19 19:50:57.630744 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 661/1305] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:57.648360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.649583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:57.672033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.672839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.674164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.674937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.084748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.095044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.133828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.135373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.147749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ece5ad51-dc5c-4a43-88f6-b485727ac274 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.567480 Jul 19 19:50:58.148391 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 645/1306] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:57 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:58.157625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3883e0c-8216-422d-834a-7203014034a4 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Calling method '.version_select at 0x7fb88dad2940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.176311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26a82a96-f430-4f90-9e1f-318556e16422 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.507549 Jul 19 19:50:58.189643 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 662/1307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:57 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:58.201364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7723972-66d7-4488-832e-170e62af1a96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88df43310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.232028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a3883e0c-8216-422d-834a-7203014034a4 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3883e0c-8216-422d-834a-7203014034a4 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/416a73b2-aea8-459e-8e21-e75a47507d78/metadata/os_version HTTP/1.1 Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:58.234223 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'image_id': '416a73b2-aea8-459e-8e21-e75a47507d78', 'id': 'os_version'} Jul 19 19:50:58.235889 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.236844 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 416a73b2-aea8-459e-8e21-e75a47507d78 Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.238106 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 416a73b2-aea8-459e-8e21-e75a47507d78 could not be found. Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:58.239460 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:58.240750 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.245249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3883e0c-8216-422d-834a-7203014034a4 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.245249 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3883e0c-8216-422d-834a-7203014034a4 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "GET /compute/v2.1/images/416a73b2-aea8-459e-8e21-e75a47507d78/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.095347 Jul 19 19:50:58.245249 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 646/1308] 10.222.0.33 () {58 vars in 1292 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/images/416a73b2-aea8-459e-8e21-e75a47507d78/metadata/os_version => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:50:58.255711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a593bf7-3cd8-4239-b7db-537f55602597 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Calling method '.version_select at 0x7fb88dc0b940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.312993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9a593bf7-3cd8-4239-b7db-537f55602597 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a593bf7-3cd8-4239-b7db-537f55602597 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/0a73e015-400a-4690-99e9-6f115b3d6ad7/metadata HTTP/1.1 Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:58.315237 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'image_id': '0a73e015-400a-4690-99e9-6f115b3d6ad7'} Jul 19 19:50:58.316666 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.317513 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0a73e015-400a-4690-99e9-6f115b3d6ad7 Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.318632 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a73e015-400a-4690-99e9-6f115b3d6ad7 could not be found. Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:58.319903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:58.321084 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.323955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a593bf7-3cd8-4239-b7db-537f55602597 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.325076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a593bf7-3cd8-4239-b7db-537f55602597 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "GET /compute/v2.1/images/0a73e015-400a-4690-99e9-6f115b3d6ad7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074553 Jul 19 19:50:58.326247 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 647/1309] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/images/0a73e015-400a-4690-99e9-6f115b3d6ad7/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:50:58.335588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f18ea62e-053c-4e69-aba1-0a4c68cca03e tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Action: 'update_all', calling method: .version_select at 0x7fb88db77e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:58.338577 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7723972-66d7-4488-832e-170e62af1a96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.147432 Jul 19 19:50:58.339589 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 663/1310] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:58.351055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.353176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] [instance: bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:58.363770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.364247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.365023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.365453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.376059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f18ea62e-053c-4e69-aba1-0a4c68cca03e tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f18ea62e-053c-4e69-aba1-0a4c68cca03e tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/images/33942d6e-ff12-45f8-9465-d8d0bac536b4/metadata HTTP/1.1 Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 57 Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:58.378418 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:58.380045 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'image_id': '33942d6e-ff12-45f8-9465-d8d0bac536b4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.380964 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33942d6e-ff12-45f8-9465-d8d0bac536b4 Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.383773 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33942d6e-ff12-45f8-9465-d8d0bac536b4 could not be found. Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.385542 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:58.386855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.392613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f18ea62e-053c-4e69-aba1-0a4c68cca03e tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.393706 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f18ea62e-053c-4e69-aba1-0a4c68cca03e tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "PUT /compute/v2.1/images/33942d6e-ff12-45f8-9465-d8d0bac536b4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062567 Jul 19 19:50:58.395364 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 648/1311] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:58 2022] PUT /compute/v2.1/images/33942d6e-ff12-45f8-9465-d8d0bac536b4/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 19:50:58.403658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] HTTP exception thrown: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. Jul 19 19:50:58.405471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12aa8be2-cdc8-4373-84fb-25836fadbc02 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Action: 'update', calling method: .version_select at 0x7fb88db77af0>, body: {"meta": {"os_distro": "alt"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Request method failure captured: Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 HTTP/1.1 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1woyvb1poSoixDTjVQDduXK3JkQm5T2wrDDQ1HDndLxcOWZ6_cYYoDVJR3qIuALPYDu-gnzGY0UYNd-KqkmAGWcL6VF3v3nzsGqSp3tlDNnnCo5fEvNhY06TGS1P_aSW_ZojwjdmCUXb7kbDHKvqRiZ8xsHkUaMztuvxGxanWDjlVcc Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:58.405615 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8343d8338a9c4ad19d0dcf58b9766531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8343d8338a9c4ad19d0dcf58b9766531 Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-689973307 Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 89c18af32196451a91ded3dcf6471b19 Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersOnMultiNodesTest-689973307-project Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. Jul 19 19:50:58.406994 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0'} Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.408005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. Jul 19 19:50:58.409406 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.411156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] Returning 404 to user: Instance bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.414160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2efc455f-a596-479c-ad1b-99fc4214ca48 tempest-ServersOnMultiNodesTest-689973307 tempest-ServersOnMultiNodesTest-689973307-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0" status: 404 len: 111 microversion: 2.1 time: 0.060553 Jul 19 19:50:58.414776 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 664/1312] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/servers/bfa42e8e-76f3-42bb-86d0-bcc87c8f66b0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:50:58.455244 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-12aa8be2-cdc8-4373-84fb-25836fadbc02 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12aa8be2-cdc8-4373-84fb-25836fadbc02 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/images/ce56babb-c544-40f0-814f-65050c4ed362/metadata/os_distro HTTP/1.1 Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 30 Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:50:58.466362 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: {"meta": {"os_distro": "alt"}} Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:50:58.467760 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'image_id': 'ce56babb-c544-40f0-814f-65050c4ed362', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.468691 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce56babb-c544-40f0-814f-65050c4ed362 Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.469805 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce56babb-c544-40f0-814f-65050c4ed362 could not be found. Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.470985 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:58.472220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.477918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12aa8be2-cdc8-4373-84fb-25836fadbc02 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.479932 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12aa8be2-cdc8-4373-84fb-25836fadbc02 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "PUT /compute/v2.1/images/ce56babb-c544-40f0-814f-65050c4ed362/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.079482 Jul 19 19:50:58.484604 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 649/1313] 10.222.0.33 () {60 vars in 1309 bytes} [Tue Jul 19 19:50:58 2022] PUT /compute/v2.1/images/ce56babb-c544-40f0-814f-65050c4ed362/metadata/os_distro => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 19:50:58.494643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e634e080-d31e-49f0-bd91-9f62103a8254 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Action: 'create', calling method: .version_select at 0x7fb88df430d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:58.531482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e634e080-d31e-49f0-bd91-9f62103a8254 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] HTTP exception thrown: Image not found. Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e634e080-d31e-49f0-bd91-9f62103a8254 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Request method failure captured: Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/images/9774544a-7bbb-4212-8f93-b3d54be5df85/metadata HTTP/1.1 Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 57 Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wshSVs-ufcW_qhSg1Vz0uhq-Twx_Crh56uO7Yil_vt0j2ZJo0KUJz8PM49Y4U_0nfqseVdHXIGwmhN1TKSv2rkKxY9xyLvY9IwKtwNiLlPPRgyl7LbYAirC5Plr8cnG7J9MfawoOWDAxoYOlaJpVnjqrtT0GMblSam8FBMfshYTtsU Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:50:58.535317 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be3faa283e594dc9bc52326c433100bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be3faa283e594dc9bc52326c433100bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: be3faa283e594dc9bc52326c433100bf Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-980526370 Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e13855cf96ae4f49b3799c8d42bcb75d Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-980526370-project Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 19:50:58.537464 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'image_id': '9774544a-7bbb-4212-8f93-b3d54be5df85', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.538380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9774544a-7bbb-4212-8f93-b3d54be5df85 Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:50:58.539499 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9774544a-7bbb-4212-8f93-b3d54be5df85 could not be found. Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:58.540722 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:50:58.543391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:50:58.546385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e634e080-d31e-49f0-bd91-9f62103a8254 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:58.546385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e634e080-d31e-49f0-bd91-9f62103a8254 tempest-ImagesMetadataNegativeTestJSON-980526370 tempest-ImagesMetadataNegativeTestJSON-980526370-project] 10.222.0.33 "POST /compute/v2.1/images/9774544a-7bbb-4212-8f93-b3d54be5df85/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047057 Jul 19 19:50:58.546385 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 665/1314] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Jul 19 19:50:58 2022] POST /compute/v2.1/images/9774544a-7bbb-4212-8f93-b3d54be5df85/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:50:58.565507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.566316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:58.580936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.581379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.584178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.584632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.176036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:59.177476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:59.194506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.194968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.195948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.196546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.528014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.536604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f79ed991-3b90-48f9-aae2-cf403ca4ef3f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.975310 Jul 19 19:50:59.537326 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 650/1315] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:59.543708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:59.544711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:59.552264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.552735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.554195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.554714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.671730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.689752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.694208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.696641 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e815718d-d017-4929-8c09-9d80b178c7d8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.529427 Jul 19 19:50:59.707836 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 666/1316] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:59 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:59.707836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e2dbd97-2410-46dc-815e-17a7af49c796 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88df9eb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:59.782719 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e2dbd97-2410-46dc-815e-17a7af49c796 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.082036 Jul 19 19:50:59.783579 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 667/1317] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:59 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:00.221140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:00.235220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42e5ea26-5af5-4ce5-b188-b65e0693f9c7 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.694088 Jul 19 19:51:00.236656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 651/1318] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:59 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:00.292556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0040c239-c210-445c-bd18-44808597650e req-227f6e36-1bf9-482d-b563-091d47c920c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cfbbb7-311a-45f4-b849-0619a610aeeb", "tag": "18a7c4ce-9266-4224-9c9a-42e9b71ea791"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:00.320961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0040c239-c210-445c-bd18-44808597650e req-227f6e36-1bf9-482d-b563-091d47c920c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.321876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0040c239-c210-445c-bd18-44808597650e req-227f6e36-1bf9-482d-b563-091d47c920c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.335788 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0040c239-c210-445c-bd18-44808597650e req-227f6e36-1bf9-482d-b563-091d47c920c2 service nova] Creating event network-changed:18a7c4ce-9266-4224-9c9a-42e9b71ea791 for instance e3cfbbb7-311a-45f4-b849-0619a610aeeb on n-h1-843861-3 Jul 19 19:51:00.344852 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0040c239-c210-445c-bd18-44808597650e req-227f6e36-1bf9-482d-b563-091d47c920c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057700 Jul 19 19:51:00.346178 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 668/1319] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:00.554708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:00.556027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:00.563648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.564474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.565480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.566390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.716981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:00.717686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:00.731230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.731765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.732607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.733297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.005019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.020426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ea07485-60f9-4669-95a9-e830046c106d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1321 microversion: 2.1 time: 0.470323 Jul 19 19:51:01.021504 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 652/1320] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:00 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:01.027592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dba06040-a09c-4b93-a46b-c09ca62de15d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dadab80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:01.058352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.068274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.069953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.071267 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31efc5e0-9438-4c5a-9477-9f05d028e1fc tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.359360 Jul 19 19:51:01.072085 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 669/1321] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:00 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:01.107250 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dba06040-a09c-4b93-a46b-c09ca62de15d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.084465 Jul 19 19:51:01.108492 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 653/1322] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:01 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:01.256849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:01.258342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:01.267149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.268039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.269167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.269612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.437649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.448548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f3f13cc-ad96-4e58-a4ad-d1673eabdb2c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.197875 Jul 19 19:51:01.456519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 670/1323] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:01 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:01.897920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-922037930", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:01.966558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:02.037466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:02.038387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:02.045655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.046353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.047296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.047974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.478317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:02.501075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=24 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:02.505956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:02.517729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d49a2d9-d91e-4abb-8345-02654fc1fe23 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1512 microversion: 2.1 time: 0.484052 Jul 19 19:51:02.519088 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 671/1324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:02 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:02.528134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:02.530904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:02.538949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.539774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.540893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.541788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.633915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:02.634532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:02.635191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:02.635754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:02.636365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:02.646561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.647224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.648238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.648862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.668720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Getting quotas for project 810b43b05ebb479ab9e832d5910f4c73. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:02.674100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Getting quotas for user a46b81a600b04c218f5570cb02f15fdd and project 810b43b05ebb479ab9e832d5910f4c73. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:02.686601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:02.688910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:02.736493 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98c1bf87-e0f4-48b6-aed3-b2c77c479d66 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987835 Jul 19 19:51:02.737460 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 654/1325] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:51:02.742202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52082d06-81ce-4933-acb9-01e153ebddcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88db01040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:02.790205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52082d06-81ce-4933-acb9-01e153ebddcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.051649 Jul 19 19:51:02.796208 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 655/1326] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:02 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:02.800969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6a4169bf-68df-45f0-8c9e-716c3eaf8539 req-547c98aa-bf55-4d75-a7ab-1a2b33a42fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c18486-030f-459d-bf20-bf89ef020566", "name": "network-vif-plugged", "status": "completed", "tag": "c52df97a-8af6-4359-b98b-7027d3c4e52c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:02.809367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6a4169bf-68df-45f0-8c9e-716c3eaf8539 req-547c98aa-bf55-4d75-a7ab-1a2b33a42fd4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.810036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6a4169bf-68df-45f0-8c9e-716c3eaf8539 req-547c98aa-bf55-4d75-a7ab-1a2b33a42fd4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.861617 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6a4169bf-68df-45f0-8c9e-716c3eaf8539 req-547c98aa-bf55-4d75-a7ab-1a2b33a42fd4 service nova] Creating event network-vif-plugged:c52df97a-8af6-4359-b98b-7027d3c4e52c for instance 90c18486-030f-459d-bf20-bf89ef020566 on n-h2-843861-3 Jul 19 19:51:02.880880 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6a4169bf-68df-45f0-8c9e-716c3eaf8539 req-547c98aa-bf55-4d75-a7ab-1a2b33a42fd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078420 Jul 19 19:51:02.884054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 656/1327] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:02.925142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:02.936087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:02.971479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.974104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.976593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.978637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.037694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.052384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.054617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.056022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61109a4d-c1b2-41fa-8837-ca538f4970f7 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.535471 Jul 19 19:51:03.058699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 672/1328] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:02 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:03.075796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.076810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:03.085176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.085768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.087048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.087622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.379132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.391293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e7410c1-bdb2-4c8a-af6b-49f3b6ac3fe9 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.503088 Jul 19 19:51:03.408016 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 657/1329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:02 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:03.408795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.414990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.415835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:03.418418 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffd9e19d-0fcf-4079-9c03-4df6dd8e6a22 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1512 microversion: 2.1 time: 0.358453 Jul 19 19:51:03.419001 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 673/1330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:03.422326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.422838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.423624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.424094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.436107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.436811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:03.445463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.446165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.454688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.458448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.528077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.553197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bbd98efb-f31d-4a75-a63a-05cd8ac97383 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1220 microversion: 2.1 time: 0.142841 Jul 19 19:51:03.554480 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 658/1331] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:03.800325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.813441 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f700100-c497-4f38-865e-b53b7f393455 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1320 microversion: 2.1 time: 0.382140 Jul 19 19:51:03.814232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c61ea4bd-3f60-4f6d-b327-cdb20c7d93d4 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88db77e50>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.814565 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 674/1332] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:03.900300 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c61ea4bd-3f60-4f6d-b327-cdb20c7d93d4 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.099797 Jul 19 19:51:03.901337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 659/1333] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:04.076615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.077226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:04.084787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.084974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.085726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.086165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.277430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:04.289612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:04.289767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:04.296672 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-49b1899e-fa4d-4868-a278-68c0391a3114 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.218231 Jul 19 19:51:04.297530 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 675/1334] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:04.411375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.413403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:04.431458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.433211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.434242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.434879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.574382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.575226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:04.578969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:04.591936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.592513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.598601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.600449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.790528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:04.803762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:04.807095 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aaeff5a-ff8b-4cea-b702-3d586a0215d4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1274 microversion: 2.1 time: 0.235107 Jul 19 19:51:04.810037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 676/1335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:04.817479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3a46da0-c51e-4e32-890f-9c88a54a677a tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.410761 Jul 19 19:51:04.818329 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 660/1336] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:04.836887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.837779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:04.847191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.848522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.850352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.851023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.914266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b322e6ff-e1b2-431d-8a31-c9df947e5c24 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dad20d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.984153 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b322e6ff-e1b2-431d-8a31-c9df947e5c24 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.070534 Jul 19 19:51:04.984153 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 661/1337] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:05.031349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-279ece38-2209-42aa-a35a-0f0d97baff03 req-0997c968-b444-4e74-ae58-b24f378b054d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18696-65b2-4b9f-8692-d1fa7c2e5897", "name": "network-vif-plugged", "status": "completed", "tag": "351efc05-b53e-4c94-986a-8bac70939ff1"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:05.051338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-279ece38-2209-42aa-a35a-0f0d97baff03 req-0997c968-b444-4e74-ae58-b24f378b054d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.051790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-279ece38-2209-42aa-a35a-0f0d97baff03 req-0997c968-b444-4e74-ae58-b24f378b054d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.070755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:05.092369 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-279ece38-2209-42aa-a35a-0f0d97baff03 req-0997c968-b444-4e74-ae58-b24f378b054d service nova] Creating event network-vif-plugged:351efc05-b53e-4c94-986a-8bac70939ff1 for instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 on n-h2-843861-3 Jul 19 19:51:05.101201 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-279ece38-2209-42aa-a35a-0f0d97baff03 req-0997c968-b444-4e74-ae58-b24f378b054d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072902 Jul 19 19:51:05.103137 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 662/1338] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:05.318915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.320006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:05.327789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.329091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.330224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.331135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.335519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.350291 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e41dfa1-e9c0-4223-9c6e-40305f612d43 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1320 microversion: 2.1 time: 0.521848 Jul 19 19:51:05.359870 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 677/1339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:05.698473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.714373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.715928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.717510 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dcc012dc-fc5a-4c53-9963-39ce3ba0a614 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.403632 Jul 19 19:51:05.731584 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 663/1340] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:05.835440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.836921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:05.842786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.843404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:05.846173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.846871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.847914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.848740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.854044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.854487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.855460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.855914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.723332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.726865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.736263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5dc80867-35b2-4fe3-b659-593a6f1ba508 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.897443 Jul 19 19:51:06.737398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 664/1341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:06.737520 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-192881f8-e2d8-448f-8691-a68f5106c83d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.916559 Jul 19 19:51:06.740849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 678/1342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:06.746695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04e42638-84b5-43bc-b103-c60d4533a6e2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dac1d30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:06.751227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:06.754902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:06.789178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.792045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.795323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.797038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.834288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04e42638-84b5-43bc-b103-c60d4533a6e2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.094465 Jul 19 19:51:06.834882 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 665/1343] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:07.096367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:07.096999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:07.114785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.115246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.116086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.117047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.161858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.165893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:07.188556 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58f2ab95-e4d1-4d7f-80be-c7c4916dffdb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1511 microversion: 2.1 time: 0.446320 Jul 19 19:51:07.189156 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 679/1344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:07.227935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:07.238287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.242441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:07.260250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:07.278304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.280391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.281432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.292621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.593452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:07.836520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.855748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.858178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.063338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:08.084336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:08.085945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:08.087192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4807b278-41c9-4911-998d-002ab44bfb23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 1.251103 Jul 19 19:51:08.087758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 666/1345] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:08.133271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.134224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:08.171654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.179300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.180249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.180741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.548745 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dec85943-8f4f-4e54-b5bc-0a6a88119b1c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.334437 Jul 19 19:51:08.549926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 680/1346] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:51:07 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:08.555965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.556994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:08.590308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.595055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.599373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.605692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.692847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:08.711409 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b24ff53-8ef3-47c5-95a7-6ed3527550a3 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.601741 Jul 19 19:51:08.716226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 667/1347] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:08 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:08.729652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebab786f-7123-48e5-a9a5-3e463e7fab63 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dad8430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.824067 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebab786f-7123-48e5-a9a5-3e463e7fab63 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.105164 Jul 19 19:51:08.828878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 668/1348] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:08 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:08.835580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-eefd8f96-d310-476d-a5f6-fbe530bff3e1 req-23e060d0-2881-400e-983e-24284f94a1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cfbbb7-311a-45f4-b849-0619a610aeeb", "name": "network-vif-plugged", "status": "completed", "tag": "18a7c4ce-9266-4224-9c9a-42e9b71ea791"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:08.855320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-eefd8f96-d310-476d-a5f6-fbe530bff3e1 req-23e060d0-2881-400e-983e-24284f94a1c1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.862408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-eefd8f96-d310-476d-a5f6-fbe530bff3e1 req-23e060d0-2881-400e-983e-24284f94a1c1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.908106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-eefd8f96-d310-476d-a5f6-fbe530bff3e1 req-23e060d0-2881-400e-983e-24284f94a1c1 service nova] Creating event network-vif-plugged:18a7c4ce-9266-4224-9c9a-42e9b71ea791 for instance e3cfbbb7-311a-45f4-b849-0619a610aeeb on n-h1-843861-3 Jul 19 19:51:08.923373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-eefd8f96-d310-476d-a5f6-fbe530bff3e1 req-23e060d0-2881-400e-983e-24284f94a1c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091088 Jul 19 19:51:08.925678 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 669/1349] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:08.968424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a92dc19a-a5fc-4bb7-b6ac-259e4c684729 req-50f27b9b-38dc-42cb-b8a7-63b2b2682afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:09.012186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a92dc19a-a5fc-4bb7-b6ac-259e4c684729 req-50f27b9b-38dc-42cb-b8a7-63b2b2682afc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.013097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a92dc19a-a5fc-4bb7-b6ac-259e4c684729 req-50f27b9b-38dc-42cb-b8a7-63b2b2682afc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.032330 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a92dc19a-a5fc-4bb7-b6ac-259e4c684729 req-50f27b9b-38dc-42cb-b8a7-63b2b2682afc service nova] Creating event network-changed:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:51:09.042608 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a92dc19a-a5fc-4bb7-b6ac-259e4c684729 req-50f27b9b-38dc-42cb-b8a7-63b2b2682afc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112754 Jul 19 19:51:09.044354 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 670/1350] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:09.051750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:09.059865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.061105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1410589508', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:09.069302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.070493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.071502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.072265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.233346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.246705 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cf0c944-072a-490f-9c9d-640622dd7f9a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.695319 Jul 19 19:51:09.259496 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 681/1351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:08 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:09.266534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:09.267401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:09.274227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:09.276225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.276898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.277960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.278833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.357664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.365977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:09.366423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.168560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.195405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.197000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.204137 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0546291-d640-4a5c-9452-04217cb7fe47 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.943201 Jul 19 19:51:10.205362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 682/1352] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:09 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:10.230877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.231728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:10.252443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.253653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.255210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.258909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.427322 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ac75ddb-6178-485d-ab73-c224290332cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1410589508" status: 200 len: 1515 microversion: 2.1 time: 1.380726 Jul 19 19:51:10.428330 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 671/1353] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:51:09 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1410589508 => generated 1515 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:10.434443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32e8f64a-6a3a-4978-9403-76aaf2ef5d20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dae0dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.523937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32e8f64a-6a3a-4978-9403-76aaf2ef5d20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.094684 Jul 19 19:51:10.524510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 672/1354] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:10.541724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.543693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:10.567383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.567852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.568642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.576002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.841821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.858706 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76c83a19-a011-4c25-9bc6-64b03d507a0c tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1325 microversion: 2.1 time: 0.651563 Jul 19 19:51:10.863244 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 683/1355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:10.882452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.897422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.902585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:10.928058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.931383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.933037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.940445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.282551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:11.434108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:11.443951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.444484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.694834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:11.705066 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d2999053-757a-4515-8784-90769319e763 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 1.178931 Jul 19 19:51:11.706632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 673/1356] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:11.719629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:11.720813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:11.729540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.730604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.731874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.732553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.733825 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4bc4bfc3-7fe8-43dc-80f4-2d585e8ee49e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.865100 Jul 19 19:51:11.735385 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 684/1357] 10.222.0.33 () {58 vars in 1172 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:11.742182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e81c79e2-dc40-4ee9-ac23-07c46b227c89 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dfd2700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:11.847134 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e81c79e2-dc40-4ee9-ac23-07c46b227c89 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.109547 Jul 19 19:51:11.848913 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 685/1358] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:11 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:11.864978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:11.866018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:11.881985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.882955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.884015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.884715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.294279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.312288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.314378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.315844 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e46ff56-1982-487e-b947-9fc95504701f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.608007 Jul 19 19:51:12.327170 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 674/1359] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:11 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:12.340003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:12.356331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.356938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.servers [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Removing options 'limit' from query {{(pid=126007) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:51:12.358225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:12.364709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.365419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.366409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.367019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.574562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.584496 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7f46772-8434-46a4-9d44-a86bfa8a0ba1 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1857 microversion: 2.1 time: 0.733815 Jul 19 19:51:12.594023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.596725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.598638 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 686/1360] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:11 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1857 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:12.616256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:12.617468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:12.625617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.626060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.626826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.627252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.016935 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-50e8fe35-36b3-4884-a131-97f2940e01fa tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.688092 Jul 19 19:51:13.017474 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 675/1361] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:51:12 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:13.022999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843861-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:13.025166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:13.048301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.049201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.050182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.052356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.102638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:13.118142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5655d699-2b30-4464-8811-caa69b6f4ee0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1522 microversion: 2.1 time: 0.516578 Jul 19 19:51:13.122689 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 687/1362] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:12 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:13.127888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:13.143715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:13.150802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lazy-loading 'flavor' on Instance uuid dcacc019-ce62-4a1d-a140-12a8568e453f {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:13.165928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.175267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.176969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.179600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.194127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Going to try to live migrate instance to n-h1-843861-3 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:51:13.913460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:13.939014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c884f8e-a516-42c7-baa1-16b6c2742a03 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.811407 Jul 19 19:51:13.939758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 688/1363] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:13 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:13.968588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-835631f4-a564-4b74-a679-055d69f874a7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb893038670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.071239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-835631f4-a564-4b74-a679-055d69f874a7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.125371 Jul 19 19:51:14.071982 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 689/1364] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:13 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:14.076930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.106575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:14.107328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:14.134020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.134482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.135285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.135725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.493341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:14.686157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d35d3eb-2c73-471e-a786-7d445112e869 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.612716 Jul 19 19:51:14.686700 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 690/1365] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:51:14 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:14.708015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.711033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:14.727251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.727708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.728742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.729088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.764056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:51:14.954600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb926651-848c-44fe-b487-cd3c8a565346 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 204 len: 0 microversion: 2.1 time: 0.256816 Jul 19 19:51:14.955595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 691/1366] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:14 2022] DELETE /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:14.968458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.968999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:14.983762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.987392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.996314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.998424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.066342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.084900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.095060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.106520 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bedb9417-4321-4d07-97c2-27657bef959a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 1.144850 Jul 19 19:51:16.109742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 692/1367] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:14 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:16.120021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:16.127418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.128696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.servers [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Removing options 'limit' from query {{(pid=126008) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:51:16.129311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:16.143277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.150433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.153906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.155114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.276419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:16.351319 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf420883-dbc9-4bd5-8f14-6c3c45f26d6b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.240067 Jul 19 19:51:16.352305 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 693/1368] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Jul 19 19:51:16 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:16.378340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:16.392758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:16.414993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.423790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.424676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.425118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.981503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.984599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:16.999989 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cc0e48e-1abc-4d17-a965-f5ce5fa6ed43 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.628160 Jul 19 19:51:17.000778 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 694/1369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:16 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:17.027742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.028937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:17.038537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.039587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.041149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.041828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.684968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:17.700421 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90ced4fc-9dff-4632-97e8-44e19ca8e05b tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1528 microversion: 2.1 time: 0.691547 Jul 19 19:51:17.704546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 695/1370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1528 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:17.731784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27f6f8f8-b1e1-49b8-9430-6fc886aee884 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88df35e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.816154 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27f6f8f8-b1e1-49b8-9430-6fc886aee884 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.098479 Jul 19 19:51:17.822272 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 696/1371] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:17.827046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ed71a94b-0412-4148-9ddb-5a66e5bb510f req-611c5f12-bbc5-49a8-91e0-2ce6a717b9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "name": "network-vif-unplugged", "status": "completed", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:17.872005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ed71a94b-0412-4148-9ddb-5a66e5bb510f req-611c5f12-bbc5-49a8-91e0-2ce6a717b9fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.872654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ed71a94b-0412-4148-9ddb-5a66e5bb510f req-611c5f12-bbc5-49a8-91e0-2ce6a717b9fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.904998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ed71a94b-0412-4148-9ddb-5a66e5bb510f req-611c5f12-bbc5-49a8-91e0-2ce6a717b9fb service nova] Creating event network-vif-unplugged:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:51:17.914350 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ed71a94b-0412-4148-9ddb-5a66e5bb510f req-611c5f12-bbc5-49a8-91e0-2ce6a717b9fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094447 Jul 19 19:51:17.916164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 697/1372] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:17.932123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.941602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:17.944084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:17.956835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.959015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.962138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.962902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.978957 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d307227d-05da-4ff9-98c9-7a3a6cdb8bc0 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/action" status: 202 len: 0 microversion: 2.1 time: 4.959857 Jul 19 19:51:17.980383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 676/1373] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:13 2022] POST /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/action => generated 0 bytes in 4962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:17.991905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.999238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:18.031300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.031964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.033607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.037590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.050490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:18.095061 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09f164d3-5461-4f65-8548-6df3c7b221f6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.175757 Jul 19 19:51:18.095673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 698/1374] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/servers => generated 1011 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:18.101179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.102556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:18.111935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.112879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.114328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.115022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.565292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.587218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.589452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.590866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d536a7b8-ffd0-4f2f-aed6-3391c5f9d42f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.609365 Jul 19 19:51:18.592384 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 677/1375] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:18.600910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.608314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:18.621603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.624787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.625827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.628373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.651262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.662173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a431d60-f0d4-4ace-ae85-d6d1683c7d9e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.565260 Jul 19 19:51:18.663093 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 699/1376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:18.669063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.673324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.674432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:18.689214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.689887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.690689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.691131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.872461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:18.966514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.985089 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84c33240-6e13-4ca8-92fc-884dda219cfc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.389929 Jul 19 19:51:18.985695 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 678/1377] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:18.994911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.995529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.028061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.028516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.029814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.033594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.064195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-288c9b15-799c-4ce7-abb7-e4bb6d71db9a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.399111 Jul 19 19:51:19.065468 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 700/1378] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:19.071976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e892118-7783-43aa-9828-ea252517ef48 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb893192820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.167668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e892118-7783-43aa-9828-ea252517ef48 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.099684 Jul 19 19:51:19.177506 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 701/1379] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:19.184907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.192777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.193625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.servers [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Removing options 'limit' from query {{(pid=126008) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:51:19.194635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:19.201465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.202238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.203306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.203437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.203928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.204288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.204436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lazy-loading 'fault' on Instance uuid e3cfbbb7-311a-45f4-b849-0619a610aeeb {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:19.261814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58cf0241-65d2-48ae-9bb2-b3d6ce4d1c2e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.080747 Jul 19 19:51:19.263173 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 702/1380] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:19.288330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.296504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.297601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1410589508', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:19.308146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.309001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.310065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.310680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.337193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035bdfa56304514a841334c420b1041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1136959b10a4310a7b0803d010d8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.346263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-352cfa5e-d967-497a-ac23-b373e7c1bca6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 200 len: 1315 microversion: 2.1 time: 0.359502 Jul 19 19:51:19.349679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 679/1381] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:19.456538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:19.543340 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89620627-dd71-4792-a62a-6af6c82c68cb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1410589508" status: 200 len: 346 microversion: 2.1 time: 0.265394 Jul 19 19:51:19.544853 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 703/1382] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1410589508 => generated 346 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:19.559106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a1077a05-8415-4736-80fc-ba656a24154e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:19.568435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1077a05-8415-4736-80fc-ba656a24154e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.569318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1077a05-8415-4736-80fc-ba656a24154e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.599158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a1077a05-8415-4736-80fc-ba656a24154e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:51:19.614721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.615521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.637125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:19.644868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.646062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.647072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.647631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.686327 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a1077a05-8415-4736-80fc-ba656a24154e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "POST /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c/action" status: 202 len: 0 microversion: 2.1 time: 0.118970 Jul 19 19:51:19.689231 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 680/1383] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:19 2022] POST /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:20.028545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.029119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.030065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.040449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.047029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.048043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.049172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.049391 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42628cd5-f118-4868-9bc5-479efbf4665f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.442161 Jul 19 19:51:20.051541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.052132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.070148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 704/1384] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:20.083905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.084535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.107542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.108187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.114524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.114896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.380766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.390609 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8cd800f2-d0f4-4f85-90f3-20059070cab1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.697084 Jul 19 19:51:20.395318 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 681/1385] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.406220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d51a7dc0-8592-4ad5-95ce-eae6b79ea045 req-bc806e99-5692-4abb-ae13-6c9d76492174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-plugged", "status": "completed", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:20.420479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:20.425343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.434322 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7175de61-db10-46da-ab52-571bafac34b2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1522 microversion: 2.1 time: 0.362999 Jul 19 19:51:20.438994 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 705/1386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.447127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d51a7dc0-8592-4ad5-95ce-eae6b79ea045 req-bc806e99-5692-4abb-ae13-6c9d76492174 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.449362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.450159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d51a7dc0-8592-4ad5-95ce-eae6b79ea045 req-bc806e99-5692-4abb-ae13-6c9d76492174 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.452532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.470214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.470775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.474176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.474871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.478545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d51a7dc0-8592-4ad5-95ce-eae6b79ea045 req-bc806e99-5692-4abb-ae13-6c9d76492174 service nova] Creating event network-vif-plugged:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:51:20.494136 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d51a7dc0-8592-4ad5-95ce-eae6b79ea045 req-bc806e99-5692-4abb-ae13-6c9d76492174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091555 Jul 19 19:51:20.495389 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 682/1387] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:20.514153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}, {"server_uuid": "e3cfbbb7-311a-45f4-b849-0619a610aeeb", "name": "network-vif-deleted", "tag": "18a7c4ce-9266-4224-9c9a-42e9b71ea791"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:20.537239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.541917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.586832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] Creating event network-changed:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:51:20.587345 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] Creating event network-vif-deleted:18a7c4ce-9266-4224-9c9a-42e9b71ea791 for instance e3cfbbb7-311a-45f4-b849-0619a610aeeb on n-h1-843861-3 Jul 19 19:51:20.625268 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9ff6f1df-7850-4ac2-938b-6a412769a134 req-15fd9a32-89fc-46c7-85ef-9bee6c2a86a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.128366 Jul 19 19:51:20.633688 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 683/1388] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:20.648966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4707cad3-9db4-4e88-9103-44fa08d09b73 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dca7280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.763257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4707cad3-9db4-4e88-9103-44fa08d09b73 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.127997 Jul 19 19:51:20.769074 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 684/1389] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.769252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.770157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: e3cfbbb7-311a-45f4-b849-0619a610aeeb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.783482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.783695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.784509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.785415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.808070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb HTTP/1.1 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:20.810275 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. Jul 19 19:51:20.812002 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'e3cfbbb7-311a-45f4-b849-0619a610aeeb'} Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:20.812929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. Jul 19 19:51:20.814456 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.815838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance e3cfbbb7-311a-45f4-b849-0619a610aeeb could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:20.815838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ec3bc0a-9e7b-4e53-b477-7879ea1fe3a6 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb" status: 404 len: 111 microversion: 2.1 time: 0.046863 Jul 19 19:51:20.815838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 685/1390] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/e3cfbbb7-311a-45f4-b849-0619a610aeeb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:20.824913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eef8dd2-b0e1-47e0-b1c6-842067af422e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88db86550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.889554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-5eef8dd2-b0e1-47e0-b1c6-842067af422e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Image not found. Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eef8dd2-b0e1-47e0-b1c6-842067af422e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47 HTTP/1.1 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:20.892457 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ba98ee58-5b94-45f2-be51-61dd392b4e47'} Jul 19 19:51:20.893839 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba98ee58-5b94-45f2-be51-61dd392b4e47 to delete Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.894908 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba98ee58-5b94-45f2-be51-61dd392b4e47 could not be found. Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:20.896215 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:51:20.897591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.900189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eef8dd2-b0e1-47e0-b1c6-842067af422e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:20.901540 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5eef8dd2-b0e1-47e0-b1c6-842067af422e tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47" status: 404 len: 62 microversion: 2.1 time: 0.082443 Jul 19 19:51:20.905589 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 686/1391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] DELETE /compute/v2.1/images/ba98ee58-5b94-45f2-be51-61dd392b4e47 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:20.911678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.914335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.919655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.930383 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ee296f6-3f7a-4767-8d72-d9257317558b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1316 microversion: 2.1 time: 0.486537 Jul 19 19:51:20.944126 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 706/1392] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.944490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.944490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.944490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.944773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.968459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f HTTP/1.1 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:20.970682 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:20.972128 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'deb6c658-ec3b-46d8-8086-220f79a5399f'} Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:20.972956 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:20.974217 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:20.975510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:20.975510 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05284a18-2866-45c0-9cca-c62674ee1168 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 404 len: 111 microversion: 2.1 time: 0.065497 Jul 19 19:51:20.981726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.982736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: deb6c658-ec3b-46d8-8086-220f79a5399f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.987934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 687/1393] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:20 2022] DELETE /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:20.990542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.990908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.992048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.992913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.010019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f HTTP/1.1 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:51:21.012154 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:21.013846 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'deb6c658-ec3b-46d8-8086-220f79a5399f'} Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:21.014792 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. Jul 19 19:51:21.016616 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.019461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance deb6c658-ec3b-46d8-8086-220f79a5399f could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:21.020480 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7956a1a8-e1c1-4596-846b-b60be3cbad22 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f" status: 404 len: 111 microversion: 2.1 time: 0.042814 Jul 19 19:51:21.030369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f913edd-8eb3-4375-9a18-3586501e9640 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88dca7a60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.034559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 707/1394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/deb6c658-ec3b-46d8-8086-220f79a5399f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:21.068911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.071421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:21.072754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f913edd-8eb3-4375-9a18-3586501e9640 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551961537" status: 202 len: 0 microversion: 2.1 time: 0.046380 Jul 19 19:51:21.074038 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 688/1395] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 19:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551961537 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:21.103180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.103781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.104884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.105532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.410350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.415072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.415580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:21.424779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.424779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.424779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a15f90f2-25e3-4c3f-a2d6-414f7b84c868 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.361453 Jul 19 19:51:21.438051 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 708/1396] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:21 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:21.438258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.438258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.438702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.440168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.458845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.459524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:21.490973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:21.498751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.498751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.499460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.500075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.304983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:22.313937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ae37b0ee-f2f8-4100-bd60-366fd71f16d1 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1522 microversion: 2.1 time: 0.859967 Jul 19 19:51:22.314546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 709/1397] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:21 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:22.416240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:22.445800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e69c8af-5041-47e2-ad91-156df7348e07 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.036602 Jul 19 19:51:22.458988 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 689/1398] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:21 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:22.472163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c74dc4cf-250a-4407-81cb-52f0ff1f24e5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dad5310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:22.491091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:22.573410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:22.628033 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c74dc4cf-250a-4407-81cb-52f0ff1f24e5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.167302 Jul 19 19:51:22.629852 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 690/1399] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:22 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:22.641240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:22.642506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:22.652307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.653236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.654427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.655365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.671654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a075abbf-53b2-4d5e-b762-2acc47056bde tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Action: 'create', calling method: .version_select at 0x7fb893038dc0>, body: {"keypair": {"name": "tempest-keypair-1124453541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhAkyZhsqBbeg8/zZWzkGy9kmj36XhofdA6I/eW4H64wXQShlHJglJAQyJxtTLMGecOyW9PQ1+5JbZumrAWRuNjnpneiLJ8UlHc0CRRWmjaIPE+uh+jfUQlzMf4Q5/kmQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:22.701587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a075abbf-53b2-4d5e-b762-2acc47056bde tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for project 161892765d664cff8ecadaee1ebdcc99. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:22.710623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a075abbf-53b2-4d5e-b762-2acc47056bde tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for user 3c9e9f7f20dc430da1b45bf81c13a4d8 and project 161892765d664cff8ecadaee1ebdcc99. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:22.756026 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a075abbf-53b2-4d5e-b762-2acc47056bde tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.439587 Jul 19 19:51:22.757693 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 710/1400] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:51:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:22.768815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:22.771433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:22.781556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.782362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.783594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.784585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.064675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.075480 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83420539-7f11-4c93-a169-d7ce974cd198 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1466 microversion: 2.1 time: 0.443519 Jul 19 19:51:23.078816 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 691/1401] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:22 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1466 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:23.094338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1614992076", "metadata": {"image_type": "test"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:23.096062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:23.103128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.103698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.104601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.105249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.143327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Getting quotas for project 810b43b05ebb479ab9e832d5910f4c73. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:23.149314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Getting quotas for user a46b81a600b04c218f5570cb02f15fdd and project 810b43b05ebb479ab9e832d5910f4c73. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:23.185424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.205681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.226476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.233535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a713cc4c-d163-416c-add6-3aae222d2e1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.474537 Jul 19 19:51:23.236317 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 711/1402] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:22 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:23.345915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.346556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:23.367616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.368169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.369000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.373236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.563703 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-193f83df-e399-4ab5-84f4-9575f545226b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "POST /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a/action" status: 202 len: 0 microversion: 2.1 time: 0.473158 Jul 19 19:51:23.568301 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 692/1403] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:23 2022] POST /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:51:23.576415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59df8347-9964-4e5e-9b07-9964055868e0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '.version_select at 0x7fb88dc595e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.603000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.607468 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-59df8347-9964-4e5e-9b07-9964055868e0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Image not found. Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59df8347-9964-4e5e-9b07-9964055868e0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/images/9efeedba-8529-4feb-b882-60dc1eb4f5a7 HTTP/1.1 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:23.610711 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9efeedba-8529-4feb-b882-60dc1eb4f5a7'} Jul 19 19:51:23.612498 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9efeedba-8529-4feb-b882-60dc1eb4f5a7 to delete Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:23.613848 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9efeedba-8529-4feb-b882-60dc1eb4f5a7 could not be found. Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:23.616534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:51:23.619762 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.624854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59df8347-9964-4e5e-9b07-9964055868e0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:23.626778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59df8347-9964-4e5e-9b07-9964055868e0 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/images/9efeedba-8529-4feb-b882-60dc1eb4f5a7" status: 404 len: 62 microversion: 2.1 time: 0.056968 Jul 19 19:51:23.627543 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 693/1404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:23 2022] DELETE /compute/v2.1/images/9efeedba-8529-4feb-b882-60dc1eb4f5a7 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:23.636628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.636943 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3268016-208f-4218-aa1c-e96a9af6341e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1522 microversion: 2.1 time: 0.295206 Jul 19 19:51:23.647052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 712/1405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:23.647052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64340a99-e3db-46c6-998c-faada110afa7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88df8f790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.648760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:23.658679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.659212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.660338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.660684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.721779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64340a99-e3db-46c6-998c-faada110afa7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.081814 Jul 19 19:51:23.722785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 713/1406] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:23.729394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.730110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:23.740495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.741028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.742031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.742659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.771567 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 HTTP/1.1 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:51:23.773517 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:23.774894 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456'} Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:23.775701 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:23.781861 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:23.800733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:23.804840 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef4a186f-0927-44ba-9ef5-6a563665b065 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 404 len: 111 microversion: 2.1 time: 0.080710 Jul 19 19:51:23.806590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 714/1407] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:23 2022] DELETE /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:23.811460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-10fb1d28-6772-401c-bfe1-941e02b2c2f1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88df8f1f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.980422 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-10fb1d28-6772-401c-bfe1-941e02b2c2f1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.172462 Jul 19 19:51:23.982062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 715/1408] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:23.996357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:24.001585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] [instance: 4ceadae2-7799-44a9-b9da-4897bf77f456] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:24.024730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.025377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.026359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.026986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.045515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.052855 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] HTTP exception thrown: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Request method failure captured: Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 HTTP/1.1 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wrCaW3zYfzAYNHj8kv2_4zzw0YAmfhpxHRT8sHaxztA2WZ_qNtLn-jyWPDRTNXS9r-behITfBQfeDqDlPpH68HhjoNdJy5sTjqX_twwi4Z7_W2_Ws-RgFGXyD67GdOIQDrkbo9kwCn7T9hjUQs4b9Q0IN7C2yirsMSnrs_JmXRP8e8 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:51:24.054796 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1136959b10a4310a7b0803d010d8501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1136959b10a4310a7b0803d010d8501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e1136959b10a4310a7b0803d010d8501 Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401 Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5035bdfa56304514a841334c420b1041 Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1091390401-project Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:24.056464 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4ceadae2-7799-44a9-b9da-4897bf77f456'} Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:24.057364 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. Jul 19 19:51:24.058831 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:24.060178 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2575a891-dc67-460e-9891-c864de09e209 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.424753 Jul 19 19:51:24.060178 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 694/1409] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:24.061070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] Returning 404 to user: Instance 4ceadae2-7799-44a9-b9da-4897bf77f456 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:24.062107 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e1aaf3d-d17a-4e8d-af74-2daaca072c85 tempest-ImagesOneServerNegativeTestJSON-1091390401 tempest-ImagesOneServerNegativeTestJSON-1091390401-project] 10.222.0.33 "GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456" status: 404 len: 111 microversion: 2.1 time: 0.073389 Jul 19 19:51:24.063086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 716/1410] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/servers/4ceadae2-7799-44a9-b9da-4897bf77f456 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:24.253948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:24.254609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:24.263676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.264174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.264964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.275383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.664932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:24.668364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:24.684945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.700793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.703901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.712443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:24.713733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:24.719115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.726396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.732092 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9446c21c-7bc7-406b-bbf2-ef13ae525459 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.478194 Jul 19 19:51:24.735311 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 695/1411] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:24.746425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7f6668c-73c6-41d1-a331-140a9ada6a37 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dbe9310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:24.889822 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7f6668c-73c6-41d1-a331-140a9ada6a37 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.152947 Jul 19 19:51:24.890930 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 696/1412] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:24.995450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee5abc21-2f72-40b0-8cff-2ec96f629fdd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dca7040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.092923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee5abc21-2f72-40b0-8cff-2ec96f629fdd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.101778 Jul 19 19:51:25.093663 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 697/1413] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:25.099266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.104684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:25.116990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.119934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.121105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.121797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.435909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:25.445350 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff8ebc1b-1486-4535-8378-a0fb8150cdac tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1522 microversion: 2.1 time: 0.787542 Jul 19 19:51:25.452646 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 717/1414] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:25.662188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:25.677057 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c548e4f-df53-4725-a0da-047647c1c5a4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.581289 Jul 19 19:51:25.688996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 698/1415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:25 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:25.756768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.757864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:25.775535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.776031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.776844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.777273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.872319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:25.894402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-272900572", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "4d4d2315-a7e7-4cd5-954f-b4b2f368ce6c"}], "security_groups": [{"name": "tempest-securitygroup--305025836"}], "key_name": "tempest-keypair-1124453541", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:26.138524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] validate_networks() for [('4d4d2315-a7e7-4cd5-954f-b4b2f368ce6c', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:26.169003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:26.177665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:26.189836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:26.191383 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cef1e554-9dec-4096-bebc-3950bbe96eab tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.440677 Jul 19 19:51:26.192026 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 718/1416] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:25 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:26.220937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cdcac781-415e-4701-9e49-70130d08c664 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88df768b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:26.287712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cdcac781-415e-4701-9e49-70130d08c664 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.084575 Jul 19 19:51:26.288591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 719/1417] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:26 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:26.293240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e34ef0e-6c75-4b71-960f-69fcea136c4d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88df8f670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:26.384851 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e34ef0e-6c75-4b71-960f-69fcea136c4d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1411 microversion: 2.1 time: 0.095021 Jul 19 19:51:26.386219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 720/1418] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:26 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:26.477909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:26.479003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:26.511745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.514790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:26.515976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.518759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.033067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:27.046160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a019287-e40a-4569-a6a5-2b3aeb040c66 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1522 microversion: 2.1 time: 0.583490 Jul 19 19:51:27.059097 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 721/1419] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:26 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:27.068386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:27.087781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:27.101872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.105119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.106266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.106935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.439359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:27.439941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:27.440293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:27.440712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:27.441131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:27.461422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.461879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.467453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.468159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.575507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for project 161892765d664cff8ecadaee1ebdcc99. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:27.601683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for user 3c9e9f7f20dc430da1b45bf81c13a4d8 and project 161892765d664cff8ecadaee1ebdcc99. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:27.654685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:27.657122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:27.783253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:27.818141 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4c183d3e-7629-4db1-87cf-8d59ab5e3d54 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.753401 Jul 19 19:51:27.824542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 722/1420] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:27 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:27.834673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8baf75ea-a410-4fcf-b681-bb04bb77a97b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.944829 Jul 19 19:51:27.848198 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 699/1421] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:51:27.866597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08e2dd2f-1481-47a0-b79f-a70147371707 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88db75d30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:27.878373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:27.883238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:27.904899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.908266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.909338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.911630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.407415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:28.421856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:28.428239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:28.436697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24434ed0-c34c-41f3-a589-34c3d89b7ee8 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.608108 Jul 19 19:51:28.437800 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 723/1422] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:27 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:28.446165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65fe775f-a7c0-46f5-a281-d22bbcda08bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dfc7c10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:29.385894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=16 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:31.119666 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08e2dd2f-1481-47a0-b79f-a70147371707 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 3.262096 Jul 19 19:51:31.120678 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 700/1423] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:27 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:31.125262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:31.136529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:31.152757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65fe775f-a7c0-46f5-a281-d22bbcda08bf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1420 microversion: 2.1 time: 2.713501 Jul 19 19:51:31.158710 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 724/1424] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:28 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1420 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:31.164943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:31.170035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.171828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:31.173453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.178366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.179122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.195902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.196620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.199922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.200564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.512131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:31.523460 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a9d88b6b-c559-46c3-9412-f66d29c37734 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1299 microversion: 2.1 time: 0.401694 Jul 19 19:51:31.530549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 701/1425] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:31 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:31.543277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8d1e8b93-2369-4ab5-9a4c-7ce91ad818be req-df437d1f-69ff-486d-9962-f582a0a924d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "name": "network-vif-unplugged", "status": "completed", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:31.568878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8d1e8b93-2369-4ab5-9a4c-7ce91ad818be req-df437d1f-69ff-486d-9962-f582a0a924d8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.569590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8d1e8b93-2369-4ab5-9a4c-7ce91ad818be req-df437d1f-69ff-486d-9962-f582a0a924d8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.595684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8d1e8b93-2369-4ab5-9a4c-7ce91ad818be req-df437d1f-69ff-486d-9962-f582a0a924d8 service nova] Creating event network-vif-unplugged:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h2-843861-3 Jul 19 19:51:31.618883 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8d1e8b93-2369-4ab5-9a4c-7ce91ad818be req-df437d1f-69ff-486d-9962-f582a0a924d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086730 Jul 19 19:51:31.623766 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 702/1426] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:31.636872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:31.642078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:31.657119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.660014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.661071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.661679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.062372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:32.078511 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7675bffc-bba1-456d-b782-68829df18fe3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1499 microversion: 2.1 time: 0.918454 Jul 19 19:51:32.079388 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 725/1427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:31 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1499 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:32.086247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:32.088615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:32.107111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.107789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.108721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.109317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.391033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:32.400682 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-805bda48-c16a-4917-89ca-56fe37b5056c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.775351 Jul 19 19:51:32.416302 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 703/1428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:31 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:32.421482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-13bc8c31-b43f-4ce8-a7fa-949127ab85da req-ee53af03-9aad-4cf5-a0ce-da7deee98be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-plugged", "status": "completed", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:32.442976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-13bc8c31-b43f-4ce8-a7fa-949127ab85da req-ee53af03-9aad-4cf5-a0ce-da7deee98be0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.446427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-13bc8c31-b43f-4ce8-a7fa-949127ab85da req-ee53af03-9aad-4cf5-a0ce-da7deee98be0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.470119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-13bc8c31-b43f-4ce8-a7fa-949127ab85da req-ee53af03-9aad-4cf5-a0ce-da7deee98be0 service nova] Creating event network-vif-plugged:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:51:32.491735 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-13bc8c31-b43f-4ce8-a7fa-949127ab85da req-ee53af03-9aad-4cf5-a0ce-da7deee98be0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073775 Jul 19 19:51:32.493061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 704/1429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:32.498441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f31f4cc4-096d-472e-a0f0-ae8231ae4863 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dacb0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:32.596149 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f31f4cc4-096d-472e-a0f0-ae8231ae4863 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 200 len: 1420 microversion: 2.1 time: 0.101643 Jul 19 19:51:32.597051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 705/1430] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:32.612776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:32.617005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:32.618514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:32.634817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.635551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.652604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.653755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.730909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:32.873908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:32.993921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.013676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.017056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.024739 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64df6f43-2c5b-467e-b0d2-4a4e5736f896 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1814 microversion: 2.25 time: 0.941256 Jul 19 19:51:33.025347 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ec32f17-a850-4f45-864f-28f0b086a917 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.426249 Jul 19 19:51:33.036971 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 726/1431] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1814 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:33.037304 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 706/1432] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:33.040144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c76779c3-3943-402b-a942-4b9f4a540c78 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dbfac10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.053662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.054695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:33.056250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:33.095608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.096092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.096902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.097339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.118074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c76779c3-3943-402b-a942-4b9f4a540c78 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.083742 Jul 19 19:51:33.119300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 707/1433] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:33 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:33.127545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3793acb2-58b4-4d3d-9a34-db20d2fffc88 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dacbf70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.300737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.309063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8218c7cb-4ed4-4ce2-bf11-a9a722193719 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1299 microversion: 2.1 time: 0.268667 Jul 19 19:51:33.312519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 727/1434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:33 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:33.319784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a8876399-e5d4-498c-9602-34f147d21e5f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:33.339507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8876399-e5d4-498c-9602-34f147d21e5f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.343273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8876399-e5d4-498c-9602-34f147d21e5f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.511657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a8876399-e5d4-498c-9602-34f147d21e5f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Going to try to start instance {{(pid=126008) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 19:51:33.631461 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a8876399-e5d4-498c-9602-34f147d21e5f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "POST /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c/action" status: 202 len: 0 microversion: 2.1 time: 0.315694 Jul 19 19:51:33.633314 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 728/1435] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:33 2022] POST /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:33.646846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.649354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:33.666146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.670841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.671697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.672170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.294247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:34.305529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d62a9620-9680-4001-b806-0ded549fc9ab tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.669714 Jul 19 19:51:34.311219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 729/1436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:33 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:34.316831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3793acb2-58b4-4d3d-9a34-db20d2fffc88 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 204 len: 0 microversion: 2.1 time: 1.195216 Jul 19 19:51:34.320410 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 708/1437] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:33 2022] DELETE /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:34.321348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.324456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.324585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:34.325040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:34.342584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.344141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.345749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.348488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.348867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.349189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.350585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.351286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.723941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:34.727970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:34.742458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:34.757604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:34.759099 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0eca047c-c7f6-438f-9155-ce6d3c3a1b52 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1804 microversion: 2.25 time: 0.440012 Jul 19 19:51:34.759885 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 709/1438] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:34 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1804 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:34.778025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59b05897-193c-482c-8c45-99cee4060461 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88db75c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.851440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59b05897-193c-482c-8c45-99cee4060461 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.090272 Jul 19 19:51:34.852990 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 710/1439] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:34 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:34.869443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.870257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:34.883091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.885064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.894135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.896358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.983034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:51:35.125117 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-756e419c-eff7-4128-8be6-c04a2b739351 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 204 len: 0 microversion: 2.1 time: 0.270575 Jul 19 19:51:35.126165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 711/1440] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:34 2022] DELETE /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:35.132533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.133467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:35.141071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.141810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.142809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.143428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.145610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.179275 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25b1f716-7dcc-4553-b679-7a4845875086 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1508 microversion: 2.1 time: 0.864939 Jul 19 19:51:35.199885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 730/1441] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:34 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1508 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:35.574842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.576620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-496e5d3e-5181-4cc5-be3d-a52ccec87354 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '.version_select at 0x7fb88fba83a0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.580701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-496e5d3e-5181-4cc5-be3d-a52ccec87354 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.583004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-496e5d3e-5181-4cc5-be3d-a52ccec87354 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.589033 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d0dc691d-5543-4491-ab0a-3f8bbeec5d2e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 0.458411 Jul 19 19:51:35.590400 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 712/1442] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:35.597500 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-496e5d3e-5181-4cc5-be3d-a52ccec87354 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3023 microversion: 2.25 time: 0.396160 Jul 19 19:51:35.598344 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 731/1443] 10.222.0.33 () {60 vars in 1183 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/os-migrations => generated 3023 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:35.604558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.607550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:35.615532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-930412086", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f99d3c74-93b6-4718-9088-9758ebb4ad6d"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:35.625460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.626009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.626871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.627505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.759673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] validate_networks() for [('f99d3c74-93b6-4718-9088-9758ebb4ad6d', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:36.057464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:36.070858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c9231c9e-084d-4f12-a696-6182261f0c8b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.479355 Jul 19 19:51:36.072968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 713/1444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:36.096552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:36.097657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:36.108352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.109137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:36.110952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.111740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:36.446084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:36.485881 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb94e5a9-e0ba-41cd-ab8f-c73635557882 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 2422 microversion: 2.25 time: 0.410925 Jul 19 19:51:36.500983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 714/1445] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:36 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 2422 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:36.502672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b863933-2303-4d93-99cb-ccd4af02f12a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dc2b9d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:36.561618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b863933-2303-4d93-99cb-ccd4af02f12a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.064247 Jul 19 19:51:36.562411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 715/1446] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:36 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:36.567941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:36.570409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:36.582572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.583208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:36.584841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.585312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.331583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:37.340204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d99090a-77df-4233-b35c-6168a8d7a95f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1512 microversion: 2.1 time: 0.776457 Jul 19 19:51:37.353490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 716/1447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:36 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1512 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:37.392561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:37.396342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:37.397394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:37.398166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:37.398683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:37.412747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.413560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.414714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.415752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.444338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:37.452771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for user fecc799226eb4a39950040a548b1987d and project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:37.470643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:37.473938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:37.519232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Calling method '.version_select at 0x7fb88dc2b280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:37.534753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.536056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.537169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.537806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.558854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-084cf78c-15a8-4d57-b2a4-6e3f7652c8f8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958666 Jul 19 19:51:37.560230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 732/1448] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:51:37.567300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-55eb4bd0-8274-41b7-b001-2676fb6bddcb req-4e5fe379-6d6c-4368-8767-a3834f8a8a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18696-65b2-4b9f-8692-d1fa7c2e5897", "name": "network-vif-unplugged", "status": "completed", "tag": "351efc05-b53e-4c94-986a-8bac70939ff1"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:37.577177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55eb4bd0-8274-41b7-b001-2676fb6bddcb req-4e5fe379-6d6c-4368-8767-a3834f8a8a29 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.577925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55eb4bd0-8274-41b7-b001-2676fb6bddcb req-4e5fe379-6d6c-4368-8767-a3834f8a8a29 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.615425 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-55eb4bd0-8274-41b7-b001-2676fb6bddcb req-4e5fe379-6d6c-4368-8767-a3834f8a8a29 service nova] Creating event network-vif-unplugged:351efc05-b53e-4c94-986a-8bac70939ff1 for instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 on n-h2-843861-3 Jul 19 19:51:37.621188 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-55eb4bd0-8274-41b7-b001-2676fb6bddcb req-4e5fe379-6d6c-4368-8767-a3834f8a8a29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059495 Jul 19 19:51:37.622443 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 733/1449] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:37.631544 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-916bceff-53d9-4976-a545-f9b5a8ec6034 tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.276570 Jul 19 19:51:37.632075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:37.633036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:37.637344 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 717/1450] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 19 19:51:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:37.641102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.641833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.642902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.643557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.666969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3694279b-94ac-4929-b90b-bd5154405a34 req-24bf6d8b-e7e3-472c-8794-df8615738d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6710ce1-4b25-43a4-bf46-ea323108e492", "tag": "ca9c8076-1a2e-4f89-a794-b419facd409f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:37.685651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3694279b-94ac-4929-b90b-bd5154405a34 req-24bf6d8b-e7e3-472c-8794-df8615738d9d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.686103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3694279b-94ac-4929-b90b-bd5154405a34 req-24bf6d8b-e7e3-472c-8794-df8615738d9d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.719415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3694279b-94ac-4929-b90b-bd5154405a34 req-24bf6d8b-e7e3-472c-8794-df8615738d9d service nova] Creating event network-changed:ca9c8076-1a2e-4f89-a794-b419facd409f for instance e6710ce1-4b25-43a4-bf46-ea323108e492 on n-h1-843861-3 Jul 19 19:51:37.739657 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3694279b-94ac-4929-b90b-bd5154405a34 req-24bf6d8b-e7e3-472c-8794-df8615738d9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098280 Jul 19 19:51:37.758947 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 718/1451] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:37.787456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:37.796116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:37.804094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.805031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.806402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.807008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.122190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.130531 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45c8fc49-108f-4f86-bd07-fc8a5f8a97e4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 0.369256 Jul 19 19:51:38.131116 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 719/1452] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:37 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:38.139417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.142152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:38.165001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:38.168516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.173745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.174560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.175007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.196592 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e64f8d2-cb42-46c0-90da-25c625e9ede8 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 2422 microversion: 2.25 time: 0.572634 Jul 19 19:51:38.211641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 734/1453] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:37 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 2422 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:38.224240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.228009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.232092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.servers [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Removing options 'limit' from query {{(pid=126008) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:51:38.236184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:38.238532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.241296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.242761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.260716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.262214 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e3b482d-a057-44f6-a3ac-66d7b77e086e tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.047704 Jul 19 19:51:38.272933 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 735/1454] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:51:38.278015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-050a809b-ef9d-41d4-b0a1-3db0e591d4c8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.283098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-050a809b-ef9d-41d4-b0a1-3db0e591d4c8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:38.423789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-050a809b-ef9d-41d4-b0a1-3db0e591d4c8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.437863 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-050a809b-ef9d-41d4-b0a1-3db0e591d4c8 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1207 microversion: 2.1 time: 0.158361 Jul 19 19:51:38.439129 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 736/1455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1207 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:38.444703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23977173-452e-412d-a8a8-00cf6636b1f4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dfaed30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.483843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.495801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f930538a-72c5-4310-9fd6-2e360156273b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.360121 Jul 19 19:51:38.496420 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 720/1456] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:38.511477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2090325660", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:38.552998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23977173-452e-412d-a8a8-00cf6636b1f4 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.112417 Jul 19 19:51:38.554163 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 737/1457] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:38.568850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.569749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:38.586901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.592768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.593891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.595064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.638234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:38.977403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.985783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f72a5138-b780-4113-b8ea-c6089c7ca2b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1512 microversion: 2.1 time: 0.430233 Jul 19 19:51:38.987064 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 738/1458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:38.997542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.998324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.006244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.007031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.008060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.008704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.032874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Getting quotas for project addb1392d3f74ee5938f7818931f280a. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:39.041564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Getting quotas for user 1b4e4126cff2413db184fd77603fa317 and project addb1392d3f74ee5938f7818931f280a. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:39.056729 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Request method failure captured: Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 1752 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wtIhKtVb7UAVBNQ-CBd3FVJy92n4zPdXscDb9Q743Bqa56-OrFnFn0zKFDNZy3h15SxNZ_XD5wLiz8Yi2DsXVtJ9nWu_WGGghw0X_7Q62hU9W0EIbiLwPISmE8Kpn7oKFe1xbq8qIXyxPzhMHrOfApYGLDpnPiPNACeLE1Zz-HOMcA Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: addb1392d3f74ee5938f7818931f280a Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2108376790 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/addb1392d3f74ee5938f7818931f280a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/addb1392d3f74ee5938f7818931f280a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/addb1392d3f74ee5938f7818931f280a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_addb1392d3f74ee5938f7818931f280a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2108376790 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: addb1392d3f74ee5938f7818931f280a Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2108376790 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1b4e4126cff2413db184fd77603fa317 Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2090325660", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:51:39.059129 n-d-843861-3 devstack@n-api.service[126007]: exception: Maximum number of metadata items exceeds 128 Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2090325660', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:51:39.062019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:39.066125 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-604752cd-08e8-4c9d-867e-63b45ab45c8a tempest-AbsoluteLimitsNegativeTestJSON-2108376790 tempest-AbsoluteLimitsNegativeTestJSON-2108376790-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.556339 Jul 19 19:51:39.069842 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 721/1459] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Jul 19 19:51:38 2022] POST /compute/v2.1/servers => generated 87 bytes in 573 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:39.077394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9a04ec4b-15f8-4979-82f1-ef51719e4b43 req-0b068f0f-6172-4c40-8802-1a9cf3798b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18696-65b2-4b9f-8692-d1fa7c2e5897", "name": "network-vif-deleted", "tag": "351efc05-b53e-4c94-986a-8bac70939ff1"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:39.086471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:39.088591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9a04ec4b-15f8-4979-82f1-ef51719e4b43 req-0b068f0f-6172-4c40-8802-1a9cf3798b55 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.089462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9a04ec4b-15f8-4979-82f1-ef51719e4b43 req-0b068f0f-6172-4c40-8802-1a9cf3798b55 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.109197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9a04ec4b-15f8-4979-82f1-ef51719e4b43 req-0b068f0f-6172-4c40-8802-1a9cf3798b55 service nova] Creating event network-vif-deleted:351efc05-b53e-4c94-986a-8bac70939ff1 for instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 on n-h2-843861-3 Jul 19 19:51:39.114779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9a04ec4b-15f8-4979-82f1-ef51719e4b43 req-0b068f0f-6172-4c40-8802-1a9cf3798b55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043537 Jul 19 19:51:39.116183 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 722/1460] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:39.122720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.123704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.131237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.132103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.133199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.133889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.303234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lazy-loading 'services' on Instance uuid 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:39.479759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:39.487963 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-81c604e5-c28d-4c6d-8646-dbc94e2c43dc tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1511 microversion: 2.1 time: 0.370360 Jul 19 19:51:39.489006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0561a83d-97cf-492d-bb90-e159d226e408 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments/f0f12559-3e88-49ec-98eb-b2e854bf202e" status: 202 len: 0 microversion: 2.25 time: 0.499595 Jul 19 19:51:39.492747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 739/1461] 10.222.0.33 () {60 vars in 1456 bytes} [Tue Jul 19 19:51:38 2022] DELETE /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments/f0f12559-3e88-49ec-98eb-b2e854bf202e => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:39.500940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 723/1462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:39.506457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.507256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.513803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.514621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.518152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.518919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.520481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.521133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.538696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.539157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.539981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.540425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.840169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:39.867705 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6f9e352-7ad6-4208-b6e1-0824433380dd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1259 microversion: 2.1 time: 0.365280 Jul 19 19:51:39.882154 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 724/1463] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1259 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:39.892667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.894421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.902972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.903673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.904637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.905227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.947920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-153fdaef-9c36-4068-b9fb-97f4dcb535b6 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.063709 Jul 19 19:51:39.948904 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 725/1464] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:39.959921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.961124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.968975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.969632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.970417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.971272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.389664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:40.398168 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d51013c-61e8-4e00-ac91-274e9157d1db tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 0.907027 Jul 19 19:51:40.418355 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 740/1465] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:40.423519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:40.424166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:40.432360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.432821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.433595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.434030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.504299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:40.611923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:40.626396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0709e40-7a44-4306-8ed7-a149a70a6c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.676020 Jul 19 19:51:40.641848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 726/1466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:40.649324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a828f73-33ab-407d-8a23-d7cbea5f1524 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dc59b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:40.732015 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a828f73-33ab-407d-8a23-d7cbea5f1524 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.097615 Jul 19 19:51:40.734561 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 727/1467] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:40 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:40.892782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:40.894121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:40.913394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.916211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.917458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.921822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.512966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.521310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.532495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-38354e4a-21a9-4108-87d7-874131722a1d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1512 microversion: 2.1 time: 1.112933 Jul 19 19:51:41.536230 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8ff321c-d118-4faa-a743-fccdc5d81385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.651732 Jul 19 19:51:41.537818 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 741/1468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:40 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1512 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:41.555573 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 728/1469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:40 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:41.570474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:41.571266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:41.573424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:41.574324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:41.592452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.592843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.593625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.594060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.599951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.600409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.601199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.601832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.692311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cd22623-2381-4498-a5b5-ef404ef7919e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135115 Jul 19 19:51:41.696227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 742/1470] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:41 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:41.708646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:41.716071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.717032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:42.158584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.159325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:42.161803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.162436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:42.326632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:42.335570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d69840b-3ae4-4e3a-9b92-18d09257dc47 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 0.777622 Jul 19 19:51:42.350142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:42.351594 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 729/1471] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:41 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:42.369775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:42.373959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:42.394277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.400807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:42.401742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.402203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:42.436844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:42.486458 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e82042fc-12d8-49f2-914e-2466c1cb2b71 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.788695 Jul 19 19:51:42.496349 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 743/1472] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Jul 19 19:51:41 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:42.508569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-463f155c-ab62-46db-83b2-aa562cd74f79 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e1f9d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:42.581384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-463f155c-ab62-46db-83b2-aa562cd74f79 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.083284 Jul 19 19:51:42.589426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 744/1473] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:42 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:42.601530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:42.608068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:42.619778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.620533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:42.621613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:42.622320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.522994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:43.539361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18319cf8-2461-47eb-b787-caacb9df7afb tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1512 microversion: 2.1 time: 0.948240 Jul 19 19:51:43.555639 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 745/1474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:42 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1512 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:43.567728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:43.568836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:43.584818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.586074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:43.592299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.594819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.596108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.607320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-acfd5ea8-a4ac-4f36-9ed7-c4599c54a72b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.254410 Jul 19 19:51:43.632112 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 730/1475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:42 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:43.672509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:43.681315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:43.706905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.708124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.708989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.709425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.835555 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1b1ef0a-1854-41ec-babf-fd9c920e4d51 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.200568 Jul 19 19:51:43.844246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 731/1476] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:43 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:43.850876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:43.851550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:43.899588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.900942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:43.901795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:43.902236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:44.794088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:44.810193 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6fb99ff-6e7e-4611-aee8-68b5b5b5a476 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 1.252889 Jul 19 19:51:44.810813 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 746/1477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:43 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:44.824548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:44.825199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:44.839104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:44.839618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:44.841032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:44.841480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:44.880082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:44.890387 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7240ba0d-ee31-4147-bd40-47664e8b796b tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 1.044748 Jul 19 19:51:44.892351 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 732/1478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:43 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:44.897678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffac4a49-09a3-48c9-b32b-0cd612229744 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dad8ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:44.972579 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffac4a49-09a3-48c9-b32b-0cd612229744 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.078874 Jul 19 19:51:44.973209 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 733/1479] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:44 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:44.983458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-37de3ef7-e956-4e0c-8391-eca3206090c9 req-dc7e83da-93ec-4534-9ba9-a9b8f45fb8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d03653-102d-4d49-828e-f11082c2e611", "tag": "f32ac764-1592-47ee-a500-ad9c58628726"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:44.993345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-37de3ef7-e956-4e0c-8391-eca3206090c9 req-dc7e83da-93ec-4534-9ba9-a9b8f45fb8ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:44.994032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-37de3ef7-e956-4e0c-8391-eca3206090c9 req-dc7e83da-93ec-4534-9ba9-a9b8f45fb8ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.013117 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-37de3ef7-e956-4e0c-8391-eca3206090c9 req-dc7e83da-93ec-4534-9ba9-a9b8f45fb8ce service nova] Creating event network-changed:f32ac764-1592-47ee-a500-ad9c58628726 for instance 64d03653-102d-4d49-828e-f11082c2e611 on n-h2-843861-3 Jul 19 19:51:45.030295 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-37de3ef7-e956-4e0c-8391-eca3206090c9 req-dc7e83da-93ec-4534-9ba9-a9b8f45fb8ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045785 Jul 19 19:51:45.031294 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 734/1480] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:45.039364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f3c5839d-6137-4dc8-97c8-5139541b3834 req-3011981a-f663-4b3b-acb3-bf8e3e698beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6710ce1-4b25-43a4-bf46-ea323108e492", "name": "network-vif-plugged", "status": "completed", "tag": "ca9c8076-1a2e-4f89-a794-b419facd409f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:45.049431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f3c5839d-6137-4dc8-97c8-5139541b3834 req-3011981a-f663-4b3b-acb3-bf8e3e698beb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.050540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f3c5839d-6137-4dc8-97c8-5139541b3834 req-3011981a-f663-4b3b-acb3-bf8e3e698beb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.063839 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f3c5839d-6137-4dc8-97c8-5139541b3834 req-3011981a-f663-4b3b-acb3-bf8e3e698beb service nova] Creating event network-vif-plugged:ca9c8076-1a2e-4f89-a794-b419facd409f for instance e6710ce1-4b25-43a4-bf46-ea323108e492 on n-h1-843861-3 Jul 19 19:51:45.069364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f3c5839d-6137-4dc8-97c8-5139541b3834 req-3011981a-f663-4b3b-acb3-bf8e3e698beb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Jul 19 19:51:45.075136 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 735/1481] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:45.088109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:45.106306 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-45d9dc67-22bb-4c1f-8a65-4a5fb9ee4759 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1511 microversion: 2.1 time: 0.290104 Jul 19 19:51:45.107903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 747/1482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:44 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:45.114744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:45.116693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:45.126935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.127997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.129160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:45.132816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:45.146890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.147635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.148635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.149238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.151381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.156867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.224096 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f7c996b-66cd-4e6d-b024-447fe00206e0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113296 Jul 19 19:51:45.231083 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 748/1483] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:45 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:45.236089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:45.236711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:45.244513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.244921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.245752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.246105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.524864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:45.535583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d4056dd-2f49-4351-97f2-87fac81cdc47 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.430634 Jul 19 19:51:45.548406 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 736/1484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:45 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:45.569673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:45.580532 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-272d2944-f169-411e-b615-919176400eee tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1512 microversion: 2.1 time: 0.348293 Jul 19 19:51:45.592321 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 749/1485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:45 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:45.598851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:45.602517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:45.603611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:45.609598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.610047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.610850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.611286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.646759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:45.728100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:45.736654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.737343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.828169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:45.829413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:45.841006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.846479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:45.851248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:45.854922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.265993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6aba3d70-9b87-4b51-9711-9d2196496302 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.670605 Jul 19 19:51:46.268095 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 737/1486] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:51:45 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:46.273518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:46.275934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:46.290445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.296482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.298841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.299903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.400350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:46.408565 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-efcf84a9-9da4-467a-b4b8-c411d1504517 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.584509 Jul 19 19:51:46.411912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 750/1487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:45 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:46.419055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1a400a8-b6b6-44bc-b729-df4d6ff7fb15 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e1140d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:46.522735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1a400a8-b6b6-44bc-b729-df4d6ff7fb15 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.109465 Jul 19 19:51:46.526075 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 751/1488] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:46 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:46.538861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:46.540083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:46.565298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.567200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.573185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.573833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.636910 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dded2735-190a-4a55-8726-bc3cd2ddd4b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108256 Jul 19 19:51:46.644579 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 752/1489] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:46 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:46.654979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:46.676451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:46.677172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:46.714978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:46.731321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72cdb7f7-5273-4c15-b3a0-61bee10ef33e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1366 microversion: 2.1 time: 0.461153 Jul 19 19:51:46.733457 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 738/1490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:46 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:46.746529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:46.748877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:46.770860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.771928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.796018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.796740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.798462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.799110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.804583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:46.805293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:46.935323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:46.991248 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-88c6cf9c-7886-4318-bccd-6514190748b3 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1011 microversion: 2.1 time: 0.344786 Jul 19 19:51:47.001504 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 753/1491] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 19:51:46 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1011 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:47.018306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.024247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:47.025183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:47.054416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.055502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.057092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.057968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.212525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:47.225341 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b79578e5-3fa9-4b55-9868-29d7136c97c8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.490170 Jul 19 19:51:47.227145 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 739/1492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:46 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:47.251201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:47.339939 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7387382-efcf-49dc-8c1c-a033504d1b5d tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.336472 Jul 19 19:51:47.340954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 754/1493] 10.222.0.33 () {58 vars in 1211 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:47.359643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.484540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.485498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.580581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:47.676333 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ed5fa3b-d54b-4c34-850d-a8a28cacf658 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.321192 Jul 19 19:51:47.679104 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 740/1494] 10.222.0.33 () {58 vars in 1195 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:47.686496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1b2e062b-b233-4128-9013-51e24e6e8b96 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dad8ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.810741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1b2e062b-b233-4128-9013-51e24e6e8b96 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.129643 Jul 19 19:51:47.814082 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 741/1495] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:47.826688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.827950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:47.846032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.846776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.847980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.849317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.940800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91b4ba21-ae61-4f41-adab-2fb23f535922 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125337 Jul 19 19:51:47.942114 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 742/1496] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:51:47.958788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:47.969529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:47.970399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': '1410589508', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:47.984304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.984764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.988024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:47.988545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:47.990765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:48.001222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3078361-5345-4cfe-99a5-b3a6b8d495d0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.576410 Jul 19 19:51:48.003261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 755/1497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:48.014319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.024109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:48.037537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.040274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.041290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.045765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.343192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:48.432299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:48.485446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:48.500385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-904d27e1-b370-40e0-ab18-0779fd5b7cd5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1556 microversion: 2.1 time: 0.494360 Jul 19 19:51:48.500993 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 756/1498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1556 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:48.508930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.510947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:48.525044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.531294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.532459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.533083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.611261 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4610273-29a4-4467-ad77-3f3b57816f5b tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=1410589508" status: 200 len: 346 microversion: 2.1 time: 0.667828 Jul 19 19:51:48.618672 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 743/1499] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Jul 19 19:51:47 2022] GET /compute/v2.1/servers?name=1410589508 => generated 346 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:48.642129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.647773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:48.660562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.661899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.665315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.666812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.869174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-90573a40-ed53-4417-b5fc-d86399154b1d tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249176 Jul 19 19:51:48.870127 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 744/1500] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:48.874788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.878474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:48.879215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:48.901450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.901907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.902715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.903153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.071456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:49.088784 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e393905-ffd3-4baf-9f74-43ae28d905b5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.586473 Jul 19 19:51:49.089994 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 757/1501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.094937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c548a131-5ecf-4803-9c56-b9a49055b6c0 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e670550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.169673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c548a131-5ecf-4803-9c56-b9a49055b6c0 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1422 microversion: 2.1 time: 0.078372 Jul 19 19:51:49.170277 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 758/1502] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.181598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.182310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:49.214568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:49.233969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.235681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.239066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.240307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.309109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:49.316374 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f04fc7ee-b3db-443d-b31d-d39926e6d0fd tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.139316 Jul 19 19:51:49.319859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 759/1503] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.331662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.332510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:49.358567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.359006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.359768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.360221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.369947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6d525b9-105c-4405-94a2-8d1545203f76 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.498733 Jul 19 19:51:49.376373 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 745/1504] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.424709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.437425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:49.439369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-141058950', 'deleted': False, 'project_id': '332379ea56cd49c6b5faf3f19674d175'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:51:49.446986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.447741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.449635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.450271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.626515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:51:49.675746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:49.693982 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c3225ea-1ce3-4e91-9a6d-dce28fc51fcf tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.366346 Jul 19 19:51:49.695113 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 760/1505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.741995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91e96f69-aaac-422a-8470-8af79f2bca6a tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-141058950" status: 200 len: 346 microversion: 2.1 time: 0.357349 Jul 19 19:51:49.743205 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 746/1506] 10.222.0.33 () {58 vars in 1227 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-141058950 => generated 346 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:49.753535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.756969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:49.763946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.765666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.767174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.767999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.800960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:51:49.948409 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31bed28d-e33b-45ad-af4d-647c7964d274 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 204 len: 0 microversion: 2.1 time: 0.198241 Jul 19 19:51:49.950024 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 761/1507] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:49 2022] DELETE /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:49.959192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.960240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:49.973296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.974255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.976055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.976774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.110593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.112145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:50.129788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.135785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.137377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.138368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.318814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.331193 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-718428fd-9464-4ab2-b894-71cde12e4bf2 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1518 microversion: 2.1 time: 0.376961 Jul 19 19:51:50.333645 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 747/1508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.349988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5e8deb6-558d-4597-b368-6d3d2b714586 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dd74ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.433916 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5e8deb6-558d-4597-b368-6d3d2b714586 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1431 microversion: 2.1 time: 0.098772 Jul 19 19:51:50.440648 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 748/1509] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1431 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.446497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5424863d-2a8c-4a7b-b3f6-5e19931485d7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dd74790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.449782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.459203 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27613933-a349-4177-9973-28c1ddc23019 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.355416 Jul 19 19:51:50.473851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 762/1510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:50.508183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5424863d-2a8c-4a7b-b3f6-5e19931485d7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 200 len: 1431 microversion: 2.1 time: 0.066149 Jul 19 19:51:50.525271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.525825 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 749/1511] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 1431 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.526516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:50.534946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.535621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.536591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.537177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.714091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.717688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:50.741412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.742469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.743276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.744723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.747294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.752314 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ddfb7c9-3043-4fdd-b31b-edb3ba810474 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1466 microversion: 2.1 time: 0.235134 Jul 19 19:51:50.753463 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 763/1512] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.775187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eadf78a9-ec3e-4101-80f4-ed2f6803a9c3 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e0b6d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.859950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eadf78a9-ec3e-4101-80f4-ed2f6803a9c3 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046" status: 200 len: 784 microversion: 2.1 time: 0.094771 Jul 19 19:51:50.860645 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 764/1513] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046 => generated 784 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:51:50.875874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01bec587-b461-4964-a2eb-763e91e22f96 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.941324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01bec587-b461-4964-a2eb-763e91e22f96 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.069022 Jul 19 19:51:50.947061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 765/1514] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:50.973719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4439a3a6-1994-4197-9b90-0dfed92a9d32 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e5ec790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:51.110709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:51.116102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:51.125456 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f3802a7-4d41-4065-9940-0a967c6c2b93 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.417368 Jul 19 19:51:51.126905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 750/1515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:51.349880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:51.350913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:51.375276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:51.377253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:51.379380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:51.380978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:51.995386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:52.012842 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e316ccb9-506a-427d-9a2e-265984235f55 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1518 microversion: 2.1 time: 0.666240 Jul 19 19:51:52.028390 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 751/1516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:51 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1518 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:52.040151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:52.041053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.054471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.061166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.062249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.063107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.102502 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4439a3a6-1994-4197-9b90-0dfed92a9d32 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "DELETE /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 204 len: 0 microversion: 2.1 time: 1.139653 Jul 19 19:51:52.103195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 766/1517] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:50 2022] DELETE /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 0 bytes in 1154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:51:52.531691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fb785f64-0362-4b52-bde5-51e41ef8c2ff req-c649a481-9387-40c4-899c-490d1dff37e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6710ce1-4b25-43a4-bf46-ea323108e492", "tag": "ca9c8076-1a2e-4f89-a794-b419facd409f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:52.563227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb785f64-0362-4b52-bde5-51e41ef8c2ff req-c649a481-9387-40c4-899c-490d1dff37e7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.564344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb785f64-0362-4b52-bde5-51e41ef8c2ff req-c649a481-9387-40c4-899c-490d1dff37e7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.595214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:52.650864 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b44ecdb7-a2ff-45d6-bc0e-2134b373a5b7 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.620903 Jul 19 19:51:52.654906 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 752/1518] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:52 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:52.658189 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fb785f64-0362-4b52-bde5-51e41ef8c2ff req-c649a481-9387-40c4-899c-490d1dff37e7 service nova] Creating event network-changed:ca9c8076-1a2e-4f89-a794-b419facd409f for instance e6710ce1-4b25-43a4-bf46-ea323108e492 on n-h1-843861-3 Jul 19 19:51:52.669301 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fb785f64-0362-4b52-bde5-51e41ef8c2ff req-c649a481-9387-40c4-899c-490d1dff37e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.564291 Jul 19 19:51:52.671290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa42c16b-e095-4a7c-a239-c0283f9c3d54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dddb4c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:52.695224 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 767/1519] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:52.718600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:52.719680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.727701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.728646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.729635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.730329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.744276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fa42c16b-e095-4a7c-a239-c0283f9c3d54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] HTTP exception thrown: Image not found. Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa42c16b-e095-4a7c-a239-c0283f9c3d54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Request method failure captured: Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 HTTP/1.1 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsliWblvjT6NNzzX34wUhwwgJEwfFBI9mnIRUUDECOx8_e-O9oUkXMj3jaPQa6dbBStc4cq4C3SgFPvuaMsSJmiyRaeofMDOF667roJkRqYa70UD8nACUSyRXRuOQ_3egEx7Ig1iUVva-95UTLdV80hhtxq5x6jiQ64bNuWfep6M3Y Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: a46b81a600b04c218f5570cb02f15fdd Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '553612a9-c377-421c-a6c1-bff886060570'} Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 553612a9-c377-421c-a6c1-bff886060570 Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:51:52.745822 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 553612a9-c377-421c-a6c1-bff886060570 could not be found. Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa42c16b-e095-4a7c-a239-c0283f9c3d54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa42c16b-e095-4a7c-a239-c0283f9c3d54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 404 len: 62 microversion: 2.1 time: 0.090620 Jul 19 19:51:52.750570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 753/1520] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:52 2022] GET /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:52.771125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-676680281"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:52.773257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.803233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.807237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.813531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.814745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.390624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2dc320a0-fb9b-4c02-bfe4-036820fe238d tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "POST /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a/action" status: 202 len: 0 microversion: 2.1 time: 0.632133 Jul 19 19:51:53.392405 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 754/1521] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:52 2022] POST /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 19:51:53.412642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.414897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:53.440776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.442890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.447380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.448633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.587550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.614503 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5ec0fd82-d9d5-4f06-a259-b4d0d97d047c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.913629 Jul 19 19:51:53.614934 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 768/1522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:52 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:53.619637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81be6a60-8038-46c8-aa3a-e2b6a318fd61 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e1f9d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.777149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81be6a60-8038-46c8-aa3a-e2b6a318fd61 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.161114 Jul 19 19:51:53.778111 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 769/1523] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:53.786736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.790994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:53.807545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.810980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.812044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.812675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.101663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:54.122246 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f04830af-550b-4607-9d46-ff2a02c9f4f7 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1518 microversion: 2.1 time: 0.722570 Jul 19 19:51:54.123292 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 755/1524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1518 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:54.133074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f62eb918-3db9-4983-9f14-318c20cf54d7 req-bd5f0e57-7508-48ab-9f71-ef1cf862a64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d03653-102d-4d49-828e-f11082c2e611", "name": "network-vif-plugged", "status": "completed", "tag": "f32ac764-1592-47ee-a500-ad9c58628726"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:54.156301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f62eb918-3db9-4983-9f14-318c20cf54d7 req-bd5f0e57-7508-48ab-9f71-ef1cf862a64f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.157151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f62eb918-3db9-4983-9f14-318c20cf54d7 req-bd5f0e57-7508-48ab-9f71-ef1cf862a64f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.178168 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f62eb918-3db9-4983-9f14-318c20cf54d7 req-bd5f0e57-7508-48ab-9f71-ef1cf862a64f service nova] Creating event network-vif-plugged:f32ac764-1592-47ee-a500-ad9c58628726 for instance 64d03653-102d-4d49-828e-f11082c2e611 on n-h2-843861-3 Jul 19 19:51:54.185341 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f62eb918-3db9-4983-9f14-318c20cf54d7 req-bd5f0e57-7508-48ab-9f71-ef1cf862a64f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060519 Jul 19 19:51:54.186169 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 756/1525] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:54.429114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:54.446244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-38bfd2df-d97d-47e9-a58b-901a20a57ed4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.666845 Jul 19 19:51:54.446845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 770/1526] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:54.570650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-047b6bd7-98f7-43eb-82c1-1c6263217984 req-8c602e29-ecdf-4885-8bcc-e27578bd925e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4f06a1-6e7a-45dc-93b3-21eb58d3038c", "name": "network-vif-deleted", "tag": "8627d63a-11ab-4d71-9178-4b3d01b1773d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:54.604213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-047b6bd7-98f7-43eb-82c1-1c6263217984 req-8c602e29-ecdf-4885-8bcc-e27578bd925e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.604740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-047b6bd7-98f7-43eb-82c1-1c6263217984 req-8c602e29-ecdf-4885-8bcc-e27578bd925e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.635558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:54.636234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:54.667063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.667310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.668656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-047b6bd7-98f7-43eb-82c1-1c6263217984 req-8c602e29-ecdf-4885-8bcc-e27578bd925e service nova] Creating event network-vif-deleted:8627d63a-11ab-4d71-9178-4b3d01b1773d for instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c on n-h2-843861-3 Jul 19 19:51:54.675424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.679051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.691631 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-047b6bd7-98f7-43eb-82c1-1c6263217984 req-8c602e29-ecdf-4885-8bcc-e27578bd925e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128209 Jul 19 19:51:54.699090 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 757/1527] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:54.791591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2394f61-d018-461a-9816-7224f8eefa4f tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88dd68dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:54.896180 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d2394f61-d018-461a-9816-7224f8eefa4f tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.106001 Jul 19 19:51:54.896833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 758/1528] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:54 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:55.139379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.140416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.151737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.152683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.153664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.154271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.229402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.231461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.234456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lazy-loading 'fault' on Instance uuid bc4f06a1-6e7a-45dc-93b3-21eb58d3038c {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:55.256182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.268287 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fef3985a-2f79-40ca-953d-3201bd76b854 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.641427 Jul 19 19:51:55.283465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 771/1529] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:54 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:55.376845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Calling method '.version_select at 0x7fb88e391430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.405802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.425788 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c8abc73-b8e8-4c86-bdda-f21512b96933 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 200 len: 1311 microversion: 2.1 time: 0.289745 Jul 19 19:51:55.429546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 759/1530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:55.462657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.463271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.482203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.482786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.486516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.487016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.694308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:51:55.695568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Neutron security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:51:55.696517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] HTTP exception thrown: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.696517 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Request method failure captured: Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c HTTP/1.1 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wtbTXcTD_MRk8ToeD0IchoxQiP__oMTdsw7QNGAlFPLplzS8DGAnnW7ChFbR4YD-BQriWk_5ptsy7knkPm-2iQRt0iBGIGruxfFml1vMY-iJUq7yJJxU0NK7f5_Uf5id8VC-BClEo6uhpIHX2K7e6EHApDE48pzs5lnjJX8_IQA8EU Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 365e44686b38444cae6eb1be681830b8 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c'} Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:51:55.699634 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] Jul 19 19:51:55.704604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.710375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Returning 404 to user: Security group 5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c does not exist Jul 19 19:51:55.710375 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-60b1b7e4-3a04-410d-ac18-76f56704e736'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:55.711761 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed1ac40d-8f33-4d23-bb27-a4058d9c5602 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c" status: 404 len: 194 microversion: 2.1 time: 0.427193 Jul 19 19:51:55.714163 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 772/1531] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:51:55 2022] DELETE /compute/v2.1/os-security-groups/5e0f67ad-cac2-4b54-ae6d-3a13bbdee24c => generated 194 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:55.727323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=14 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:55.731495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f73e07b4-e7b0-4e02-8583-9fe80f379980 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004667 Jul 19 19:51:55.738011 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 773/1532] 10.222.0.33 () {58 vars in 1163 bytes} [Tue Jul 19 19:51:55 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:51:55.756413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b71d1a31-8181-4c63-bd0d-6d3519a861fd tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Calling method '.version_select at 0x7fb88e391430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.944581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.967344 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d4dd7278-0695-4c0a-abc3-614c93b86108 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.507996 Jul 19 19:51:55.983718 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 760/1533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:55.991999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-631cc91c-3450-41b9-b834-1b8b24cbc1c7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e22ea60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.076437 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-631cc91c-3450-41b9-b834-1b8b24cbc1c7 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.091193 Jul 19 19:51:56.077327 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 761/1534] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:56.146636 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b71d1a31-8181-4c63-bd0d-6d3519a861fd tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.396196 Jul 19 19:51:56.155123 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 774/1535] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:56.159664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Calling method '.version_select at 0x7fb88dde0af0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.289458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.290088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.306813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.311195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.313727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.316183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.332821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:51:56.333730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 19 19:51:56.333730 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Request method failure captured: Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-security-groups/49ce01cc-8f28-4343-a6ef-589d81341ca0 HTTP/1.1 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wtbTXcTD_MRk8ToeD0IchoxQiP__oMTdsw7QNGAlFPLplzS8DGAnnW7ChFbR4YD-BQriWk_5ptsy7knkPm-2iQRt0iBGIGruxfFml1vMY-iJUq7yJJxU0NK7f5_Uf5id8VC-BClEo6uhpIHX2K7e6EHApDE48pzs5lnjJX8_IQA8EU Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 365e44686b38444cae6eb1be681830b8 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: exception: Insufficient rights for removing default security group. Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '49ce01cc-8f28-4343-a6ef-589d81341ca0'} Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:51:56.336159 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 19 19:51:56.341057 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-c7130785-c575-4251-9041-3cec42475819'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:56.345095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbf67f78-730a-4015-82b0-2f30ce34cd75 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/49ce01cc-8f28-4343-a6ef-589d81341ca0" status: 400 len: 182 microversion: 2.1 time: 0.189596 Jul 19 19:51:56.345637 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 762/1536] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 19:51:56 2022] DELETE /compute/v2.1/os-security-groups/49ce01cc-8f28-4343-a6ef-589d81341ca0 => generated 182 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:51:56.352318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-871cbf50-933e-49ac-9ffc-f9f2a12f4d1d req-b510f44c-6dc7-4a3c-8f5c-a69b889c9217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-unplugged", "status": "completed", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:56.361957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-871cbf50-933e-49ac-9ffc-f9f2a12f4d1d req-b510f44c-6dc7-4a3c-8f5c-a69b889c9217 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.362548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-871cbf50-933e-49ac-9ffc-f9f2a12f4d1d req-b510f44c-6dc7-4a3c-8f5c-a69b889c9217 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.378644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-871cbf50-933e-49ac-9ffc-f9f2a12f4d1d req-b510f44c-6dc7-4a3c-8f5c-a69b889c9217 service nova] Creating event network-vif-unplugged:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:51:56.387417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-871cbf50-933e-49ac-9ffc-f9f2a12f4d1d req-b510f44c-6dc7-4a3c-8f5c-a69b889c9217 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039793 Jul 19 19:51:56.388521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 763/1537] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:56.397970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Calling method '.version_select at 0x7fb88de79ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.470209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:51:56.471096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Neutron security group 9cd475b4-6871-403a-9556-d417d8f75ba4 not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:51:56.471887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] HTTP exception thrown: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.471887 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Request method failure captured: Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-security-groups/9cd475b4-6871-403a-9556-d417d8f75ba4 HTTP/1.1 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wtbTXcTD_MRk8ToeD0IchoxQiP__oMTdsw7QNGAlFPLplzS8DGAnnW7ChFbR4YD-BQriWk_5ptsy7knkPm-2iQRt0iBGIGruxfFml1vMY-iJUq7yJJxU0NK7f5_Uf5id8VC-BClEo6uhpIHX2K7e6EHApDE48pzs5lnjJX8_IQA8EU Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 365e44686b38444cae6eb1be681830b8 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9cd475b4-6871-403a-9556-d417d8f75ba4'} Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:51:56.475069 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] Jul 19 19:51:56.480383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.484885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Returning 404 to user: Security group 9cd475b4-6871-403a-9556-d417d8f75ba4 does not exist Jul 19 19:51:56.484885 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-9e1ce089-4b33-47c5-8bc1-3838470cb782'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:56.485751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9dfc470b-c136-4aa5-9d3c-53dd32ebd9d3 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/9cd475b4-6871-403a-9556-d417d8f75ba4" status: 404 len: 194 microversion: 2.1 time: 0.094373 Jul 19 19:51:56.486324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 764/1538] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/os-security-groups/9cd475b4-6871-403a-9556-d417d8f75ba4 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:56.494672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.495412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: bc4f06a1-6e7a-45dc-93b3-21eb58d3038c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.512976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.515006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.516540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.516540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.536763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] HTTP exception thrown: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Request method failure captured: Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c HTTP/1.1 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsN7W14FZnii3Bhnf3su0zZc9kPifpFJZtH6c_fxZ_EoJSYWPKmOnryeRNlaVRBIFzz87Nu9BVbyQezyGoNiB9NxCYLcTYADBPBPMJaSZKDpnsDGwE89XgZNWyfk_DlAB991L_4b-kinj-jPBYIrhF15PynI_1NVatr4gRtLMfj12Q Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 15e70c76f9914eb3a2c0a2e067dfb1b6 Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'bc4f06a1-6e7a-45dc-93b3-21eb58d3038c'} Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.540695 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.545650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Returning 404 to user: Instance bc4f06a1-6e7a-45dc-93b3-21eb58d3038c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:56.546222 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea9f4a69-b8f7-47ca-8673-097ec8ec32e6 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c" status: 404 len: 111 microversion: 2.1 time: 0.058527 Jul 19 19:51:56.549954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 765/1539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/bc4f06a1-6e7a-45dc-93b3-21eb58d3038c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:56.561727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Action: 'update', calling method: .version_select at 0x7fb88e385310>, body: {"security_group": {"name": "tempest-sg-79165562", "description": "tempest-description-270788154"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:56.647930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:56.653469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:51:56.654509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Neutron security group 8c076b21-8d3d-4738-9a83-615dd36d3bad not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:51:56.655215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] HTTP exception thrown: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.655215 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Request method failure captured: Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/os-security-groups/8c076b21-8d3d-4738-9a83-615dd36d3bad HTTP/1.1 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 99 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wtbTXcTD_MRk8ToeD0IchoxQiP__oMTdsw7QNGAlFPLplzS8DGAnnW7ChFbR4YD-BQriWk_5ptsy7knkPm-2iQRt0iBGIGruxfFml1vMY-iJUq7yJJxU0NK7f5_Uf5id8VC-BClEo6uhpIHX2K7e6EHApDE48pzs5lnjJX8_IQA8EU Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e6dfc40b78242cbba36702d771fd107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6e6dfc40b78242cbba36702d771fd107 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-327103031 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 365e44686b38444cae6eb1be681830b8 Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-327103031-project Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: {"security_group": {"name": "tempest-sg-79165562", "description": "tempest-description-270788154"}} Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '8c076b21-8d3d-4738-9a83-615dd36d3bad', 'body': {'security_group': {'name': 'tempest-sg-79165562', 'description': 'tempest-description-270788154'}}} Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:51:56.658772 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] Returning 404 to user: Security group 8c076b21-8d3d-4738-9a83-615dd36d3bad does not exist Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-5f1708db-2d53-4fb5-8eac-ab472ea4401c'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4acd2f91-decd-4e70-9c17-71b1dfe5f452 tempest-SecurityGroupsNegativeTestJSON-327103031 tempest-SecurityGroupsNegativeTestJSON-327103031-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/8c076b21-8d3d-4738-9a83-615dd36d3bad" status: 404 len: 194 microversion: 2.1 time: 0.109259 Jul 19 19:51:56.663552 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 766/1540] 10.222.0.33 () {60 vars in 1288 bytes} [Tue Jul 19 19:51:56 2022] PUT /compute/v2.1/os-security-groups/8c076b21-8d3d-4738-9a83-615dd36d3bad => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:56.674896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.675472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.687622 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3eda5ae7-846c-4986-836b-2a37fee5a92a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1307 microversion: 2.1 time: 0.401396 Jul 19 19:51:56.691435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 775/1541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:56.708099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.708911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.710036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.710955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.756906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:51:56.916422 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0c0da2e-1292-4c24-a08d-915a54b2c1b0 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "DELETE /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 204 len: 0 microversion: 2.1 time: 0.253190 Jul 19 19:51:56.917331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 767/1542] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:56 2022] DELETE /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:56.926672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.928172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.942194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.942967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.943981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.945427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.985813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.986704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.995337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.997813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.000667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.001299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.139464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:57.806163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.831519 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54b4dd28-6bcd-479a-84bc-fa16d6eaba00 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1517 microversion: 2.1 time: 0.906296 Jul 19 19:51:57.832926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 776/1543] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1517 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:57.837883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a136b217-a9e0-486e-845d-7621d43d5c9c tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb892fc9040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.004765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.033364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b90e697-1105-4aee-ba2e-636e3bc020a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.052607 Jul 19 19:51:58.044606 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 768/1544] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:58.059217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.060252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.068125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.068862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.069832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.070668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.451987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.463684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f1cbe68d-702d-4c90-9838-36be41ad1e17 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1487 microversion: 2.1 time: 0.417059 Jul 19 19:51:58.466720 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 769/1545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1487 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:58.486691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:58.490853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.510636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.511790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.518249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.518693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.579922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lazy-loading 'flavor' on Instance uuid 64d03653-102d-4d49-828e-f11082c2e611 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:58.817045 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c597baa6-7f51-48a8-8555-098828c0d17b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611/action" status: 202 len: 0 microversion: 2.1 time: 0.336823 Jul 19 19:51:58.819953 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 770/1546] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:58 2022] POST /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:58.832791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.834005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.849604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.850170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.851101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.851641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.861304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:59.487329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:59.544439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:59.553677 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d66566f5-e944-4e81-89d8-a61ef76e5c20 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1495 microversion: 2.1 time: 0.725677 Jul 19 19:51:59.557162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 771/1547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1495 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:59.572704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:59.574066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:59.612049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.612784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:59.618496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.619210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.203787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:00.223558 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5067e10b-97a3-415e-9026-c2c97d03fb85 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 200 len: 1517 microversion: 2.1 time: 0.661915 Jul 19 19:52:00.236571 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 772/1548] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:59 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:00.246294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:00.249241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:00.271167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.271991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.278662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.279419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.756143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:00.768726 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2904114-b840-44dc-ab29-a64db6aa95f0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.530656 Jul 19 19:52:00.769334 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 773/1549] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:00 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:00.793742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c616110b-5b6a-4f51-9313-e6dc070f283f req-59f5607e-ed8d-470d-9f82-9ff447812ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-plugged", "status": "completed", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:00.811346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c616110b-5b6a-4f51-9313-e6dc070f283f req-59f5607e-ed8d-470d-9f82-9ff447812ff1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.811785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c616110b-5b6a-4f51-9313-e6dc070f283f req-59f5607e-ed8d-470d-9f82-9ff447812ff1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.850979 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c616110b-5b6a-4f51-9313-e6dc070f283f req-59f5607e-ed8d-470d-9f82-9ff447812ff1 service nova] Creating event network-vif-plugged:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:52:00.859273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c616110b-5b6a-4f51-9313-e6dc070f283f req-59f5607e-ed8d-470d-9f82-9ff447812ff1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082958 Jul 19 19:52:00.861385 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 774/1550] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:00.869962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6b7a8a2e-366d-4550-b10a-ce3fd0eba946 req-63b8d9c8-6127-40fd-9c44-acc0d7dcb3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c18486-030f-459d-bf20-bf89ef020566", "name": "network-vif-deleted", "tag": "c52df97a-8af6-4359-b98b-7027d3c4e52c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:00.890877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6b7a8a2e-366d-4550-b10a-ce3fd0eba946 req-63b8d9c8-6127-40fd-9c44-acc0d7dcb3fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.891581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6b7a8a2e-366d-4550-b10a-ce3fd0eba946 req-63b8d9c8-6127-40fd-9c44-acc0d7dcb3fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.915634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6b7a8a2e-366d-4550-b10a-ce3fd0eba946 req-63b8d9c8-6127-40fd-9c44-acc0d7dcb3fe service nova] Creating event network-vif-deleted:c52df97a-8af6-4359-b98b-7027d3c4e52c for instance 90c18486-030f-459d-bf20-bf89ef020566 on n-h2-843861-3 Jul 19 19:52:00.932837 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6b7a8a2e-366d-4550-b10a-ce3fd0eba946 req-63b8d9c8-6127-40fd-9c44-acc0d7dcb3fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070035 Jul 19 19:52:00.937905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 775/1551] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:00.949872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:00.961319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:00.969742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.970378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.971334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.971972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.232967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.258897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3853b9ee-320c-4297-9e91-c2334eca817f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 200 len: 1478 microversion: 2.1 time: 0.318935 Jul 19 19:52:01.262357 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 776/1552] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:00 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 1478 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:01.271821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:01.274776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 90c18486-030f-459d-bf20-bf89ef020566] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:01.292664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.293194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.293999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.294441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.343459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] HTTP exception thrown: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Request method failure captured: Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 HTTP/1.1 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsN7W14FZnii3Bhnf3su0zZc9kPifpFJZtH6c_fxZ_EoJSYWPKmOnryeRNlaVRBIFzz87Nu9BVbyQezyGoNiB9NxCYLcTYADBPBPMJaSZKDpnsDGwE89XgZNWyfk_DlAB991L_4b-kinj-jPBYIrhF15PynI_1NVatr4gRtLMfj12Q Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 15e70c76f9914eb3a2c0a2e067dfb1b6 Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '90c18486-030f-459d-bf20-bf89ef020566'} Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:01.345153 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Returning 404 to user: Instance 90c18486-030f-459d-bf20-bf89ef020566 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da1b22d6-d3c0-4322-81ab-bb2a5f4a1579 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566" status: 404 len: 111 microversion: 2.1 time: 0.084658 Jul 19 19:52:01.349644 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 777/1553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:01 2022] GET /compute/v2.1/servers/90c18486-030f-459d-bf20-bf89ef020566 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:01.365134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1583882467"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:01.372975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:01.377630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:01.391983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.392418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.397248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.397770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.933983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:07.810978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:09.965361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a136b217-a9e0-486e-845d-7621d43d5c9c tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 12.131066 Jul 19 19:52:09.973426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 777/1554] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 12139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:09.982912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:09.984766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:09.996882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.000964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.003473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.005034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.056888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:10.244085 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a895f25-81a5-4db8-a24b-66a37b9bcd46 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 204 len: 0 microversion: 2.1 time: 0.266431 Jul 19 19:52:10.254175 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 778/1555] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:09 2022] DELETE /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:10.259622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.274511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:10.290028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.290494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.291291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.291729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.378742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ddecd53-d529-4a1f-8579-b6c2db33ba96 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611/action" status: 202 len: 0 microversion: 2.1 time: 9.022849 Jul 19 19:52:10.380741 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 778/1556] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:01 2022] POST /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611/action => generated 0 bytes in 9031 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:52:10.386351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b17912fe-30a6-44d4-8fe5-0ad1b60bcd01 req-b26764f7-0957-4ca8-a04f-2cc819942691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "name": "network-vif-unplugged", "status": "completed", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:10.397874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b17912fe-30a6-44d4-8fe5-0ad1b60bcd01 req-b26764f7-0957-4ca8-a04f-2cc819942691 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.398753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b17912fe-30a6-44d4-8fe5-0ad1b60bcd01 req-b26764f7-0957-4ca8-a04f-2cc819942691 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.417639 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b17912fe-30a6-44d4-8fe5-0ad1b60bcd01 req-b26764f7-0957-4ca8-a04f-2cc819942691 service nova] Creating event network-vif-unplugged:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:52:10.424076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b17912fe-30a6-44d4-8fe5-0ad1b60bcd01 req-b26764f7-0957-4ca8-a04f-2cc819942691 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041599 Jul 19 19:52:10.425561 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 779/1557] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:10.432300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.433190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:10.440375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.441332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.442324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.442921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.485287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:10.661343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:10.674208 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b8b13a1-c838-47e3-8554-bc54364898e4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.418316 Jul 19 19:52:10.676566 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 779/1558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:10 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:10.684274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.685179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:10.702891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.704090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.705435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.706133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.749126 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-79509604-0112-4e22-bb6a-7df65f4b86c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 204 len: 0 microversion: 2.1 time: 0.320020 Jul 19 19:52:10.760671 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 780/1559] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:10 2022] DELETE /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:10.764477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9cb4e7f-733c-40fa-932c-2c2d1308f22d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e2f4c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.853766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c9cb4e7f-733c-40fa-932c-2c2d1308f22d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.094669 Jul 19 19:52:10.854954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 781/1560] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:10 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:10.868716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.874284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:10.885711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.886463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.888345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.888946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.058471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.075152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31bcf61c-88d8-4846-9ff7-bd6f23bfddec tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1518 microversion: 2.1 time: 0.397000 Jul 19 19:52:11.079175 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 780/1561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:10 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:11.090231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b3165ca-8e38-4402-8763-c3138e352379 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb892fc9d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:11.173696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.175222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b3165ca-8e38-4402-8763-c3138e352379 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.094613 Jul 19 19:52:11.179723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 781/1562] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:11 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:11.193534 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb0c5331-6e12-4d59-8572-97c188678d9c tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1713 microversion: 2.1 time: 0.332313 Jul 19 19:52:11.194992 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 782/1563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:10 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1713 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:11.695745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:11.696397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:11.706118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.706569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.707384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.707835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.867089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f28ae639-508f-4664-a1ea-21a7f6fc99bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e1f3ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:11.938780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f28ae639-508f-4664-a1ea-21a7f6fc99bd tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.076048 Jul 19 19:52:11.939650 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 783/1564] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:11 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:12.015845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:12.043703 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb2bef71-2959-4642-b19c-740e40df8047 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.352660 Jul 19 19:52:12.054935 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 782/1565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:11 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:12.093220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:12.093837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:12.123765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.124388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:12.125234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.125673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:12.194366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5433731-be7f-44ad-9ae0-e80b8908ed4b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88def6f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:12.272393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b5433731-be7f-44ad-9ae0-e80b8908ed4b tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.083760 Jul 19 19:52:12.272991 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 783/1566] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:12 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:12.288330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:12.288954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:12.327877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.336756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:12.337884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.340263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.604973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.613984 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03f82558-01dd-48ad-a44b-8109cb88faad tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1518 microversion: 2.1 time: 1.524603 Jul 19 19:52:13.619371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 784/1567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:12 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1518 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:13.633613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3f6a8ec7-ce51-4cd5-8da6-2bd82dbd3a71 req-f0137a12-e0d3-4a5c-9f32-ac1a429fba8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:13.663952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3f6a8ec7-ce51-4cd5-8da6-2bd82dbd3a71 req-f0137a12-e0d3-4a5c-9f32-ac1a429fba8b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.664406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3f6a8ec7-ce51-4cd5-8da6-2bd82dbd3a71 req-f0137a12-e0d3-4a5c-9f32-ac1a429fba8b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.731776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3f6a8ec7-ce51-4cd5-8da6-2bd82dbd3a71 req-f0137a12-e0d3-4a5c-9f32-ac1a429fba8b service nova] Creating event network-changed:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:52:13.746765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.760963 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3f6a8ec7-ce51-4cd5-8da6-2bd82dbd3a71 req-f0137a12-e0d3-4a5c-9f32-ac1a429fba8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139952 Jul 19 19:52:13.767199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c6824ac-9558-48a2-a8b2-266473bdea74 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1713 microversion: 2.1 time: 1.485538 Jul 19 19:52:13.767690 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 785/1568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:13.782072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 784/1569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:12 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1713 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:13.782992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-537654c8-a48c-48fe-b8d6-e74111a72f2e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e2673a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:13.890185 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-537654c8-a48c-48fe-b8d6-e74111a72f2e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.121112 Jul 19 19:52:13.906033 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 786/1570] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:13 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:13.920724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:13.930291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:13.965355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.968729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.973336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.973799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.256553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96590c36-587d-4b8b-8125-b254e5ff2b91 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Action: 'create', calling method: .version_select at 0x7fb88e1c9e50>, body: {"keypair": {"name": "tempest-keypair-36947594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0w88MuzyGATK4gW6X1j2IWE5FrlmSBPpFN76/7fCcJtKlsYMmIn4zwJOl99fEpKUTGXflHe9UWrrzd4fTlyyRGEfQYgfRfUIdRO+vYil4qK9BIY9l/aEtTGjPGIEQC7g=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:14.293189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-96590c36-587d-4b8b-8125-b254e5ff2b91 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:14.318140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-96590c36-587d-4b8b-8125-b254e5ff2b91 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for user 918f7d77e006476eaf800fbf195bbeb4 and project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:14.387899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96590c36-587d-4b8b-8125-b254e5ff2b91 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.597650 Jul 19 19:52:14.388968 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 785/1571] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:52:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:14.401275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f1111b7c-4e0a-4137-ae6d-9b6c6c4419be tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e0b6700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:14.494266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f1111b7c-4e0a-4137-ae6d-9b6c6c4419be tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.098552 Jul 19 19:52:14.495563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 786/1572] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:14 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:14.637602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:14.641353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:14.654000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.656796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.657994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.659704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.703526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:14.713792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e90e8ccf-bfcb-49b4-90cc-b4277552ff22 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.806549 Jul 19 19:52:14.728199 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 787/1573] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:13 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:14.786172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:14.786800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:14.806293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.806743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.816120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.817651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.050538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.061881 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5003fc76-77bf-4349-97bd-e1d4c883a78c tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1476 microversion: 2.1 time: 0.429013 Jul 19 19:52:15.068215 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 787/1574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:14 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:15.085534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30911401-a91c-4e05-91a8-8473ca7e8be7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e114dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:15.167693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.190184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-638e1142-fe23-42be-957b-ed86a789e3e3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1647 microversion: 2.1 time: 0.408468 Jul 19 19:52:15.199878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 788/1575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:14 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1647 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:15.215987 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30911401-a91c-4e05-91a8-8473ca7e8be7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.145037 Jul 19 19:52:15.216803 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 788/1576] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:15 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:15.227538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-443e47c8-780b-4a00-a2d9-5795958b54de req-3a6327ea-ba34-42d0-8d8f-f9ad9c230810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "name": "network-vif-unplugged", "status": "completed", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:15.248668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-443e47c8-780b-4a00-a2d9-5795958b54de req-3a6327ea-ba34-42d0-8d8f-f9ad9c230810 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.250898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-443e47c8-780b-4a00-a2d9-5795958b54de req-3a6327ea-ba34-42d0-8d8f-f9ad9c230810 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.283099 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-443e47c8-780b-4a00-a2d9-5795958b54de req-3a6327ea-ba34-42d0-8d8f-f9ad9c230810 service nova] Creating event network-vif-unplugged:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h2-843861-3 Jul 19 19:52:15.306730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-443e47c8-780b-4a00-a2d9-5795958b54de req-3a6327ea-ba34-42d0-8d8f-f9ad9c230810 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087626 Jul 19 19:52:15.311873 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 789/1577] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:15.509777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-165f0123-28d0-4544-b3ac-f36adb7b95e5 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb892fc9940>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:15.649319 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-165f0123-28d0-4544-b3ac-f36adb7b95e5 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.145580 Jul 19 19:52:15.649926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 789/1578] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:15 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:15.753293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:15.753920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:15.812987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.813452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.829058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.829800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.955947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c0d2b6a8-75cb-43e2-b030-910950ff10f7 req-b9abbc08-6ba7-4f77-a2aa-886387bc38d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5222c8a3-7937-441a-b90d-8def0acc785c", "name": "network-vif-deleted", "tag": "da801c05-53f6-4494-be84-b8bf1c5842a8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:15.982890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c0d2b6a8-75cb-43e2-b030-910950ff10f7 req-b9abbc08-6ba7-4f77-a2aa-886387bc38d0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.983733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c0d2b6a8-75cb-43e2-b030-910950ff10f7 req-b9abbc08-6ba7-4f77-a2aa-886387bc38d0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.012714 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c0d2b6a8-75cb-43e2-b030-910950ff10f7 req-b9abbc08-6ba7-4f77-a2aa-886387bc38d0 service nova] Creating event network-vif-deleted:da801c05-53f6-4494-be84-b8bf1c5842a8 for instance 5222c8a3-7937-441a-b90d-8def0acc785c on n-h1-843861-3 Jul 19 19:52:16.039121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c0d2b6a8-75cb-43e2-b030-910950ff10f7 req-b9abbc08-6ba7-4f77-a2aa-886387bc38d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086636 Jul 19 19:52:16.045356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 790/1579] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:52:16.101992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:16.103040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:16.134752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.136206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.143327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.147023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.332696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.334047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.336737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lazy-loading 'fault' on Instance uuid 5222c8a3-7937-441a-b90d-8def0acc785c {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:52:16.694148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e70c76f9914eb3a2c0a2e067dfb1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332379ea56cd49c6b5faf3f19674d175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:16.713013 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f18f89d-dbe3-4f8b-a96e-1cc84a4fca97 tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 200 len: 1311 microversion: 2.1 time: 0.623943 Jul 19 19:52:16.725435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 791/1580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:16 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 1311 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:16.736830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:16.737782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:16.746134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.746972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.748067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.748749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.874489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.877693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.882814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lazy-loading 'fault' on Instance uuid 5f969122-53c1-4308-8cfb-dce1a81752aa {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:52:17.062893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:17.097749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c74c0448-180e-461e-8987-b83b32fa6f92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.332413 Jul 19 19:52:17.102485 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 790/1581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:15 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:17.136910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23c47e72-00b3-47b9-a9ee-8e29db410551 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dd68790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:17.277736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23c47e72-00b3-47b9-a9ee-8e29db410551 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.169435 Jul 19 19:52:17.278331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 791/1582] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:17 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:17.293807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-77a7dbd5-13b7-4215-ad4b-24470ec75a82 req-5fb065b6-c4f5-4ce2-bc0b-c9465182fc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f969122-53c1-4308-8cfb-dce1a81752aa", "name": "network-vif-deleted", "tag": "cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:17.303202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec0c5c154014ebcb2640ed9e91474ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622c76e97384d70bfc9cd9e5c64c031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:17.315389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19b99d04-e3b0-4237-9772-8f67499f24a0 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 200 len: 1355 microversion: 2.1 time: 0.581473 Jul 19 19:52:17.334950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-77a7dbd5-13b7-4215-ad4b-24470ec75a82 req-5fb065b6-c4f5-4ce2-bc0b-c9465182fc7c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.337216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 792/1583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:16 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 1355 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:17.338191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-77a7dbd5-13b7-4215-ad4b-24470ec75a82 req-5fb065b6-c4f5-4ce2-bc0b-c9465182fc7c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.365820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d45560cf-1c5c-4621-9749-c91f3932fd54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e1141f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:17.370064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-77a7dbd5-13b7-4215-ad4b-24470ec75a82 req-5fb065b6-c4f5-4ce2-bc0b-c9465182fc7c service nova] Creating event network-vif-deleted:cbc9d00b-c098-4b3a-a1ae-9ae147e0ca06 for instance 5f969122-53c1-4308-8cfb-dce1a81752aa on n-h2-843861-3 Jul 19 19:52:17.383483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-77a7dbd5-13b7-4215-ad4b-24470ec75a82 req-5fb065b6-c4f5-4ce2-bc0b-c9465182fc7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103900 Jul 19 19:52:17.385472 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 792/1584] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:17.468631 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d45560cf-1c5c-4621-9749-c91f3932fd54 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1426 microversion: 2.1 time: 0.127678 Jul 19 19:52:17.470481 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 793/1585] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:17 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1426 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:17.732850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:17.733848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] [instance: 5222c8a3-7937-441a-b90d-8def0acc785c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:17.756803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.757266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.758082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.758519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.821525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] HTTP exception thrown: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Request method failure captured: Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c HTTP/1.1 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsN7W14FZnii3Bhnf3su0zZc9kPifpFJZtH6c_fxZ_EoJSYWPKmOnryeRNlaVRBIFzz87Nu9BVbyQezyGoNiB9NxCYLcTYADBPBPMJaSZKDpnsDGwE89XgZNWyfk_DlAB991L_4b-kinj-jPBYIrhF15PynI_1NVatr4gRtLMfj12Q Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332379ea56cd49c6b5faf3f19674d175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 332379ea56cd49c6b5faf3f19674d175 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1974389208 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 15e70c76f9914eb3a2c0a2e067dfb1b6 Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServerFiltersTestJSON-1974389208-project Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5222c8a3-7937-441a-b90d-8def0acc785c'} Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:17.827028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. Jul 19 19:52:17.833710 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:17.838352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] Returning 404 to user: Instance 5222c8a3-7937-441a-b90d-8def0acc785c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:17.841577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8f66761-2c84-4af9-8996-638e9472115f tempest-ListServerFiltersTestJSON-1974389208 tempest-ListServerFiltersTestJSON-1974389208-project] 10.222.0.33 "GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c" status: 404 len: 111 microversion: 2.1 time: 0.112916 Jul 19 19:52:17.849972 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 793/1586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:17 2022] GET /compute/v2.1/servers/5222c8a3-7937-441a-b90d-8def0acc785c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:18.118497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.119114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:18.148897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.149565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.155138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.155678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.293916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f2174b7-ffd4-438c-95c8-40c6636f5c50 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dd68700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.408997 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f2174b7-ffd4-438c-95c8-40c6636f5c50 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.116625 Jul 19 19:52:18.412267 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 794/1587] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:18.420235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.420848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:18.444296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.445601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.446400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.450300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.459392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:18.489926 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa HTTP/1.1 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5f969122-53c1-4308-8cfb-dce1a81752aa'} Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.497370 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:18.503575 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.507147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:18.508355 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39f7ee4c-e63d-48b0-9699-f4d7fdf7eeed tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 404 len: 111 microversion: 2.1 time: 0.094915 Jul 19 19:52:18.513213 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 795/1588] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:18.519182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1098913b-371b-42fb-bb1d-c4090d109d89 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e264310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.597204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1098913b-371b-42fb-bb1d-c4090d109d89 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1435 microversion: 2.1 time: 0.082778 Jul 19 19:52:18.605800 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 796/1589] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1435 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:18.612008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.612707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:18.621982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.622696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.624160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.624769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.654554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e HTTP/1.1 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93d6ae0e-2945-4327-acef-5be53b8d649e'} Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:18.658754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:18.663572 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6790e8d3-5205-4d4d-ab6d-a3e8af5eba3a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 404 len: 111 microversion: 2.1 time: 0.053332 Jul 19 19:52:18.665679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 797/1590] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:18 2022] DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:18.681295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cee2f4f5-33e3-408b-a787-ce2894e2a0d2 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e264280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.755606 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cee2f4f5-33e3-408b-a787-ce2894e2a0d2 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 200 len: 1435 microversion: 2.1 time: 0.070920 Jul 19 19:52:18.764000 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 798/1591] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 1435 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:18.780646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.781703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:18.790340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.791098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.792146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.792797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.820041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e HTTP/1.1 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93d6ae0e-2945-4327-acef-5be53b8d649e'} Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.821800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:18.826306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be9854ad-50e6-4992-99ca-28a4373eee42 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 404 len: 111 microversion: 2.1 time: 0.056854 Jul 19 19:52:18.833473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 799/1592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:18.839943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.840662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:18.867744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.869890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.875115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:18.876566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:18.883769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:18.897282 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a2513bf-337d-481b-8e2a-8df5a73adff0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.782577 Jul 19 19:52:18.909521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 794/1593] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:18.922116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5128d576-25e2-49f4-8098-e92ed93b38c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '.version_select at 0x7fb88e114160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:18.982752 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5128d576-25e2-49f4-8098-e92ed93b38c3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204217529" status: 202 len: 0 microversion: 2.1 time: 0.070103 Jul 19 19:52:18.984599 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 795/1594] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 19:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204217529 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:19.262495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:19.291841 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-373ff38f-cf04-44db-b921-7700dbaa37b9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1466 microversion: 2.1 time: 0.457182 Jul 19 19:52:19.301052 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 800/1595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:18 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1466 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:19.334920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b042d595-48c5-48e2-8023-9d1d9673730a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e1fb700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:19.422634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1de86e90-067a-40f8-b37a-2e5a95df8c2a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e2fc310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:20.505870 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b042d595-48c5-48e2-8023-9d1d9673730a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "DELETE /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b" status: 204 len: 0 microversion: 2.1 time: 1.176357 Jul 19 19:52:20.509503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 796/1596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:19 2022] DELETE /compute/v2.1/images/aa1026ba-94b8-406d-97a8-7731e5942c2b => generated 0 bytes in 1178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:20.514714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:20.516217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:20.541503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.544267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.555466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.555949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.570043 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1de86e90-067a-40f8-b37a-2e5a95df8c2a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 1.151260 Jul 19 19:52:20.577138 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 801/1597] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:19 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:20.595324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0013a1f6-12ff-4970-bca0-035c9e8c2f53 req-7cbfa918-3899-4614-b073-c4c6168ad40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d03653-102d-4d49-828e-f11082c2e611", "name": "network-vif-plugged", "status": "completed", "tag": "f32ac764-1592-47ee-a500-ad9c58628726"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:20.660077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0013a1f6-12ff-4970-bca0-035c9e8c2f53 req-7cbfa918-3899-4614-b073-c4c6168ad40f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.661179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0013a1f6-12ff-4970-bca0-035c9e8c2f53 req-7cbfa918-3899-4614-b073-c4c6168ad40f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.715699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0013a1f6-12ff-4970-bca0-035c9e8c2f53 req-7cbfa918-3899-4614-b073-c4c6168ad40f service nova] Creating event network-vif-plugged:f32ac764-1592-47ee-a500-ad9c58628726 for instance 64d03653-102d-4d49-828e-f11082c2e611 on n-h2-843861-3 Jul 19 19:52:20.742886 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0013a1f6-12ff-4970-bca0-035c9e8c2f53 req-7cbfa918-3899-4614-b073-c4c6168ad40f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164129 Jul 19 19:52:20.749957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 802/1598] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:20.761597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a8054c1f-a4b4-4e62-8752-cdfcd4cbdb0a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '.version_select at 0x7fb88e0d0b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:20.832952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a8054c1f-a4b4-4e62-8752-cdfcd4cbdb0a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] HTTP exception thrown: Image not found. Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a8054c1f-a4b4-4e62-8752-cdfcd4cbdb0a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Request method failure captured: Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 HTTP/1.1 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsliWblvjT6NNzzX34wUhwwgJEwfFBI9mnIRUUDECOx8_e-O9oUkXMj3jaPQa6dbBStc4cq4C3SgFPvuaMsSJmiyRaeofMDOF667roJkRqYa70UD8nACUSyRXRuOQ_3egEx7Ig1iUVva-95UTLdV80hhtxq5x6jiQ64bNuWfep6M3Y Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: a46b81a600b04c218f5570cb02f15fdd Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '553612a9-c377-421c-a6c1-bff886060570'} Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 553612a9-c377-421c-a6c1-bff886060570 to delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 553612a9-c377-421c-a6c1-bff886060570 could not be found. Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.835158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a8054c1f-a4b4-4e62-8752-cdfcd4cbdb0a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:20.839652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a8054c1f-a4b4-4e62-8752-cdfcd4cbdb0a tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "DELETE /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570" status: 404 len: 62 microversion: 2.1 time: 0.085421 Jul 19 19:52:20.843499 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 803/1599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:20 2022] DELETE /compute/v2.1/images/553612a9-c377-421c-a6c1-bff886060570 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:52:20.854134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1275596187", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f19a5d12-0473-44ee-be21-62751fb327e5"}], "security_groups": [{"name": "tempest-securitygroup--2026680579"}], "key_name": "tempest-keypair-36947594", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:21.573527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:21.574023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] validate_networks() for [('f19a5d12-0473-44ee-be21-62751fb327e5', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:21.591605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4da1ac50-cc80-4e60-b096-e9f10405f706 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.080774 Jul 19 19:52:21.596530 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 797/1600] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:20 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:21.610178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:21.610675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:21.641230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:21.646010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:21.647180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:21.647987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:21.796233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:21.992531 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a2a2662-c718-44a5-801e-b3306e615abc tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 204 len: 0 microversion: 2.1 time: 0.389910 Jul 19 19:52:21.999979 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 798/1601] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:21 2022] DELETE /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:22.013412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0acec36d-130b-441b-adad-c4d3777303ab tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.036348 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:52:22.036348 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:52:22.091047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0acec36d-130b-441b-adad-c4d3777303ab tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/346731123" status: 202 len: 0 microversion: 2.1 time: 0.086586 Jul 19 19:52:22.092181 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 799/1602] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:52:21 2022] DELETE /compute/v2.1/flavors/346731123 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:22.118380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-13b511d8-5b39-400a-a5f1-57932d3dd436 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e391f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.247744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-13b511d8-5b39-400a-a5f1-57932d3dd436 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.153963 Jul 19 19:52:22.249895 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 800/1603] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:22.272604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.278622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:22.293993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.294812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.296161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.297138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.715660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:22.738141 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-88b43071-4f6b-4c0c-a3b0-143d42e80b24 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1472 microversion: 2.1 time: 0.486182 Jul 19 19:52:22.742050 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 801/1604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:22.755417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6cba5fb-9113-4acf-9651-aa7c19ac7740 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.807083 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6cba5fb-9113-4acf-9651-aa7c19ac7740 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.063367 Jul 19 19:52:22.814081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 802/1605] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:22.824609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.825644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:22.856848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.857374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.858181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.858614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.863681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:23.307178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:23.326420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for user 918f7d77e006476eaf800fbf195bbeb4 and project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:23.371114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:23.392438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:23.398855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:23.400037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:23.401352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:23.404486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:23.406551 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4c4dec0-3dd6-4520-bb6b-177ca9b12205 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 0.588522 Jul 19 19:52:23.418419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.419355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.420595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.422083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.429017 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 803/1606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:23.438512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eae78746-2410-4e78-a4e2-694dcbe6fa95 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.442580 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:52:23.442580 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:52:23.451356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:23.465578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Getting quotas for user 918f7d77e006476eaf800fbf195bbeb4 and project 0ae955bec2d54c2b8a3a81e042c3ae74. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:23.499482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eae78746-2410-4e78-a4e2-694dcbe6fa95 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2119075084" status: 202 len: 0 microversion: 2.1 time: 0.069113 Jul 19 19:52:23.500368 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 804/1607] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:52:23 2022] DELETE /compute/v2.1/flavors/2119075084 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:23.508422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:23.509863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be26d1fa-c630-4981-b0bf-f3c403aa0f0e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88def6ee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.511951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:23.589552 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df00ef8d-f19f-4339-ad12-90cb8f5f73e0 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.747856 Jul 19 19:52:23.595730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 804/1608] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 2749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:23.600130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0849ed3e-bb46-4b68-8930-2946e17ef350 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.625934 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0849ed3e-bb46-4b68-8930-2946e17ef350 tempest-ServersWithSpecificFlavorTestJSON-575226657 tempest-ServersWithSpecificFlavorTestJSON-575226657-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033784 Jul 19 19:52:23.636440 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 805/1609] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:52:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:23.636440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9a15292-8757-4ae7-b92c-4267e29edccd tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.641303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9a15292-8757-4ae7-b92c-4267e29edccd tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:23.643018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be26d1fa-c630-4981-b0bf-f3c403aa0f0e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.138041 Jul 19 19:52:23.643909 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 805/1610] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:23 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:23.671213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.677403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:23.720673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.721354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.739600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.740216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.796366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa HTTP/1.1 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '5f969122-53c1-4308-8cfb-dce1a81752aa'} Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:23.798213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:23.805907 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a318fa7e-6fd9-4829-8208-149f3fe15d92 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 404 len: 111 microversion: 2.1 time: 0.134498 Jul 19 19:52:23.808151 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 806/1611] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:23 2022] DELETE /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:23.817612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:23.818234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:23.838108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.838566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.839363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.839818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.117920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9a15292-8757-4ae7-b92c-4267e29edccd tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.152411 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9a15292-8757-4ae7-b92c-4267e29edccd tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1276 microversion: 2.1 time: 0.520427 Jul 19 19:52:24.166616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 806/1612] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:23 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1276 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:24.189232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.196091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 5f969122-53c1-4308-8cfb-dce1a81752aa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.242006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.246433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.250576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.251483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.311265 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa HTTP/1.1 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5f969122-53c1-4308-8cfb-dce1a81752aa'} Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.318879 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. Jul 19 19:52:24.323576 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.327114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 5f969122-53c1-4308-8cfb-dce1a81752aa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:24.328394 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0a23670-6ee9-45da-b06d-c31e5a0bb41a tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa" status: 404 len: 111 microversion: 2.1 time: 0.160727 Jul 19 19:52:24.329547 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 807/1613] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:24 2022] GET /compute/v2.1/servers/5f969122-53c1-4308-8cfb-dce1a81752aa => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:24.342071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-caf43da7-796c-4f23-8c55-5b4b98d6da15 req-166a4d5c-49fa-47dd-85b8-2d648acd6ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-unplugged", "status": "completed", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:24.342592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:24.367480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-caf43da7-796c-4f23-8c55-5b4b98d6da15 req-166a4d5c-49fa-47dd-85b8-2d648acd6ca0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.368312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-caf43da7-796c-4f23-8c55-5b4b98d6da15 req-166a4d5c-49fa-47dd-85b8-2d648acd6ca0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.387792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-caf43da7-796c-4f23-8c55-5b4b98d6da15 req-166a4d5c-49fa-47dd-85b8-2d648acd6ca0 service nova] Creating event network-vif-unplugged:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:52:24.395530 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-caf43da7-796c-4f23-8c55-5b4b98d6da15 req-166a4d5c-49fa-47dd-85b8-2d648acd6ca0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063718 Jul 19 19:52:24.397196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 808/1614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:24.403664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.409870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.419936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.420815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.424723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.425785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.454008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e HTTP/1.1 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93d6ae0e-2945-4327-acef-5be53b8d649e'} Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:24.456986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:24.461425 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:24.465480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:24.467443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2a55bf3-d8ff-4039-92b2-289358cc64a3 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 404 len: 111 microversion: 2.1 time: 0.068587 Jul 19 19:52:24.469365 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 809/1615] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:24 2022] DELETE /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:24.485003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.486848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.506098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.507188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.510437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.511952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:25.652475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:25.666254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:25.678186 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-593839fa-edea-4f89-9357-ae4549eae3fb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.203694 Jul 19 19:52:25.690398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 810/1616] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:24 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:25.695741 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-552ffe8a-8f76-4685-9e7c-1cc5bea1689e tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1472 microversion: 2.1 time: 1.882290 Jul 19 19:52:25.699537 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 807/1617] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:23 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1472 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:25.701397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:25.701955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] [instance: 93d6ae0e-2945-4327-acef-5be53b8d649e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:25.717246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:25.718584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:25.720774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:25.721240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:25.748699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8dbb26fe-59c5-43d5-87e2-b8eb236b8585 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e455040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:25.759449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] HTTP exception thrown: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Request method failure captured: Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e HTTP/1.1 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wo_8dEY44oB2HAsNnrdN46xPkX_lPtOoO_a-npipjzpgUbBqgQ6rNPVVXDoVJ-DIlxG-VEzJQoVvTzXEvwkqg3M_CaU9hTQrJW5W7TgqBtD_BuaZtB1dM_E2geldyYEMhyGLcP3c7AQMZRbcTT3FYNZlIA9AtK2CqyxCT6LW3iFztU Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2622c76e97384d70bfc9cd9e5c64c031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2622c76e97384d70bfc9cd9e5c64c031 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995 Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0ec0c5c154014ebcb2640ed9e91474ee Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1063710995-project Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93d6ae0e-2945-4327-acef-5be53b8d649e'} Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:25.762924 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] Returning 404 to user: Instance 93d6ae0e-2945-4327-acef-5be53b8d649e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:25.768206 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78f83d68-fd09-4c71-9c4e-5be08e774727 tempest-ServersWithSpecificFlavorTestJSON-1063710995 tempest-ServersWithSpecificFlavorTestJSON-1063710995-project] 10.222.0.33 "GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e" status: 404 len: 111 microversion: 2.1 time: 0.072260 Jul 19 19:52:25.769013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 811/1618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:25 2022] GET /compute/v2.1/servers/93d6ae0e-2945-4327-acef-5be53b8d649e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:25.779211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:25.779771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:25.810414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:25.812236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:25.813725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:25.818429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:25.868759 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8dbb26fe-59c5-43d5-87e2-b8eb236b8585 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.156172 Jul 19 19:52:25.870451 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 808/1619] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:25 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:26.074680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:26.085513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee5d3128-c8f7-423f-bbff-210e66309b90 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1336 microversion: 2.1 time: 0.315543 Jul 19 19:52:26.090948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 812/1620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:25 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1336 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:26.378710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1254831199", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "be49fee4-8a96-4ded-8c00-6bf222c5131e"}], "block_device_mapping_v2": [{"uuid": "346769c7-fe8a-4eb0-98a6-0bd1d01cb6fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:26.507953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] validate_networks() for [('be49fee4-8a96-4ded-8c00-6bf222c5131e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:26.699498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:26.701377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:26.722743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.723936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.731215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.732093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.851331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.912888 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56b25d7d-f1aa-466e-9d8d-1ceb2b0b064c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1716 microversion: 2.1 time: 1.214005 Jul 19 19:52:27.914196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 813/1621] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:26 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1716 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:27.925454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:27.929221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:27.955570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.956780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.961996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.962728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.578407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a46b81a600b04c218f5570cb02f15fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810b43b05ebb479ab9e832d5910f4c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:28.590857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7927f28f-5c8b-40a4-882d-fe6835c00bd9 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 200 len: 1430 microversion: 2.1 time: 0.675346 Jul 19 19:52:28.592313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 814/1622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:27 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 1430 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:28.630795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d35342ed-b2be-4a4b-8803-eda122583e25 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e3af5e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:28.730749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d35342ed-b2be-4a4b-8803-eda122583e25 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.120275 Jul 19 19:52:28.731908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 815/1623] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:28 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:28.742394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:28.745882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:28.771504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.775596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.783118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.783848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.695100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.719266 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6bc971b3-5fa1-4f9e-9dea-ce6efffe935d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1334 microversion: 2.1 time: 0.986051 Jul 19 19:52:29.723150 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 816/1624] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:28 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1334 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:29.731339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-79c79253-d44d-4cb0-897b-6a14021b9885 req-88c5170a-37e9-470d-8035-88565d4c60e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95e2522-3569-4aa3-aef5-31e59466530a", "name": "network-vif-deleted", "tag": "5b81aae8-6c72-4144-be8e-2e95cc2b5cbd"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:29.747653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-79c79253-d44d-4cb0-897b-6a14021b9885 req-88c5170a-37e9-470d-8035-88565d4c60e3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.752527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-79c79253-d44d-4cb0-897b-6a14021b9885 req-88c5170a-37e9-470d-8035-88565d4c60e3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.784768 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-79c79253-d44d-4cb0-897b-6a14021b9885 req-88c5170a-37e9-470d-8035-88565d4c60e3 service nova] Creating event network-vif-deleted:5b81aae8-6c72-4144-be8e-2e95cc2b5cbd for instance e95e2522-3569-4aa3-aef5-31e59466530a on n-h1-843861-3 Jul 19 19:52:29.797138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-79c79253-d44d-4cb0-897b-6a14021b9885 req-88c5170a-37e9-470d-8035-88565d4c60e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071941 Jul 19 19:52:29.798416 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 817/1625] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:29.803794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:29.815827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:29.826970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.827717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.828731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.829335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.001565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:30.002911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:30.005409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:30.006121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:30.007201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:30.031441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.036926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.039685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.040395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.121580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:30.135479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Getting quotas for user 937de5092f1d4e10b36c151ebf1db333 and project 5577704b5db34579abdb9bba3932b73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:30.213720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.234205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d1e3f35a-513b-4231-89f9-05c9f0b9eab0 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1706 microversion: 2.1 time: 0.434397 Jul 19 19:52:30.234801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 818/1626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:29 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1706 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:30.243309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.243918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] [instance: e95e2522-3569-4aa3-aef5-31e59466530a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:30.270236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.272122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.274834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.276779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.319582 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] HTTP exception thrown: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Request method failure captured: Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a HTTP/1.1 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wsliWblvjT6NNzzX34wUhwwgJEwfFBI9mnIRUUDECOx8_e-O9oUkXMj3jaPQa6dbBStc4cq4C3SgFPvuaMsSJmiyRaeofMDOF667roJkRqYa70UD8nACUSyRXRuOQ_3egEx7Ig1iUVva-95UTLdV80hhtxq5x6jiQ64bNuWfep6M3Y Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_810b43b05ebb479ab9e832d5910f4c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 810b43b05ebb479ab9e832d5910f4c73 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-819242974 Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: a46b81a600b04c218f5570cb02f15fdd Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesOneServerTestJSON-819242974-project Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'e95e2522-3569-4aa3-aef5-31e59466530a'} Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:30.321283 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] Returning 404 to user: Instance e95e2522-3569-4aa3-aef5-31e59466530a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:30.328922 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e8906b4-56be-43db-9ad0-b66a6bd404d1 tempest-ImagesOneServerTestJSON-819242974 tempest-ImagesOneServerTestJSON-819242974-project] 10.222.0.33 "GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a" status: 404 len: 111 microversion: 2.1 time: 0.086946 Jul 19 19:52:30.330129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:30.330129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='346769c7-fe8a-4eb0-98a6-0bd1d01cb6fe',volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:30.343747 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 819/1627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/servers/e95e2522-3569-4aa3-aef5-31e59466530a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:30.366193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a68c4e8-9e9f-4da1-80d5-e55eab967efe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88de79dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.540460 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a68c4e8-9e9f-4da1-80d5-e55eab967efe tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.195474 Jul 19 19:52:30.541354 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 820/1628] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:30.546747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96aee6ac-7500-4de8-a1d2-72ad7848ddc6 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '.version_select at 0x7fb88dac1af0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.549274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96aee6ac-7500-4de8-a1d2-72ad7848ddc6 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.549721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96aee6ac-7500-4de8-a1d2-72ad7848ddc6 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.609829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96aee6ac-7500-4de8-a1d2-72ad7848ddc6 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.067382 Jul 19 19:52:30.615870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 821/1629] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:30.630570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.639252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:30.665899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.666424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.667125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.667567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.732566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70afd2a4-3769-4e6c-a827-01071204766e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.362017 Jul 19 19:52:30.735540 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 809/1630] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:52:30.747648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.750705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:30.772796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.773323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.774011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.788682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.962621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.971759 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b149ea6-3d43-4ba9-82bb-1b6570607ee6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1334 microversion: 2.1 time: 0.234756 Jul 19 19:52:30.972379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 810/1631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1334 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:30.990114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.991283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:31.000235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:31.288850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:31.318357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:31.331364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:31.337198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e266491-4413-4fb0-aec2-3fbbde5fe3b5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1104 microversion: 2.25 time: 0.355664 Jul 19 19:52:31.346875 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 811/1632] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1104 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:31.555631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15dd5a98-73c4-4db4-9ce4-222fa9fe9d71 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88def6a60>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:31.669561 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15dd5a98-73c4-4db4-9ce4-222fa9fe9d71 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.118949 Jul 19 19:52:31.680073 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 812/1633] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:31 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:31.724778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a25038ce-d0a8-4838-950a-5bd7a1bfe5bc tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1857 microversion: 2.1 time: 1.100108 Jul 19 19:52:31.733548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 822/1634] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1857 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:31.755000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:31.756197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:31.779046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.779845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:31.783514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.784845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:31.994436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:31.995189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:32.001908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:32.019024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.022503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.025415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.026598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.265841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4db6955c-0671-4abe-804c-4de59b60ac7c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1857 microversion: 2.1 time: 0.517704 Jul 19 19:52:32.277690 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 813/1635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:31 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1857 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:32.354833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:32.356224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:32.366610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.371708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.375004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.377852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.587730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.597305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a709e59-1407-481e-b092-04861c49bcff tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 0.611223 Jul 19 19:52:32.605112 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 823/1636] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:31 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:32.610383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:32.615718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:32.624366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.626891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.627516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.628852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.630082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.638888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.643493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.646925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4eafd8f1-7bff-495e-94bb-2e728a536bb3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1233 microversion: 2.25 time: 0.296058 Jul 19 19:52:32.648405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 814/1637] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:32 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1233 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:32.686438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94d44cc7-2db8-496a-bb4c-9b7f9464634c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d699e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:32.810277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94d44cc7-2db8-496a-bb4c-9b7f9464634c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.127908 Jul 19 19:52:32.811446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 815/1638] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:32 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:32.843414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lazy-loading 'services' on Instance uuid dcacc019-ce62-4a1d-a140-12a8568e453f {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:52:33.011260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34598a45-3d33-4497-8ff6-2321b2838f11 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments/10b92fb4-8a74-457d-be99-c9ec5acb1428" status: 202 len: 0 microversion: 2.1 time: 0.400180 Jul 19 19:52:33.031134 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 824/1639] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 19:52:32 2022] DELETE /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments/10b92fb4-8a74-457d-be99-c9ec5acb1428 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:33.041360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:33.043613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.067222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.067684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.078480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.079425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.260751 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c636108e-22a6-4c80-84b6-94e3c449db2a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219870 Jul 19 19:52:33.264870 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 816/1640] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:33 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:33.615036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:33.620063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:33.621000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.648113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.648567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.649546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.650183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.668666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:33.669285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.700292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.701320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.702160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.702594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.133328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:34.440473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.451148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.465060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.467057 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3740e44d-5504-4c2e-96c2-335ded7cc62d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1251 microversion: 2.25 time: 0.804289 Jul 19 19:52:34.479319 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 817/1641] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:33 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1251 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:34.487393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1561e15d-cf3b-4f10-a352-5a17fc1e3562 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e1fb670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:34.566116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1561e15d-cf3b-4f10-a352-5a17fc1e3562 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.084903 Jul 19 19:52:34.567303 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 818/1642] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:34 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:34.578688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:34.587789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:34.605702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.611034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.617023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.617962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.778257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-197d967f-b62a-40f8-aded-8bc4b7e81dfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209762 Jul 19 19:52:34.787234 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 819/1643] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:34 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:35.279350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-898886960", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c7bb9508-6d4f-4858-ab37-d67d2eca9aa8"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:35.374684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.396045 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca2468eb-e1a3-4474-bc26-d220ba20a7d6 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 1.782296 Jul 19 19:52:35.408579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] validate_networks() for [('c7bb9508-6d4f-4858-ab37-d67d2eca9aa8', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:35.408772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 825/1644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:33 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:35.488615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:35.489560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:35.501533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.508338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.509446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.511337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.978274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.995911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.997537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.998889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6a89334-8f23-453e-be36-d5538b1db376 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1251 microversion: 2.25 time: 0.514763 Jul 19 19:52:36.000521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 826/1645] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:35 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1251 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:36.017149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ba5a80c-fbd5-44fd-b8bf-d8b84cda7fe5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb890766550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:36.131711 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ba5a80c-fbd5-44fd-b8bf-d8b84cda7fe5 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.128031 Jul 19 19:52:36.132455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 827/1646] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:36 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:36.163772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:36.167241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:36.185805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.190699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.191593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.192072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.294250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:36.344377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04457c08-7996-430d-a9e7-5358f60e0dfa tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200971 Jul 19 19:52:36.357559 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 828/1647] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:36 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:36.415692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:36.416354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:36.437632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.438093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.439371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.439840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.350479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.374698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1e39ea95-01c5-43d5-99d7-632f20a8093d tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 1.963954 Jul 19 19:52:38.384643 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 829/1648] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:36 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:38.397133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2aa55033-74f9-4ba6-bae9-de88bb1e05e7 req-35c7b661-8482-46f3-b118-0d34319b2b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999dfd20-abe4-40c0-9d5b-ef178f5f56d5", "tag": "bd0218d9-c5ba-4c35-88f8-ae077a101c84"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:38.413304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2aa55033-74f9-4ba6-bae9-de88bb1e05e7 req-35c7b661-8482-46f3-b118-0d34319b2b3b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.413979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2aa55033-74f9-4ba6-bae9-de88bb1e05e7 req-35c7b661-8482-46f3-b118-0d34319b2b3b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.435995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2aa55033-74f9-4ba6-bae9-de88bb1e05e7 req-35c7b661-8482-46f3-b118-0d34319b2b3b service nova] Creating event network-changed:bd0218d9-c5ba-4c35-88f8-ae077a101c84 for instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 on n-h2-843861-3 Jul 19 19:52:38.442231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2aa55033-74f9-4ba6-bae9-de88bb1e05e7 req-35c7b661-8482-46f3-b118-0d34319b2b3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055650 Jul 19 19:52:38.443443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 830/1649] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:38.449225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:38.450135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:38.464058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.464769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.465766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.466360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.042632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:39.044598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:39.045741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:39.047770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:39.048458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:39.077843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.080923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.082121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.084574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.138329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Getting quotas for project 34f08654bc0c4c5ebd470add3fbdd33f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:39.162960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Getting quotas for user f8b01a00ec0b4496bd10a8c34fffc12f and project 34f08654bc0c4c5ebd470add3fbdd33f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:39.181670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:39.193686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Going to run 2 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:39.200818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 60bdfaab-698a-4b51-a784-97a5f5545b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:39.201765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:39.205872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:39.211840 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e6c9428-6a49-49e8-9b22-5f05a2a22062 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 0.766990 Jul 19 19:52:39.215369 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 831/1650] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:38 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:39.236249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bfe7b086-3150-40bf-b1d3-76d05f8df8aa tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88dad2040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.307824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=60bdfaab-698a-4b51-a784-97a5f5545b2a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:39.331190 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bfe7b086-3150-40bf-b1d3-76d05f8df8aa tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae" status: 200 len: 661 microversion: 2.1 time: 0.112982 Jul 19 19:52:39.331983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 832/1651] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae => generated 661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:39.347535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d16ce6c-9e08-4c67-9d32-bf7824c517c0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e0d0f70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.450029 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d16ce6c-9e08-4c67-9d32-bf7824c517c0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.116560 Jul 19 19:52:39.451374 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 833/1652] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:39.465496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.466872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:39.484578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.485393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.487346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.489518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.493798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-254cf27e-ae9c-4e14-bce9-bc835695d92b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.704887 Jul 19 19:52:39.495179 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 820/1653] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:39.502106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8eb0e8c7-87bf-4417-9640-cd60db7b3c46 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e455160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.609892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8eb0e8c7-87bf-4417-9640-cd60db7b3c46 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae" status: 200 len: 661 microversion: 2.1 time: 0.113410 Jul 19 19:52:39.618769 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 821/1654] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae => generated 661 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:39.625863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.638233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:39.654284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.658251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.658485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-718056b1-2858-4be2-a658-6dc9b258d541 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204837 Jul 19 19:52:39.659531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.660373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.661322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 834/1655] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:39.676559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:39.687108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:39.688517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Searching by: {'deleted': False, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:52:39.713458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.714259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.716043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.717728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.996618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f813e4f9-d807-41cf-8511-743e8d973319 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.324129 Jul 19 19:52:39.998260 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 835/1656] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/servers => generated 675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:40.018361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af243bf3-6eeb-4115-bf4f-89337866c238 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:40.032736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af243bf3-6eeb-4115-bf4f-89337866c238 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:40.154450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af243bf3-6eeb-4115-bf4f-89337866c238 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:40.165191 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af243bf3-6eeb-4115-bf4f-89337866c238 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1219 microversion: 2.1 time: 0.159448 Jul 19 19:52:40.168840 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 836/1657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:40 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:40.235566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:40.236213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:40.257854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:40.261032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:40.262418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:40.263136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:40.810370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:40.828739 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66f6bc53-ff47-4bf8-8ec1-6d9e1351d9f9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 1.208326 Jul 19 19:52:40.830015 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 822/1658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:39 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:40.845408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-befa7ab1-2ae4-4424-b813-5de4c175b5ba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e1264c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.365599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:41.390146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:41.395158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:41.396644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-299026ff-67f5-47da-8940-01a026590047 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 1.165911 Jul 19 19:52:41.415398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 837/1659] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:40 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:41.450883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.452820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:41.487201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.490337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:41.493766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.494522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:41.496555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-befa7ab1-2ae4-4424-b813-5de4c175b5ba tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.660598 Jul 19 19:52:41.497335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 823/1660] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:40 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:41.517159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.517987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:41.544705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.545167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:41.545970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.546410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:41.578397 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0cd489cb-6e05-4b5f-bf85-d108121113a6 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161454 Jul 19 19:52:41.588361 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 838/1661] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:41 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:41.599614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-110a923d-ab51-41ea-a96b-da7941122f92 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e3af5e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.675620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-110a923d-ab51-41ea-a96b-da7941122f92 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a" status: 200 len: 662 microversion: 2.1 time: 0.084579 Jul 19 19:52:41.677196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 839/1662] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:41 2022] GET /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:41.690940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3823072a-aa88-4198-8c63-485d3e6fca99 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e2ca4c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.803970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3823072a-aa88-4198-8c63-485d3e6fca99 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a" status: 200 len: 662 microversion: 2.1 time: 0.119147 Jul 19 19:52:41.806113 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 840/1663] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:41 2022] GET /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:52:41.851046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:41.852529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:41.882602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.883920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:41.885570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:41.886174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.194914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.210703 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8c48363-e09f-4cff-a1dd-a0cb68d1e544 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1223 microversion: 2.1 time: 0.708086 Jul 19 19:52:42.216556 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 824/1664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:41 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1223 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:42.435292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.438890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.442282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.465533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.466155 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5863339-4a15-43d4-acba-396aaf0aea54 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 0.607975 Jul 19 19:52:42.466999 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 841/1665] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:41 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:42.479745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.480944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.487758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.513609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36f4a544-cf70-4e52-b0ef-04adb8d79385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e264160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.639794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36f4a544-cf70-4e52-b0ef-04adb8d79385 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.131912 Jul 19 19:52:42.641122 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 842/1666] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:42.647905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.661765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.681944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.682887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.683969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.684748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.777378 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7aafc67a-3cc3-4288-bf82-bc1b5c98423d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134586 Jul 19 19:52:42.782422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 843/1667] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:43.235881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:43.236894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:43.253176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.255383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.257927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.258485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.477389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.490730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e711a466-fdb1-43e4-bd73-e9943b3ae56a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1277 microversion: 2.1 time: 0.262362 Jul 19 19:52:43.492103 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 844/1668] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:43 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:43.505986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:43.506967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:43.522148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.522606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.523382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.523834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.587073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:44.614142 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a074a70c-a7a0-4487-a5c0-9ada5f36e4dc tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 1.119302 Jul 19 19:52:44.615195 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 845/1669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:43 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:44.623762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de0ad5ab-d382-41fd-bd7a-6a20d8f6f271 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e2fc0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:44.718321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de0ad5ab-d382-41fd-bd7a-6a20d8f6f271 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7" status: 200 len: 662 microversion: 2.1 time: 0.101387 Jul 19 19:52:44.718896 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 846/1670] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:44 2022] GET /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7 => generated 662 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:44.735969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5dbf373-9488-4067-a30a-39af18d86dd6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e3af040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:44.752142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:44.767163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:44.774305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:44.775707 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aa13a52-bb40-480d-9e00-f843fba5d5e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 2.344113 Jul 19 19:52:44.786809 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 825/1671] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:44.792955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:44.793637 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5dbf373-9488-4067-a30a-39af18d86dd6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1438 microversion: 2.1 time: 0.066136 Jul 19 19:52:44.794201 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 847/1672] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:44 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:44.802398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:44.812213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-31091235-9bf1-45b3-836a-a37dab7ec6fb req-b601e148-00a4-4e0b-bbbb-7a35a4c3cca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:44.817288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.817963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.819652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.820300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.822058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-31091235-9bf1-45b3-836a-a37dab7ec6fb req-b601e148-00a4-4e0b-bbbb-7a35a4c3cca7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.822507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-31091235-9bf1-45b3-836a-a37dab7ec6fb req-b601e148-00a4-4e0b-bbbb-7a35a4c3cca7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.846080 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-31091235-9bf1-45b3-836a-a37dab7ec6fb req-b601e148-00a4-4e0b-bbbb-7a35a4c3cca7 service nova] Creating event network-changed:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h1-843861-3 Jul 19 19:52:44.857965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6d08bcd-72ab-4452-8650-8447cb6e32c5 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069837 Jul 19 19:52:44.859839 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 826/1673] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:52:44 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:52:44.861760 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-31091235-9bf1-45b3-836a-a37dab7ec6fb req-b601e148-00a4-4e0b-bbbb-7a35a4c3cca7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066171 Jul 19 19:52:44.862632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 848/1674] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:44.868825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efff1695-5946-4302-a82c-6f5e6973507e"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:44.873619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:44.885900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:44.886514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:44.890647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.891099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.891890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.892324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.909603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.910411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:44.912035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:44.912639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.245671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:45.259586 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9698c145-56bb-4350-9659-e7764ae7426b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1277 microversion: 2.1 time: 0.395586 Jul 19 19:52:45.261813 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 827/1675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:44 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1277 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:45.276703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aa6ae029-6d9f-47c4-bb58-f04b9f93c880 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d692e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:45.370323 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bddcdb0-9b4c-4fbc-9a9e-4a9e778e544f tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "POST /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506283 Jul 19 19:52:45.374942 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 849/1676] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:52:44 2022] POST /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:45.385619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aa6ae029-6d9f-47c4-bb58-f04b9f93c880 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7" status: 200 len: 662 microversion: 2.1 time: 0.121606 Jul 19 19:52:45.388252 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 828/1677] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:45 2022] GET /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7 => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:45.420852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-759ca7db-70e6-4771-9aa1-e43b6ea47269 req-1ceb07cd-317a-4304-a103-e0e380d263bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999dfd20-abe4-40c0-9d5b-ef178f5f56d5", "name": "network-vif-plugged", "status": "completed", "tag": "bd0218d9-c5ba-4c35-88f8-ae077a101c84"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:45.438201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-759ca7db-70e6-4771-9aa1-e43b6ea47269 req-1ceb07cd-317a-4304-a103-e0e380d263bd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.439366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-759ca7db-70e6-4771-9aa1-e43b6ea47269 req-1ceb07cd-317a-4304-a103-e0e380d263bd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.510725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1674441242", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:45.533761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-759ca7db-70e6-4771-9aa1-e43b6ea47269 req-1ceb07cd-317a-4304-a103-e0e380d263bd service nova] Creating event network-vif-plugged:bd0218d9-c5ba-4c35-88f8-ae077a101c84 for instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 on n-h2-843861-3 Jul 19 19:52:45.569708 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-759ca7db-70e6-4771-9aa1-e43b6ea47269 req-1ceb07cd-317a-4304-a103-e0e380d263bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153076 Jul 19 19:52:45.579204 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 850/1678] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:45.637074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:45.638045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:45.652988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.655148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:45.655292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.656255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.659990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.173356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:46.188555 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-923e573d-9be3-4338-b83b-23b1fab4f1eb tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1402 microversion: 2.1 time: 0.555406 Jul 19 19:52:46.191353 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 851/1679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:45 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1402 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:46.205125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:46.206016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:46.232746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.233188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.233982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.234414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.658263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:47.659003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:47.659480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:47.659928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:47.660682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:47.670238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.682349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.695293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.699512 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f8e823d-1812-435b-af87-cf67c0a58571 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 1.506206 Jul 19 19:52:47.701104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.701500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.716215 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 852/1680] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:46 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:47.719545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.720121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.734123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc8787b0-bb9b-4611-9753-e03cb69a2076 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88db01ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.786042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Getting quotas for project a89e0608370448d6bd14438297c2d1f5. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:47.797558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Getting quotas for user 8225eaa1e93e42b7b265fb2618b7055f and project a89e0608370448d6bd14438297c2d1f5. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:47.852423 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc8787b0-bb9b-4611-9753-e03cb69a2076 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1447 microversion: 2.1 time: 0.130095 Jul 19 19:52:47.853360 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 853/1681] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:47.873378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.874942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.875726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:47.877961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:47.899367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.902024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.904804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.906003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.021737 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2cee67f7-9202-499f-a2ef-93d93ebadd96 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514827 Jul 19 19:52:48.032890 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 829/1682] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:48.040553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.041416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:48.049823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.050459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.052043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.052655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.542991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.553362 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9cc47f25-86cf-4896-a980-1976b42f02a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 0.698568 Jul 19 19:52:48.558242 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 854/1683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:48.571743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12eece93-e534-48e2-8561-0146a143a367 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88dc0b790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.699625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12eece93-e534-48e2-8561-0146a143a367 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 200 len: 1447 microversion: 2.1 time: 0.138922 Jul 19 19:52:48.700297 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 855/1684] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:52:48 2022] GET /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:48.711929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1611908814", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:48.750813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.759744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-225b666c-e1bc-4959-9b35-c2c90e9d4540 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1588 microversion: 2.1 time: 0.725712 Jul 19 19:52:48.769014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 830/1685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:48 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1588 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:48.801707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-085e0e9e-fe31-4489-9cb0-a1eb7b086f49 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88def6c10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:49.781569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-085e0e9e-fe31-4489-9cb0-a1eb7b086f49 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 204 len: 0 microversion: 2.1 time: 1.010174 Jul 19 19:52:49.782660 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 831/1686] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:48 2022] DELETE /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:49.798696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:49.802762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:49.823988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.825197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:49.825847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.826891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.827511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.846082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:50.159703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:50.694866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.709854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.714535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.717640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d85f872-3ab7-4967-80eb-8acfee1a0bbb tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 0.925560 Jul 19 19:52:50.719228 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 832/1687] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:49 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:50.742634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:50.746986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:50.765592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.766058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.766841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.767276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.818932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:50.977331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:50.978475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:50.979337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:50.979976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:50.980733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:51.003124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.004194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.005267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.005898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.021290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:51.069364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Getting quotas for project a89e0608370448d6bd14438297c2d1f5. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:51.091129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Getting quotas for user 8225eaa1e93e42b7b265fb2618b7055f and project a89e0608370448d6bd14438297c2d1f5. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:51.116010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:51.118332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:51.168740 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2bcc17d3-2814-4de1-ac36-f14c27c78278 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.447484 Jul 19 19:52:51.170897 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 833/1688] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:52:50 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5/os-interface => generated 284 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:51.177393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.178824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:51.201888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.206836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.209247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f78f63e-e289-4dd6-ae6f-d65f1ba1ee40 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.507868 Jul 19 19:52:51.210964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 856/1689] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:51.217829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.218490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.222304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.223055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:51.237201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.242752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.244184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.244800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.315250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:51.470100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de7f4bf1-852e-480e-b292-e660a9a3dc23 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 204 len: 0 microversion: 2.1 time: 0.256557 Jul 19 19:52:51.472175 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 857/1690] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:51 2022] DELETE /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:51.480021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fb0cfdb5-8ac6-4981-896f-5b55f3529d6c req-b98fb074-5784-4a93-ba5c-a3b8287a2175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bdfaab-698a-4b51-a784-97a5f5545b2a", "tag": "3be711d5-ffb3-442b-a436-3f4bc5d987a4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:51.489747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fb0cfdb5-8ac6-4981-896f-5b55f3529d6c req-b98fb074-5784-4a93-ba5c-a3b8287a2175 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.490634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fb0cfdb5-8ac6-4981-896f-5b55f3529d6c req-b98fb074-5784-4a93-ba5c-a3b8287a2175 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.525565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fb0cfdb5-8ac6-4981-896f-5b55f3529d6c req-b98fb074-5784-4a93-ba5c-a3b8287a2175 service nova] Creating event network-changed:3be711d5-ffb3-442b-a436-3f4bc5d987a4 for instance 60bdfaab-698a-4b51-a784-97a5f5545b2a on n-h2-843861-3 Jul 19 19:52:51.537721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fb0cfdb5-8ac6-4981-896f-5b55f3529d6c req-b98fb074-5784-4a93-ba5c-a3b8287a2175 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063460 Jul 19 19:52:51.540025 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 858/1691] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:51.555094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c87e5a25-7baf-499f-992c-ef9558d26c4a req-a74c2712-8783-446e-94bd-84d1603c6e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d03653-102d-4d49-828e-f11082c2e611", "name": "network-vif-unplugged", "status": "completed", "tag": "f32ac764-1592-47ee-a500-ad9c58628726"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:51.579834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c87e5a25-7baf-499f-992c-ef9558d26c4a req-a74c2712-8783-446e-94bd-84d1603c6e58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.581376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c87e5a25-7baf-499f-992c-ef9558d26c4a req-a74c2712-8783-446e-94bd-84d1603c6e58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.613016 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c87e5a25-7baf-499f-992c-ef9558d26c4a req-a74c2712-8783-446e-94bd-84d1603c6e58 service nova] Creating event network-vif-unplugged:f32ac764-1592-47ee-a500-ad9c58628726 for instance 64d03653-102d-4d49-828e-f11082c2e611 on n-h2-843861-3 Jul 19 19:52:51.661072 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c87e5a25-7baf-499f-992c-ef9558d26c4a req-a74c2712-8783-446e-94bd-84d1603c6e58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115562 Jul 19 19:52:51.669213 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 859/1692] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:51.685698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e7686f8-e359-45e8-8b5c-90c4afeb8464 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.688190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e7686f8-e359-45e8-8b5c-90c4afeb8464 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:51.736459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:51.748184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b244c98-11db-4e0f-a2af-8a4d7cb86e06 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 0.575234 Jul 19 19:52:51.749471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 834/1693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:51 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:51.756332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-795313606", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f99d3c74-93b6-4718-9088-9758ebb4ad6d"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:51.880910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] validate_networks() for [('f99d3c74-93b6-4718-9088-9758ebb4ad6d', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:51.938948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e7686f8-e359-45e8-8b5c-90c4afeb8464 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:51.947352 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e7686f8-e359-45e8-8b5c-90c4afeb8464 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1218 microversion: 2.1 time: 0.276805 Jul 19 19:52:51.957199 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 860/1694] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:51 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:51.986219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.988926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:52.007445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.029498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:52.032490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.033220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.749152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.784937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.801774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.811851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf611e15-7365-45cd-b430-82ac99b8501e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 1.855283 Jul 19 19:52:53.813261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 861/1695] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:51 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:53.824012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-172c0380-c19e-4f90-8e8c-17dd09ef81a8 req-e7e3d8fb-3ad0-4ab8-b33d-f2723e8020cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27786bf1-21f7-4642-a0bc-3450ef410caa", "tag": "f9565ce6-02a5-4768-a863-5eb0bf992a80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:53.841992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-172c0380-c19e-4f90-8e8c-17dd09ef81a8 req-e7e3d8fb-3ad0-4ab8-b33d-f2723e8020cd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.842656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-172c0380-c19e-4f90-8e8c-17dd09ef81a8 req-e7e3d8fb-3ad0-4ab8-b33d-f2723e8020cd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.865312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-172c0380-c19e-4f90-8e8c-17dd09ef81a8 req-e7e3d8fb-3ad0-4ab8-b33d-f2723e8020cd service nova] Creating event network-changed:f9565ce6-02a5-4768-a863-5eb0bf992a80 for instance 27786bf1-21f7-4642-a0bc-3450ef410caa on n-h1-843861-3 Jul 19 19:52:53.876471 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-172c0380-c19e-4f90-8e8c-17dd09ef81a8 req-e7e3d8fb-3ad0-4ab8-b33d-f2723e8020cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060039 Jul 19 19:52:53.877091 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 862/1696] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:53.891124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:53.891846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:53.907158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.907615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.908440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.908881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.643515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:54.646005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:54.646846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:54.647485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:54.648651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:54.666498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=21 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:54.680089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.681981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.685586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.686670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.746359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:54.756461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Getting quotas for user fecc799226eb4a39950040a548b1987d and project 09eb1578906647e08c57dab00a8d4b69. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:54.784216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:54.788089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:54.845367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89d768f4-0d2d-4ee8-b818-a19191881803 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.094591 Jul 19 19:52:54.851561 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 835/1697] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:54.851940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:54.852865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:54.863120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.865288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.866968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.868061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.140587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.155457 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-30bb131b-eb79-4ec2-8efa-ef160f8a7f14 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 1.269293 Jul 19 19:52:55.158916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 863/1698] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:53 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:55.177019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:55.178430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:55.190813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.194769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.199959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.201017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.239929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.268860 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c628efff-da24-4925-b41e-bbec91823e62 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1276 microversion: 2.1 time: 0.420652 Jul 19 19:52:55.269461 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 836/1699] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:54 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1276 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:55.287595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-244d13ef-9354-45f5-992a-4e983057d6ff tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:55.288732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-244d13ef-9354-45f5-992a-4e983057d6ff tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:55.475198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-244d13ef-9354-45f5-992a-4e983057d6ff tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.483197 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-244d13ef-9354-45f5-992a-4e983057d6ff tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1207 microversion: 2.1 time: 0.207778 Jul 19 19:52:55.498253 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 837/1700] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:55 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1207 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:56.176018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:56.177485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:56.199509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.200114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.208138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.209006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.323616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.332688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.341917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.343182 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0711c0a-0e2c-4649-ba17-882a8c05ac82 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1293 microversion: 2.25 time: 2.180462 Jul 19 19:52:57.352693 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 864/1701] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:55 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1293 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:57.361838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.362320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.387801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.388179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.388959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.389399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.839131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.848353 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe22ddd8-77c9-412d-adaa-6230e11637c6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1276 microversion: 2.1 time: 0.494381 Jul 19 19:52:57.849892 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 865/1702] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1276 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:57.854721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.855459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.864281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.865508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.866595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.867300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.059549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.089669 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0423be5-c4b4-4555-83e4-9cf76adea3b2 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1265 microversion: 2.1 time: 0.238471 Jul 19 19:52:58.094078 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 866/1703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:58.111473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-41c525c4-48fc-447b-8b88-0e3e4c644e0b req-7b14ec20-e7b2-4cc2-b22b-7c32c20a7954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d03653-102d-4d49-828e-f11082c2e611", "name": "network-vif-deleted", "tag": "f32ac764-1592-47ee-a500-ad9c58628726"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:58.112762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.131334 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27dca9f2-f961-43d8-bd11-4da3bf5bbcd4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 1.957649 Jul 19 19:52:58.133955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 838/1704] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:56 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:58.139447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-41c525c4-48fc-447b-8b88-0e3e4c644e0b req-7b14ec20-e7b2-4cc2-b22b-7c32c20a7954 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.143716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-41c525c4-48fc-447b-8b88-0e3e4c644e0b req-7b14ec20-e7b2-4cc2-b22b-7c32c20a7954 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.173685 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-41c525c4-48fc-447b-8b88-0e3e4c644e0b req-7b14ec20-e7b2-4cc2-b22b-7c32c20a7954 service nova] Creating event network-vif-deleted:f32ac764-1592-47ee-a500-ad9c58628726 for instance 64d03653-102d-4d49-828e-f11082c2e611 on n-h2-843861-3 Jul 19 19:52:58.189555 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-41c525c4-48fc-447b-8b88-0e3e4c644e0b req-7b14ec20-e7b2-4cc2-b22b-7c32c20a7954 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093194 Jul 19 19:52:58.197624 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 867/1705] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:58.366150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.366847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.375552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.376035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.378077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.378923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.406878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0d72dd2-b65f-4c0b-8481-3f26c9aff6f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2105461074", "ram": 512, "vcpus": 1, "disk": 10, "id": 453867472, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:58.409318 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:52:58.409318 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:52:58.440653 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b0d72dd2-b65f-4c0b-8481-3f26c9aff6f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.304776 Jul 19 19:52:58.443541 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 839/1706] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:58.688653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4186f6f1-6b53-48f3-8d18-ad5388dbfc4f tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.709076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-4186f6f1-6b53-48f3-8d18-ad5388dbfc4f tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] HTTP exception thrown: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4186f6f1-6b53-48f3-8d18-ad5388dbfc4f tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Request method failure captured: Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuX-hJpvy5OrLsIW69N_1l7iwPgp7koHqeetHDBMl-abGnsoHTLeNUKZEnzjQG2ZpXg3MAZ1j4TnhXn0OWPI50TVrNS0TI3ReNci1mkyguVDb_Rz-dv_Px-odcgSHsHDWGF7v-sKlDD16TO4rmMUUhJ-yA2p8WXtfOoeFQGLfSyFqU Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: dc288c483022490fad8a8b9bf37f520f Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:cpu_thread_policy'} Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:52:58.715447 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:52:58.720108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4186f6f1-6b53-48f3-8d18-ad5388dbfc4f tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Returning 404 to user: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:58.720108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4186f6f1-6b53-48f3-8d18-ad5388dbfc4f tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] 10.222.0.33 "GET /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.266584 Jul 19 19:52:58.727965 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 840/1707] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:52:58.746088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.747347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.764597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.766772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.768895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.769349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.003605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.014503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.016071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.017213 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ca8feb5-48dc-491f-ab90-bd2837d9ae37 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.657448 Jul 19 19:52:59.017780 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 868/1708] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:59.033231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a6497eb7-621f-4f44-8e53-417d554d9b76 req-7aabaefe-9818-4e5c-9b54-f9425f941acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999dfd20-abe4-40c0-9d5b-ef178f5f56d5", "tag": "bd0218d9-c5ba-4c35-88f8-ae077a101c84"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:59.066565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a6497eb7-621f-4f44-8e53-417d554d9b76 req-7aabaefe-9818-4e5c-9b54-f9425f941acb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.068730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a6497eb7-621f-4f44-8e53-417d554d9b76 req-7aabaefe-9818-4e5c-9b54-f9425f941acb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.100115 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a6497eb7-621f-4f44-8e53-417d554d9b76 req-7aabaefe-9818-4e5c-9b54-f9425f941acb service nova] Creating event network-changed:bd0218d9-c5ba-4c35-88f8-ae077a101c84 for instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 on n-h2-843861-3 Jul 19 19:52:59.111359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a6497eb7-621f-4f44-8e53-417d554d9b76 req-7aabaefe-9818-4e5c-9b54-f9425f941acb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084657 Jul 19 19:52:59.120400 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 869/1709] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:59.132008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29ba4eab-5d68-48ac-a28b-ccf2073eba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:59.158653 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:52:59.158653 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:52:59.161386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29ba4eab-5d68-48ac-a28b-ccf2073eba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'dc288c483022490fad8a8b9bf37f520f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5725c179e59c4ea9a956469defbfd3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29ba4eab-5d68-48ac-a28b-ccf2073eba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Request method failure captured: Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/flavors/453867472/os-extra_specs HTTP/1.1 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 66 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wuX-hJpvy5OrLsIW69N_1l7iwPgp7koHqeetHDBMl-abGnsoHTLeNUKZEnzjQG2ZpXg3MAZ1j4TnhXn0OWPI50TVrNS0TI3ReNci1mkyguVDb_Rz-dv_Px-odcgSHsHDWGF7v-sKlDD16TO4rmMUUhJ-yA2p8WXtfOoeFQGLfSyFqU Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: dc288c483022490fad8a8b9bf37f520f Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'flavor_id': '453867472', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:52:59.166944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:52:59.171584 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:52:59.174426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29ba4eab-5d68-48ac-a28b-ccf2073eba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:59.177049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-29ba4eab-5d68-48ac-a28b-ccf2073eba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] 10.222.0.33 "POST /compute/v2.1/flavors/453867472/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.053020 Jul 19 19:52:59.184769 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 870/1710] 10.222.0.33 () {60 vars in 1220 bytes} [Tue Jul 19 19:52:59 2022] POST /compute/v2.1/flavors/453867472/os-extra_specs => generated 124 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:59.200167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.201015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.209971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.210796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.211953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.225980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.375160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.387544 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9c0f24b4-3970-41e4-91f3-c876256f6a8b tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1588 microversion: 2.1 time: 0.654744 Jul 19 19:52:59.388736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 841/1711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1588 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:59.402379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.404984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.413052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:59.431027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.434613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.435669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.438623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.705309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.718772 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2dda9894-cafc-43c9-88ac-5a4fb87f44dc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1265 microversion: 2.1 time: 0.328583 Jul 19 19:52:59.719690 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 842/1712] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:59.727789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.728438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.743137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.744101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.745118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.745722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.637378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.647237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-989ba1b2-677a-4095-a1c4-45cc07882cde tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 1.461101 Jul 19 19:53:00.648603 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 871/1713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:00.657933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74e5693f-9506-4040-875b-554fcb85c65f tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:00.661481 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:00.661481 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:53:00.670058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:00.702251 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74e5693f-9506-4040-875b-554fcb85c65f tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/453867472/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052249 Jul 19 19:53:00.702954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 872/1714] 10.222.0.33 () {60 vars in 1220 bytes} [Tue Jul 19 19:53:00 2022] POST /compute/v2.1/flavors/453867472/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:53:00.709592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6e99929a-1015-4117-b9fc-356eb8711091 req-853df988-93c6-4f8b-84c9-7ae36f85aeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bdfaab-698a-4b51-a784-97a5f5545b2a", "name": "network-vif-plugged", "status": "completed", "tag": "3be711d5-ffb3-442b-a436-3f4bc5d987a4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:00.719025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6e99929a-1015-4117-b9fc-356eb8711091 req-853df988-93c6-4f8b-84c9-7ae36f85aeff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.719463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6e99929a-1015-4117-b9fc-356eb8711091 req-853df988-93c6-4f8b-84c9-7ae36f85aeff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.732774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6e99929a-1015-4117-b9fc-356eb8711091 req-853df988-93c6-4f8b-84c9-7ae36f85aeff service nova] Creating event network-vif-plugged:3be711d5-ffb3-442b-a436-3f4bc5d987a4 for instance 60bdfaab-698a-4b51-a784-97a5f5545b2a on n-h2-843861-3 Jul 19 19:53:00.737946 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6e99929a-1015-4117-b9fc-356eb8711091 req-853df988-93c6-4f8b-84c9-7ae36f85aeff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Jul 19 19:53:00.738723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 873/1715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:00.744220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.744923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.752192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.752653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.753433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.753869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.799463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.817227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7a66dd2-fb64-49c0-91c7-943f2ec1af21 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 1.095835 Jul 19 19:53:00.818053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 843/1716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:00.824627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70312455-c40d-4f7c-be25-75f3cc2d303d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.825497 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:00.825497 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:53:00.826460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70312455-c40d-4f7c-be25-75f3cc2d303d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'dc288c483022490fad8a8b9bf37f520f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5725c179e59c4ea9a956469defbfd3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70312455-c40d-4f7c-be25-75f3cc2d303d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Request method failure captured: Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuX-hJpvy5OrLsIW69N_1l7iwPgp7koHqeetHDBMl-abGnsoHTLeNUKZEnzjQG2ZpXg3MAZ1j4TnhXn0OWPI50TVrNS0TI3ReNci1mkyguVDb_Rz-dv_Px-odcgSHsHDWGF7v-sKlDD16TO4rmMUUhJ-yA2p8WXtfOoeFQGLfSyFqU Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: dc288c483022490fad8a8b9bf37f520f Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:numa_nodes'} Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:00.828325 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70312455-c40d-4f7c-be25-75f3cc2d303d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70312455-c40d-4f7c-be25-75f3cc2d303d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012176 Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 844/1717] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:00 2022] DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:00.839207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.841399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.850941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.851878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.852728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.853433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.986022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.995272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf64c445-1361-468f-b95c-3b0ef1829df1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1265 microversion: 2.1 time: 0.161652 Jul 19 19:53:00.996819 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 845/1718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:01.003209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78be80ab-2178-4cae-b900-7f7e49740e26 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:01.005421 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:01.005421 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:53:01.021733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:01.029936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78be80ab-2178-4cae-b900-7f7e49740e26 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/453867472/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031756 Jul 19 19:53:01.030722 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 846/1719] 10.222.0.33 () {60 vars in 1220 bytes} [Tue Jul 19 19:53:00 2022] POST /compute/v2.1/flavors/453867472/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:53:01.045642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e42a6ea1-b1b9-4dbb-b34a-620263f5991d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:01.047531 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:01.047531 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:53:01.049042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e42a6ea1-b1b9-4dbb-b34a-620263f5991d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'dc288c483022490fad8a8b9bf37f520f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5725c179e59c4ea9a956469defbfd3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e42a6ea1-b1b9-4dbb-b34a-620263f5991d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Request method failure captured: Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 22 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuX-hJpvy5OrLsIW69N_1l7iwPgp7koHqeetHDBMl-abGnsoHTLeNUKZEnzjQG2ZpXg3MAZ1j4TnhXn0OWPI50TVrNS0TI3ReNci1mkyguVDb_Rz-dv_Px-odcgSHsHDWGF7v-sKlDD16TO4rmMUUhJ-yA2p8WXtfOoeFQGLfSyFqU Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5725c179e59c4ea9a956469defbfd3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5725c179e59c4ea9a956469defbfd3d9 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: dc288c483022490fad8a8b9bf37f520f Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: {"hw:numa_nodes": "1"} Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:53:01.052021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:53:01.056484 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.057793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e42a6ea1-b1b9-4dbb-b34a-620263f5991d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:01.058793 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e42a6ea1-b1b9-4dbb-b34a-620263f5991d tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813 tempest-FlavorsExtraSpecsNegativeTestJSON-1663519813-project] 10.222.0.33 "PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017745 Jul 19 19:53:01.059283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 847/1720] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:53:01 2022] PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:01.068665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3b52e09-3182-4303-9506-ffd0a97d315d tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.071054 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:01.071054 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:53:01.083196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a3b52e09-3182-4303-9506-ffd0a97d315d tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] HTTP exception thrown: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3b52e09-3182-4303-9506-ffd0a97d315d tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Request method failure captured: Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuY25PnmIH_HlL-H0QxFvCrwt-y1pZyerv1h8cn-YPYu5xxl7rEgINY8GQ7YNFeqT460BdFykwmt9pCy8v3Xg9Y7xAbSD9uG_43y7ppmQHq_POehiLF5UJSGs117t3MZex5gN_NMWwWEljIZ3QTcnKMrGO92d3rfwuzzFxp4E_wAAI Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 6d968bc708b6416781f4fc3dd113edbe Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:cpu_thread_policy'} Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:53:01.084752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.091773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3b52e09-3182-4303-9506-ffd0a97d315d tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Returning 404 to user: Flavor 453867472 has no extra specs with key hw:cpu_thread_policy. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:01.091773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3b52e09-3182-4303-9506-ffd0a97d315d tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.021299 Jul 19 19:53:01.091773 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 848/1721] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 19:53:01 2022] DELETE /compute/v2.1/flavors/453867472/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:01.097112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fffa16f-5eed-4287-8856-4339f178b0c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:01.101405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-6fffa16f-5eed-4287-8856-4339f178b0c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fffa16f-5eed-4287-8856-4339f178b0c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Request method failure captured: Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 27 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuY25PnmIH_HlL-H0QxFvCrwt-y1pZyerv1h8cn-YPYu5xxl7rEgINY8GQ7YNFeqT460BdFykwmt9pCy8v3Xg9Y7xAbSD9uG_43y7ppmQHq_POehiLF5UJSGs117t3MZex5gN_NMWwWEljIZ3QTcnKMrGO92d3rfwuzzFxp4E_wAAI Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 6d968bc708b6416781f4fc3dd113edbe Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: {"hw:cpu_policy": "shared"} Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: exception: Request body and URI mismatch Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 19 19:53:01.104443 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.109928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fffa16f-5eed-4287-8856-4339f178b0c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:01.109928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6fffa16f-5eed-4287-8856-4339f178b0c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013793 Jul 19 19:53:01.109928 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 849/1722] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:53:01 2022] PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:53:01.123491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25f1d446-b5d6-42bd-af17-d89f2c651896 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25f1d446-b5d6-42bd-af17-d89f2c651896 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Request method failure captured: Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 49 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuY25PnmIH_HlL-H0QxFvCrwt-y1pZyerv1h8cn-YPYu5xxl7rEgINY8GQ7YNFeqT460BdFykwmt9pCy8v3Xg9Y7xAbSD9uG_43y7ppmQHq_POehiLF5UJSGs117t3MZex5gN_NMWwWEljIZ3QTcnKMrGO92d3rfwuzzFxp4E_wAAI Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1045b59f114e4f5abd2d63c67ae9810d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1045b59f114e4f5abd2d63c67ae9810d Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 6d968bc708b6416781f4fc3dd113edbe Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'flavor_id': '453867472', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:53:01.126896 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:53:01.132103 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:01.133650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25f1d446-b5d6-42bd-af17-d89f2c651896 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:01.134981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25f1d446-b5d6-42bd-af17-d89f2c651896 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021601 Jul 19 19:53:01.135571 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 850/1723] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:53:01 2022] PUT /compute/v2.1/flavors/453867472/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:53:01.148945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1cb13cc1-a388-496a-9deb-bea9bb77e5f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.150613 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:01.150613 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:53:01.177425 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1cb13cc1-a388-496a-9deb-bea9bb77e5f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/453867472" status: 202 len: 0 microversion: 2.1 time: 0.036202 Jul 19 19:53:01.178974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 851/1724] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:53:01 2022] DELETE /compute/v2.1/flavors/453867472 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:53:01.187681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f68cf939-de2b-4449-a69f-89c9fe33cdfe tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.216477 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f68cf939-de2b-4449-a69f-89c9fe33cdfe tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552 tempest-FlavorsExtraSpecsNegativeTestJSON-1166320552-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032097 Jul 19 19:53:01.217810 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 852/1725] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:01.338133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.346806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.350022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.351144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68264d14-e696-4532-a6c9-00081516635f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.611174 Jul 19 19:53:01.365731 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 874/1726] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:01.666121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.666820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:01.673889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.674601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.675458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.676113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.836138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.836922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:01.854388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.855663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.858948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.860449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.944638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:02.188853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.200821 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c33b020-bdbd-4234-a124-72fad4642b8c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.538088 Jul 19 19:53:02.204486 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 853/1727] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.221746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-699c3071-4ab5-4382-abca-64e275083efe req-ede95be2-34a7-434e-b357-26cccd235feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:02.242602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-699c3071-4ab5-4382-abca-64e275083efe req-ede95be2-34a7-434e-b357-26cccd235feb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.243342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-699c3071-4ab5-4382-abca-64e275083efe req-ede95be2-34a7-434e-b357-26cccd235feb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.302453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-699c3071-4ab5-4382-abca-64e275083efe req-ede95be2-34a7-434e-b357-26cccd235feb service nova] Creating event network-changed:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:53:02.317467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-699c3071-4ab5-4382-abca-64e275083efe req-ede95be2-34a7-434e-b357-26cccd235feb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108920 Jul 19 19:53:02.318878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 854/1728] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:02.328697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.331689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.357788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.359897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.363918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.365674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.614140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.626619 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-122baa12-09d5-46df-b724-a1eab304354c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 0.795869 Jul 19 19:53:02.627412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 875/1729] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.636858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.640455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.647677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.648404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.653870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.654399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.103590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.119969 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1cec9e45-914a-4436-8543-848b357a6208 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.796864 Jul 19 19:53:03.120962 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 855/1730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:03.131329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dd9328a6-8b6a-4a00-8ec7-93f9e329d0e7 req-7e7ba5bf-bbd2-4814-ae4d-bec746b4ef8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27786bf1-21f7-4642-a0bc-3450ef410caa", "name": "network-vif-plugged", "status": "completed", "tag": "f9565ce6-02a5-4768-a863-5eb0bf992a80"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:03.148127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd9328a6-8b6a-4a00-8ec7-93f9e329d0e7 req-7e7ba5bf-bbd2-4814-ae4d-bec746b4ef8d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.149454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd9328a6-8b6a-4a00-8ec7-93f9e329d0e7 req-7e7ba5bf-bbd2-4814-ae4d-bec746b4ef8d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.169121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dd9328a6-8b6a-4a00-8ec7-93f9e329d0e7 req-7e7ba5bf-bbd2-4814-ae4d-bec746b4ef8d service nova] Creating event network-vif-plugged:f9565ce6-02a5-4768-a863-5eb0bf992a80 for instance 27786bf1-21f7-4642-a0bc-3450ef410caa on n-h1-843861-3 Jul 19 19:53:03.175050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dd9328a6-8b6a-4a00-8ec7-93f9e329d0e7 req-7e7ba5bf-bbd2-4814-ae4d-bec746b4ef8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052629 Jul 19 19:53:03.181600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 856/1731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:03.211519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.223597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.226921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.240905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.242330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.243134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.245732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.248213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.248793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.250449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73649aca-b6e3-48df-802f-0acb5e096be2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.621094 Jul 19 19:53:03.262626 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 876/1732] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:03.647849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.648722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.656752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.659301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.661108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.662482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.670873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.686010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57246f09-0bf3-4eab-a5fc-21e616c6b48f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.468733 Jul 19 19:53:03.686632 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 857/1733] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:04.137593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.138626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.150258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.150741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.151529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.152007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.155271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.169877 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b96d68b-f622-4b08-95b0-4013cde9caa1 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 0.526757 Jul 19 19:53:04.171067 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 877/1734] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:04.271121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.273111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.282573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.283455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.284667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.285903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.453414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.466551 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f6daf80-7475-4cf1-8cac-fe106079af9a tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.331760 Jul 19 19:53:04.467789 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 858/1735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:04.475998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-82ce34a8-a0de-4697-a3da-cf69f77e4c83 req-b4dabb1b-a339-4003-ae86-4626e1f674c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eed787c-37b2-47db-b62c-36184e2deedf", "tag": "121c7c63-feab-412b-8930-3d950e9e63f4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:04.508099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-82ce34a8-a0de-4697-a3da-cf69f77e4c83 req-b4dabb1b-a339-4003-ae86-4626e1f674c5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.509439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-82ce34a8-a0de-4697-a3da-cf69f77e4c83 req-b4dabb1b-a339-4003-ae86-4626e1f674c5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.530766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-82ce34a8-a0de-4697-a3da-cf69f77e4c83 req-b4dabb1b-a339-4003-ae86-4626e1f674c5 service nova] Creating event network-changed:121c7c63-feab-412b-8930-3d950e9e63f4 for instance 3eed787c-37b2-47db-b62c-36184e2deedf on n-h1-843861-3 Jul 19 19:53:04.537661 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-82ce34a8-a0de-4697-a3da-cf69f77e4c83 req-b4dabb1b-a339-4003-ae86-4626e1f674c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067511 Jul 19 19:53:04.539581 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 859/1736] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:04.571665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.575766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:04.581128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.584555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.585770 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a6cecc2-4da1-4926-8533-47d1a8de2492 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.321019 Jul 19 19:53:04.596348 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 878/1737] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:04.705986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.707265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.716145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.717253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.718817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.719530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.720368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:04.899661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.910523 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cd30118-e200-4a7a-b798-7d4113a111b9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.210592 Jul 19 19:53:04.911162 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 860/1738] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:05.186979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.187880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.194755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.195143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.195926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.196365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.261483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e95e94d-e201-468a-9bb9-15ace17b742c tempest-InstanceUsageAuditLogTestJSON-625110920 tempest-InstanceUsageAuditLogTestJSON-625110920-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.262508 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:05.262508 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:53:05.283253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e95e94d-e201-468a-9bb9-15ace17b742c tempest-InstanceUsageAuditLogTestJSON-625110920 tempest-InstanceUsageAuditLogTestJSON-625110920-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 19:53:05" status: 200 len: 318 microversion: 2.1 time: 0.152571 Jul 19 19:53:05.290868 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 879/1739] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019%3A53%3A05 => generated 318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:05.295416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6697f36c-6df4-43d5-a123-4fb66397612f tempest-InstanceUsageAuditLogTestJSON-625110920 tempest-InstanceUsageAuditLogTestJSON-625110920-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.296513 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:05.296513 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:53:05.309278 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6697f36c-6df4-43d5-a123-4fb66397612f tempest-InstanceUsageAuditLogTestJSON-625110920 tempest-InstanceUsageAuditLogTestJSON-625110920-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.017311 Jul 19 19:53:05.309976 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 880/1740] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:05.344554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.354818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f21ef90-75bf-4d07-83cb-bd5fb71597e5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1319 microversion: 2.1 time: 0.172370 Jul 19 19:53:05.377460 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 861/1741] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:05.486064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.487071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.496638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.497772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.498592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.499052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.608964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.609592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.611583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:05.618637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.629427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.633628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.634271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.666999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.675026 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9670aff9-99ee-4950-9db6-0f8e7b4bfa12 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.193496 Jul 19 19:53:05.676288 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 881/1742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:05.818303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.829424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.831997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.842645 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5120969d-2f17-4e64-871d-8df163dd0b76 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.241379 Jul 19 19:53:05.843389 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 862/1743] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:05.930050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.931223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.937942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.938394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.939351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.939840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.387271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:06.388016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:06.395557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.396122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.396978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.397515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.831925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.841279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f35fa30f-e297-419a-98d6-70ea66c43b05 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.916915 Jul 19 19:53:06.841878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 882/1744] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:06.849842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f99505fa-59e8-4870-b045-164632b6b706 req-2387991a-271a-4bad-b83f-f3d412aac8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd50d038-ce43-427b-85e0-5df2ff046890", "tag": "4a6e9edd-c06e-48ad-89e6-ee4212390ae8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:06.860398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f99505fa-59e8-4870-b045-164632b6b706 req-2387991a-271a-4bad-b83f-f3d412aac8bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.861093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f99505fa-59e8-4870-b045-164632b6b706 req-2387991a-271a-4bad-b83f-f3d412aac8bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.881899 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f99505fa-59e8-4870-b045-164632b6b706 req-2387991a-271a-4bad-b83f-f3d412aac8bb service nova] Creating event network-changed:4a6e9edd-c06e-48ad-89e6-ee4212390ae8 for instance dd50d038-ce43-427b-85e0-5df2ff046890 on n-h2-843861-3 Jul 19 19:53:06.888955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f99505fa-59e8-4870-b045-164632b6b706 req-2387991a-271a-4bad-b83f-f3d412aac8bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045627 Jul 19 19:53:06.890011 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 883/1745] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:06.896579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:06.897964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:06.912884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.913335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.914917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.915369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.981410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.018847 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4da69c42-f837-46b4-9ce4-974af56c2429 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 200 len: 1507 microversion: 2.1 time: 0.638162 Jul 19 19:53:07.023867 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 863/1746] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:06 2022] GET /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 1507 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:07.028802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:07.036425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:07.046441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.050037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.063749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.064331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.068858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:07.533759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.549787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2e6fbb3-8a9f-4e3e-b768-ac30cc8a1a6c tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.656669 Jul 19 19:53:07.552862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 884/1747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:06 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:07.567312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:07.569469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 60bdfaab-698a-4b51-a784-97a5f5545b2a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:07.580108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.581131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.583271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.584659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.634290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.658047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.660042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.663222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09f7a568-9ea4-4232-87a8-f4580bcabf89 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.637471 Jul 19 19:53:07.691072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 864/1748] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:07 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:08.040596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d8d9f84a-ad69-4a93-8556-d7b631cdcd59"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:08.042591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.051071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.057312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.058349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.060426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.068285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.078314 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc7c49bf-9aac-4356-a5a9-cd0e10b1cd81 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/60bdfaab-698a-4b51-a784-97a5f5545b2a" status: 200 len: 1506 microversion: 2.1 time: 0.524064 Jul 19 19:53:08.091768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 885/1749] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:07 2022] GET /compute/v2.1/servers/60bdfaab-698a-4b51-a784-97a5f5545b2a => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:08.116572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.123529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.152954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.153649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.154872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.155737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.294152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] HTTP exception thrown: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Request method failure captured: Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments/efff1695-5946-4302-a82c-6f5e6973507e HTTP/1.1 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 74 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1ws51IcvNpEBmJ4FDEqa2AbIQZqJwbBV08upvNy0ZOJ1nBZUK06BMyumB9qPnMaavvlkF_CrW8cC6oFnwBMs8PRmIMT5SeWrfAhTolWEFl8ILWwDl84zDbqfGeeEH1MxCHNcrEVpqtJZRorncubcCmsZ8U1fTZw1WXN-wXXz0tsLdyQ Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6c2a34698da741898ea9520cf6da3386 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6c2a34698da741898ea9520cf6da3386"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6c2a34698da741898ea9520cf6da3386 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesAdminNegativeTest-641721641-project-admin Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea703372a3234ddb868acae5892c9f66 Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesAdminNegativeTest-641721641-project-admin Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: {"volumeAttachment": {"volumeId": "d8d9f84a-ad69-4a93-8556-d7b631cdcd59"}} Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: exception: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': 'e6710ce1-4b25-43a4-bf46-ea323108e492', 'id': 'efff1695-5946-4302-a82c-6f5e6973507e', 'body': {'volumeAttachment': {'volumeId': 'd8d9f84a-ad69-4a93-8556-d7b631cdcd59'}}} Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. (HTTP 404) (Request-ID: req-1125d651-1c4e-46e7-b368-d6f68fce9c04) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:08.327178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. Jul 19 19:53:08.334959 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:08.345421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Returning 400 to user: Volume d8d9f84a-ad69-4a93-8556-d7b631cdcd59 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:08.349100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-395b4ff9-8e42-4863-8487-f07b30a4c729 tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments/efff1695-5946-4302-a82c-6f5e6973507e" status: 400 len: 107 microversion: 2.1 time: 0.650241 Jul 19 19:53:08.350710 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 865/1750] 10.222.0.33 () {60 vars in 1432 bytes} [Tue Jul 19 19:53:07 2022] PUT /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments/efff1695-5946-4302-a82c-6f5e6973507e => generated 107 bytes in 659 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:53:08.357511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.373718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 60bdfaab-698a-4b51-a784-97a5f5545b2a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.411519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.412026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.412817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.413258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.463382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.475672 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-63d29a44-324a-41c4-a331-ed8940886061 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.382225 Jul 19 19:53:08.476451 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 886/1751] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:08.485206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 60bdfaab-698a-4b51-a784-97a5f5545b2a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:08.487501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.488036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.497046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.497507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.498270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.498699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.650101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lazy-loading 'services' on Instance uuid e6710ce1-4b25-43a4-bf46-ea323108e492 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:08.650560 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93969bab-63ba-4890-a4a2-ead5b0f8e7c4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60bdfaab-698a-4b51-a784-97a5f5545b2a" status: 204 len: 0 microversion: 2.1 time: 0.297846 Jul 19 19:53:08.651738 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 866/1752] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:08 2022] DELETE /compute/v2.1/servers/60bdfaab-698a-4b51-a784-97a5f5545b2a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:08.657993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-26e359b8-3e6c-45de-810e-98907dd7eef2 req-843218e4-b1bd-4c8a-869b-2de635f27b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "name": "network-vif-plugged", "status": "completed", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:08.692204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-26e359b8-3e6c-45de-810e-98907dd7eef2 req-843218e4-b1bd-4c8a-869b-2de635f27b7a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.692654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-26e359b8-3e6c-45de-810e-98907dd7eef2 req-843218e4-b1bd-4c8a-869b-2de635f27b7a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.719414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-26e359b8-3e6c-45de-810e-98907dd7eef2 req-843218e4-b1bd-4c8a-869b-2de635f27b7a service nova] Creating event network-vif-plugged:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h1-843861-3 Jul 19 19:53:08.726604 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-26e359b8-3e6c-45de-810e-98907dd7eef2 req-843218e4-b1bd-4c8a-869b-2de635f27b7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071377 Jul 19 19:53:08.727223 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 867/1753] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:08.749648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.753310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.762865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.772062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.773439 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84d56fd5-8092-4228-9b53-d7cd06fe723e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments/efff1695-5946-4302-a82c-6f5e6973507e" status: 202 len: 0 microversion: 2.1 time: 0.280025 Jul 19 19:53:08.774931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.775685 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 887/1754] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 19:53:08 2022] DELETE /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments/efff1695-5946-4302-a82c-6f5e6973507e => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:08.776250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.791771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.792832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.802697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.803413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.806631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.807071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.851515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 27786bf1-21f7-4642-a0bc-3450ef410caa] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:08.989826 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-afd59a0b-b695-45fc-b1f1-43612a242e2a tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa" status: 204 len: 0 microversion: 2.1 time: 0.206338 Jul 19 19:53:08.990962 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 888/1755] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:08 2022] DELETE /compute/v2.1/servers/27786bf1-21f7-4642-a0bc-3450ef410caa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:08.997096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.998720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:09.006578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.006825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.007708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.008428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.259651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.271039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22832fee-f67d-4008-b99e-f44b8631585d tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.539383 Jul 19 19:53:09.272760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 868/1756] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:09.287399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:09.288793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:09.288925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.297292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.298134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.299297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.300623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.301797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.302189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.303284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e053389c-17a5-43f0-a6aa-cc0310719916 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.310791 Jul 19 19:53:09.308781 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 889/1757] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:09.330642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-903679035", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c7bb9508-6d4f-4858-ab37-d67d2eca9aa8"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:09.366388 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0cb4d0b4-7129-4bf5-ac87-8feaaea73352 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092465 Jul 19 19:53:09.370881 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 869/1758] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:09 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:09.411665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] validate_networks() for [('c7bb9508-6d4f-4858-ab37-d67d2eca9aa8', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:09.493668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:09.495395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:09.503978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.507430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.508716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.509402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.796742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.811422 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-044d8045-7a61-4675-afa4-faa5e31dd757 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.323073 Jul 19 19:53:09.812611 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 870/1759] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:09 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:09.975073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:09.975631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:09.976146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:09.976819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:09.977251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:10.005218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.009465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.013434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.013889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.062488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Getting quotas for project 34f08654bc0c4c5ebd470add3fbdd33f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:10.077103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Getting quotas for user f8b01a00ec0b4496bd10a8c34fffc12f and project 34f08654bc0c4c5ebd470add3fbdd33f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:10.095643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Going to run 2 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:10.099018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:10.148179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=6b3f022c-830e-4d6f-9dae-d81fc010178d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:10.243954 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a87f5d75-389a-4aa2-9200-32cfc924f588 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.930825 Jul 19 19:53:10.245813 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 890/1760] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:53:10.268748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.281598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.285026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Searching by: {'deleted': False, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:53:10.289629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Action: 'update', calling method: .version_select at 0x7fb88d5af820>, body: {"quota_set": {"ram": "5120"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:10.322136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.323259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.323481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.323958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.355647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:53:10.390147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.390932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.392294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.393181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.430238 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43bf00b1-6eb6-4e82-951e-d25b7c182543 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.179215 Jul 19 19:53:10.437420 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 891/1761] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:10.437420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.437420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.446126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.446689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.447424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.452392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.486747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e99cbd2f-8682-4e9f-b5cf-e41f66ca34c4 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69" status: 200 len: 148 microversion: 2.57 time: 0.418175 Jul 19 19:53:10.489238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 871/1762] 10.222.0.33 () {62 vars in 1302 bytes} [Tue Jul 19 19:53:10 2022] PUT /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69 => generated 148 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:53:10.497015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.497984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.506952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.508651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.510402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.512031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.820534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.834913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.836715 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08efb4d8-d8b6-44aa-969d-6cd38aecaec3 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.404576 Jul 19 19:53:10.846052 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 892/1763] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:10.846052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.846052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.851354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.852904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.854038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1d23108-d020-4b3f-ac35-1b9442bf5d98 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1281 microversion: 2.25 time: 0.363140 Jul 19 19:53:10.855352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.856014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.856967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.857932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.865468 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 872/1764] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1281 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:10.871953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50c5b908-994c-43f1-8cd7-0a5850f12b6e tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.872621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50c5b908-994c-43f1-8cd7-0a5850f12b6e tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.900019 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f12bc71c-ca59-4c4c-abce-a68a392d5eba tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060858 Jul 19 19:53:10.901772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 893/1765] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:10.906666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Calling method '.version_select at 0x7fb88d557430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.948185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50c5b908-994c-43f1-8cd7-0a5850f12b6e tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.956712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50c5b908-994c-43f1-8cd7-0a5850f12b6e tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1217 microversion: 2.1 time: 0.090003 Jul 19 19:53:10.966612 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 873/1766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:10.971551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-82a99713-8180-4e9c-bf0f-4b69705784c4 req-01776ade-8244-49b3-9166-f6722295f9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed787c-37b2-47db-b62c-36184e2deedf", "name": "network-vif-plugged", "status": "completed", "tag": "121c7c63-feab-412b-8930-3d950e9e63f4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:10.993327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-82a99713-8180-4e9c-bf0f-4b69705784c4 req-01776ade-8244-49b3-9166-f6722295f9f3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.993856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-82a99713-8180-4e9c-bf0f-4b69705784c4 req-01776ade-8244-49b3-9166-f6722295f9f3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.007749 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-82a99713-8180-4e9c-bf0f-4b69705784c4 req-01776ade-8244-49b3-9166-f6722295f9f3 service nova] Creating event network-vif-plugged:121c7c63-feab-412b-8930-3d950e9e63f4 for instance 3eed787c-37b2-47db-b62c-36184e2deedf on n-h1-843861-3 Jul 19 19:53:11.015039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-82a99713-8180-4e9c-bf0f-4b69705784c4 req-01776ade-8244-49b3-9166-f6722295f9f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046783 Jul 19 19:53:11.016173 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 874/1767] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:11.056423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.071092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.079224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.082955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.083782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.084248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.204146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.204598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.208826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.209468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.268864 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5f90a8d-6384-40fb-b172-25ee13a4b281 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69/detail" status: 200 len: 463 microversion: 2.57 time: 0.365416 Jul 19 19:53:11.281028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 894/1768] 10.222.0.33 () {60 vars in 1303 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69/detail => generated 463 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:53:11.477239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e1f3040>, body: {"quota_set": {"ram": "2048"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:11.594552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.595009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.597020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.600757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.625382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:11.633611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6821f6c-b773-4d91-aba3-044353c0f6fe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 0.615338 Jul 19 19:53:11.636491 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 875/1769] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:11.683535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.684548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.685313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.685981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.825897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:INSERT=9,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:11.854003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.854615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.869353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.874436 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73cccacb-94ee-40ce-a225-44a17612af96 tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69?user_id=f03ac35225e6433089d0426f18625e20" status: 200 len: 148 microversion: 2.57 time: 0.399838 Jul 19 19:53:11.880474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.881765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.882705 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 895/1770] 10.222.0.33 () {62 vars in 1383 bytes} [Tue Jul 19 19:53:11 2022] PUT /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69?user_id=f03ac35225e6433089d0426f18625e20 => generated 148 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:53:11.882864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.893947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.895060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.920545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.922601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.924115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.926272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.260278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.280102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.286736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.291820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.293049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22ffd80a-2eb2-4e72-9e49-9cff2e194c15 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1477 microversion: 2.25 time: 1.408622 Jul 19 19:53:13.305960 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 896/1771] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1477 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:13.309843 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2313d5e4-dfb4-4450-a403-20c8017e84fc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 1.459273 Jul 19 19:53:13.314449 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 876/1772] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:13.320781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-179a9aaf-8f61-42f4-b466-4f887242013f tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] Calling method '.version_select at 0x7fb88d5a3dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.327775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.330139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.338334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.339081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.340151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.340794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.414749 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05306a95-7bc7-4450-bd55-a634c818262a tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097001 Jul 19 19:53:13.417759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 877/1773] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:13.425793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.438452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.453595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.454374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.455372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.456062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.490296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-179a9aaf-8f61-42f4-b466-4f887242013f tempest-QuotasAdminTestV257-1198340784 tempest-QuotasAdminTestV257-1198340784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69?user_id=f03ac35225e6433089d0426f18625e20" status: 200 len: 190 microversion: 2.57 time: 0.188365 Jul 19 19:53:13.498169 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 897/1774] 10.222.0.33 () {60 vars in 1363 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/os-quota-sets/78ff999ee8a04c6799ee988d5d15dd69?user_id=f03ac35225e6433089d0426f18625e20 => generated 190 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:53:13.503733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.512608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.524460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.524922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.525707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.526150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.583150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:13.648340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.670607 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ec784117-381a-40fe-87c0-098a4078294c tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1275 microversion: 2.1 time: 0.248737 Jul 19 19:53:13.674193 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 878/1775] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1275 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:13.679311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3e8ab9cd-a2b0-4e4e-965f-a7012a71fdf3 req-9e4f17b5-07b0-438a-a06a-a3ccbb824f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-plugged", "status": "completed", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:13.717197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3e8ab9cd-a2b0-4e4e-965f-a7012a71fdf3 req-9e4f17b5-07b0-438a-a06a-a3ccbb824f9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.721242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3e8ab9cd-a2b0-4e4e-965f-a7012a71fdf3 req-9e4f17b5-07b0-438a-a06a-a3ccbb824f9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.760229 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3e8ab9cd-a2b0-4e4e-965f-a7012a71fdf3 req-9e4f17b5-07b0-438a-a06a-a3ccbb824f9e service nova] Creating event network-vif-plugged:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:53:13.783501 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3e8ab9cd-a2b0-4e4e-965f-a7012a71fdf3 req-9e4f17b5-07b0-438a-a06a-a3ccbb824f9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107664 Jul 19 19:53:13.788286 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 879/1776] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:13.806837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.808098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.813815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:13.827491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.831439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.834232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.835684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:14.840212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:14.850230 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d484f7c-7132-4528-8028-eea76333be93 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1318 microversion: 2.1 time: 1.349773 Jul 19 19:53:14.856588 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 898/1777] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1318 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:14.870846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1772084878", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "58406271-8733-4495-9c0c-acccb6026722"}], "block_device_mapping_v2": [{"uuid": "a7a0f9ef-1cb3-42aa-a65a-06653775be3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:15.031848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 2eaa8fdc-9404-451a-a51b-f244b8bbf372 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:15.059462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] validate_networks() for [('58406271-8733-4495-9c0c-acccb6026722', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:15.084726 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1276722-c267-48f1-8d6b-385f64aa8490 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1970 microversion: 2.25 time: 1.294651 Jul 19 19:53:15.087318 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 880/1778] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1970 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:15.100802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:15.102380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:15.119337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.121161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.123716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.125585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.681838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:15.691297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8daf7e54-d888-4c41-8c8d-e89be9de34ee tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.601560 Jul 19 19:53:15.692515 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 881/1779] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:15 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:15.713661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:15.714646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:15.728633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.729116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.734671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.735131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.805420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:15.842605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ff485d2-945f-43f2-a63c-8dbc7262f270 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142421 Jul 19 19:53:15.845489 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 882/1780] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:15 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:15.863047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:15.863663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:15.876061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.876464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.877245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.877700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.767950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:16.771028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:16.772003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:16.772748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:16.774378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:16.788070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.804802 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c77d0a2-f847-442c-9cb9-56ffc787a277 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.957342 Jul 19 19:53:16.808462 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 883/1781] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:15 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:16.818773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.818773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.818773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.822914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a7a0a0e4-5a78-4197-a832-26b05c08859a req-6a70ff73-092e-410e-88b3-745db8993e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27786bf1-21f7-4642-a0bc-3450ef410caa", "name": "network-vif-deleted", "tag": "f9565ce6-02a5-4768-a863-5eb0bf992a80"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:16.823925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.831702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a7a0a0e4-5a78-4197-a832-26b05c08859a req-6a70ff73-092e-410e-88b3-745db8993e45 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.832748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a7a0a0e4-5a78-4197-a832-26b05c08859a req-6a70ff73-092e-410e-88b3-745db8993e45 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.846749 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a7a0a0e4-5a78-4197-a832-26b05c08859a req-6a70ff73-092e-410e-88b3-745db8993e45 service nova] Creating event network-vif-deleted:f9565ce6-02a5-4768-a863-5eb0bf992a80 for instance 27786bf1-21f7-4642-a0bc-3450ef410caa on n-h1-843861-3 Jul 19 19:53:16.853437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a7a0a0e4-5a78-4197-a832-26b05c08859a req-6a70ff73-092e-410e-88b3-745db8993e45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Jul 19 19:53:16.854331 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 884/1782] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.860119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.860832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.868530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.869169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.869956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.870392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.885871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:16.902774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Getting quotas for user 99eac0488e77448cb55a255d49ad2c58 and project ed9dcbfa07ab477cafd92d9e6268c565. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:17.035667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:17.038796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7a0f9ef-1cb3-42aa-a65a-06653775be3b',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:17.150146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 2eaa8fdc-9404-451a-a51b-f244b8bbf372 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:17.179236 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7d83978-20fe-4a04-b9e3-0c607fadd731 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1970 microversion: 2.25 time: 0.323560 Jul 19 19:53:17.180443 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 885/1783] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1970 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:17.186540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.187417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.196017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.196744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.197977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.198581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.323212 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68a04b00-6f81-40c7-9a40-462aa0546cb2 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.463027 Jul 19 19:53:17.324314 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 899/1784] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:53:17.330090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5162255e-e70c-4b43-996b-1cb9e9e72156 req-2d82a567-1cf8-4d7b-8f62-4f813b674061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3f022c-830e-4d6f-9dae-d81fc010178d", "tag": "3348f67a-fb05-403e-80e9-33caa0ca0480"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:17.341049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5162255e-e70c-4b43-996b-1cb9e9e72156 req-2d82a567-1cf8-4d7b-8f62-4f813b674061 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.342015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5162255e-e70c-4b43-996b-1cb9e9e72156 req-2d82a567-1cf8-4d7b-8f62-4f813b674061 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.368850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5162255e-e70c-4b43-996b-1cb9e9e72156 req-2d82a567-1cf8-4d7b-8f62-4f813b674061 service nova] Creating event network-changed:3348f67a-fb05-403e-80e9-33caa0ca0480 for instance 6b3f022c-830e-4d6f-9dae-d81fc010178d on n-h2-843861-3 Jul 19 19:53:17.379792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5162255e-e70c-4b43-996b-1cb9e9e72156 req-2d82a567-1cf8-4d7b-8f62-4f813b674061 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053248 Jul 19 19:53:17.381601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 900/1785] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:17.394372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1cf8ac2d-8782-4b2b-ab9c-f10f92c9d73b req-ce8f7f63-da00-455a-86aa-c734b89072d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50d038-ce43-427b-85e0-5df2ff046890", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e9edd-c06e-48ad-89e6-ee4212390ae8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:17.412089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1cf8ac2d-8782-4b2b-ab9c-f10f92c9d73b req-ce8f7f63-da00-455a-86aa-c734b89072d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.413927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1cf8ac2d-8782-4b2b-ab9c-f10f92c9d73b req-ce8f7f63-da00-455a-86aa-c734b89072d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.429727 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1cf8ac2d-8782-4b2b-ab9c-f10f92c9d73b req-ce8f7f63-da00-455a-86aa-c734b89072d3 service nova] Creating event network-vif-plugged:4a6e9edd-c06e-48ad-89e6-ee4212390ae8 for instance dd50d038-ce43-427b-85e0-5df2ff046890 on n-h2-843861-3 Jul 19 19:53:17.436101 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1cf8ac2d-8782-4b2b-ab9c-f10f92c9d73b req-ce8f7f63-da00-455a-86aa-c734b89072d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046377 Jul 19 19:53:17.437464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 901/1786] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:17.447571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.448839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.457893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.459580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.460698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.461401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.070035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.087031 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e4356e8-ac46-4f84-a431-e2235b512fe7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1468 microversion: 2.1 time: 0.904504 Jul 19 19:53:18.088422 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 886/1787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1468 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.094366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.095756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.108990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.109850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.110875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.111380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.111772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.120091 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b736d35-15e0-4181-91a1-758face9063e tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.680793 Jul 19 19:53:18.120687 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 902/1788] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.131588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.137626 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:18.137626 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:53:18.140744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.146133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.147341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.148063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.171033 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c93b0fd1-cfd6-45e8-97a9-d27262328aa7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081082 Jul 19 19:53:18.172985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 887/1789] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:18.198277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.199100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.200976 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e328e4dd-a502-481e-a188-fa3789fe0022 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.074979 Jul 19 19:53:18.201597 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 903/1790] 10.222.0.33 () {60 vars in 1216 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:53:18.207343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.208197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.211589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.212923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.213866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.214305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.215365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.216025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.217124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.217708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.413460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.429767 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2cf4bb70-ce46-4822-969d-58f3e920879c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1103 microversion: 2.1 time: 0.255678 Jul 19 19:53:18.430563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 888/1791] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1103 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.435444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.436081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.445451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.445908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.447475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.447475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.610313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.622829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce8f5a38-3c6f-48a6-8bac-27306fbe3e62 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.419665 Jul 19 19:53:18.629691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 904/1792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.639683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843861-3", "block_migration": "auto"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:18.641100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.650590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.651335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.652340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.652977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.687607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'flavor' on Instance uuid 2eaa8fdc-9404-451a-a51b-f244b8bbf372 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:18.703441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Going to try to live migrate instance to n-h2-843861-3 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:53:18.728099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.738555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42ea1ee9-6334-4fb6-a851-af99bc27fc14 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1468 microversion: 2.1 time: 0.306666 Jul 19 19:53:18.750102 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 889/1793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.762602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-795207957"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:18.764075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.772138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.772593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.773367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.773794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.086370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aea51f06-4673-47f3-863b-355e97ef64c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "POST /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a/action" status: 202 len: 0 microversion: 2.1 time: 0.329993 Jul 19 19:53:19.087020 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 890/1794] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:18 2022] POST /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:53:19.092009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bdfaab-698a-4b51-a784-97a5f5545b2a", "name": "network-vif-deleted", "tag": "3be711d5-ffb3-442b-a436-3f4bc5d987a4"}, {"name": "network-changed", "server_uuid": "62263366-4c8e-4423-ae2b-69120cbfa444", "tag": "5963d583-a944-4475-bc9c-8ad01922351e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:19.102018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.102458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.115770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] Creating event network-vif-deleted:3be711d5-ffb3-442b-a436-3f4bc5d987a4 for instance 60bdfaab-698a-4b51-a784-97a5f5545b2a on n-h2-843861-3 Jul 19 19:53:19.116312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] Creating event network-changed:5963d583-a944-4475-bc9c-8ad01922351e for instance 62263366-4c8e-4423-ae2b-69120cbfa444 on n-h1-843861-3 Jul 19 19:53:19.124717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ca519f49-4468-406a-a973-a35d485c6918 req-346939f8-177d-4630-97fb-3eff00821c43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036423 Jul 19 19:53:19.125327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 891/1795] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:19.252467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-604103b8-cfa8-4b3a-9815-d8ad002cd616 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.262003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-604103b8-cfa8-4b3a-9815-d8ad002cd616 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.135414 Jul 19 19:53:19.262591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 892/1796] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:19.269027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-184a0ce2-2816-4913-9849-aeeb60c1df1e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5cb430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.313637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-184a0ce2-2816-4913-9849-aeeb60c1df1e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.049844 Jul 19 19:53:19.314223 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 893/1797] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.319476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.320288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.327094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.327544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.328383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.328821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.515630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.535220 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d540892f-e2c3-4a55-97af-160fbf76da4b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.219413 Jul 19 19:53:19.535986 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 894/1798] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.541771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.543418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.550670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.551144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.552081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.552516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.602474 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74181126-e4a0-47b4-afb4-505c23408be6 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064198 Jul 19 19:53:19.603065 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 895/1799] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:53:19.608986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4d16490-783c-44a1-a7a3-0591e76379d3 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.634568 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4d16490-783c-44a1-a7a3-0591e76379d3 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027957 Jul 19 19:53:19.645771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 896/1800] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.652363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.652986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.659426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.659910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.660787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.661224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.782640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.790869 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a54110c2-5ef6-4ed8-9658-4020f5a2428b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1095 microversion: 2.1 time: 0.143951 Jul 19 19:53:19.791452 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 897/1801] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1095 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.796010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.796550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.813125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.813889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.814645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.815156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.955194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.963355 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-68f9ea83-bbf4-4dfb-9ccb-bff29ad49e59 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.170846 Jul 19 19:53:19.963989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 898/1802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.968466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4730ddf0-7372-4b09-9941-c10feb51d3b4 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.976970 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4730ddf0-7372-4b09-9941-c10feb51d3b4 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012003 Jul 19 19:53:19.977531 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 899/1803] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:19.981908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1438890250", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "4d4d2315-a7e7-4cd5-954f-b4b2f368ce6c"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:20.036985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] validate_networks() for [('4d4d2315-a7e7-4cd5-954f-b4b2f368ce6c', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:20.407745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:20.629239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:20.629656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:20.630157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:20.630581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:20.630964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:20.640554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.640998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.641783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.642208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.667438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for project 161892765d664cff8ecadaee1ebdcc99. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:20.673242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Getting quotas for user 3c9e9f7f20dc430da1b45bf81c13a4d8 and project 161892765d664cff8ecadaee1ebdcc99. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:20.685498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:20.687745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:20.733224 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-982895e7-8d76-4795-bded-9ff6beb56722 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754657 Jul 19 19:53:20.733940 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 900/1804] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:53:20.738723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d5432a2f-8641-4cfc-9926-de4cd9da9181 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.747568 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d5432a2f-8641-4cfc-9926-de4cd9da9181 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012592 Jul 19 19:53:20.748623 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 901/1805] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:20.753611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c500eca5-5f41-4551-a25f-1529fe4e10f6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5cb0d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.805955 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c500eca5-5f41-4551-a25f-1529fe4e10f6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.056214 Jul 19 19:53:20.807655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 902/1806] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:20.814603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.815151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:20.823151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.823746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.825319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.825551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.975329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.984058 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41f1c1ac-7a47-47cf-b2b3-43aaefcafd26 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1307 microversion: 2.1 time: 0.174433 Jul 19 19:53:20.987982 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 903/1807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:20.995703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9874837f-b3ae-4582-8f0b-0c375b98a6e2 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.996348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9874837f-b3ae-4582-8f0b-0c375b98a6e2 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.057077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9874837f-b3ae-4582-8f0b-0c375b98a6e2 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.064972 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9874837f-b3ae-4582-8f0b-0c375b98a6e2 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1218 microversion: 2.1 time: 0.075347 Jul 19 19:53:21.065473 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 904/1808] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.070533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-814d926d-ae67-4d5f-aaa5-4134ff15fe6d tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.096477 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-814d926d-ae67-4d5f-aaa5-4134ff15fe6d tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.029798 Jul 19 19:53:21.097115 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 905/1809] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.103231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.105703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.111408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.112128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.113045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.114218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.191546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.204127 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4160299-00ef-43b4-97ba-bccb40404c86 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1151 microversion: 2.1 time: 0.105925 Jul 19 19:53:21.205011 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 906/1810] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1151 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.210667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.211491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.221802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.222722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.224038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.225138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.554381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.558207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:21.566969 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a130f29d-c04b-4ebb-ba86-2e1411571255 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.359956 Jul 19 19:53:21.567627 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 907/1811] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.572303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3702462-2d48-4ec1-9f88-896b330348ca tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.583492 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3702462-2d48-4ec1-9f88-896b330348ca tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014303 Jul 19 19:53:21.584222 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 908/1812] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:21.594671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddbc40be-3f57-4f8c-8d8f-0c0fcbba0de3 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.620911 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddbc40be-3f57-4f8c-8d8f-0c0fcbba0de3 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.030039 Jul 19 19:53:21.621513 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 909/1813] 10.222.0.33 () {58 vars in 1168 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.635143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d5a81d0-98d7-4cc5-a01a-fe39c257d001 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.646512 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d5a81d0-98d7-4cc5-a01a-fe39c257d001 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.015070 Jul 19 19:53:21.647066 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 910/1814] 10.222.0.33 () {58 vars in 1160 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:21.658739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74716c97-26d8-4333-a11c-a7302fec8cfd tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.666785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74716c97-26d8-4333-a11c-a7302fec8cfd tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011675 Jul 19 19:53:21.667657 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 911/1815] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:21.677029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af2854de-44c0-485a-a1b8-fbbe21b9056c tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.721609 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af2854de-44c0-485a-a1b8-fbbe21b9056c tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.047997 Jul 19 19:53:21.722934 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 912/1816] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:21.737848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-861d5a64-b157-4b45-9c3e-6c671dae07bb tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.746343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-861d5a64-b157-4b45-9c3e-6c671dae07bb tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012995 Jul 19 19:53:21.746923 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 913/1817] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:21.757380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-727b9795-7f84-4eb8-8b34-508197e263ed tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.773907 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-727b9795-7f84-4eb8-8b34-508197e263ed tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020645 Jul 19 19:53:21.774480 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 914/1818] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:21.786212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ea6a1e6-24cb-45b9-8b41-6e4992c5d5e2 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.794265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ea6a1e6-24cb-45b9-8b41-6e4992c5d5e2 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011727 Jul 19 19:53:21.794822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 915/1819] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:21.804523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f072614e-562f-4563-b4ee-7f4e08aba190 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.819480 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f072614e-562f-4563-b4ee-7f4e08aba190 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.018408 Jul 19 19:53:21.820147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 916/1820] 10.222.0.33 () {58 vars in 1147 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:21.826912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ec5c77e9-5d46-4c60-9cd8-a4e49c6b07a8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb892fc9430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.870173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ec5c77e9-5d46-4c60-9cd8-a4e49c6b07a8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.048913 Jul 19 19:53:21.870941 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 917/1821] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.881348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c29bed89-f4b7-40e6-bff3-2c5aa111a01a tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.894392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c29bed89-f4b7-40e6-bff3-2c5aa111a01a tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022283 Jul 19 19:53:21.895159 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 918/1822] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:21.907569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-600b34bc-8021-4df5-a621-0e94e7c9c058 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.916826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-600b34bc-8021-4df5-a621-0e94e7c9c058 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013995 Jul 19 19:53:21.917833 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 919/1823] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:21.929142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ce6aad2-5a95-458c-97bb-06c6b1de3980 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.952716 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ce6aad2-5a95-458c-97bb-06c6b1de3980 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.027814 Jul 19 19:53:21.963349 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 920/1824] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.969212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9ebe67d-7783-44ce-891b-0243b4a52c6b tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.974734 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a04fcd04-99de-4b35-a4ad-76e3ff2e9257 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372/action" status: 202 len: 0 microversion: 2.25 time: 3.343711 Jul 19 19:53:21.977126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 905/1825] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:53:18 2022] POST /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372/action => generated 0 bytes in 3347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:21.988095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.989767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.013159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.013620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.016486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9ebe67d-7783-44ce-891b-0243b4a52c6b tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050264 Jul 19 19:53:22.017734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.019322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.025652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 921/1826] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:22.043683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.044357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.062969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.063424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.069212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.071055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.631540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.650336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.653474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.655544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.657313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-47efee62-1467-483f-b7b2-67cb906856b4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.675354 Jul 19 19:53:22.668283 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58cf7a52-425d-48b8-80b7-1f0c9669d730 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1487 microversion: 2.1 time: 0.634856 Jul 19 19:53:22.668283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 922/1827] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1487 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:22.670929 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 906/1828] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:22.678462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.679247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-665290b5-e6bd-4311-87df-546ce3e93716 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.681377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.697282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.698310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.701176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.701947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.708299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-665290b5-e6bd-4311-87df-546ce3e93716 tempest-FlavorsV2TestJSON-756384664 tempest-FlavorsV2TestJSON-756384664-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041195 Jul 19 19:53:22.711502 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 923/1829] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:22.733602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.734218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.736235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:22.743446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.743682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.744383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.745030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.877557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.888386 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1377447-16cd-4554-8b19-5b08dd1ff1df tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1169 microversion: 2.1 time: 0.172071 Jul 19 19:53:22.899839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.903940 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 924/1830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1169 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:22.913719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7974a2ed-5a2b-4a2b-8470-6f579871e852 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1276 microversion: 2.1 time: 0.241199 Jul 19 19:53:22.916593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 907/1831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:22.921371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d3324928-f90c-409d-94f4-e40afcd668f2 req-d87aefc6-4a6b-489a-9c2f-4625c97afb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3f022c-830e-4d6f-9dae-d81fc010178d", "name": "network-vif-plugged", "status": "completed", "tag": "3348f67a-fb05-403e-80e9-33caa0ca0480"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:22.932765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.934763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.943758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d3324928-f90c-409d-94f4-e40afcd668f2 req-d87aefc6-4a6b-489a-9c2f-4625c97afb1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.944725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d3324928-f90c-409d-94f4-e40afcd668f2 req-d87aefc6-4a6b-489a-9c2f-4625c97afb1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.949071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.949628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.950422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.950885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.977863 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d3324928-f90c-409d-94f4-e40afcd668f2 req-d87aefc6-4a6b-489a-9c2f-4625c97afb1f service nova] Creating event network-vif-plugged:3348f67a-fb05-403e-80e9-33caa0ca0480 for instance 6b3f022c-830e-4d6f-9dae-d81fc010178d on n-h2-843861-3 Jul 19 19:53:22.984253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d3324928-f90c-409d-94f4-e40afcd668f2 req-d87aefc6-4a6b-489a-9c2f-4625c97afb1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074606 Jul 19 19:53:22.985287 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 925/1832] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:22.991715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1590285067"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:22.993276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:23.004337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.005096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.006099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.006814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.523142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6182ef8b-3439-4c87-a0f7-76d0bbcd052b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "POST /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890/action" status: 202 len: 0 microversion: 2.1 time: 0.536119 Jul 19 19:53:23.524280 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 926/1833] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:22 2022] POST /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:53:23.532640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36d5690e-1004-4a8b-867e-76cc0df6470e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5ce670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:23.615500 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36d5690e-1004-4a8b-867e-76cc0df6470e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.089116 Jul 19 19:53:23.622898 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 927/1834] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.648495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c923621-6d6a-46bc-9313-09690058d891 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d659dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:23.688238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:23.696538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8642a5a1-4880-4389-ae37-83a81064315b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.778594 Jul 19 19:53:23.703644 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 908/1835] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.709090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:23.709999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:23.721478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.723378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.724969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.726590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.731024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c923621-6d6a-46bc-9313-09690058d891 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a" status: 200 len: 1412 microversion: 2.1 time: 0.099670 Jul 19 19:53:23.742191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 928/1836] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.747098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce0246bb-3ec6-40f3-97d7-b2298f16968b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d5c71f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:23.871925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ce0246bb-3ec6-40f3-97d7-b2298f16968b tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a" status: 200 len: 1412 microversion: 2.1 time: 0.121355 Jul 19 19:53:23.872923 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 929/1837] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.886649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e709000-12d0-405c-abde-556d934e9448 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88e117280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.117051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e709000-12d0-405c-abde-556d934e9448 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a" status: 204 len: 0 microversion: 2.1 time: 0.235746 Jul 19 19:53:24.118210 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 930/1838] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:23 2022] DELETE /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:53:24.123786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.124809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.139402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.140308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.141262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.142279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.913454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.922804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.925157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.927129 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12048a77-6483-4ae3-b64c-5124280981de tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.222038 Jul 19 19:53:24.928461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 909/1839] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:24.933140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.933992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.940506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.941268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.942841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.943499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.022803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.037531 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4777a13-acba-4690-b95a-6b1a6afc4662 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1276 microversion: 2.1 time: 0.107024 Jul 19 19:53:25.038532 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 910/1840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.039220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.044431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc5ce570-f01b-491e-b6b7-5bc1d0548893 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d5a3dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.047019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-091496ce-b6ec-4253-bbc0-eb1d173ba597 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.927381 Jul 19 19:53:25.070307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 931/1841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.078122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-dc5ce570-f01b-491e-b6b7-5bc1d0548893 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Image not found. Jul 19 19:53:25.078297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-08cfdc06-347f-42fd-bf16-a11626f4a199 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb892fc9f70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc5ce570-f01b-491e-b6b7-5bc1d0548893 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a HTTP/1.1 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '41316e01-628c-4067-b174-289fd7f92d3a'} Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 41316e01-628c-4067-b174-289fd7f92d3a Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:53:25.081372 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41316e01-628c-4067-b174-289fd7f92d3a could not be found. Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:53:25.087722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:25.093704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc5ce570-f01b-491e-b6b7-5bc1d0548893 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:25.094761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc5ce570-f01b-491e-b6b7-5bc1d0548893 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a" status: 404 len: 62 microversion: 2.1 time: 0.054151 Jul 19 19:53:25.096247 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 911/1842] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:25.103270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.104113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.112663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.113123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.114045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.114487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.153377 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-08cfdc06-347f-42fd-bf16-a11626f4a199 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.081885 Jul 19 19:53:25.154520 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 932/1843] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.168335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7a77a339-91bb-452c-9de9-17da1000409b req-0d6d46e0-7026-4aae-9630-1b9cbb3229c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62263366-4c8e-4423-ae2b-69120cbfa444", "name": "network-vif-plugged", "status": "completed", "tag": "5963d583-a944-4475-bc9c-8ad01922351e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:25.183314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7a77a339-91bb-452c-9de9-17da1000409b req-0d6d46e0-7026-4aae-9630-1b9cbb3229c8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.184139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7a77a339-91bb-452c-9de9-17da1000409b req-0d6d46e0-7026-4aae-9630-1b9cbb3229c8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.200867 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7a77a339-91bb-452c-9de9-17da1000409b req-0d6d46e0-7026-4aae-9630-1b9cbb3229c8 service nova] Creating event network-vif-plugged:5963d583-a944-4475-bc9c-8ad01922351e for instance 62263366-4c8e-4423-ae2b-69120cbfa444 on n-h1-843861-3 Jul 19 19:53:25.208479 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7a77a339-91bb-452c-9de9-17da1000409b req-0d6d46e0-7026-4aae-9630-1b9cbb3229c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050942 Jul 19 19:53:25.210257 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 933/1844] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:25.223646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.224931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.235635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.236580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.238002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.239116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.884484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.894868 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49a9ef19-af4a-434d-9f1c-400d6d395527 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.795846 Jul 19 19:53:25.896291 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 912/1845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.934730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.946487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-28cbba2a-671c-4f6f-9a90-f3260249c0b0 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1499 microversion: 2.1 time: 0.734774 Jul 19 19:53:25.947351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 934/1846] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1499 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.958351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.959124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.990200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.991621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.995064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.995749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.062590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.063391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.087277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.087727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.088539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.088968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.558911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:26.569331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:26.571246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:26.572966 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e84609a-0b92-41c8-9f50-ee272f96c233 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.630131 Jul 19 19:53:26.574112 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 913/1847] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:26.587737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.588434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.594819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.595475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.596464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.597118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.836626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:26.848297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4ca34f3-c67a-474e-991b-7f508505aab3 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.797480 Jul 19 19:53:26.849233 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 935/1848] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:26.861407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7a168e4-ec10-48e2-82d7-bf5627b8c99f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d555b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.930694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=38 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:26.967431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7a168e4-ec10-48e2-82d7-bf5627b8c99f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.116719 Jul 19 19:53:26.970570 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 936/1849] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:26.978234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.978860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.999737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.012136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.013164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.013627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.445989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.454823 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7da39088-a073-4e44-9740-1e1c6e4099e7 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1317 microversion: 2.1 time: 0.482520 Jul 19 19:53:27.455115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.467227 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b6d9c88-65af-4ad0-ab9e-e034d5dfb797 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.891676 Jul 19 19:53:27.468712 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 914/1851] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:27.468947 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 937/1851] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:27.476931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.477804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.483236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-062e2636-bbe6-4cf8-802f-37e23e40866e req-c9c706ad-a537-496d-a4a3-becbecc4ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-plugged", "status": "completed", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:27.495618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.498252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.499920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.502560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.505636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-062e2636-bbe6-4cf8-802f-37e23e40866e req-c9c706ad-a537-496d-a4a3-becbecc4ea34 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.508320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-062e2636-bbe6-4cf8-802f-37e23e40866e req-c9c706ad-a537-496d-a4a3-becbecc4ea34 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.543415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-062e2636-bbe6-4cf8-802f-37e23e40866e req-c9c706ad-a537-496d-a4a3-becbecc4ea34 service nova] Creating event network-vif-plugged:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:53:27.559658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-062e2636-bbe6-4cf8-802f-37e23e40866e req-c9c706ad-a537-496d-a4a3-becbecc4ea34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085682 Jul 19 19:53:27.564803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 915/1852] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:27.604037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.613066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.624110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.625263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.626971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.627697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.086102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.098935 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fe1b91f-0f27-43ba-a352-4499a1f5f758 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1505 microversion: 2.1 time: 0.627708 Jul 19 19:53:28.099519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 938/1853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:28.118526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.119426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:28.134011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.134666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.139625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.140290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.163339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=15 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:28.368707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.380963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.382501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.389030 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-856196a8-c5f9-44ab-b8a1-f1db95f38438 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.801452 Jul 19 19:53:28.390385 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 916/1854] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:28.404184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-48745989-50d9-4c6f-842e-4bd0fa78d080 req-20226bb1-5766-4420-b9ef-52b532c48753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:28.421247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-48745989-50d9-4c6f-842e-4bd0fa78d080 req-20226bb1-5766-4420-b9ef-52b532c48753 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.421698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-48745989-50d9-4c6f-842e-4bd0fa78d080 req-20226bb1-5766-4420-b9ef-52b532c48753 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.432609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:28.455531 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-48745989-50d9-4c6f-842e-4bd0fa78d080 req-20226bb1-5766-4420-b9ef-52b532c48753 service nova] Creating event network-changed:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h2-843861-3 Jul 19 19:53:28.461190 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-48745989-50d9-4c6f-842e-4bd0fa78d080 req-20226bb1-5766-4420-b9ef-52b532c48753 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069416 Jul 19 19:53:28.472320 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 917/1855] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:28.484506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2e0b8b86-3a36-45ce-8191-761a7f228fbe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4c9430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.610952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2e0b8b86-3a36-45ce-8191-761a7f228fbe tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.136613 Jul 19 19:53:28.611533 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 918/1856] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:28.623391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.628678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:28.647582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.650117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.653328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.654364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.918196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.927303 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fff0527a-c503-47dd-b9a2-30d2be409c12 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.820686 Jul 19 19:53:28.945896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 939/1857] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:28.964976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.966539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:29.003399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.008302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.013174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.013683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.625486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:29.640406 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c9c0243-ff59-4a28-bff0-f7fbad1bf4a5 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 200 len: 1504 microversion: 2.1 time: 1.027600 Jul 19 19:53:29.651973 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 919/1858] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 1504 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:29.651973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:29.651973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:29.677278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.677732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.680184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.680628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.873513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:29.883209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab746d7d-e8c3-447e-9a7f-a92bf17c8a4f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.935895 Jul 19 19:53:29.897546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 940/1859] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:29.911235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:29.912145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:29.924892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.927540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.928575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.929179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.080636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:30.090349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c256001-8a19-4059-85c8-329f3b0f6416 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1505 microversion: 2.1 time: 0.447796 Jul 19 19:53:30.090940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 920/1860] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:29 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:30.100078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b3709dd-0a74-4288-b3b4-b190b7683c68 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d52aa60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:30.198605 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b3709dd-0a74-4288-b3b4-b190b7683c68 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.103012 Jul 19 19:53:30.205148 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 921/1861] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:30 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:30.242090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:30.242976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:30.261004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.261886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.262871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.264341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.655160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:31.061517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:31.392612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.405610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.412648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.416803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9e605fd-18e7-4ee9-bbe6-191c99d62a2f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.517842 Jul 19 19:53:31.420482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 941/1862] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:29 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:31.434731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.435751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:31.447184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.450838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.452718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.453421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.654700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.665165 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49fb76e2-fa9d-43cd-a7ac-e6ae0712d934 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 200 len: 1504 microversion: 2.1 time: 1.458975 Jul 19 19:53:31.683491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 922/1863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:30 2022] GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 1504 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:31.696537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e1e0e11d-c7b6-4736-864e-dade3c8e95ef req-04ce463f-3cb6-45c7-9371-4c63df44e37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3761ec9-34c0-43b0-8b34-d6d8576d3dd9", "tag": "f14d785e-4350-4a4a-8103-bb39646f1385"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:31.717796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e1e0e11d-c7b6-4736-864e-dade3c8e95ef req-04ce463f-3cb6-45c7-9371-4c63df44e37e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.718575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e1e0e11d-c7b6-4736-864e-dade3c8e95ef req-04ce463f-3cb6-45c7-9371-4c63df44e37e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.758676 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e1e0e11d-c7b6-4736-864e-dade3c8e95ef req-04ce463f-3cb6-45c7-9371-4c63df44e37e service nova] Creating event network-changed:f14d785e-4350-4a4a-8103-bb39646f1385 for instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 on n-h1-843861-3 Jul 19 19:53:31.773430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e1e0e11d-c7b6-4736-864e-dade3c8e95ef req-04ce463f-3cb6-45c7-9371-4c63df44e37e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087258 Jul 19 19:53:31.776065 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 923/1864] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:31.802271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.803357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:31.811181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.812056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.813107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.814413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.486712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:32.498730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-765afdb7-f3fa-43a6-8d5d-4dcff951a4f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.719310 Jul 19 19:53:32.514679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:32.528631 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23c2f7aa-685c-4131-b528-764d9e32fb9c tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 1.106343 Jul 19 19:53:32.538798 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 924/1865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:32.543789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.544435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.546408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 942/1866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:32.552911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e14f116d-d4c5-4a9e-8936-3b2f7418dcf7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d59cb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.570381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.570830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.571632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.572103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.649750 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e14f116d-d4c5-4a9e-8936-3b2f7418dcf7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.102172 Jul 19 19:53:32.653053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 943/1867] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:32 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:32.672014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ab82a6c8-ab23-468a-bd1d-d04501828f67 req-790b00be-cc4f-44d9-9abe-231c11065bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50d038-ce43-427b-85e0-5df2ff046890", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e9edd-c06e-48ad-89e6-ee4212390ae8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:32.697859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ab82a6c8-ab23-468a-bd1d-d04501828f67 req-790b00be-cc4f-44d9-9abe-231c11065bd7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.698215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ab82a6c8-ab23-468a-bd1d-d04501828f67 req-790b00be-cc4f-44d9-9abe-231c11065bd7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.717582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ab82a6c8-ab23-468a-bd1d-d04501828f67 req-790b00be-cc4f-44d9-9abe-231c11065bd7 service nova] Creating event network-vif-plugged:4a6e9edd-c06e-48ad-89e6-ee4212390ae8 for instance dd50d038-ce43-427b-85e0-5df2ff046890 on n-h2-843861-3 Jul 19 19:53:32.724583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ab82a6c8-ab23-468a-bd1d-d04501828f67 req-790b00be-cc4f-44d9-9abe-231c11065bd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070289 Jul 19 19:53:32.725429 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 944/1868] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:32.730949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.731912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.741251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.742104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.743306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.744302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.790765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:32.872740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:32.917490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a2645eba-54da-4550-9da1-fc093ceab7f2 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 204 len: 0 microversion: 2.1 time: 0.189173 Jul 19 19:53:32.922526 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 945/1869] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:32 2022] DELETE /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:32.930563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.931894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.949551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.950412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.951721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.952432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.258618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.267395 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-088f9baa-1535-4297-a4d9-e043e3ee5cc6 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1505 microversion: 2.1 time: 0.727405 Jul 19 19:53:33.271142 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 925/1870] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:32 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:33.276121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.282926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.299576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.312668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.314316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.315096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.371674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:33.408780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.420205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.422143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.423689 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05d2a39c-43e2-4879-a7eb-408ce13cbab0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.497894 Jul 19 19:53:33.425132 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 946/1871] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:32 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:33.519284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.520530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.529521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.532857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.533856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.535684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.540134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa0f2122-5d60-4f53-9a4b-33e0b2b875d4 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 204 len: 0 microversion: 2.1 time: 0.267115 Jul 19 19:53:33.548239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 926/1872] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:33 2022] DELETE /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:33.560661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.562767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.578130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.579439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.582934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.583570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.839794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.848540 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2780218-cc72-456e-93f9-14c4d5a684bb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.333012 Jul 19 19:53:33.858189 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 947/1873] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:33.858189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.859105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.866433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.877819 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecfbcbd4-568f-4f70-a353-04867e567ea7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.328147 Jul 19 19:53:33.879859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 927/1874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:33.892687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.893411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.895388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.895851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.087864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:34.113063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ae3c201-bfc7-4de3-bb2b-2f386ad36933 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 200 len: 1510 microversion: 2.1 time: 0.258000 Jul 19 19:53:34.113063 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 948/1875] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:34.117821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c010c5a3-de72-48c4-ba8f-cd9694e96ccc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5b0a60>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:34.200773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c010c5a3-de72-48c4-ba8f-cd9694e96ccc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.086975 Jul 19 19:53:34.201672 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 949/1876] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:34 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:34.225072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9856df1d-624a-4d18-b122-3ed2e220fab3 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Action: 'create', calling method: .version_select at 0x7fb88d485ca0>, body: {"pool": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:34.308978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:34.308978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:34.346083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.350156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.351036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.356013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.686188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:34.700548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4bd22cf-73e3-4df2-9400-75cb324e3270 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1500 microversion: 2.1 time: 0.407368 Jul 19 19:53:34.701471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 950/1877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:34 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:34.708637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:34.709260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:34.718848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.719373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.720797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.721448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.451469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.473878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.476927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.478396 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af8f9121-26ec-403b-b814-4fc9a4d5ab1e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.775965 Jul 19 19:53:35.479589 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 951/1878] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:34 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:35.493869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.496295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.507454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.516640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.522620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.523397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.980283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.989181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f741c927-d401-48b2-8505-90b697eb6f53 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1211 microversion: 2.1 time: 0.507947 Jul 19 19:53:35.989760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 952/1879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1211 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:36.010848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.011041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.029893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.030351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.031146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.031694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.373653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.381483 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dfe603fd-8ded-4cb2-91b2-c96694c1d393 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.390657 Jul 19 19:53:36.382067 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 953/1880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:36.392691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.404777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.411592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.412358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.413313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.413944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.052281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:37.068630 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7014c306-b05d-4312-a574-aa63dc4d8880 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 200 len: 1510 microversion: 2.1 time: 0.679447 Jul 19 19:53:37.069266 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 954/1881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:36 2022] GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:37.074098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1f694a1d-7a77-4779-85e6-884a1b5ebc7b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5ce550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:37.193183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1f694a1d-7a77-4779-85e6-884a1b5ebc7b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.121976 Jul 19 19:53:37.194610 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 955/1882] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:37 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:37.202110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:37.203092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:37.210426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.211056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.212194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.212792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.528635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:38.553035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a49133d-edb6-4c61-9bd5-d3daf1f5e483 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1487 microversion: 2.1 time: 1.356939 Jul 19 19:53:38.559600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 956/1883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:37 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1487 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:38.576927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:38.581642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:38.593522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.594233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.601970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.602839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.785957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:39.795780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:39.801265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:39.802560 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a73cb26-d201-49e3-8c1a-f6387a20012c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.241095 Jul 19 19:53:39.803150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 957/1884] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:38 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:39.814509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f7092d16-9585-4651-9f10-90fbb3592129 req-77943c8a-4479-468c-814e-11253aeb1d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50d038-ce43-427b-85e0-5df2ff046890", "name": "network-vif-unplugged", "status": "completed", "tag": "4a6e9edd-c06e-48ad-89e6-ee4212390ae8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:39.838373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f7092d16-9585-4651-9f10-90fbb3592129 req-77943c8a-4479-468c-814e-11253aeb1d99 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.841227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f7092d16-9585-4651-9f10-90fbb3592129 req-77943c8a-4479-468c-814e-11253aeb1d99 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.878356 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9856df1d-624a-4d18-b122-3ed2e220fab3 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.996905 Jul 19 19:53:39.879361 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 928/1885] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:53:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:39.881594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f7092d16-9585-4651-9f10-90fbb3592129 req-77943c8a-4479-468c-814e-11253aeb1d99 service nova] Creating event network-vif-unplugged:4a6e9edd-c06e-48ad-89e6-ee4212390ae8 for instance dd50d038-ce43-427b-85e0-5df2ff046890 on n-h2-843861-3 Jul 19 19:53:39.887392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f7092d16-9585-4651-9f10-90fbb3592129 req-77943c8a-4479-468c-814e-11253aeb1d99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078130 Jul 19 19:53:39.888248 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 958/1886] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:39.893684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:39.896725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:39.914034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:39.918085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.918989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.919258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:39.920388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.929004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.972814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.976689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.992291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.997034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.319511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.331774 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ff15aa2-f4e9-407b-a5f2-7a35809f5aa4 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.440394 Jul 19 19:53:40.348481 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 959/1887] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:39 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.377292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.378824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:40.410607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.413268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.415540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.419799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.469309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.479579 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35432a64-3bdf-4aa9-89ea-36e4d280b42e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1199 microversion: 2.1 time: 0.597922 Jul 19 19:53:40.480803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 929/1888] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:39 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1199 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.487698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c32b755b-f3cc-4ca4-bbec-dcdf99a0a6e2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d46dc10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.536630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.537207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.537773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lazy-loading 'fault' on Instance uuid 6b3f022c-830e-4d6f-9dae-d81fc010178d {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:40.541706 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c32b755b-f3cc-4ca4-bbec-dcdf99a0a6e2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.059535 Jul 19 19:53:40.548616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 930/1889] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:40 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.579932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.580451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:40.596661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.597737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.598764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.601665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.628505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b01a00ec0b4496bd10a8c34fffc12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f08654bc0c4c5ebd470add3fbdd33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.646814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:40.649182 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e897762f-a464-45c8-a163-f91d025fc677 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 200 len: 1307 microversion: 2.1 time: 0.297723 Jul 19 19:53:40.670052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 960/1890] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:40 2022] GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.671086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-aa2fb8df-953e-41a4-8286-1b9af219ed01 req-db3e2ccd-fa1c-4a73-b01f-0e92ae9f6db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3f022c-830e-4d6f-9dae-d81fc010178d", "name": "network-vif-deleted", "tag": "3348f67a-fb05-403e-80e9-33caa0ca0480"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:40.696558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-aa2fb8df-953e-41a4-8286-1b9af219ed01 req-db3e2ccd-fa1c-4a73-b01f-0e92ae9f6db9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.697284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-aa2fb8df-953e-41a4-8286-1b9af219ed01 req-db3e2ccd-fa1c-4a73-b01f-0e92ae9f6db9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.738949 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-aa2fb8df-953e-41a4-8286-1b9af219ed01 req-db3e2ccd-fa1c-4a73-b01f-0e92ae9f6db9 service nova] Creating event network-vif-deleted:3348f67a-fb05-403e-80e9-33caa0ca0480 for instance 6b3f022c-830e-4d6f-9dae-d81fc010178d on n-h2-843861-3 Jul 19 19:53:40.755433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-aa2fb8df-953e-41a4-8286-1b9af219ed01 req-db3e2ccd-fa1c-4a73-b01f-0e92ae9f6db9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092037 Jul 19 19:53:40.777782 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 961/1891] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:40.804569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1cac5cc-8c17-4e9f-928a-2054ff0abb6b tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d5438b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.899284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51cea105-34e1-43e9-b1b9-47aa25ee4dc1 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 204 len: 0 microversion: 2.1 time: 0.348440 Jul 19 19:53:40.906809 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 931/1892] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:40 2022] DELETE /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:40.935042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.944376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:40.958637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:40.976020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.976473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.977560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.980944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.210932 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1cac5cc-8c17-4e9f-928a-2054ff0abb6b tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/d4fb5892-85bb-4bbd-9cc6-5c29a353a127" status: 200 len: 141 microversion: 2.1 time: 0.429737 Jul 19 19:53:41.215665 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 962/1893] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:53:40 2022] GET /compute/v2.1/os-floating-ips/d4fb5892-85bb-4bbd-9cc6-5c29a353a127 => generated 141 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:41.223641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-217836e9-770a-41b7-b36a-94903182b478 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d566160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.269041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.274952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-217836e9-770a-41b7-b36a-94903182b478 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Image not found. Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-217836e9-770a-41b7-b36a-94903182b478 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a HTTP/1.1 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '41316e01-628c-4067-b174-289fd7f92d3a'} Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41316e01-628c-4067-b174-289fd7f92d3a to delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41316e01-628c-4067-b174-289fd7f92d3a could not be found. Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.279918 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:53:41.291101 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:41.296970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.296970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.296970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eec094d3-946b-4a23-96f7-74e2e7cd1d9c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.381770 Jul 19 19:53:41.301568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-217836e9-770a-41b7-b36a-94903182b478 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:41.304197 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-217836e9-770a-41b7-b36a-94903182b478 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a" status: 404 len: 62 microversion: 2.1 time: 0.090023 Jul 19 19:53:41.304477 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 932/1894] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:40 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:41.308842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 963/1895] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] DELETE /compute/v2.1/images/41316e01-628c-4067-b174-289fd7f92d3a => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:41.313379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f8ea2e9-82bf-4914-8c70-5631fbd5a914 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d470820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.325365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.326569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.343791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.344935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.345859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.346414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.423490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:41.507157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.api [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Instance is already in deleting state, ignoring this request Jul 19 19:53:41.508157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2d9118e-7f58-4bbe-be75-a0a2f4d89341 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 204 len: 0 microversion: 2.1 time: 0.193695 Jul 19 19:53:41.511731 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 964/1896] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:41 2022] DELETE /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:41.516032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.518070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.528935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.529393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.530201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.530616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.604191 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f8ea2e9-82bf-4914-8c70-5631fbd5a914 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.298051 Jul 19 19:53:41.605352 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 933/1897] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:41.624498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.625168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.632799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.633840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.634244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.634672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.801780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.805675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:41.811089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e8bc480-d1db-4ab9-986b-40e11389a807 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.300968 Jul 19 19:53:41.811769 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 965/1898] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:41.817205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.818025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.828898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.829416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.830281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.830786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.836214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.846474 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db8379af-5034-4211-8745-17cbea514b2d tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1199 microversion: 2.1 time: 0.239727 Jul 19 19:53:41.856031 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 934/1899] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1199 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:41.864442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a333cac7-9ea1-417e-8412-404f295fef78 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d49f5e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.919657 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a333cac7-9ea1-417e-8412-404f295fef78 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.059025 Jul 19 19:53:41.920717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 935/1900] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:41.925617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbbee795-1dc0-4cf6-8dda-58f46e3369c9 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d4bd280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.128983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:42.146092 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f29ca0b-743e-4cbe-a1fd-739888da8c99 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1493 microversion: 2.1 time: 0.327030 Jul 19 19:53:42.149407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 966/1901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:42.156279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.157005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 6b3f022c-830e-4d6f-9dae-d81fc010178d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:42.185034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.189160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.190842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.191492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.212361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] HTTP exception thrown: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Request method failure captured: Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d HTTP/1.1 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuCG-U-zzrovbBaWsuzQzV3jKAn8IM9iXty89hXQX9xqQKlwjY3YybTim7soQtmq_ciDCGeYTrM_leM1h6SDYNpKZT7YGuyrLBt9SvRRwCmv_qq7sB20B2b68sJyHgF-gb5cYgv-x5gKQfTqS5tzCtpOxprrSsztXfiyj2IbIAHJok Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 34f08654bc0c4c5ebd470add3fbdd33f Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 34f08654bc0c4c5ebd470add3fbdd33f Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateTestJSON-394718505-project Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f8b01a00ec0b4496bd10a8c34fffc12f Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateTestJSON-394718505-project Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6b3f022c-830e-4d6f-9dae-d81fc010178d'} Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.214154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. Jul 19 19:53:42.220126 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.227472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Returning 404 to user: Instance 6b3f022c-830e-4d6f-9dae-d81fc010178d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:42.227932 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6cdacdf-8203-4a77-b7a1-4328f963ff95 tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d" status: 404 len: 111 microversion: 2.1 time: 0.077406 Jul 19 19:53:42.231613 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 967/1902] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:42 2022] GET /compute/v2.1/servers/6b3f022c-830e-4d6f-9dae-d81fc010178d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:42.234204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62263366-4c8e-4423-ae2b-69120cbfa444", "name": "network-vif-unplugged", "status": "completed", "tag": "5963d583-a944-4475-bc9c-8ad01922351e"}, {"server_uuid": "a3761ec9-34c0-43b0-8b34-d6d8576d3dd9", "name": "network-vif-plugged", "status": "completed", "tag": "f14d785e-4350-4a4a-8103-bb39646f1385"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:42.245618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.246196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.264379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] Creating event network-vif-unplugged:5963d583-a944-4475-bc9c-8ad01922351e for instance 62263366-4c8e-4423-ae2b-69120cbfa444 on n-h1-843861-3 Jul 19 19:53:42.265694 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] Creating event network-vif-plugged:f14d785e-4350-4a4a-8103-bb39646f1385 for instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 on n-h1-843861-3 Jul 19 19:53:42.275717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5c54af2a-5520-4ce9-934c-385d52cc7daa req-a0cb1715-1d7c-403c-aef8-c31c401aa79c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044895 Jul 19 19:53:42.281783 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 968/1903] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:42.290987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.292220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] [instance: 62263366-4c8e-4423-ae2b-69120cbfa444] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:42.300187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.301061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.302316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.306142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.328494 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] HTTP exception thrown: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Request method failure captured: Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 HTTP/1.1 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuCG-U-zzrovbBaWsuzQzV3jKAn8IM9iXty89hXQX9xqQKlwjY3YybTim7soQtmq_ciDCGeYTrM_leM1h6SDYNpKZT7YGuyrLBt9SvRRwCmv_qq7sB20B2b68sJyHgF-gb5cYgv-x5gKQfTqS5tzCtpOxprrSsztXfiyj2IbIAHJok Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 34f08654bc0c4c5ebd470add3fbdd33f Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34f08654bc0c4c5ebd470add3fbdd33f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 34f08654bc0c4c5ebd470add3fbdd33f Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateTestJSON-394718505 Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateTestJSON-394718505-project Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f8b01a00ec0b4496bd10a8c34fffc12f Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateTestJSON-394718505-project Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '62263366-4c8e-4423-ae2b-69120cbfa444'} Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.330186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] Returning 404 to user: Instance 62263366-4c8e-4423-ae2b-69120cbfa444 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:42.337024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6ffe3e0-feb4-4a33-9d88-a22ccf7d479b tempest-MultipleCreateTestJSON-394718505 tempest-MultipleCreateTestJSON-394718505-project] 10.222.0.33 "GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444" status: 404 len: 111 microversion: 2.1 time: 0.048405 Jul 19 19:53:42.338154 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 969/1904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:42 2022] GET /compute/v2.1/servers/62263366-4c8e-4423-ae2b-69120cbfa444 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:42.347442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.351323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:42.358028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.358483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.365145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.372434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:43.008990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:43.021848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:43.033103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:43.046010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-86bec9f9-68a5-4ca4-93ef-669866c3553c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.694036 Jul 19 19:53:43.046010 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 970/1905] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:42 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:43.050048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-27d3346f-5e06-4390-a308-82f19e9e485a req-3e8af952-c386-4efb-88ad-bca3ba72737b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62263366-4c8e-4423-ae2b-69120cbfa444", "name": "network-vif-deleted", "tag": "5963d583-a944-4475-bc9c-8ad01922351e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:43.067386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-27d3346f-5e06-4390-a308-82f19e9e485a req-3e8af952-c386-4efb-88ad-bca3ba72737b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:43.068298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-27d3346f-5e06-4390-a308-82f19e9e485a req-3e8af952-c386-4efb-88ad-bca3ba72737b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:43.095582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-27d3346f-5e06-4390-a308-82f19e9e485a req-3e8af952-c386-4efb-88ad-bca3ba72737b service nova] Creating event network-vif-deleted:5963d583-a944-4475-bc9c-8ad01922351e for instance 62263366-4c8e-4423-ae2b-69120cbfa444 on n-h1-843861-3 Jul 19 19:53:43.102837 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-27d3346f-5e06-4390-a308-82f19e9e485a req-3e8af952-c386-4efb-88ad-bca3ba72737b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066813 Jul 19 19:53:43.104208 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 971/1906] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:43.110504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:43.111210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:43.122988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:43.124045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:43.124392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:43.125756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:43.537639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:43.557530 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db2072f4-e2b2-48e3-ba83-7b29110cd772 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1318 microversion: 2.1 time: 0.451982 Jul 19 19:53:43.569380 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 972/1907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:43 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:43.571772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:43.573481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:43.583668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:43.584230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:43.585329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:43.585868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.066273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bbbee795-1dc0-4cf6-8dda-58f46e3369c9 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d4fb5892-85bb-4bbd-9cc6-5c29a353a127" status: 202 len: 0 microversion: 2.1 time: 2.144326 Jul 19 19:53:44.067194 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 936/1908] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:41 2022] DELETE /compute/v2.1/os-floating-ips/d4fb5892-85bb-4bbd-9cc6-5c29a353a127 => generated 0 bytes in 2146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:44.070732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:44.079695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a3d21e7-b93a-4516-952b-406e370d797f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4c9c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.080192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c18e283b-18c6-45b2-93c4-bba469b4c8fd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1199 microversion: 2.1 time: 0.516272 Jul 19 19:53:44.080488 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 973/1909] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:43 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1199 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:44.099893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.100903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:44.117335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.117867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.118678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.119059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.185909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a3d21e7-b93a-4516-952b-406e370d797f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.098357 Jul 19 19:53:44.193945 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 937/1910] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:44.215236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8278497-d6db-4e60-a34e-29c9b296320f tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Action: 'create', calling method: .version_select at 0x7fb88d49fdc0>, body: {"pool": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:45.114310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.129874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64c01bbf-a2ba-4528-a5df-11649f411450 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1493 microversion: 2.1 time: 1.047596 Jul 19 19:53:45.131392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 974/1911] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1493 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.141178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.142170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:45.150478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.151076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:45.152020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.152693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:45.619180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.635166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.636694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.637971 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cdc6d1c-3277-422b-840c-1489cce719b0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.505164 Jul 19 19:53:45.638874 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 975/1912] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:45.645496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.646165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:45.653917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.654371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:45.656070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.656070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.229884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:46.250426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6368e256-140a-4d1e-a061-ae67608c1ae7 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1507 microversion: 2.1 time: 0.610435 Jul 19 19:53:46.263317 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 976/1913] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:46.268539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:46.269195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:46.293507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.294308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.295725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.303902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.066392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:47.081405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00991ed9-14fc-47d4-ab5b-cd98943d4ecb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1199 microversion: 2.1 time: 0.816789 Jul 19 19:53:47.093348 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 977/1914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:46 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1199 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.099906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aa5674e-99fc-400e-aa3d-507ff029b303 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d51bee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.162018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aa5674e-99fc-400e-aa3d-507ff029b303 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1454 microversion: 2.1 time: 0.067029 Jul 19 19:53:47.163244 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 978/1915] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.170008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.170957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:47.178955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.179868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.180844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.181450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.259184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.261520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.262471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lazy-loading 'fault' on Instance uuid dd50d038-ce43-427b-85e0-5df2ff046890 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:47.357820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fecc799226eb4a39950040a548b1987d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09eb1578906647e08c57dab00a8d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:47.369604 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79ff91a7-0ae1-4fd1-a296-37f1d96d352f tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 200 len: 1297 microversion: 2.1 time: 0.204095 Jul 19 19:53:47.380397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 979/1916] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 1297 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.385700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3c86b79f-d149-4443-90ce-609f1b9c07c3 req-bd60bf05-31fb-47bc-8484-0cf2cd228728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50d038-ce43-427b-85e0-5df2ff046890", "name": "network-vif-deleted", "tag": "4a6e9edd-c06e-48ad-89e6-ee4212390ae8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:47.396435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3c86b79f-d149-4443-90ce-609f1b9c07c3 req-bd60bf05-31fb-47bc-8484-0cf2cd228728 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.397238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3c86b79f-d149-4443-90ce-609f1b9c07c3 req-bd60bf05-31fb-47bc-8484-0cf2cd228728 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.414333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3c86b79f-d149-4443-90ce-609f1b9c07c3 req-bd60bf05-31fb-47bc-8484-0cf2cd228728 service nova] Creating event network-vif-deleted:4a6e9edd-c06e-48ad-89e6-ee4212390ae8 for instance dd50d038-ce43-427b-85e0-5df2ff046890 on n-h2-843861-3 Jul 19 19:53:47.424278 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3c86b79f-d149-4443-90ce-609f1b9c07c3 req-bd60bf05-31fb-47bc-8484-0cf2cd228728 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Jul 19 19:53:47.425506 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 980/1917] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:47.433663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.434654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:47.437088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:47.443520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.444274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.445242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.445850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.470447 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 19:53:47.471049 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 19:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.33) !!! Jul 19 19:53:48.119925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:48.153104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:48.157458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:48.159529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-422a8f4e-4c53-46b9-adae-1c4d829f7f23 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.731300 Jul 19 19:53:48.161966 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 981/1918] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:48.172500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e7207d3b-adc3-4b59-b797-bbc2cde2c3a7 req-3d03d943-f54d-4a3e-9360-61be8d01d3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "name": "network-vif-plugged", "status": "completed", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:48.199963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e7207d3b-adc3-4b59-b797-bbc2cde2c3a7 req-3d03d943-f54d-4a3e-9360-61be8d01d3ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.200879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e7207d3b-adc3-4b59-b797-bbc2cde2c3a7 req-3d03d943-f54d-4a3e-9360-61be8d01d3ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.226257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e7207d3b-adc3-4b59-b797-bbc2cde2c3a7 req-3d03d943-f54d-4a3e-9360-61be8d01d3ec service nova] Creating event network-vif-plugged:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h2-843861-3 Jul 19 19:53:48.241728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e7207d3b-adc3-4b59-b797-bbc2cde2c3a7 req-3d03d943-f54d-4a3e-9360-61be8d01d3ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073027 Jul 19 19:53:48.242365 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 982/1919] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:48.247624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:48.248423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:48.268087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.268617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.269124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.270381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.011070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:49.026205 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15704365-8361-4d81-909f-a6d068e2e4e1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1199 microversion: 2.1 time: 0.782050 Jul 19 19:53:49.026817 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 983/1920] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:48 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1199 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:49.033715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ca6d6e3-483b-425c-99d6-77dde51fa350 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d51b160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.131724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ca6d6e3-483b-425c-99d6-77dde51fa350 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1463 microversion: 2.1 time: 0.102528 Jul 19 19:53:49.133046 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 984/1921] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:49 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1463 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:49.140144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.140894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: dd50d038-ce43-427b-85e0-5df2ff046890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:49.150563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.151233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.152336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.152909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.181066 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 HTTP/1.1 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'dd50d038-ce43-427b-85e0-5df2ff046890'} Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.183680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. Jul 19 19:53:49.188391 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.191174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance dd50d038-ce43-427b-85e0-5df2ff046890 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:49.192546 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32a8defc-77c3-4855-a5e5-823765eda4c7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890" status: 404 len: 111 microversion: 2.1 time: 0.058152 Jul 19 19:53:49.197045 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 985/1922] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:49 2022] GET /compute/v2.1/servers/dd50d038-ce43-427b-85e0-5df2ff046890 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:49.204133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e36ce2b0-2d70-4a57-afe9-4bf0bed9722b"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:49.205544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:49.214969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.215654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.216644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.217242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.287023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] HTTP exception thrown: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Request method failure captured: Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9/os-volume_attachments/c5f28544-8cda-44fa-bbd2-0ac037363a96 HTTP/1.1 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 74 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1ws51IcvNpEBmJ4FDEqa2AbIQZqJwbBV08upvNy0ZOJ1nBZUK06BMyumB9qPnMaavvlkF_CrW8cC6oFnwBMs8PRmIMT5SeWrfAhTolWEFl8ILWwDl84zDbqfGeeEH1MxCHNcrEVpqtJZRorncubcCmsZ8U1fTZw1WXN-wXXz0tsLdyQ Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6c2a34698da741898ea9520cf6da3386 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c2a34698da741898ea9520cf6da3386"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6c2a34698da741898ea9520cf6da3386"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6c2a34698da741898ea9520cf6da3386 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-641721641 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesAdminNegativeTest-641721641-project-admin Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea703372a3234ddb868acae5892c9f66 Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesAdminNegativeTest-641721641-project-admin Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: {"volumeAttachment": {"volumeId": "e36ce2b0-2d70-4a57-afe9-4bf0bed9722b"}} Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: exception: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': 'a3761ec9-34c0-43b0-8b34-d6d8576d3dd9', 'id': 'c5f28544-8cda-44fa-bbd2-0ac037363a96', 'body': {'volumeAttachment': {'volumeId': 'e36ce2b0-2d70-4a57-afe9-4bf0bed9722b'}}} Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. (HTTP 404) (Request-ID: req-457cb6d2-0259-43e2-acdf-7aefb6322966) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:49.289800 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. Jul 19 19:53:49.294496 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.300585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] Returning 404 to user: Volume c5f28544-8cda-44fa-bbd2-0ac037363a96 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:49.300585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0660a95f-5040-472b-a4ef-c47ebe427cec tempest-VolumesAdminNegativeTest-641721641 tempest-VolumesAdminNegativeTest-641721641-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9/os-volume_attachments/c5f28544-8cda-44fa-bbd2-0ac037363a96" status: 404 len: 109 microversion: 2.1 time: 0.097857 Jul 19 19:53:49.300585 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 986/1923] 10.222.0.33 () {60 vars in 1432 bytes} [Tue Jul 19 19:53:49 2022] PUT /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9/os-volume_attachments/c5f28544-8cda-44fa-bbd2-0ac037363a96 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:49.301019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ffe7e76-9f0a-4dd6-a37b-59444fbf6a36 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d51b5e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.385826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ffe7e76-9f0a-4dd6-a37b-59444fbf6a36 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 200 len: 1463 microversion: 2.1 time: 0.088551 Jul 19 19:53:49.387469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 987/1924] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:49 2022] GET /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 1463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:49.398887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.399509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:49.418446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.421454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.422525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.423020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.822303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:49.837020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:49.838964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:49.842334 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bd89c4cd-0b75-481c-b89d-89dab12c3fb9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.449368 Jul 19 19:53:49.854831 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 988/1925] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:49 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:49.861603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6e3a063-d036-4294-85d4-6d8e48264073 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d51b940>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.896844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b6e3a063-d036-4294-85d4-6d8e48264073 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Image not found. Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6e3a063-d036-4294-85d4-6d8e48264073 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb HTTP/1.1 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'da6aa281-bc47-4dfd-b8f3-9d82381b77eb'} Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image da6aa281-bc47-4dfd-b8f3-9d82381b77eb to delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da6aa281-bc47-4dfd-b8f3-9d82381b77eb could not be found. Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.898846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6e3a063-d036-4294-85d4-6d8e48264073 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6e3a063-d036-4294-85d4-6d8e48264073 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb" status: 404 len: 62 microversion: 2.1 time: 0.045415 Jul 19 19:53:49.904049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 989/1926] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:49 2022] DELETE /compute/v2.1/images/da6aa281-bc47-4dfd-b8f3-9d82381b77eb => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:49.914694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:49.915329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:49.938777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.939244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.940479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:49.942880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.984427 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8278497-d6db-4e60-a34e-29c9b296320f tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.789335 Jul 19 19:53:49.991668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 938/1927] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:53:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:49.997691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-cf30dd45-0c71-4343-8e6d-b723158160db req-44d83789-a4b2-44ff-ace9-4438ff4bbbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "name": "network-vif-unplugged", "status": "completed", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.015555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cf30dd45-0c71-4343-8e6d-b723158160db req-44d83789-a4b2-44ff-ace9-4438ff4bbbf0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.020481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cf30dd45-0c71-4343-8e6d-b723158160db req-44d83789-a4b2-44ff-ace9-4438ff4bbbf0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.047623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-cf30dd45-0c71-4343-8e6d-b723158160db req-44d83789-a4b2-44ff-ace9-4438ff4bbbf0 service nova] Creating event network-vif-unplugged:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h1-843861-3 Jul 19 19:53:50.064532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-cf30dd45-0c71-4343-8e6d-b723158160db req-44d83789-a4b2-44ff-ace9-4438ff4bbbf0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070829 Jul 19 19:53:50.065590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 939/1928] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.078287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.080316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:50.097120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.098273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.100137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.102442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.134274 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 HTTP/1.1 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '64d03653-102d-4d49-828e-f11082c2e611'} Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:50.142104 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aaf6ffb3-6289-497a-9a8c-460fa37fa7bc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 404 len: 111 microversion: 2.1 time: 0.076393 Jul 19 19:53:50.149885 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 940/1929] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:50.157470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3324969-33c2-4319-ab10-78cda7295811 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d4bd8b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.672108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:50.681574 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1fd7bfb-11ae-440e-ae95-0be14a9db1f0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1468 microversion: 2.1 time: 0.778031 Jul 19 19:53:50.686107 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 990/1930] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:49 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1468 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:50.695184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.696719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:50.708304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.714792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.721091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.721815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.726942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:51.056099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.063682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2454df74-7a02-4c9e-a328-fc70426cd4eb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1382 microversion: 2.1 time: 0.376305 Jul 19 19:53:51.064316 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 991/1931] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:50 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1382 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:51.079706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.080373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64d03653-102d-4d49-828e-f11082c2e611] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.087104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.087562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.088376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.089025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.103345 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 HTTP/1.1 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '64d03653-102d-4d49-828e-f11082c2e611'} Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.104987 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance 64d03653-102d-4d49-828e-f11082c2e611 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34efea5c-b09e-49ad-97d1-109ef87b3cd9 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611" status: 404 len: 111 microversion: 2.1 time: 0.030468 Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 992/1932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/64d03653-102d-4d49-828e-f11082c2e611 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:51.111943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1281018287"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:51.113542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.119317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.119772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.120580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.121014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.471990 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e669685-ce55-4498-805e-3daaf4bdb14d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "POST /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf/action" status: 202 len: 0 microversion: 2.1 time: 0.363469 Jul 19 19:53:51.475430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 993/1933] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:51 2022] POST /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:53:51.481746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.482924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.493123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.494308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.495624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.496393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.565542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3324969-33c2-4319-ab10-78cda7295811 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e" status: 202 len: 0 microversion: 2.1 time: 1.418410 Jul 19 19:53:51.566702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 941/1934] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e => generated 0 bytes in 1420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:51.574065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.575123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.586835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.587460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.589345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.589982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.766227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.776849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.778722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.780149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a2922b7-f856-4faa-947b-256dc059f5f3 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.303224 Jul 19 19:53:51.781230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 994/1935] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:51.795045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-286b0835-ec30-4dab-92cf-20a0e67dbe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d5438b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.824467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-286b0835-ec30-4dab-92cf-20a0e67dbe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Image not found. Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-286b0835-ec30-4dab-92cf-20a0e67dbe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 HTTP/1.1 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e19473e1-b345-4aea-87a9-0350bba13298'} Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e19473e1-b345-4aea-87a9-0350bba13298 to delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e19473e1-b345-4aea-87a9-0350bba13298 could not be found. Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.826527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-286b0835-ec30-4dab-92cf-20a0e67dbe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:51.831149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-286b0835-ec30-4dab-92cf-20a0e67dbe15 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298" status: 404 len: 62 microversion: 2.1 time: 0.045503 Jul 19 19:53:51.833460 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 995/1936] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] DELETE /compute/v2.1/images/e19473e1-b345-4aea-87a9-0350bba13298 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:51.838013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65d59e48-afc7-4d5b-adfa-4a7d3045eabd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5ce5e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.845240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-882606b3-77e2-4374-a8f1-56b912abe939 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1533 microversion: 2.1 time: 0.277030 Jul 19 19:53:51.846046 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 942/1937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1533 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:51.851623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d5238b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.891168 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65d59e48-afc7-4d5b-adfa-4a7d3045eabd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.057240 Jul 19 19:53:51.896375 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 996/1938] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:51.902933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.903543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.904661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a20ffafd-a59a-4f7a-ad3c-83b00eac950e could not be found", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:53:51.905343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] HTTP exception thrown: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Request method failure captured: Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e HTTP/1.1 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wu9mCVO8HjCVN63_-u81qltqCd5Jxb936f2upfL1Taw46n02ZW_ZQce53GYJUwGuWA6fu6EKDu_jYh79kq7ixeNfkzTwyNJAshicXbw06KB-JYTziD9-uHE_EShsxBoHTuS0_6Yaz-Jk53Caa2nLkWX_Lusnzm5LK3K1bim_In-4LI Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 73a9dd08f6e14617b5950a7e76ce23d2 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 73a9dd08f6e14617b5950a7e76ce23d2 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsTestJSON-613077040-project Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3b4eaa154bf547bfa62278aa00212da8 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsTestJSON-613077040-project Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: exception: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a20ffafd-a59a-4f7a-ad3c-83b00eac950e'} Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a20ffafd-a59a-4f7a-ad3c-83b00eac950e could not be found Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3e2b296-a2e5-45ba-a214-a968faff885b'] Jul 19 19:53:51.907704 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e. Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Returning 404 to user: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:51.913396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-01ef8a50-ea0e-437e-99cf-ee36152a9f10 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e" status: 404 len: 111 microversion: 2.1 time: 0.062422 Jul 19 19:53:51.918605 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 943/1939] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:51.918708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.919163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.919946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.920570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.921178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.923881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.935385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.936532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.937325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.937767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.940855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:51.943724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 HTTP/1.1 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '64c18696-65b2-4b9f-8692-d1fa7c2e5897'} Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:51.948446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:51.953266 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:51.957439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:51.959072 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b77b1c97-7f4b-43a3-b9b6-e3790e3eb2be tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 404 len: 111 microversion: 2.1 time: 0.060641 Jul 19 19:53:51.960014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 997/1940] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:51 2022] DELETE /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:51.968273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Calling method '.version_select at 0x7fb88d4aef70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.032224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a20ffafd-a59a-4f7a-ad3c-83b00eac950e could not be found", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:53:52.033323 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] HTTP exception thrown: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Request method failure captured: Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e HTTP/1.1 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wu9mCVO8HjCVN63_-u81qltqCd5Jxb936f2upfL1Taw46n02ZW_ZQce53GYJUwGuWA6fu6EKDu_jYh79kq7ixeNfkzTwyNJAshicXbw06KB-JYTziD9-uHE_EShsxBoHTuS0_6Yaz-Jk53Caa2nLkWX_Lusnzm5LK3K1bim_In-4LI Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 73a9dd08f6e14617b5950a7e76ce23d2 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73a9dd08f6e14617b5950a7e76ce23d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 73a9dd08f6e14617b5950a7e76ce23d2 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsTestJSON-613077040 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsTestJSON-613077040-project Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3b4eaa154bf547bfa62278aa00212da8 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsTestJSON-613077040-project Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: exception: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a20ffafd-a59a-4f7a-ad3c-83b00eac950e'} Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a20ffafd-a59a-4f7a-ad3c-83b00eac950e could not be found Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da1697f0-d289-4d81-b4ad-2c81edb38420'] Jul 19 19:53:52.035427 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e. Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e Jul 19 19:53:52.040267 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.045567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] Returning 404 to user: Floating IP not found for ID a20ffafd-a59a-4f7a-ad3c-83b00eac950e {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:52.047258 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73ac9b3c-5591-4078-a31f-2a4a1f872910 tempest-FloatingIPsTestJSON-613077040 tempest-FloatingIPsTestJSON-613077040-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e" status: 404 len: 111 microversion: 2.1 time: 0.085803 Jul 19 19:53:52.048248 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 998/1941] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:51 2022] DELETE /compute/v2.1/os-floating-ips/a20ffafd-a59a-4f7a-ad3c-83b00eac950e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:52.057758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.058796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: 64c18696-65b2-4b9f-8692-d1fa7c2e5897] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.068586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.069422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.070480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.071260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.097673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 HTTP/1.1 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '64c18696-65b2-4b9f-8692-d1fa7c2e5897'} Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.100217 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. Jul 19 19:53:52.105001 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.107932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance 64c18696-65b2-4b9f-8692-d1fa7c2e5897 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:52.109123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aeccebed-b99e-4cb3-a836-e0028ff0e437 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897" status: 404 len: 111 microversion: 2.1 time: 0.059610 Jul 19 19:53:52.110212 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 999/1942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/64c18696-65b2-4b9f-8692-d1fa7c2e5897 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:52.117177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4b56d97b-34fb-4910-8c94-2098aa759a93 req-b359cfff-30b3-482d-9049-0b4fb1a0224e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:52.126592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4b56d97b-34fb-4910-8c94-2098aa759a93 req-b359cfff-30b3-482d-9049-0b4fb1a0224e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.127696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4b56d97b-34fb-4910-8c94-2098aa759a93 req-b359cfff-30b3-482d-9049-0b4fb1a0224e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.145414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4b56d97b-34fb-4910-8c94-2098aa759a93 req-b359cfff-30b3-482d-9049-0b4fb1a0224e service nova] Creating event network-changed:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h1-843861-3 Jul 19 19:53:52.152075 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4b56d97b-34fb-4910-8c94-2098aa759a93 req-b359cfff-30b3-482d-9049-0b4fb1a0224e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039933 Jul 19 19:53:52.153456 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1000/1943] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:52.162196 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-664f25f1-4f8c-43a2-8ee4-a7a6d2be7cde tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1533 microversion: 2.1 time: 0.247175 Jul 19 19:53:52.162779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 944/1944] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1533 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:52.172871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7700398-a4f7-466f-b93c-70d0b982bddc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '.version_select at 0x7fb88d59c040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.185589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.193279 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:53:52.193279 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:53:52.199352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.201803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.205253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.206173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.235353 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e7700398-a4f7-466f-b93c-70d0b982bddc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Image not found. Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7700398-a4f7-466f-b93c-70d0b982bddc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b HTTP/1.1 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b'} Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b to delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b could not be found. Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.237553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:53:52.244999 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.246801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5369ffcf-dcf4-4ce3-ae20-91372aab7734 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063669 Jul 19 19:53:52.246801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 945/1945] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:52.248447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7700398-a4f7-466f-b93c-70d0b982bddc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:52.250405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7700398-a4f7-466f-b93c-70d0b982bddc tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b" status: 404 len: 62 microversion: 2.1 time: 0.095527 Jul 19 19:53:52.251424 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1001/1946] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] DELETE /compute/v2.1/images/9a5871ff-f20b-4a9c-8d6c-087d3e3fad0b => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:52.258621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843861-3", "block_migration": false, "disk_over_commit": false}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:52.260071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.261673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.262285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.269965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.270652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.271789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.272417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.278012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.280808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.281819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.284051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.305644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lazy-loading 'flavor' on Instance uuid 79f230f7-d9fe-4c80-84d1-49790b3c618c {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:52.320641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Going to try to live migrate instance to n-h1-843861-3 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:53:52.321453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda HTTP/1.1 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a765cdd0-ec1d-471f-af7b-aa75e2ad6bda'} Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:52.326764 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.332303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:52.336004 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-796d6ab0-b798-434e-9e60-39c065a9ba31 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 404 len: 111 microversion: 2.1 time: 0.075810 Jul 19 19:53:52.339686 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1002/1947] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:52 2022] DELETE /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:52.346293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.346905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] [instance: a765cdd0-ec1d-471f-af7b-aa75e2ad6bda] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.381888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.383204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.386403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.387432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.430091 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] HTTP exception thrown: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Request method failure captured: Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda HTTP/1.1 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wq4_K3a72v3P8y6JiujAPN8zo7vVh0DOA92KCAdxbdwjZfBR18IrVaAn8vrVXbswY62zkd3heOTij1UqeG8pzDHn0M9R2lON273wtboBPxVLo_q5ohUJaxty3XqzN8bLi2IUSl1hRLhS9MO-UImvscNNuFTklSJt0Nk6-aMHwrvoPg Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09eb1578906647e08c57dab00a8d4b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 09eb1578906647e08c57dab00a8d4b69 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesTestJSON-706605683 Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fecc799226eb4a39950040a548b1987d Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesTestJSON-706605683-project Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a765cdd0-ec1d-471f-af7b-aa75e2ad6bda'} Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.432618 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. Jul 19 19:53:52.437997 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:52.440731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] Returning 404 to user: Instance a765cdd0-ec1d-471f-af7b-aa75e2ad6bda could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:52.440731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dfb08d94-8383-4e9d-b845-de646872f2f7 tempest-ImagesTestJSON-706605683 tempest-ImagesTestJSON-706605683-project] 10.222.0.33 "GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda" status: 404 len: 111 microversion: 2.1 time: 0.099445 Jul 19 19:53:52.440731 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1003/1948] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/a765cdd0-ec1d-471f-af7b-aa75e2ad6bda => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:52.719273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.720664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.728629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.729324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.730350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.731038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.762059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:52.969252 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-000b8a9e-51af-4b49-96d8-230585f5c47e tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 204 len: 0 microversion: 2.1 time: 0.252198 Jul 19 19:53:52.974806 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1004/1949] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:52 2022] DELETE /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:52.998684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.002391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.025223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.025876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.028392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.031889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.454577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.469580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.471590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.473785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e98eff4-6e71-4984-af0b-9f0de842446c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.497477 Jul 19 19:53:53.474741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1005/1950] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:53.491175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94846864-a5df-4a0c-a4e4-94005adc31ab tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d543310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.556662 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94846864-a5df-4a0c-a4e4-94005adc31ab tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.080318 Jul 19 19:53:53.564353 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1006/1951] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:53 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.599739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.600877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.620729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.621205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.623303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.623781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.863791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.877467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d55fc54-3c34-444d-b127-ac98e9083e40 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1513 microversion: 2.1 time: 0.311593 Jul 19 19:53:53.879862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1007/1952] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:53 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.887548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-19fb67fa-a277-4621-b21f-2167c142f85e req-05f8afc9-3726-46c1-9bb7-9a50a0bbf8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-unplugged", "status": "completed", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:53.902005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-19fb67fa-a277-4621-b21f-2167c142f85e req-05f8afc9-3726-46c1-9bb7-9a50a0bbf8cd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.902936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-19fb67fa-a277-4621-b21f-2167c142f85e req-05f8afc9-3726-46c1-9bb7-9a50a0bbf8cd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.919533 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-19fb67fa-a277-4621-b21f-2167c142f85e req-05f8afc9-3726-46c1-9bb7-9a50a0bbf8cd service nova] Creating event network-vif-unplugged:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:53:53.925390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-19fb67fa-a277-4621-b21f-2167c142f85e req-05f8afc9-3726-46c1-9bb7-9a50a0bbf8cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043928 Jul 19 19:53:53.926944 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1008/1953] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:54.494401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:54.495231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:54.508749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.509197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.509975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.510411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:55.379544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.411649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.414756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.420720 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74920f17-00cb-494a-bcba-f16ddb054c44 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.931824 Jul 19 19:53:55.421390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1009/1954] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:54 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:55.431175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92446bc9-4ab0-4965-8a03-ede32d53bb73 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4bb670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:55.518913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92446bc9-4ab0-4965-8a03-ede32d53bb73 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.093440 Jul 19 19:53:55.525988 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1010/1955] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:55 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:55.534651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:55.536726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:55.547045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:55.548121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:55.568475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:55.569323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.037666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:56.052344 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a59b88e6-ca9f-4b5c-98f0-cce2fd6089cd tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1513 microversion: 2.1 time: 0.523413 Jul 19 19:53:56.065919 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1011/1956] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:55 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1513 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:56.441912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:56.442532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:56.461985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.464128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.468466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.470318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.933608 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3bddbaa2-2442-48b9-bfc0-25a2bdd9283c tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c/action" status: 202 len: 0 microversion: 2.1 time: 4.682190 Jul 19 19:53:56.938486 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 946/1957] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:52 2022] POST /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c/action => generated 0 bytes in 4688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:56.952653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-409c7450-fa07-4ff5-9d17-6823f5faad91 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d43aca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:57.070061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-409c7450-fa07-4ff5-9d17-6823f5faad91 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.130277 Jul 19 19:53:57.070654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 947/1958] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:56 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:57.086253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:57.087861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:57.098941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.106292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.107469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.109748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.639519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.671952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.673519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.680757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-edd42a1a-aede-48a6-b6dc-ffa242854169 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.238234 Jul 19 19:53:57.692062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1012/1959] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:56 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:57.698933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:57.703834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:57.715375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.715836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.716639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.717072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.819141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.822565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.826349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lazy-loading 'fault' on Instance uuid a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:58.333628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:58.341665 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-935713bc-db29-4275-bd12-9e2cec389b10 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 200 len: 1308 microversion: 2.1 time: 0.648361 Jul 19 19:53:58.344784 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1013/1960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:57 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:58.355114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f6daca8-b0fa-4cc5-9d9d-c8424fcfd300 req-5d72ccc4-b6a2-45aa-ae4e-b4d0c2161f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3761ec9-34c0-43b0-8b34-d6d8576d3dd9", "name": "network-vif-deleted", "tag": "f14d785e-4350-4a4a-8103-bb39646f1385"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:58.395386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f6daca8-b0fa-4cc5-9d9d-c8424fcfd300 req-5d72ccc4-b6a2-45aa-ae4e-b4d0c2161f93 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.400448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f6daca8-b0fa-4cc5-9d9d-c8424fcfd300 req-5d72ccc4-b6a2-45aa-ae4e-b4d0c2161f93 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.444367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:58.456916 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a78e54ea-0c59-43fe-8ac7-3e5c5a344c7e tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.375773 Jul 19 19:53:58.457907 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 948/1961] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:57 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:58.477349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d091bf7e-64f3-471f-b87a-674ac653beb7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4859d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:58.592929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d091bf7e-64f3-471f-b87a-674ac653beb7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.130229 Jul 19 19:53:58.593713 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 949/1962] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:58 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:58.699086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:58.700147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:58.715474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.716366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.718853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.720083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.078755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f6daca8-b0fa-4cc5-9d9d-c8424fcfd300 req-5d72ccc4-b6a2-45aa-ae4e-b4d0c2161f93 service nova] Creating event network-vif-deleted:f14d785e-4350-4a4a-8103-bb39646f1385 for instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 on n-h1-843861-3 Jul 19 19:53:59.090113 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f6daca8-b0fa-4cc5-9d9d-c8424fcfd300 req-5d72ccc4-b6a2-45aa-ae4e-b4d0c2161f93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.742590 Jul 19 19:53:59.100332 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1014/1963] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:59.365678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:59.366992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: a3761ec9-34c0-43b0-8b34-d6d8576d3dd9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:59.390109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.398851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.400909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.404370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.440716 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] HTTP exception thrown: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Request method failure captured: Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 HTTP/1.1 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wsurnYh8mNZZ1zpLp5VyEpLmj2XrFpyMEJD426pY6O1APbZg-5jCbQmcm4x7H2w3SWaginSP-PMVJH_vmwfoswnJr0znld53YCQDCR6zd7zjAF64D6LLWLjx17uW-5msFKMRyAoDm3wX-tSucQ-7BF0K0NV_ef0TFZZrtn-Qcxbo_I Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 161892765d664cff8ecadaee1ebdcc99 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 161892765d664cff8ecadaee1ebdcc99 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesAdminNegativeTest-738722790-project Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3c9e9f7f20dc430da1b45bf81c13a4d8 Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesAdminNegativeTest-738722790-project Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a3761ec9-34c0-43b0-8b34-d6d8576d3dd9'} Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:59.443437 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. Jul 19 19:53:59.449691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:53:59.450902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Returning 404 to user: Instance a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:59.460902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19e19550-de2d-43c3-a9dd-9f505dcfaddb tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9" status: 404 len: 111 microversion: 2.1 time: 0.101460 Jul 19 19:53:59.464692 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1015/1964] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:59 2022] GET /compute/v2.1/servers/a3761ec9-34c0-43b0-8b34-d6d8576d3dd9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:53:59.475509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:59.477074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:59.498551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.499078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.500009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.500705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.540969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:59.932799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:59.942832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:59.953888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:59.970122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5b77de8-4c6b-4e1e-820f-2fc7cb54fe13 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.272883 Jul 19 19:53:59.976915 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 950/1965] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:58 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:59.997105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76c691e1-2ea4-4cc8-b5cc-ded872ed1f28 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4443a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:00.070269 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76c691e1-2ea4-4cc8-b5cc-ded872ed1f28 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.091855 Jul 19 19:54:00.070982 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 951/1966] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:53:59 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:00.410846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:00.420613 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22af5141-de48-4325-8eb9-a845283ec292 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.949358 Jul 19 19:54:00.428475 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1016/1967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:59 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:00.584069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d4fef0e2-3ae0-4565-b51c-ba8ba7e56662 req-2dc7dd30-6d29-41db-9ac2-e4c201abcf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "name": "network-vif-unplugged", "status": "completed", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:00.609677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d4fef0e2-3ae0-4565-b51c-ba8ba7e56662 req-2dc7dd30-6d29-41db-9ac2-e4c201abcf07 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:00.610132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d4fef0e2-3ae0-4565-b51c-ba8ba7e56662 req-2dc7dd30-6d29-41db-9ac2-e4c201abcf07 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:00.647710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d4fef0e2-3ae0-4565-b51c-ba8ba7e56662 req-2dc7dd30-6d29-41db-9ac2-e4c201abcf07 service nova] Creating event network-vif-unplugged:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h1-843861-3 Jul 19 19:54:00.660851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d4fef0e2-3ae0-4565-b51c-ba8ba7e56662 req-2dc7dd30-6d29-41db-9ac2-e4c201abcf07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080630 Jul 19 19:54:00.666799 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 952/1968] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:00.997069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:01.008262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:01.031327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.032922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:01.041099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.047063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:01.087665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42f7619a-e6c6-42fb-9967-12cb6cf38c95 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1f3040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:01.198367 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42f7619a-e6c6-42fb-9967-12cb6cf38c95 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.117880 Jul 19 19:54:01.205007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 953/1969] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:01 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:01.452407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:01.453166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:01.476199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.477925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:01.481236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.481901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.228689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:02.271275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:02.281827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:02.301398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:02.305175 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58fc29f6-bbb9-43f7-b026-2b750c5e5e0e tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.313743 Jul 19 19:54:02.305882 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1017/1970] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:00 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:02.323549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c8f0594-8f05-4b8d-8ec3-e5da081d9da8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4e2a60>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:02.432312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c8f0594-8f05-4b8d-8ec3-e5da081d9da8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.124033 Jul 19 19:54:02.433211 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1018/1971] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:02 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:02.812331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-89c748b7-85f1-45b3-988f-46bae067cdfe req-d84b51f7-37b1-446f-9654-679a777abb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed787c-37b2-47db-b62c-36184e2deedf", "name": "network-vif-plugged", "status": "completed", "tag": "121c7c63-feab-412b-8930-3d950e9e63f4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:02.842194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-89c748b7-85f1-45b3-988f-46bae067cdfe req-d84b51f7-37b1-446f-9654-679a777abb79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.848598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-89c748b7-85f1-45b3-988f-46bae067cdfe req-d84b51f7-37b1-446f-9654-679a777abb79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.883857 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-89c748b7-85f1-45b3-988f-46bae067cdfe req-d84b51f7-37b1-446f-9654-679a777abb79 service nova] Creating event network-vif-plugged:121c7c63-feab-412b-8930-3d950e9e63f4 for instance 3eed787c-37b2-47db-b62c-36184e2deedf on n-h1-843861-3 Jul 19 19:54:02.903021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-89c748b7-85f1-45b3-988f-46bae067cdfe req-d84b51f7-37b1-446f-9654-679a777abb79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095230 Jul 19 19:54:02.907309 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1019/1972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:03.332686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:03.333648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:03.349928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.350435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.360215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.360897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:04.158784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:04.174184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abbcd2f9-754f-441b-800f-82938de3d436 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 2.728999 Jul 19 19:54:04.175128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 954/1973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:01 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:04.189575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1495f8a8-9646-4c1d-a9c1-90c72d209637 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88db01a60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:04.261451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:04.288518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:04.290569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:04.292056 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d78a7c25-1855-40fc-b187-3b9fbbb75552 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.970689 Jul 19 19:54:04.297510 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1020/1974] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:03 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:04.318858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1495f8a8-9646-4c1d-a9c1-90c72d209637 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.141227 Jul 19 19:54:04.320031 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 955/1975] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:04 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:05.192610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:05.193881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:05.222482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.227886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.228935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.241581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.313875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:05.315161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:05.330135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.330871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.331891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.338564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:06.089096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:06.099521 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96a2961f-57df-4d30-8da3-0381497a8a03 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.911373 Jul 19 19:54:06.105386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1021/1976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:05 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:06.118157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2eb6c9e2-6f12-44d6-9591-1928e409428d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4de430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:06.192117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:06.204965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:06.209811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:06.215022 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-338625f3-637d-409f-855d-4e3a3458df1d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.905949 Jul 19 19:54:06.236296 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 956/1977] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:05 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:06.257185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2eb6c9e2-6f12-44d6-9591-1928e409428d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.150282 Jul 19 19:54:06.258131 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1022/1978] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:06 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:07.125824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:07.128495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:07.150490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:07.151358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:07.152457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:07.153168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:07.249110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:07.250098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:07.274812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:07.277017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:07.278127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:07.278916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:08.316029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:08.335921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:08.337964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:08.339196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4c30a5f0-6a5b-4e16-b7df-1933c1cc4313 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 1.096683 Jul 19 19:54:08.346032 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1023/1979] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:07 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:08.357427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4da430a5-c3d8-4d48-9652-d2789cf13132 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4deaf0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:08.509458 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4da430a5-c3d8-4d48-9652-d2789cf13132 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.161498 Jul 19 19:54:08.517910 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1024/1980] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:08 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:09.044244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:09.054035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d16f8ab-3983-4536-b37d-6f292d65b5de tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.934328 Jul 19 19:54:09.060802 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 957/1981] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:07 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:09.258831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:09.260173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.307099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.308203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.315099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.316010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.357422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:09.358150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.371439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.382306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.394839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.395922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.420508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:09.704390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a313c4f8-edc1-4636-8e12-43f438102c13 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 204 len: 0 microversion: 2.1 time: 0.448476 Jul 19 19:54:09.709630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1025/1982] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:09 2022] DELETE /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:09.730253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7896b10-070c-484f-98a3-66ecd7920668 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb892fc9430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:09.823711 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7896b10-070c-484f-98a3-66ecd7920668 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.112119 Jul 19 19:54:09.824985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1026/1983] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:09 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:09.845904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:09.852844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.886945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.893300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.898213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.899525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.155175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.171789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.181185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.187791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cd02438-6679-4a63-b136-70443543116a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1487 microversion: 2.25 time: 0.834662 Jul 19 19:54:10.195127 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 958/1984] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:09 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1487 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:10.203208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.209800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.237052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.240027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.247442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.250134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.818497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.857083 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ab7bc00-f124-4e33-ae5d-54d5c7315691 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1680 microversion: 2.1 time: 1.024035 Jul 19 19:54:10.857775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1027/1985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:09 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1680 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:10.895800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a63718b3-3fc2-49ef-b7aa-bd54f9bbeb9d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d68eb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.977411 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a63718b3-3fc2-49ef-b7aa-bd54f9bbeb9d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.118473 Jul 19 19:54:10.978039 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1028/1986] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:11.212355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:11.222662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fba6ff3e-1d85-4c74-92e5-8abdfc1cd54a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.023147 Jul 19 19:54:11.228819 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 959/1987] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:11.238009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.239496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.248453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.249698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.258801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.261296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.876685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.877307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.902853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=35 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:11.912713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.913176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.921607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.926090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.122854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.137640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.147155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.150862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65bed1db-3ce5-4d51-8006-85db6e2b7980 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1477 microversion: 2.25 time: 1.941415 Jul 19 19:54:13.166142 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1029/1988] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1477 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:13.180210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25065c28-3ba5-408e-8a6e-7b2ac497ca6a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d6423a0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:13.266873 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25065c28-3ba5-408e-8a6e-7b2ac497ca6a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.098009 Jul 19 19:54:13.268955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1030/1989] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:13 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:13.283364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:13.286306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:13.305010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.307753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.323355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.324575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.744236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.764158 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f9aee8b-101f-4ee4-b8cc-df082011d1ef tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1680 microversion: 2.1 time: 1.887020 Jul 19 19:54:13.767938 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 960/1990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1680 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:14.340121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1189952616", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "e9642555-0085-4b94-be20-d5b7d3910573"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:14.510963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] validate_networks() for [('e9642555-0085-4b94-be20-d5b7d3910573', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:15.165548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.186649 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22634bc4-d842-4768-8fa1-1db7f277b06b tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.915510 Jul 19 19:54:15.187349 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1031/1991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:13 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:15.195634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-04cb0f24-7339-41bf-8b82-bda9c2ff8607 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '.version_select at 0x7fb88d642b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.198664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04cb0f24-7339-41bf-8b82-bda9c2ff8607 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.199370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04cb0f24-7339-41bf-8b82-bda9c2ff8607 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.213715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-04cb0f24-7339-41bf-8b82-bda9c2ff8607 tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3622 microversion: 2.25 time: 0.025098 Jul 19 19:54:15.214651 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1032/1992] 10.222.0.33 () {60 vars in 1183 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/os-migrations => generated 3622 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:15.219765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d83d12e8-c409-4ed5-9664-3b76f55bd0bc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88def6700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.281875 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d83d12e8-c409-4ed5-9664-3b76f55bd0bc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.065743 Jul 19 19:54:15.283559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1033/1993] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:15.295176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.302631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.303516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Searching by: {'deleted': False, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:54:15.320228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.320797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.321715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.322163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.379873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:54:15.459652 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-443c21ad-1b92-4c90-90fe-c06d3e1c59d9 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.174520 Jul 19 19:54:15.461043 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1034/1994] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/servers => generated 340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:15.481801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.482613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:15.493763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.494178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.495003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.495455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.682906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:16.695618 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59bcf99e-db0f-4098-9572-73212bde34c5 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1680 microversion: 2.1 time: 1.233577 Jul 19 19:54:16.709604 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1035/1995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1680 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:16.719331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:16.722276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:16.755298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.755689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.758431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.758943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.333971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:17.335192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:17.336019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:17.336628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:17.337314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:17.372167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.373803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.380994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.382091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.448428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Getting quotas for project 2b09518f29534466a270630498384363. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:17.466117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Getting quotas for user 9c807b4d649844f3bc2efe82b1a69a53 and project 2b09518f29534466a270630498384363. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:17.504049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:17.506048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] Lazy-loading 'services' on Instance uuid 2eaa8fdc-9404-451a-a51b-f244b8bbf372 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:54:17.512670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:17.550094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e157add-3603-493c-8e8d-035075fb692a tempest-LiveAutoBlockMigrationV225Test-200127100 tempest-LiveAutoBlockMigrationV225Test-200127100-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1970 microversion: 2.25 time: 0.836855 Jul 19 19:54:17.570347 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1036/1996] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:16 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1970 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:17.602413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.616838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.617758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Searching by: {'deleted': False, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:54:17.636955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:17.648140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.648762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.657784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.660807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.722144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36fe550a-30fa-410e-8026-086e32cc4071 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.952030 Jul 19 19:54:17.736713 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 961/1997] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:17.780123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.789557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.820564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.821018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.821813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.822252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.871051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:54:18.058821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:18.103329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:18.104066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.199353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.225065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7707b12-8c13-4157-8915-6f3dbdce8b67 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.471372 Jul 19 19:54:19.226114 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 962/1998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.236936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e34205dc-584b-4a1e-b3e1-a3f1066aca1b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d563550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.312375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e34205dc-584b-4a1e-b3e1-a3f1066aca1b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.085012 Jul 19 19:54:19.312958 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 963/1999] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:19 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.328437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.329212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:19.339991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.341854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.343373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.344224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.358829 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36916b7c-6b57-4e2e-8f54-97496e39b289 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.781460 Jul 19 19:54:19.359701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1037/2000] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.376935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.377576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:19.392520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.393296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.396608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.400485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.464067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:19.726977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9e9f7f20dc430da1b45bf81c13a4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161892765d664cff8ecadaee1ebdcc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.742786 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6764fa11-3299-4a0c-b849-787ce4b317f8 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 200 len: 1613 microversion: 2.1 time: 0.380957 Jul 19 19:54:19.746868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1038/2001] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:19 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 1613 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.779773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.782229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:19.804454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.806932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.807776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.808257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.883885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:20.080418 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-606ac5be-041c-48c9-b828-5585b9bd564a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 204 len: 0 microversion: 2.25 time: 0.765821 Jul 19 19:54:20.086715 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 964/2002] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:54:19 2022] DELETE /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:54:20.273133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1461445937", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f3bf10e4-0964-4285-a33f-4eaa440332de"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:20.365480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] validate_networks() for [('f3bf10e4-0964-4285-a33f-4eaa440332de', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:20.814143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:20.828097 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f013dc5d-6b55-487f-aadd-4cfc9a452011 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1268 microversion: 2.1 time: 1.075446 Jul 19 19:54:20.829199 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1039/2003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:19 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1268 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:20.843202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be50df29-2d0d-43ff-910b-552aacd1caef tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:20.861882 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be50df29-2d0d-43ff-910b-552aacd1caef tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029260 Jul 19 19:54:20.864703 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1040/2004] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:54:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:20.884474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:20.885410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:20.905761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.911281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.915951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.921776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.728144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.744062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.747921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.771329 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1afd911b-f8b1-4258-8d53-187005d6d0f2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1483 microversion: 2.25 time: 0.901055 Jul 19 19:54:21.790819 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1041/2005] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:20 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1483 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:21.808201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:21.816805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:21.823743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.825544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.826610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.828650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.180990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:23.190489 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eeb2129a-89bb-451d-bc66-d7dc7bd8eebd tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.397549 Jul 19 19:54:23.208845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1042/2006] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:21 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:23.215031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c793d8b-9784-4b18-969f-9d0135134e53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88def6ca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.319954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c793d8b-9784-4b18-969f-9d0135134e53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.109677 Jul 19 19:54:23.320850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1043/2007] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:23.333467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.336456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] [instance: e6710ce1-4b25-43a4-bf46-ea323108e492] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.354687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.355561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.356916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.357587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.374730 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] HTTP exception thrown: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Request method failure captured: Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 HTTP/1.1 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wsurnYh8mNZZ1zpLp5VyEpLmj2XrFpyMEJD426pY6O1APbZg-5jCbQmcm4x7H2w3SWaginSP-PMVJH_vmwfoswnJr0znld53YCQDCR6zd7zjAF64D6LLWLjx17uW-5msFKMRyAoDm3wX-tSucQ-7BF0K0NV_ef0TFZZrtn-Qcxbo_I Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 161892765d664cff8ecadaee1ebdcc99 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_161892765d664cff8ecadaee1ebdcc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 161892765d664cff8ecadaee1ebdcc99 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-738722790 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesAdminNegativeTest-738722790-project Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3c9e9f7f20dc430da1b45bf81c13a4d8 Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesAdminNegativeTest-738722790-project Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e6710ce1-4b25-43a4-bf46-ea323108e492'} Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:23.377559 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. Jul 19 19:54:23.383459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:23.385809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Returning 404 to user: Instance e6710ce1-4b25-43a4-bf46-ea323108e492 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:23.387603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-238f5bc9-c458-401a-b531-e77801a8e2e0 tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492" status: 404 len: 111 microversion: 2.1 time: 0.065631 Jul 19 19:54:23.388542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1044/2008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/e6710ce1-4b25-43a4-bf46-ea323108e492 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:23.399701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.400542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.409944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.411386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.413191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.414082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.480847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:23.504109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:23.504621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:23.505001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:23.505412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:23.505814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:23.533198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.534027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.535666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.541552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.575007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:23.608386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Getting quotas for project 2096f2ea01e7491ea1cb0245a0c5dafb. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:23.628426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Getting quotas for user 8414eba87cbd432fb280e4580a040e14 and project 2096f2ea01e7491ea1cb0245a0c5dafb. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:23.674643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:23.676764 n-d-843861-3 devstack@n-api.service[126007]: WARNING nova.utils [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1461445937 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-146144593 Jul 19 19:54:23.678024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:23.725951 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb446f54-5340-42c3-8db5-5240a6415f6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "DELETE /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 204 len: 0 microversion: 2.1 time: 0.335400 Jul 19 19:54:23.728426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1045/2009] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:23 2022] DELETE /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:23.742879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-96b323f5-21ee-40bc-9ddf-fa0204b24270 req-ead46f40-c7a3-4117-9a45-d12128b0422c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6710ce1-4b25-43a4-bf46-ea323108e492", "name": "network-vif-deleted", "tag": "ca9c8076-1a2e-4f89-a794-b419facd409f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:23.761116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-96b323f5-21ee-40bc-9ddf-fa0204b24270 req-ead46f40-c7a3-4117-9a45-d12128b0422c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.761685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-96b323f5-21ee-40bc-9ddf-fa0204b24270 req-ead46f40-c7a3-4117-9a45-d12128b0422c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.783823 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-96b323f5-21ee-40bc-9ddf-fa0204b24270 req-ead46f40-c7a3-4117-9a45-d12128b0422c service nova] Creating event network-vif-deleted:ca9c8076-1a2e-4f89-a794-b419facd409f for instance e6710ce1-4b25-43a4-bf46-ea323108e492 on n-h1-843861-3 Jul 19 19:54:23.791648 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-96b323f5-21ee-40bc-9ddf-fa0204b24270 req-ead46f40-c7a3-4117-9a45-d12128b0422c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059409 Jul 19 19:54:23.792852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1046/2010] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:23.801101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.815351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.827161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.828339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.829788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.830925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.850877 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c42c904-ceff-473b-ba4f-2848ab1e37cc tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.758109 Jul 19 19:54:23.856609 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 965/2011] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:23.861590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.862227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.881878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.882824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.884491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.885257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.209508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.228300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32aa9561-cf41-40c2-9d67-73101ed4685f tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1274 microversion: 2.1 time: 0.433034 Jul 19 19:54:24.239329 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1047/2012] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1274 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:24.251150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fa01ec7-c2b4-4fcc-8021-e1f984e809de tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] Calling method '.version_select at 0x7fb88d4deb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:24.303086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fa01ec7-c2b4-4fcc-8021-e1f984e809de tempest-VolumesAdminNegativeTest-738722790 tempest-VolumesAdminNegativeTest-738722790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124453541" status: 202 len: 0 microversion: 2.1 time: 0.060389 Jul 19 19:54:24.303794 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1048/2013] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 19:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124453541 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:54:24.321019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:24.333783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:24.361640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.365580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.366802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.371777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.833409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.850102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.851642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.852901 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6efd1428-c82f-432e-9277-6004e16751f0 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1483 microversion: 2.25 time: 0.999924 Jul 19 19:54:24.853449 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 966/2014] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1483 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:24.865411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:24.866303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:24.884235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.884763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.885784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.886506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.878049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:25.886872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb241eea-02b9-4efe-a03d-aa96535b3f34 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1236 microversion: 2.1 time: 1.030813 Jul 19 19:54:25.890888 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 967/2015] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:24 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1236 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:25.900448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:25.906106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:25.915386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.919186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.926827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.927696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.217252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:26.230686 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fdc7e44-4a1f-4288-b61f-5c46e5800589 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1713 microversion: 2.1 time: 1.918917 Jul 19 19:54:26.248917 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1049/2016] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:24 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1713 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:26.255719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a5e148f-3d6b-47a4-b865-1ed99e6358b6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4e21f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.391403 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a5e148f-3d6b-47a4-b865-1ed99e6358b6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.138391 Jul 19 19:54:26.391403 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1050/2017] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:26 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:26.406409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.412949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:26.441428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.446039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.447187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.447910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.110875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.123840 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aea1c987-b7cc-475d-b8e5-14a109963d0a tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1274 microversion: 2.1 time: 0.729951 Jul 19 19:54:27.124710 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1051/2018] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:26 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1274 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:27.141337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.142281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.151417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.153271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.154352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.163272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.296861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.321153 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45cb9b26-b78e-4e26-9dcd-3428ff9ad474 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.426086 Jul 19 19:54:27.323462 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 968/2019] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:25 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:27.344413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.345048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.355330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.355786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.357921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.358497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.672294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.682474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.684310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.685715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a2ff71d-a32d-4def-8998-5c988779b853 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1441 microversion: 2.25 time: 0.559315 Jul 19 19:54:27.696007 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1052/2020] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1441 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:27.702441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.702982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.709916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.709916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.710499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.711321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.782018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:27.872788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.885308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c60e26fd-801e-4e86-88df-04f2c0f662fe tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1290 microversion: 2.1 time: 0.545830 Jul 19 19:54:27.888007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 969/2021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1290 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:27.902367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e6a0a40-a937-456e-b0da-3291ea7e78fd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d46daf0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:28.010031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e6a0a40-a937-456e-b0da-3291ea7e78fd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1455 microversion: 2.1 time: 0.119766 Jul 19 19:54:28.011163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 970/2022] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:28.022144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-75100159-b439-4f06-9384-12c3da8b03f5 req-8d1552ad-5420-41df-bcd5-dde893a8ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:28.041966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75100159-b439-4f06-9384-12c3da8b03f5 req-8d1552ad-5420-41df-bcd5-dde893a8ddb1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.042672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75100159-b439-4f06-9384-12c3da8b03f5 req-8d1552ad-5420-41df-bcd5-dde893a8ddb1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.050536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:28.084365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-75100159-b439-4f06-9384-12c3da8b03f5 req-8d1552ad-5420-41df-bcd5-dde893a8ddb1 service nova] Creating event network-vif-unplugged:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h2-843861-3 Jul 19 19:54:28.090590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-75100159-b439-4f06-9384-12c3da8b03f5 req-8d1552ad-5420-41df-bcd5-dde893a8ddb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076620 Jul 19 19:54:28.093013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 971/2023] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:28.145343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:28.146362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:28.161342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.161877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.167297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.168028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.718735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.753197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.768678 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01eb33c8-a812-4c3f-80c8-fd0689b7e461 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1713 microversion: 2.1 time: 2.070348 Jul 19 19:54:29.787768 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1053/2024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1713 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:29.805970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:29.806546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:29.810293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00101ed7-ed40-4b8a-b29d-2afb71b4af4c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 1.672290 Jul 19 19:54:29.818459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 972/2025] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:28 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:29.834013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.842586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:29.846617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:29.851245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.852546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.853063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.869734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.874306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.880820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.883544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.602366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.625614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.627263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.629102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-077a5e4e-4ad3-491d-ad05-c3b9510e2163 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1266 microversion: 2.25 time: 0.808549 Jul 19 19:54:30.636118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 973/2026] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:29 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1266 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:30.649814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:30.650596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:30.672703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.680107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.681252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.682676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.452472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:31.466076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d58d81c5-c188-4ad3-a565-83aac94d845a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.673652 Jul 19 19:54:31.481477 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1054/2027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:29 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:31.497604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-85e318c2-f601-4da3-b472-1554124a9a0e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4deb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:31.585272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-85e318c2-f601-4da3-b472-1554124a9a0e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1464 microversion: 2.1 time: 0.091892 Jul 19 19:54:31.585852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1055/2028] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:31 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1464 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:31.609041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ded24918-9374-4ffc-9d07-01b9b3ed431b req-1b6ed42c-5b8e-4e98-9992-9d82bede489b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999dfd20-abe4-40c0-9d5b-ef178f5f56d5", "name": "network-vif-unplugged", "status": "completed", "tag": "bd0218d9-c5ba-4c35-88f8-ae077a101c84"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:31.626594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ded24918-9374-4ffc-9d07-01b9b3ed431b req-1b6ed42c-5b8e-4e98-9992-9d82bede489b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.627568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ded24918-9374-4ffc-9d07-01b9b3ed431b req-1b6ed42c-5b8e-4e98-9992-9d82bede489b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.644752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:31.652902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ded24918-9374-4ffc-9d07-01b9b3ed431b req-1b6ed42c-5b8e-4e98-9992-9d82bede489b service nova] Creating event network-vif-unplugged:bd0218d9-c5ba-4c35-88f8-ae077a101c84 for instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 on n-h2-843861-3 Jul 19 19:54:31.659251 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6412f668-0b7b-4a99-8e00-b5f87e8cbe31 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 1.021877 Jul 19 19:54:31.665086 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 974/2029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:30 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:31.674503 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ded24918-9374-4ffc-9d07-01b9b3ed431b req-1b6ed42c-5b8e-4e98-9992-9d82bede489b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065510 Jul 19 19:54:31.674503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1056/2030] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:31.688212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1466402e-cae7-4d2a-aa67-1727581b6895 req-0259af6e-08a0-4617-89c8-a605db395eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaa8fdc-9404-451a-a51b-f244b8bbf372", "name": "network-vif-deleted", "tag": "2f18d001-40d4-4570-9f4a-3f08e5580100"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:31.706187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b7a7eded-44b5-4b84-8280-8c800dc5e5fd req-1f5fab1a-1ddd-4e7b-9d69-8198d50fc571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade257ce-d488-4823-8909-cf7f02bde948", "tag": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:31.711504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1466402e-cae7-4d2a-aa67-1727581b6895 req-0259af6e-08a0-4617-89c8-a605db395eed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.719254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1466402e-cae7-4d2a-aa67-1727581b6895 req-0259af6e-08a0-4617-89c8-a605db395eed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.731564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b7a7eded-44b5-4b84-8280-8c800dc5e5fd req-1f5fab1a-1ddd-4e7b-9d69-8198d50fc571 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.736932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b7a7eded-44b5-4b84-8280-8c800dc5e5fd req-1f5fab1a-1ddd-4e7b-9d69-8198d50fc571 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.748862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1466402e-cae7-4d2a-aa67-1727581b6895 req-0259af6e-08a0-4617-89c8-a605db395eed service nova] Creating event network-vif-deleted:2f18d001-40d4-4570-9f4a-3f08e5580100 for instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 on n-h2-843861-3 Jul 19 19:54:31.772291 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1466402e-cae7-4d2a-aa67-1727581b6895 req-0259af6e-08a0-4617-89c8-a605db395eed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104300 Jul 19 19:54:31.773586 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1057/2031] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:31.782419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:31.783378 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b7a7eded-44b5-4b84-8280-8c800dc5e5fd req-1f5fab1a-1ddd-4e7b-9d69-8198d50fc571 service nova] Creating event network-changed:007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 for instance ade257ce-d488-4823-8909-cf7f02bde948 on n-h2-843861-3 Jul 19 19:54:31.783726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:31.796297 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b7a7eded-44b5-4b84-8280-8c800dc5e5fd req-1f5fab1a-1ddd-4e7b-9d69-8198d50fc571 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105947 Jul 19 19:54:31.797633 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 975/2032] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:31.802709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.803324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.804595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.805325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.810553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:31.813532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:31.826810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.827977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.829113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.829848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.677105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:32.692290 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1cbc25af-67f3-44bc-944d-2a2f6606186f tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1645 microversion: 2.1 time: 0.916612 Jul 19 19:54:32.692899 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1058/2033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:31 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1645 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:32.713617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fee709f9-047a-426d-8d9f-90d322671a35 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1c9700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:32.818462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fee709f9-047a-426d-8d9f-90d322671a35 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 200 len: 1464 microversion: 2.1 time: 0.124225 Jul 19 19:54:32.828974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1059/2034] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:32 2022] GET /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 1464 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:32.837793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:32.838421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:32.845947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.846581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.848029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.848470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.138068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.180292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.182076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.183322 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0d1da92-9e6e-4925-9c01-b2e684b269c1 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1266 microversion: 2.25 time: 0.353251 Jul 19 19:54:33.183908 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1060/2035] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:32 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:33.194953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:33.201814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:33.229595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.230475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.243675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.244179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.280979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.325743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98015895-3e21-41a4-9de6-141731fcdcff tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 1.526386 Jul 19 19:54:33.326299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 976/2036] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:31 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:33.348829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:33.349472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:33.366562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.367246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.368074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.368508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.575703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:33.658028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:33.944983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.961728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bde8cf16-3a5b-4810-bcc7-d0d75e78470f tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.776731 Jul 19 19:54:33.976338 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1061/2037] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:33 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:33.991475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:33.992965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.020813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.021265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.022061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.022511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.027139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:34.301132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:34.339954 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f8c176a-499b-441b-a0c1-6a67e8c1c187 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 1.000366 Jul 19 19:54:34.342832 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 977/2038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:33 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:34.353638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.365772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.377311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.378407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.380326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.381470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.891785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918f7d77e006476eaf800fbf195bbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae955bec2d54c2b8a3a81e042c3ae74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:34.913824 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52170a96-beb9-4bbf-9d61-68437256ee6a tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 200 len: 1645 microversion: 2.1 time: 0.568830 Jul 19 19:54:34.936055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 978/2039] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:34 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 1645 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:34.947761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b9a2c3ae-a00d-4d97-b321-0adaf1383bfa req-216587f9-f85e-4658-a35a-c17d02206a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed787c-37b2-47db-b62c-36184e2deedf", "name": "network-vif-unplugged", "status": "completed", "tag": "121c7c63-feab-412b-8930-3d950e9e63f4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:34.963060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b9a2c3ae-a00d-4d97-b321-0adaf1383bfa req-216587f9-f85e-4658-a35a-c17d02206a85 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.964627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b9a2c3ae-a00d-4d97-b321-0adaf1383bfa req-216587f9-f85e-4658-a35a-c17d02206a85 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.002381 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b9a2c3ae-a00d-4d97-b321-0adaf1383bfa req-216587f9-f85e-4658-a35a-c17d02206a85 service nova] Creating event network-vif-unplugged:121c7c63-feab-412b-8930-3d950e9e63f4 for instance 3eed787c-37b2-47db-b62c-36184e2deedf on n-h1-843861-3 Jul 19 19:54:35.027049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b9a2c3ae-a00d-4d97-b321-0adaf1383bfa req-216587f9-f85e-4658-a35a-c17d02206a85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077365 Jul 19 19:54:35.029056 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 979/2040] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:35.038838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:35.040331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:35.051469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.052849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.054496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.055536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.182605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:35.231004 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9aa5af04-0e27-455d-87a8-f842b2e35410 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1468 microversion: 2.1 time: 1.247848 Jul 19 19:54:35.232182 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1062/2041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:33 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1468 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:35.245621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:35.262933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:35.264579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:35.265245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:35.265908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-02726a59-8ff3-4bc3-a537-4cc167c5f520 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1266 microversion: 2.25 time: 0.234662 Jul 19 19:54:35.273732 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 980/2042] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:35 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:35.289153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}, {"server_uuid": "999dfd20-abe4-40c0-9d5b-ef178f5f56d5", "name": "network-vif-deleted", "tag": "bd0218d9-c5ba-4c35-88f8-ae077a101c84"}, {"name": "network-changed", "server_uuid": "afd11a05-5224-4baa-943b-fc1fc5ce3e6e", "tag": "53f2f330-a676-49f5-bfc4-28bfe34a0d0b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:35.290069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:35.319751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.320377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.350893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.351998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.356991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.357973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.360063 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Creating event network-changed:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h2-843861-3 Jul 19 19:54:35.360594 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Creating event network-vif-deleted:bd0218d9-c5ba-4c35-88f8-ae077a101c84 for instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 on n-h2-843861-3 Jul 19 19:54:35.361107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] Creating event network-changed:53f2f330-a676-49f5-bfc4-28bfe34a0d0b for instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e on n-h1-843861-3 Jul 19 19:54:35.400094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-281a5005-6533-4e89-960e-139aac2d7f21 req-1ce7d4c3-5324-4f1e-8851-30adb0a1127a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.124628 Jul 19 19:54:35.401160 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 981/2043] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:35.409433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:35.410172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:35.444155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.445291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.446801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.448532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.012189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.025498 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf593f4a-a645-4c76-b719-3e6130506993 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.786577 Jul 19 19:54:36.040906 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1063/2044] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:35 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:36.053978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1273309234"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:36.057574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.070051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.071663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.074872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.075769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.258147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.269426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a959c5cc-f39a-4a67-8047-ab978d66c316 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.866257 Jul 19 19:54:36.271426 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 982/2045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:35 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:36.279043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.284904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.295587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.297163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.298107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.298707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.493241 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65adaa83-f0f7-4f8e-9f98-4910a503303d tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "POST /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a/action" status: 202 len: 0 microversion: 2.1 time: 0.450464 Jul 19 19:54:36.495726 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1064/2046] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:54:36 2022] POST /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:54:36.508502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.509677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] [instance: 999dfd20-abe4-40c0-9d5b-ef178f5f56d5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.540108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.554299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.555886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.558184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.597551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.607977 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d5744c2-0d18-4b2d-9aaa-00d6315550ee tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 0.332778 Jul 19 19:54:36.612717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 983/2047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:36.638227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.639633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.647098 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] HTTP exception thrown: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Request method failure captured: Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 HTTP/1.1 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wtsBa1JLnXtIL9ggjgAn4xMbmmhJjcKNk0EN66oC3vRf52y1oTQgA_UvyRRbx82-82wfAf7axKGmG1x-YOb1UhTzAYRnRKdUtj-HbTavp2oFB9cydhGP-etCuc8T7x5EenUK50EJIaaFC9TWSGsnYtuWCTDu8eHXsfuvwruW-0oK6M Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0ae955bec2d54c2b8a3a81e042c3ae74 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestManualDisk-203892213 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ae955bec2d54c2b8a3a81e042c3ae74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ae955bec2d54c2b8a3a81e042c3ae74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ae955bec2d54c2b8a3a81e042c3ae74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ae955bec2d54c2b8a3a81e042c3ae74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestManualDisk-203892213 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0ae955bec2d54c2b8a3a81e042c3ae74 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestManualDisk-203892213 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestManualDisk-203892213-project Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 918f7d77e006476eaf800fbf195bbeb4 Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestManualDisk-203892213-project Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '999dfd20-abe4-40c0-9d5b-ef178f5f56d5'} Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.653808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. Jul 19 19:54:36.657212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.659367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Returning 404 to user: Instance 999dfd20-abe4-40c0-9d5b-ef178f5f56d5 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.662693 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-056a13f6-2ff8-4c53-95a7-5fdb80d0e43c tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5" status: 404 len: 111 microversion: 2.1 time: 0.164625 Jul 19 19:54:36.663896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1065/2048] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/999dfd20-abe4-40c0-9d5b-ef178f5f56d5 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.665384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.666028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.668826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.670072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.685004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df1e0962-6d85-4873-a87a-66692596d87c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e237ca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.765444 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df1e0962-6d85-4873-a87a-66692596d87c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.100279 Jul 19 19:54:36.766387 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1066/2049] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:36.772581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb2f0f9e-48f7-47ef-8461-7748eb766105 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] Calling method '.version_select at 0x7fb88e114b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.798303 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb2f0f9e-48f7-47ef-8461-7748eb766105 tempest-ServersTestManualDisk-203892213 tempest-ServersTestManualDisk-203892213-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36947594" status: 202 len: 0 microversion: 2.1 time: 0.030661 Jul 19 19:54:36.799245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1067/2050] 10.222.0.33 () {58 vars in 1214 bytes} [Tue Jul 19 19:54:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36947594 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:54:36.804252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.829558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.834025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.839300 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a957ae5-320b-4505-8b73-9f570ed2c5d4 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 200 len: 1266 microversion: 2.25 time: 0.222794 Jul 19 19:54:36.842742 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 984/2051] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:37.044616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:37.048246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:37.054124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.061758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:37.062642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.063090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:37.288418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:37.289324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:37.323265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.324344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:37.325635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.326249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:37.707762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:37.723272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1655504-ca76-4def-a0bd-dbaaf1fb6f42 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.681191 Jul 19 19:54:37.724171 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1068/2052] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:37 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:37.756978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:37.763955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:37.795402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.795871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:37.808494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:37.808995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.461129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:38.476773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18c7eeeb-4cce-4a1f-9874-2f4d92b8c8a4 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 0.736638 Jul 19 19:54:38.486902 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1069/2053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:37 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:38.486902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59fcbb3b-acce-46dd-9f78-d4f955ce1d43 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1fbe50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:38.493441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:38.511800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-903ad3fc-70b1-4d99-b850-cfe0ba880cf8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 1.228245 Jul 19 19:54:38.516698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 985/2054] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:37 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:38.537483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:38.540131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 2eaa8fdc-9404-451a-a51b-f244b8bbf372] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:38.568805 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59fcbb3b-acce-46dd-9f78-d4f955ce1d43 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.089692 Jul 19 19:54:38.574316 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1070/2055] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:38 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:38.574504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.574728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.575570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.576053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.642383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:38.653583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] HTTP exception thrown: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Request method failure captured: Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 HTTP/1.1 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnzsiBmjsrNzMWXmES-6slSGZEdOxfR9xK3jqX_0n9FGGKKy23CX3pASSk9agydPUSBeqqB6WEbYJ6ePvrcZHTEXXGl3oIx6k-v4890egkXSbD3F36BL7PCxqSydQlpeN7Q5RsqJATQQDPicKzttO8d3_bVGUpU7geddhSAE3fbs3o Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 937de5092f1d4e10b36c151ebf1db333 Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2eaa8fdc-9404-451a-a51b-f244b8bbf372'} Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. Jul 19 19:54:38.658598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:54:38.662224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Returning 404 to user: Instance 2eaa8fdc-9404-451a-a51b-f244b8bbf372 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:38.662817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7711490-3c1e-47a2-bc99-81b8988a2655 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372" status: 404 len: 111 microversion: 2.25 time: 0.138885 Jul 19 19:54:38.665698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 986/2056] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:38 2022] GET /compute/v2.1/servers/2eaa8fdc-9404-451a-a51b-f244b8bbf372 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:54:38.741796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:38.742450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:38.753860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.754332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.772397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.772870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.382019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:39.396289 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e420ed4e-4347-46e6-9dde-0791f21eaaf8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.655056 Jul 19 19:54:39.397781 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1071/2057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:38 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:39.494926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:39.495552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:39.516548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.517041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.517886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.518381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.535623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:39.536516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:39.549388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.550639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.551585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.561947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:40.219351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:40.232485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-833afc28-1a82-4ba9-86fc-8c5d98b49a1f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 0.740991 Jul 19 19:54:40.249027 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 987/2058] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:39 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:40.261208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f246036-6732-4768-b1a2-370273e540d6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88db561f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:40.348053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f246036-6732-4768-b1a2-370273e540d6 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.105160 Jul 19 19:54:40.353306 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 988/2059] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:40 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:40.355192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:40.359106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7a1b3c53-8847-4cbf-b988-a15ccf7f1217 req-44f4e836-6578-49a0-b188-71ce09d85678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade257ce-d488-4823-8909-cf7f02bde948", "name": "network-vif-plugged", "status": "completed", "tag": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:40.366273 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b90273a6-e96f-4b5e-a37f-774df2fd3ae4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.835463 Jul 19 19:54:40.376066 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1072/2060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:39 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:40.381944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a1b3c53-8847-4cbf-b988-a15ccf7f1217 req-44f4e836-6578-49a0-b188-71ce09d85678 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:40.382707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a1b3c53-8847-4cbf-b988-a15ccf7f1217 req-44f4e836-6578-49a0-b188-71ce09d85678 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:40.413665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7a1b3c53-8847-4cbf-b988-a15ccf7f1217 req-44f4e836-6578-49a0-b188-71ce09d85678 service nova] Creating event network-vif-plugged:007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 for instance ade257ce-d488-4823-8909-cf7f02bde948 on n-h2-843861-3 Jul 19 19:54:40.416848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:40.417714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:40.423334 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7a1b3c53-8847-4cbf-b988-a15ccf7f1217 req-44f4e836-6578-49a0-b188-71ce09d85678 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068499 Jul 19 19:54:40.427833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 989/2061] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:40.435762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:40.439504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:40.443094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:40.443549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:40.849051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:40.862362 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6050f7b-9b22-48d4-9be0-912a8cf28f04 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.451291 Jul 19 19:54:40.866722 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1073/2062] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:40 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:41.261886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:41.264433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:41.300850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.301843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.302906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.305240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.366927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db20e0b9-4f6c-4309-a288-579ccc64a3dc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e117700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:41.454719 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db20e0b9-4f6c-4309-a288-579ccc64a3dc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.093110 Jul 19 19:54:41.455659 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1074/2063] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:41 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:41.473020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:41.474101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:41.488141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.488954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.492332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.493051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.414087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.435867 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7aa2f757-05db-48df-882d-c48060fd3d84 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.967226 Jul 19 19:54:42.437112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1075/2064] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:41 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:42.442240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:42.448981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:42.460819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:42.461490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.464865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:42.468309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.552261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.569099 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-69a83059-bbe7-4bf8-9947-f8a1b940ab25 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1332 microversion: 2.1 time: 1.315659 Jul 19 19:54:42.570930 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 990/2065] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:41 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1332 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:42.584263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51a7f9de-1917-4e97-b8a9-581caa37c7b1 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d49ff70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:42.684282 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51a7f9de-1917-4e97-b8a9-581caa37c7b1 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.111881 Jul 19 19:54:42.686902 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 991/2066] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:42 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:42.702107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c47c0f37-fbfe-423b-b19d-591237056659 req-54d280e6-1a0f-43d1-ac11-89b15d99a834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:42.728102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:42.733525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c47c0f37-fbfe-423b-b19d-591237056659 req-54d280e6-1a0f-43d1-ac11-89b15d99a834 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:42.733978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c47c0f37-fbfe-423b-b19d-591237056659 req-54d280e6-1a0f-43d1-ac11-89b15d99a834 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.746736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.763667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-562b142a-8886-4d4b-ade8-86261a04f55d tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.325266 Jul 19 19:54:42.766838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1076/2067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:42 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:42.781327 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c47c0f37-fbfe-423b-b19d-591237056659 req-54d280e6-1a0f-43d1-ac11-89b15d99a834 service nova] Creating event network-vif-unplugged:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h2-843861-3 Jul 19 19:54:42.796889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c47c0f37-fbfe-423b-b19d-591237056659 req-54d280e6-1a0f-43d1-ac11-89b15d99a834 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102730 Jul 19 19:54:42.798276 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 992/2068] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:43.453629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:43.455995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:43.466144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.466753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:43.467693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.468337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:43.587862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:43.589318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:43.607307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.610111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:43.611347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.612710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.265521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.291215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c2d8f20-f2ae-4fb0-a8d3-e0cf3b190930 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.835631 Jul 19 19:54:44.293045 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1077/2069] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:43 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:44.305736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.319426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52e247ec-8b3b-46ac-9583-66e2bd268535 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1535 microversion: 2.1 time: 0.736340 Jul 19 19:54:44.320265 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 993/2070] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:43 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1535 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:44.324704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-267081329", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "207c4030-07ef-41e5-80f0-21e6cd680299"}, {"uuid": "e827af61-c934-4d6b-81cf-43397d809a6a"}, {"uuid": "207c4030-07ef-41e5-80f0-21e6cd680299"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:44.327628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d086767b-0cc0-4455-ba97-9e5674110137 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d444dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:44.453145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d086767b-0cc0-4455-ba97-9e5674110137 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.122582 Jul 19 19:54:44.458640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] validate_networks() for [('207c4030-07ef-41e5-80f0-21e6cd680299', None, None, None, None, None), ('e827af61-c934-4d6b-81cf-43397d809a6a', None, None, None, None, None), ('207c4030-07ef-41e5-80f0-21e6cd680299', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:44.464280 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 994/2071] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:44 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:44.472093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:44.473513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:44.492524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:44.492977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.493833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:44.497943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.945638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.961651 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-99a23df7-91c5-4634-8658-eb8f25c6a18b tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.495723 Jul 19 19:54:44.971510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 995/2072] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:44 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:44.984930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca3f50d9-2138-4877-b953-ca2a5d7a8a12 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'create', calling method: .version_select at 0x7fb88d563040>, body: {"pool": "02c2b43a-dc9b-4bb5-bc11-df88962220ed"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:52.461039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:52.461523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:52.462558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:52.462971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:52.463676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:52.467053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:52.530450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.534421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.539511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.542215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.597615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Getting quotas for project 702f2a7aa83346a39543c724e129480a. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:52.612420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Getting quotas for user a59e4b2ee66540fbbb389b87a517b686 and project 702f2a7aa83346a39543c724e129480a. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:52.645214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:52.649710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:52.746547 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65265346-4a1f-41f5-aa9c-8cf5a3f30429 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.451309 Jul 19 19:54:52.749851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1078/2073] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 8455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:52.763268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-121a41ce-1f11-45ce-8c68-13feaec393ce req-d15dc263-6696-4434-85b4-44a252bad03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd11a05-5224-4baa-943b-fc1fc5ce3e6e", "name": "network-vif-plugged", "status": "completed", "tag": "53f2f330-a676-49f5-bfc4-28bfe34a0d0b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:52.792730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-121a41ce-1f11-45ce-8c68-13feaec393ce req-d15dc263-6696-4434-85b4-44a252bad03e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.793914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-121a41ce-1f11-45ce-8c68-13feaec393ce req-d15dc263-6696-4434-85b4-44a252bad03e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.817056 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-121a41ce-1f11-45ce-8c68-13feaec393ce req-d15dc263-6696-4434-85b4-44a252bad03e service nova] Creating event network-vif-plugged:53f2f330-a676-49f5-bfc4-28bfe34a0d0b for instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e on n-h1-843861-3 Jul 19 19:54:52.841336 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-121a41ce-1f11-45ce-8c68-13feaec393ce req-d15dc263-6696-4434-85b4-44a252bad03e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086133 Jul 19 19:54:52.850080 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1079/2074] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:52.862330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:52.866400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:52.882258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.885613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.886650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.887343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:53.802896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:53.813877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0774261-abe5-4dae-8f01-c89cf79d3573 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1392 microversion: 2.1 time: 0.959247 Jul 19 19:54:53.828785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1080/2075] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:52 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1392 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:53.837186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-693e0832-2235-4193-a754-ba5098f9e532 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e464310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:53.981976 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-693e0832-2235-4193-a754-ba5098f9e532 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.151457 Jul 19 19:54:54.002743 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1081/2076] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:53 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:54.008421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:54.009079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:54.039158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.042651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.043568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.044059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.492641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:54.508449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:54.542112 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-273754e9-211a-48af-a657-df3a86fedb57 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1316 microversion: 2.1 time: 0.519550 Jul 19 19:54:54.556117 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1082/2077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:54 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:54.573313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:54.575190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:54.591838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.593838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.594810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.596367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.678990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:54.784474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:54.949432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9af12e87-48e4-42e9-b434-927a6891f79c tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 204 len: 0 microversion: 2.25 time: 0.391009 Jul 19 19:54:54.950784 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1083/2078] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:54:54 2022] DELETE /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:54:54.954186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=29 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:54.961775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:54.962711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:54.969666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.970447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.971366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.971984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.046167 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca3f50d9-2138-4877-b953-ca2a5d7a8a12 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 10.069340 Jul 19 19:54:55.047089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 996/2079] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:54:44 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 10071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:55.054824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:55.055653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:55.069436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.070064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.071638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.072792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.159085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.170266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ef7a27b-b5e2-4abb-8cbb-302df620eef1 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1272 microversion: 2.1 time: 0.217994 Jul 19 19:54:55.177037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1084/2080] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:54 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:55.192021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-19dfee59-4320-4ac4-a4d6-3db488aa3109 req-62bd317a-0efb-46c7-b234-6d92a89adb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-plugged", "status": "completed", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:55.218484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-19dfee59-4320-4ac4-a4d6-3db488aa3109 req-62bd317a-0efb-46c7-b234-6d92a89adb58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.219142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-19dfee59-4320-4ac4-a4d6-3db488aa3109 req-62bd317a-0efb-46c7-b234-6d92a89adb58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.247198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-19dfee59-4320-4ac4-a4d6-3db488aa3109 req-62bd317a-0efb-46c7-b234-6d92a89adb58 service nova] Creating event network-vif-plugged:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:54:55.262963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-19dfee59-4320-4ac4-a4d6-3db488aa3109 req-62bd317a-0efb-46c7-b234-6d92a89adb58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083778 Jul 19 19:54:55.263725 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1085/2081] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:55.272134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:55.296201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:55.313442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.314069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.315061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.315634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.824034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.833718 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57fe914c-d166-48d7-8459-865f6df0b8db tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1382 microversion: 2.1 time: 0.785229 Jul 19 19:54:55.840660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 997/2082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:55 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1382 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:55.852487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-daf5a13c-4c30-464a-901d-a7f3696e07a0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1f3820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:55.903441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.954097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.957991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.986566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af57cb46-19c1-4dac-b3cc-ce7a896a61e9 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1732 microversion: 2.25 time: 0.718822 Jul 19 19:54:55.987342 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1086/2083] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:55 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1732 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:56.011206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.2"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:56.020485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-daf5a13c-4c30-464a-901d-a7f3696e07a0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.170116 Jul 19 19:54:56.020646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:56.021253 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 998/2084] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:55 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:56.028779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.029681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.030850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.031511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.039902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:56.044864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:56.050211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.050679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.052073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.052724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.091088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Acquired lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:54:56.731734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:56.742739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-862cd720-ae37-4b58-a425-0e3e4f68f6e8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1504 microversion: 2.1 time: 0.709637 Jul 19 19:54:56.743354 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 999/2085] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:56 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1504 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:56.763675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1dccbf0c-3f5f-4bc2-bd94-c7c0ae4979d3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '.version_select at 0x7fb88d563550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:56.771971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dccbf0c-3f5f-4bc2-bd94-c7c0ae4979d3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.778317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dccbf0c-3f5f-4bc2-bd94-c7c0ae4979d3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.794025 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1dccbf0c-3f5f-4bc2-bd94-c7c0ae4979d3 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.044479 Jul 19 19:54:56.795312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1000/2086] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:54:56 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:56.800619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:56.801625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:56.808837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.809659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.810687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.811351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.935884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:56.950152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0baa57e2-3a18-4e30-b4f8-c8daec639268 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1270 microversion: 2.1 time: 0.153366 Jul 19 19:54:56.963214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1001/2087] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:56 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:56.969572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:56.971152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:56.981624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.984440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.985631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.986411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.147942 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b04702e-e045-41d0-b84b-d13a419e8434 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "DELETE /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.182839 Jul 19 19:54:57.155026 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1002/2088] 10.222.0.33 () {58 vars in 1295 bytes} [Tue Jul 19 19:54:56 2022] DELETE /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e/os-server-password => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:57.169775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:57.172614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:57.187596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.188248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.189166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.189751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.936370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a12a3f33-469e-449f-8a00-cd1c539fb805 tempest-LiveMigrationTest-432320179 tempest-LiveMigrationTest-432320179-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1533 microversion: 2.1 time: 0.780225 Jul 19 19:54:57.944630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1003/2089] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:57 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1533 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:57.960705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:57.961546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:57.974256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.974912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.975744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.976214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.691001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.709478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.711056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.721115 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2cfaab8e-c664-4af9-affd-86fa9e8abd5a tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1732 microversion: 2.25 time: 0.774983 Jul 19 19:54:58.738429 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1004/2090] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:57 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1732 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:58.755960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e70c7a50-934e-471c-a52f-86134e4f7010 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d444c10>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.841808 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e70c7a50-934e-471c-a52f-86134e4f7010 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.101730 Jul 19 19:54:58.846553 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1005/2091] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:54:58 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:58.852720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.854653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:58.866801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.867641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.868807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.869493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.908624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2bcef162-e4b2-4d2a-b6e3-e9739116082c tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.060311 Jul 19 19:54:58.909231 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1006/2092] 10.222.0.33 () {58 vars in 1292 bytes} [Tue Jul 19 19:54:58 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e/os-server-password => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:54:58.921509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.933775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:58.955882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.956488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.957146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.957590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:59.057449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:59.247846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff4f98e2-3540-4898-9fca-6381d6664515 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 204 len: 0 microversion: 2.1 time: 0.336123 Jul 19 19:54:59.253583 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1007/2093] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:58 2022] DELETE /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:59.265968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:59.269785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:59.291394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:59.296499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:59.302728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:59.303713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.054435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:00.068637 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f682eafd-dc3f-43de-8210-0176467ce67b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1312 microversion: 2.1 time: 0.817218 Jul 19 19:55:00.069568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1008/2094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:59 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1312 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:00.088254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:00.088872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:00.109101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.109561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.110350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.111329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.177864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:00.496611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68d3d2bb-dc2c-4f65-a317-9210ac52d9ee tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "DELETE /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 204 len: 0 microversion: 2.1 time: 0.425661 Jul 19 19:55:00.497218 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1009/2095] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:00 2022] DELETE /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:00.505950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:00.506587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:00.520961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.521422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.522231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.522673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:01.798830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:01.808707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48112d6f-e90c-4764-90ca-3f4897e6cbfc tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1388 microversion: 2.1 time: 1.307318 Jul 19 19:55:01.813283 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1010/2096] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:00 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1388 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:01.842054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:01.842746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:01.872875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:01.873347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:01.879171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:01.879774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.564974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:02.600380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.604916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:02.616976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.622464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.626585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05b18154-0d35-4f36-8cc9-c80c97cd38e5 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 200 len: 1664 microversion: 2.25 time: 0.800972 Jul 19 19:55:02.630616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1011/2097] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:01 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 1664 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:02.632324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:02.645276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1927c7c1-f54c-4c9f-ae77-ca96b453c4f3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d563280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:02.741710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1927c7c1-f54c-4c9f-ae77-ca96b453c4f3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.109725 Jul 19 19:55:02.747476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1012/2098] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:02 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:02.758114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:02.758960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:02.775895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.776480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.778185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.780351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:03.544167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:03.558725 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eec15107-ce4f-4def-bfdc-5fa737c7b4a3 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1510 microversion: 2.1 time: 0.810220 Jul 19 19:55:03.559330 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1013/2099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:02 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1510 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:03.580770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:03.582131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:03.602435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:03.609199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:55:03.614198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:03.615234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:03.615689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.678220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:04.691576 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08b0f2ce-6234-4abf-902c-280b76c244ea tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1333 microversion: 2.1 time: 1.131102 Jul 19 19:55:04.694730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1014/2100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:03 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1333 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:04.716439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6c0f37c4-648c-421f-bccf-5fe72f700a24 req-7a2d050e-e194-4a66-8484-5c12e761d521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30db9d98-0a6e-4fd2-bcf9-9829b67fc344", "name": "network-vif-deleted", "tag": "ef3ef018-95ea-4416-97ee-a09f4c49c4a5"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:04.736478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6c0f37c4-648c-421f-bccf-5fe72f700a24 req-7a2d050e-e194-4a66-8484-5c12e761d521 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.738145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6c0f37c4-648c-421f-bccf-5fe72f700a24 req-7a2d050e-e194-4a66-8484-5c12e761d521 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.779137 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6c0f37c4-648c-421f-bccf-5fe72f700a24 req-7a2d050e-e194-4a66-8484-5c12e761d521 service nova] Creating event network-vif-deleted:ef3ef018-95ea-4416-97ee-a09f4c49c4a5 for instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 on n-h1-843861-3 Jul 19 19:55:04.803008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6c0f37c4-648c-421f-bccf-5fe72f700a24 req-7a2d050e-e194-4a66-8484-5c12e761d521 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106719 Jul 19 19:55:04.809472 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1015/2101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:04.831176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:04.837235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:04.851101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.853561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.854982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.856971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.146655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:05.163086 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d41ea3fe-7a8e-4ea4-b11b-c963b2b5d6ec tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1184 microversion: 2.1 time: 0.352010 Jul 19 19:55:05.169935 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1016/2102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:04 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1184 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:05.182759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:05.188866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 30db9d98-0a6e-4fd2-bcf9-9829b67fc344] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:05.205142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.207832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.211051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.215077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.260366 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] HTTP exception thrown: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Request method failure captured: Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 HTTP/1.1 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnzsiBmjsrNzMWXmES-6slSGZEdOxfR9xK3jqX_0n9FGGKKy23CX3pASSk9agydPUSBeqqB6WEbYJ6ePvrcZHTEXXGl3oIx6k-v4890egkXSbD3F36BL7PCxqSydQlpeN7Q5RsqJATQQDPicKzttO8d3_bVGUpU7geddhSAE3fbs3o Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 937de5092f1d4e10b36c151ebf1db333 Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '30db9d98-0a6e-4fd2-bcf9-9829b67fc344'} Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. Jul 19 19:55:05.270652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Returning 404 to user: Instance 30db9d98-0a6e-4fd2-bcf9-9829b67fc344 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:05.274111 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9133bee9-4dbd-493f-a075-3f299d006c09 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344" status: 404 len: 111 microversion: 2.25 time: 0.101843 Jul 19 19:55:05.274661 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1017/2103] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:05 2022] GET /compute/v2.1/servers/30db9d98-0a6e-4fd2-bcf9-9829b67fc344 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:05.296066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6193dfca-f17e-47db-902a-e91af0b241e3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d557430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:05.397221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6193dfca-f17e-47db-902a-e91af0b241e3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.121621 Jul 19 19:55:05.397839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1018/2104] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:05 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:05.428451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:05.429235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:05.458712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.459186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.460058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.460511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:06.026593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:06.859424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c807b4d649844f3bc2efe82b1a69a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b09518f29534466a270630498384363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:06.872506 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68f47b5b-080f-4214-ba1f-e8073558d4a8 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 200 len: 1510 microversion: 2.1 time: 1.473561 Jul 19 19:55:06.873119 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1019/2105] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:05 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 1510 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:06.892390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b939115-c504-47c8-a41f-a6fae019cf8d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '.version_select at 0x7fb88e22ed30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:06.960627 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b939115-c504-47c8-a41f-a6fae019cf8d tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077298325" status: 204 len: 0 microversion: 2.25 time: 0.086409 Jul 19 19:55:06.961592 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1020/2106] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 19:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077298325 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:55:06.981685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:06.982578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:07.019930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.025076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.026358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.033223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.902321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Updating instance_info_cache with network_info: [{"id": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6", "address": "fa:16:3e:2d:32:a4", "network": {"id": "f3bf10e4-0964-4285-a33f-4eaa440332de", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-701829013-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2096f2ea01e7491ea1cb0245a0c5dafb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap007d4e23-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:55:07.917368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Releasing lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:55:07.919366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-766e195d-fb58-4294-82c4-a7b7b69ec76f tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 202 len: 0 microversion: 2.1 time: 11.930770 Jul 19 19:55:07.922396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1087/2107] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:54:55 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 0 bytes in 11934 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:55:07.937656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:07.939496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:07.963159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.964473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.968491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.969472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.185930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.203790 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e529d42-83d4-4c32-b669-9cce492a359a tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1184 microversion: 2.1 time: 0.277165 Jul 19 19:55:08.204665 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1088/2108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:07 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1184 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:08.213671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.223707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7b597f1-88cb-4e00-822b-8708bb40248c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e3a8a60>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:08.234586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0afbcaee-28c1-4198-b2a2-1fd1e3987a51 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1333 microversion: 2.1 time: 1.271537 Jul 19 19:55:08.245339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1021/2109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:06 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1333 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:08.250339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f230f7-d9fe-4c80-84d1-49790b3c618c", "name": "network-vif-deleted", "tag": "0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0"}, {"name": "network-changed", "server_uuid": "ade257ce-d488-4823-8909-cf7f02bde948", "tag": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:08.260812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.267477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.316080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7b597f1-88cb-4e00-822b-8708bb40248c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.095493 Jul 19 19:55:08.321570 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1089/2110] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:08 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:08.321761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] Creating event network-vif-deleted:0b3e0efe-6add-4e8b-9bdb-1d6c844d27f0 for instance 79f230f7-d9fe-4c80-84d1-49790b3c618c on n-h1-843861-3 Jul 19 19:55:08.321761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] Creating event network-changed:007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 for instance ade257ce-d488-4823-8909-cf7f02bde948 on n-h2-843861-3 Jul 19 19:55:08.338386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:08.339103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] [instance: afd11a05-5224-4baa-943b-fc1fc5ce3e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:08.354629 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a314216d-b6a2-4c4c-af44-691950a54857 req-9239c9db-308b-4852-b59c-7a78635f732a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107839 Jul 19 19:55:08.355123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.359978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.361702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1022/2111] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:08.363699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.364624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.372776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5832237-1d10-428a-80ce-5cc563f8cc73 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'create', calling method: .version_select at 0x7fb88e8984c0>, body: {"pool": "02c2b43a-dc9b-4bb5-bc11-df88962220ed"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:08.417199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] HTTP exception thrown: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Request method failure captured: Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e HTTP/1.1 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wvj3P1RWCun0fnWp1WMjMbYtWn8oo1ItcX_cdIlLHmc6qpMb-ccx3AXwvLErSfz0y_1mA9yGG_veCNB6cqlYO3IVHgGq5RfKQOea3iIJDTlOwP50diLw0JZEksb9uhbzM0au3Vbwmr7Zyx_6x_4dWJbPGMa2cHMUz9RcG_VD1wZzMg Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2b09518f29534466a270630498384363 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerPasswordTestJSON-2073725382 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b09518f29534466a270630498384363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b09518f29534466a270630498384363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b09518f29534466a270630498384363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b09518f29534466a270630498384363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerPasswordTestJSON-2073725382 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2b09518f29534466a270630498384363 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2073725382 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerPasswordTestJSON-2073725382-project Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 9c807b4d649844f3bc2efe82b1a69a53 Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerPasswordTestJSON-2073725382-project Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'afd11a05-5224-4baa-943b-fc1fc5ce3e6e'} Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:08.419460 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. Jul 19 19:55:08.422947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:08.424358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] Returning 404 to user: Instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:08.427061 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9f72615-3cfa-4339-be9a-3e3e17295440 tempest-ServerPasswordTestJSON-2073725382 tempest-ServerPasswordTestJSON-2073725382-project] 10.222.0.33 "GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e" status: 404 len: 111 microversion: 2.1 time: 0.105025 Jul 19 19:55:08.428519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1090/2112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:08 2022] GET /compute/v2.1/servers/afd11a05-5224-4baa-943b-fc1fc5ce3e6e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:09.226407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:09.227408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:09.254538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.261254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:09.265073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.267435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:09.499399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:09.507429 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-591de2ae-3cf5-4210-8774-97ced7e59f42 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1184 microversion: 2.1 time: 0.288454 Jul 19 19:55:09.508063 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1091/2113] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:09 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1184 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:09.522007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:09.530486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:09.538685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.541559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:09.549393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.551348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.552271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:10.589224 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dee8f87e-b242-49e9-804e-1786e4998070 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 1.071169 Jul 19 19:55:10.595466 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1092/2114] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:09 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:10.605683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b548dc33-6bc0-4b72-a76d-b13b7526f131 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1ddca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:10.719801 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b548dc33-6bc0-4b72-a76d-b13b7526f131 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1455 microversion: 2.1 time: 0.122346 Jul 19 19:55:10.725569 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1093/2115] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:10 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:10.747190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:10.747840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:10.771748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.773986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.784350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.784938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.870344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:11.153992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d991d8a-2194-480a-a524-8d67afa2187f tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 204 len: 0 microversion: 2.25 time: 0.431471 Jul 19 19:55:11.157922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1094/2116] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:55:10 2022] DELETE /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:55:11.189480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:11.190267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:11.218992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.220091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.229072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.229072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.769025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:11.805578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b15bc48b-c1ca-471d-9243-c479c458fea8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 200 len: 1184 microversion: 2.1 time: 0.642278 Jul 19 19:55:11.816606 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1095/2117] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:11 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 1184 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:11.828471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-45230a53-5ad5-45b1-ba29-7463c3075421 req-ac1a35ba-baab-47eb-9544-5e31b09dce09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd11a05-5224-4baa-943b-fc1fc5ce3e6e", "name": "network-vif-deleted", "tag": "53f2f330-a676-49f5-bfc4-28bfe34a0d0b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:11.868276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-45230a53-5ad5-45b1-ba29-7463c3075421 req-ac1a35ba-baab-47eb-9544-5e31b09dce09 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.868778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-45230a53-5ad5-45b1-ba29-7463c3075421 req-ac1a35ba-baab-47eb-9544-5e31b09dce09 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.924935 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-45230a53-5ad5-45b1-ba29-7463c3075421 req-ac1a35ba-baab-47eb-9544-5e31b09dce09 service nova] Creating event network-vif-deleted:53f2f330-a676-49f5-bfc4-28bfe34a0d0b for instance afd11a05-5224-4baa-943b-fc1fc5ce3e6e on n-h1-843861-3 Jul 19 19:55:11.932128 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-45230a53-5ad5-45b1-ba29-7463c3075421 req-ac1a35ba-baab-47eb-9544-5e31b09dce09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111917 Jul 19 19:55:11.933523 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1096/2118] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:11.949664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:11.970151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:11.991761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.992632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.993670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.994315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:13.784150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:13.816941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:13.833485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:13.860160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4451ac93-b2d5-4ff7-9a60-fb65a6969468 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1549 microversion: 2.25 time: 1.915725 Jul 19 19:55:13.861099 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1097/2119] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:11 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1549 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:13.884594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:13.886552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:13.922596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:13.924075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:13.925122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:13.925771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:16.881579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:16.892202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a8eb0e9-8755-453d-99fc-2b4bfe01024e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 3.027327 Jul 19 19:55:16.896694 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1098/2120] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:13 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 3033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:16.909536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ff40203-5573-4623-ae76-7994863d3bc5 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e3a83a0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:17.011080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ff40203-5573-4623-ae76-7994863d3bc5 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1464 microversion: 2.1 time: 0.112856 Jul 19 19:55:17.012417 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1099/2121] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:16 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1464 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:17.043327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:17.046380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: 79f230f7-d9fe-4c80-84d1-49790b3c618c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:17.056174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.063065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.065012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.065797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.099165 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] HTTP exception thrown: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Request method failure captured: Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c HTTP/1.1 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wn2EvQxapX-QU-e2Akni2mxz28mMkWoXNRy21t1SYOX85VfTqkbK0Pe4ZacS8w7bxFxhu0OSDJPYXh6aAw6xfeyx6G_oZ9apVdjmDIvqJKv9rmtMbRsqCXI7X3hwSV8odJbo2x9JEBPCUYuyLSTQjpQRCxcM1KyVVhzdskgdaBdtFQ Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-LiveMigrationTest-684058780 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99eac0488e77448cb55a255d49ad2c58 Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '79f230f7-d9fe-4c80-84d1-49790b3c618c'} Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:17.101313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. Jul 19 19:55:17.105677 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:17.106342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Returning 404 to user: Instance 79f230f7-d9fe-4c80-84d1-49790b3c618c could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:17.107484 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b5336bd1-77cd-4dd7-9674-be367d4a22d3 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c" status: 404 len: 111 microversion: 2.1 time: 0.093589 Jul 19 19:55:17.109473 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1100/2122] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:17 2022] GET /compute/v2.1/servers/79f230f7-d9fe-4c80-84d1-49790b3c618c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:17.125880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:17.125880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:17.143012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.143920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.148117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.148859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.274184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.281464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.286565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lazy-loading 'fault' on Instance uuid b60ee976-8c02-432d-a4ed-fd9009f66131 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:55:17.645237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:17.663286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:17.670242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:17.682389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a6e3791-362d-4da0-af3c-f5e88bdb52b2 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 200 len: 1352 microversion: 2.25 time: 0.570706 Jul 19 19:55:17.683294 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1101/2123] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:17 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 1352 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:17.705306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a4b2b6cd-4a93-4924-8e6c-917d933e9da1 req-347ede4c-0771-47e5-a650-46b6095635de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "tag": "ebd78267-6306-46b7-b4be-b4429fe70de8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:17.740066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a4b2b6cd-4a93-4924-8e6c-917d933e9da1 req-347ede4c-0771-47e5-a650-46b6095635de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.741603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a4b2b6cd-4a93-4924-8e6c-917d933e9da1 req-347ede4c-0771-47e5-a650-46b6095635de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.787221 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a4b2b6cd-4a93-4924-8e6c-917d933e9da1 req-347ede4c-0771-47e5-a650-46b6095635de service nova] Creating event network-changed:ebd78267-6306-46b7-b4be-b4429fe70de8 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:17.807853 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a4b2b6cd-4a93-4924-8e6c-917d933e9da1 req-347ede4c-0771-47e5-a650-46b6095635de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120019 Jul 19 19:55:17.812338 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1102/2124] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:18.073482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1251850818", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "aac4dfe9-2452-4793-8d3f-f09ee27c4959"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:18.184856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] validate_networks() for [('aac4dfe9-2452-4793-8d3f-f09ee27c4959', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:18.257340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:18.280945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:19.461712 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5832237-1d10-428a-80ce-5cc563f8cc73 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 11.098610 Jul 19 19:55:19.462326 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1023/2125] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 19:55:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 11100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:19.467103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66c7af9e-0b94-4c0b-86af-5a7e48c08d66 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4441f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:19.571817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66c7af9e-0b94-4c0b-86af-5a7e48c08d66 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 200 len: 1464 microversion: 2.1 time: 0.108111 Jul 19 19:55:19.592140 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1024/2126] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:19 2022] GET /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 1464 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:19.628156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:19.629561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:19.656315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.668993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.669853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.670281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.636782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:20.651267 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6dceb018-40d6-496e-a45f-1a0ed3efb5b3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 1.055958 Jul 19 19:55:20.655908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1025/2127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:19 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:20.674339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:20.679953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: b60ee976-8c02-432d-a4ed-fd9009f66131] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:20.701409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.701902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.702656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.734015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.772454 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] HTTP exception thrown: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Request method failure captured: Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 HTTP/1.1 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wnzsiBmjsrNzMWXmES-6slSGZEdOxfR9xK3jqX_0n9FGGKKy23CX3pASSk9agydPUSBeqqB6WEbYJ6ePvrcZHTEXXGl3oIx6k-v4890egkXSbD3F36BL7PCxqSydQlpeN7Q5RsqJATQQDPicKzttO8d3_bVGUpU7geddhSAE3fbs3o Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 937de5092f1d4e10b36c151ebf1db333 Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b60ee976-8c02-432d-a4ed-fd9009f66131'} Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. Jul 19 19:55:20.775232 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. Jul 19 19:55:20.779113 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.791124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Returning 404 to user: Instance b60ee976-8c02-432d-a4ed-fd9009f66131 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:20.792285 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b7feaecb-38b4-48cc-a2ed-907929b98785 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131" status: 404 len: 111 microversion: 2.25 time: 0.134838 Jul 19 19:55:20.796650 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1026/2128] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:20 2022] GET /compute/v2.1/servers/b60ee976-8c02-432d-a4ed-fd9009f66131 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:20.802552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.150"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:20.808940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:20.822588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.823294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.824347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.824966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.898675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Acquired lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:55:21.666851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:21.667308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:21.667726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:21.671604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:21.674086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:21.707725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.708191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.715657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.719770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.764707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:21.838191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Getting quotas for project 236615ee22d84821b187cb758efb0324. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:21.869920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Getting quotas for user 27a09d4a63c54394b4da3f41e259e816 and project 236615ee22d84821b187cb758efb0324. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:21.931230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:21.939940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:22.123415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-226ecb25-f4b5-4758-a053-e4d60fcaf644 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.306999 Jul 19 19:55:22.130020 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1103/2129] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:55:22.147110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:22.147738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:22.165586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.166057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:22.166863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.167304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.135505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed.", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:55:23.136685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Releasing lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:55:23.137425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.137425 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Request method failure captured: Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action HTTP/1.1 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 46 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wvqI4inu1Rh4wQxQqJe4sphFuh7zVnHeMdK1Jcwdh2kgfsWQ1sJe9AqjmdTl6YPA1HQUsHyx6MrokvjIm16SCyg3wtl16bNf4aej5y44AwTAhuIugLaMnlrdJ8oWENX1S0za5zFI6og_husH8Is110aWdAzeO1QfDwp_aQha8WKdo4 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8414eba87cbd432fb280e4580a040e14 Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: {"addFloatingIp": {"address": "172.25.7.150"}} Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ade257ce-d488-4823-8909-cf7f02bde948', 'body': {'addFloatingIp': {'address': '172.25.7.150'}}} Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:55:23.139682 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] Jul 19 19:55:23.143946 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:23.150449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Returning 400 to user: Cannot associate floating IP 172.25.7.150 (10e15773-48b3-4da9-917f-fda066bf918e) with port 007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 02c2b43a-dc9b-4bb5-bc11-df88962220ed. Jul 19 19:55:23.150449 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-60174032-6d31-4571-919f-0f100e50b61a'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:23.151917 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18c170dd-282f-4c13-b909-8c610f8a6297 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 400 len: 381 microversion: 2.1 time: 2.353373 Jul 19 19:55:23.152707 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1027/2130] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:20 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 381 bytes in 2355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:23.163898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60ee976-8c02-432d-a4ed-fd9009f66131", "name": "network-vif-deleted", "tag": "e070350a-655d-45a8-9e49-1d78412b9951"}, {"name": "network-changed", "server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "tag": "a05aab05-ece2-4044-93d1-f9caa419e513"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:23.188076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.188534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.205499 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] Creating event network-vif-deleted:e070350a-655d-45a8-9e49-1d78412b9951 for instance b60ee976-8c02-432d-a4ed-fd9009f66131 on n-h1-843861-3 Jul 19 19:55:23.226327 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] Creating event network-changed:a05aab05-ece2-4044-93d1-f9caa419e513 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:23.264583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1b558fcb-3c7e-4166-aa13-a4f4994f787e req-a2834bc5-f116-438e-b277-34aaaf7033a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.110391 Jul 19 19:55:23.266528 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1028/2131] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:23.286409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a1352406-8b58-48a6-9a9e-d0ee8dde2f53 req-5ddc934a-10cf-4c11-8021-12277c921d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-unplugged", "status": "completed", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:23.317089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a1352406-8b58-48a6-9a9e-d0ee8dde2f53 req-5ddc934a-10cf-4c11-8021-12277c921d92 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.317783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a1352406-8b58-48a6-9a9e-d0ee8dde2f53 req-5ddc934a-10cf-4c11-8021-12277c921d92 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.339652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a1352406-8b58-48a6-9a9e-d0ee8dde2f53 req-5ddc934a-10cf-4c11-8021-12277c921d92 service nova] Creating event network-vif-unplugged:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:55:23.340762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:23.347698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a1352406-8b58-48a6-9a9e-d0ee8dde2f53 req-5ddc934a-10cf-4c11-8021-12277c921d92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079721 Jul 19 19:55:23.349014 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1029/2132] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:23.353841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ce4465b-2136-4cea-b769-90ad3b045fc2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1468 microversion: 2.1 time: 1.224726 Jul 19 19:55:23.354518 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1104/2133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:22 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1468 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:23.360278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:23.370641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:23.371566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:23.384912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:23.402755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.407435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.408183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.408966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.409791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.411977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.412137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.417535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.496856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:23.704516 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9599a087-4467-46c0-88a9-3afd81a2e1ce tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 204 len: 0 microversion: 2.25 time: 0.353435 Jul 19 19:55:23.705779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1030/2134] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:55:23 2022] DELETE /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:55:23.716194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:23.719421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:23.740620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.742248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.744670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.745410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:24.139696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:24.153420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:24.159012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:24.178363 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-512045fd-154b-4f04-9441-dfc9f8469ed4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1311 microversion: 2.21 time: 0.470956 Jul 19 19:55:24.205141 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1031/2135] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:23 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1311 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:24.224858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-474b0792-90ff-4fe5-bb96-60998e157045 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '.version_select at 0x7fb88de94ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:24.792577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:24.807382 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a76ddd8-743a-414d-accd-99e3d576a321 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 1.450676 Jul 19 19:55:24.810433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1105/2136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:23 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:24.820812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b7141ba-cf5b-49d5-90fd-590222b0dd17 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e5f7550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:24.998629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b7141ba-cf5b-49d5-90fd-590222b0dd17 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-07-19T19%3A52%3A42Z" status: 200 len: 1903 microversion: 2.1 time: 0.186780 Jul 19 19:55:24.999765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1106/2137] 10.222.0.33 () {58 vars in 1198 bytes} [Tue Jul 19 19:55:24 2022] GET /compute/v2.1/images?changes-since=2022-07-19T19%3A52%3A42Z => generated 1903 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:25.006846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:25.008293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.021844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.022510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.023465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.024086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.843440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.870013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.873064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937de5092f1d4e10b36c151ebf1db333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577704b5db34579abdb9bba3932b73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.883780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d907f88e-37aa-45c3-ad31-cfe69c4d5144 tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 200 len: 1565 microversion: 2.25 time: 0.880197 Jul 19 19:55:25.884488 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1107/2138] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:24 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 1565 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:25.898224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bcb3e7a4-2221-4f7b-9311-3ba69b40e46f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5c7af0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.091490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bcb3e7a4-2221-4f7b-9311-3ba69b40e46f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-270699223" status: 200 len: 484 microversion: 2.1 time: 0.205731 Jul 19 19:55:26.092204 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1108/2139] 10.222.0.33 () {58 vars in 1228 bytes} [Tue Jul 19 19:55:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-270699223 => generated 484 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:26.121148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.124128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:26.152065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.152528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.158928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.159505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.461845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.485531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.489006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.491366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-20e74a90-3ea3-4c12-b181-23b0ddce2f7c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1317 microversion: 2.21 time: 0.391736 Jul 19 19:55:26.493098 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1109/2140] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:26 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:26.502269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.503603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:26.514909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.515792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.517504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.518777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.553236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:26.710174 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5cc2f8c1-68ff-4e63-8aa8-6d0f3b52544c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 204 len: 0 microversion: 2.1 time: 0.214517 Jul 19 19:55:26.712174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1110/2141] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:26 2022] DELETE /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:26.724430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-72a08bc7-c154-4465-b60b-9fb7ac8f390e req-428c6f9b-dd4d-4b29-8422-70a38c41901f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a6c25e-b10d-4c0c-a85b-dbb2499c7221", "name": "network-vif-deleted", "tag": "378cc490-0e0d-41b9-a49a-5deffcedd9bd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:26.741450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-72a08bc7-c154-4465-b60b-9fb7ac8f390e req-428c6f9b-dd4d-4b29-8422-70a38c41901f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.741981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-72a08bc7-c154-4465-b60b-9fb7ac8f390e req-428c6f9b-dd4d-4b29-8422-70a38c41901f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.766282 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-72a08bc7-c154-4465-b60b-9fb7ac8f390e req-428c6f9b-dd4d-4b29-8422-70a38c41901f service nova] Creating event network-vif-deleted:378cc490-0e0d-41b9-a49a-5deffcedd9bd for instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 on n-h2-843861-3 Jul 19 19:55:26.779263 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-72a08bc7-c154-4465-b60b-9fb7ac8f390e req-428c6f9b-dd4d-4b29-8422-70a38c41901f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062859 Jul 19 19:55:26.786501 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1111/2142] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:26.794393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.795122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:26.803152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.803609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.804568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.804992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.625359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:27.633525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a00773f-6124-4901-87f0-2459e41ddd83 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.845610 Jul 19 19:55:27.634129 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1112/2143] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:26 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:27.638715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05e7ff43-d8cf-4f3c-b020-9e919893aae2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5c7550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:27.770019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05e7ff43-d8cf-4f3c-b020-9e919893aae2 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?server=d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 957 microversion: 2.1 time: 0.134699 Jul 19 19:55:27.777616 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1113/2144] 10.222.0.33 () {58 vars in 1208 bytes} [Tue Jul 19 19:55:27 2022] GET /compute/v2.1/images?server=d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 957 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:27.777616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b15377c1-b158-4bd7-b381-d1518fb201fe req-217a5fd3-c94a-4e94-89a4-36a5b17f94eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "tag": "a3bc80fa-7a1b-4118-b4e8-e74048ee5c93"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:27.788973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b15377c1-b158-4bd7-b381-d1518fb201fe req-217a5fd3-c94a-4e94-89a4-36a5b17f94eb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.789945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b15377c1-b158-4bd7-b381-d1518fb201fe req-217a5fd3-c94a-4e94-89a4-36a5b17f94eb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.804367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b15377c1-b158-4bd7-b381-d1518fb201fe req-217a5fd3-c94a-4e94-89a4-36a5b17f94eb service nova] Creating event network-changed:a3bc80fa-7a1b-4118-b4e8-e74048ee5c93 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:27.809819 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b15377c1-b158-4bd7-b381-d1518fb201fe req-217a5fd3-c94a-4e94-89a4-36a5b17f94eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037235 Jul 19 19:55:27.810707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1114/2145] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:27.816824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:27.817758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:27.824629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.825081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.825869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.826317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.590047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.598307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e0bb4a9-322b-49bc-bd17-d4f5776d2941 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1666 microversion: 2.1 time: 0.786292 Jul 19 19:55:28.599009 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1115/2146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:27 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1666 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:28.603887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:28.604689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] [instance: 55a6c25e-b10d-4c0c-a85b-dbb2499c7221] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:28.610890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.611419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.612151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.612591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.627629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] HTTP exception thrown: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Request method failure captured: Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 HTTP/1.1 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wnzsiBmjsrNzMWXmES-6slSGZEdOxfR9xK3jqX_0n9FGGKKy23CX3pASSk9agydPUSBeqqB6WEbYJ6ePvrcZHTEXXGl3oIx6k-v4890egkXSbD3F36BL7PCxqSydQlpeN7Q5RsqJATQQDPicKzttO8d3_bVGUpU7geddhSAE3fbs3o Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5577704b5db34579abdb9bba3932b73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5577704b5db34579abdb9bba3932b73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5577704b5db34579abdb9bba3932b73b Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 937de5092f1d4e10b36c151ebf1db333 Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1566385760-project Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '55a6c25e-b10d-4c0c-a85b-dbb2499c7221'} Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. Jul 19 19:55:28.629314 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] Returning 404 to user: Instance 55a6c25e-b10d-4c0c-a85b-dbb2499c7221 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:28.633253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01dc2ab4-c15f-49c6-ae06-5062ad126cdf tempest-LiveAutoBlockMigrationV225Test-1566385760 tempest-LiveAutoBlockMigrationV225Test-1566385760-project] 10.222.0.33 "GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221" status: 404 len: 111 microversion: 2.25 time: 0.030616 Jul 19 19:55:28.634866 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1116/2147] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:28 2022] GET /compute/v2.1/servers/55a6c25e-b10d-4c0c-a85b-dbb2499c7221 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:28.639722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:28.642889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:28.648453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.648905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.649929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.650375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.013922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:29.023407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:29.025169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:29.026285 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-009e4b92-4a4d-4a43-b51d-8a40de86c676 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1317 microversion: 2.21 time: 0.390521 Jul 19 19:55:29.026841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1117/2148] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:28 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:29.037322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d862fda2-77b7-4084-bb9c-f34ffda9c56c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5c7d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.095604 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d862fda2-77b7-4084-bb9c-f34ffda9c56c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 485 microversion: 2.1 time: 0.067476 Jul 19 19:55:29.096379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1118/2149] 10.222.0.33 () {58 vars in 1316 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf => generated 485 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:29.108017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.109003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:29.115692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.116432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.117281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.117906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.671115 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-474b0792-90ff-4fe5-bb96-60998e157045 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/10e15773-48b3-4da9-917f-fda066bf918e" status: 202 len: 0 microversion: 2.1 time: 5.462538 Jul 19 19:55:29.673361 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1032/2150] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:55:24 2022] DELETE /compute/v2.1/os-floating-ips/10e15773-48b3-4da9-917f-fda066bf918e => generated 0 bytes in 5468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:55:29.689186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad273b60-522d-425f-8d11-4c4d02988d48 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88de94160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.953819 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad273b60-522d-425f-8d11-4c4d02988d48 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 485 microversion: 2.1 time: 0.277478 Jul 19 19:55:29.966851 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1033/2151] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf => generated 485 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:29.973048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.973917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:29.980684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.981787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.982980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.983575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.998491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.017126 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fa4b11e-2812-4021-917f-a6af8838d2dc tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.913604 Jul 19 19:55:30.032701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1119/2152] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:30.050593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.2"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:31.248646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.263542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.283279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62d9686b-864b-4825-b11f-1cb882fc4314 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1666 microversion: 2.1 time: 1.315149 Jul 19 19:55:31.283498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.284153 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1034/2153] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1666 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:31.288516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.289635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.290386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.301057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7850c065-dd15-44ac-b5e5-938119c0e5bc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88de79430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.501955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7850c065-dd15-44ac-b5e5-938119c0e5bc tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.215030 Jul 19 19:55:31.503145 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1035/2154] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:55:31 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:31.509197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.511654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.519202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.520010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.521044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.521681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.761680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:31.903437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:32.360352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:32.371088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:32.386248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:32.387542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d301ce76-50f2-44cc-93ca-4bf77646d91e tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.883109 Jul 19 19:55:32.388168 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1036/2155] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:31 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:32.406174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:32.406921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:32.418142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.420734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.422556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.422969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.551431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Acquired lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:55:33.513952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.547488 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db51ce4c-9cd5-4a0c-9cb7-d6915ba1afd5 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 1.152825 Jul 19 19:55:33.548842 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1037/2156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:32 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:33.558240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7539fe46-d5ea-4cf4-830f-a035429980f8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88db56f70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:33.707402 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7539fe46-d5ea-4cf4-830f-a035429980f8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.156714 Jul 19 19:55:33.719089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1038/2157] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 19:55:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:33.730605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:33.733423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:33.747082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:33.750054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.759293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:33.759894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.874337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:33.876117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.878347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lazy-loading 'fault' on Instance uuid dcacc019-ce62-4a1d-a140-12a8568e453f {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:55:34.019576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:34.057757 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9caafbfc-7972-4ddd-8ad3-8bf897c282b8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 200 len: 1324 microversion: 2.1 time: 0.337206 Jul 19 19:55:34.058678 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1039/2158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:33 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:34.077609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:34.078239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:34.095140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.096288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.099705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.103579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.755424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:34.767556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:34.770857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:34.776036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3fd96d7b-470a-409c-b09b-0f9bec7c9d1a tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.708003 Jul 19 19:55:34.801019 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1040/2159] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:34 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:34.806530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-acefaea4-942d-4cba-bcbf-47fc508e262b req-968b383d-e17d-4000-8e79-7f17a339817c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcacc019-ce62-4a1d-a140-12a8568e453f", "name": "network-vif-deleted", "tag": "423f4552-1e2e-4d9f-9299-e1874bf92b80"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:34.819873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-acefaea4-942d-4cba-bcbf-47fc508e262b req-968b383d-e17d-4000-8e79-7f17a339817c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.820333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-acefaea4-942d-4cba-bcbf-47fc508e262b req-968b383d-e17d-4000-8e79-7f17a339817c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.867467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-acefaea4-942d-4cba-bcbf-47fc508e262b req-968b383d-e17d-4000-8e79-7f17a339817c service nova] Creating event network-vif-deleted:423f4552-1e2e-4d9f-9299-e1874bf92b80 for instance dcacc019-ce62-4a1d-a140-12a8568e453f on n-h1-843861-3 Jul 19 19:55:34.918545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-acefaea4-942d-4cba-bcbf-47fc508e262b req-968b383d-e17d-4000-8e79-7f17a339817c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115893 Jul 19 19:55:34.922928 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1041/2160] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:34.936080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4990f1d7-99d1-45d8-8057-a2f90ad89f8b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d44a5e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.023712 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4990f1d7-99d1-45d8-8057-a2f90ad89f8b tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.099298 Jul 19 19:55:35.024570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1042/2161] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:55:34 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:35.032214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.033258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:35.040606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.041143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.042002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.042508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.444685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.454113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2870be1-07e7-4642-a767-82c10ba09959 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.427667 Jul 19 19:55:35.465827 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1043/2162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:35.473696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72325319-786e-4422-b778-e6fc481a3681 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e8984c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.669875 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72325319-786e-4422-b778-e6fc481a3681 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-07-19T19%3A52%3A35Z" status: 200 len: 6334 microversion: 2.1 time: 0.202780 Jul 19 19:55:35.673076 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1044/2163] 10.222.0.33 () {58 vars in 1219 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-19T19%3A52%3A35Z => generated 6334 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:35.679590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.688069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: dcacc019-ce62-4a1d-a140-12a8568e453f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:35.695012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.695844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.696811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.697403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.720705 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] HTTP exception thrown: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Request method failure captured: Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f HTTP/1.1 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wn2EvQxapX-QU-e2Akni2mxz28mMkWoXNRy21t1SYOX85VfTqkbK0Pe4ZacS8w7bxFxhu0OSDJPYXh6aAw6xfeyx6G_oZ9apVdjmDIvqJKv9rmtMbRsqCXI7X3hwSV8odJbo2x9JEBPCUYuyLSTQjpQRCxcM1KyVVhzdskgdaBdtFQ Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveMigrationTest-684058780 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99eac0488e77448cb55a255d49ad2c58 Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'dcacc019-ce62-4a1d-a140-12a8568e453f'} Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.722818 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. Jul 19 19:55:35.726978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.736863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:55:35.743510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Returning 404 to user: Instance dcacc019-ce62-4a1d-a140-12a8568e453f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:35.746928 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9069db09-1c3c-4e03-9640-ae82dda6c1f1 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f" status: 404 len: 111 microversion: 2.1 time: 0.069964 Jul 19 19:55:35.747519 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1045/2164] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/servers/dcacc019-ce62-4a1d-a140-12a8568e453f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:35.759016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa550f5c-2384-4827-b92c-4db7855c5e12 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d444dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.977101 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa550f5c-2384-4827-b92c-4db7855c5e12 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-270699223" status: 200 len: 664 microversion: 2.1 time: 0.227142 Jul 19 19:55:35.977978 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1046/2165] 10.222.0.33 () {58 vars in 1249 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-270699223 => generated 664 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:35.990461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1efac2bf-2b68-4c1f-b25c-ab73bb04e064 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '.version_select at 0x7fb88e2673a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:36.052189 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1efac2bf-2b68-4c1f-b25c-ab73bb04e064 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933181618" status: 202 len: 0 microversion: 2.1 time: 0.070092 Jul 19 19:55:36.057289 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1047/2166] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 19:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933181618 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:55:36.073608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:36.077945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:36.096400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.096920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.100820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.101452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.210797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.236139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.245506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.247617 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76788815-fffe-4299-9de6-429708ef5259 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 1.188086 Jul 19 19:55:37.248452 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1048/2167] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:36 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:37.266847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa1e69e0-b42d-43eb-9023-1f0df8a68599 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e41a1f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.473063 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa1e69e0-b42d-43eb-9023-1f0df8a68599 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1467 microversion: 2.1 time: 0.222831 Jul 19 19:55:37.487442 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1049/2168] 10.222.0.33 () {58 vars in 1337 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf => generated 1467 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:37.509294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.510463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:37.521073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.521918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.522987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.523658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.256382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:38.269207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-436508cb-9843-4ba4-973e-8fbd84cbdc72 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.778738 Jul 19 19:55:38.270166 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1050/2169] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:38.277333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Updating instance_info_cache with network_info: [{"id": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6", "address": "fa:16:3e:2d:32:a4", "network": {"id": "f3bf10e4-0964-4285-a33f-4eaa440332de", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-701829013-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2096f2ea01e7491ea1cb0245a0c5dafb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap007d4e23-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:55:38.281750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facddbcd-6a00-410b-b202-18616aa36449", "tag": "5187f2ac-af93-4a99-8ab4-a7fce54661f3"}, {"name": "network-changed", "server_uuid": "ade257ce-d488-4823-8909-cf7f02bde948", "tag": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:38.294607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Releasing lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:55:38.297254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22594ebb-b145-455f-8741-b712ec72a37c tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 202 len: 0 microversion: 2.1 time: 8.263306 Jul 19 19:55:38.302017 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1120/2170] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:30 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 0 bytes in 8269 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:55:38.305967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.307492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.308199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27825809-64ea-46fd-ad46-dd00f85974c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d5b09d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:38.348198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] Creating event network-changed:5187f2ac-af93-4a99-8ab4-a7fce54661f3 for instance facddbcd-6a00-410b-b202-18616aa36449 on n-h1-843861-3 Jul 19 19:55:38.349961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] Creating event network-changed:007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 for instance ade257ce-d488-4823-8909-cf7f02bde948 on n-h2-843861-3 Jul 19 19:55:38.369741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9c2e3c5b-b87b-470b-b599-9acfa4d25def req-1cdd4eac-11ab-4b4d-abc1-92e15726ed00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097492 Jul 19 19:55:38.370612 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1051/2171] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:38.381597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:38.387209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:38.402404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.402629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.403366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.403859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.708457 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27825809-64ea-46fd-ad46-dd00f85974c0 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1467 microversion: 2.1 time: 0.403903 Jul 19 19:55:38.709327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1121/2172] 10.222.0.33 () {58 vars in 1323 bytes} [Tue Jul 19 19:55:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F3eed787c-37b2-47db-b62c-36184e2deedf => generated 1467 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:38.723085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4066aaf-a0ce-4d89-8966-7305905e6850 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '.version_select at 0x7fb88dfd51f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.255228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.259770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:39.274372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.285803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.288728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cce54d6-ae88-48cc-a104-8cac0a434c1c tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.911489 Jul 19 19:55:39.291656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1052/2173] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:38 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:39.303122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8de76723-f6e4-496b-b264-dc052cf1d9fd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88deb6b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.562547 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8de76723-f6e4-496b-b264-dc052cf1d9fd tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.259911 Jul 19 19:55:39.563593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1053/2174] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 19:55:39 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:39.577777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.578413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:39.601445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.601903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.602753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.603195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.269730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.290351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9339d6d4-8caf-446e-98f9-1f022f758364 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.721208 Jul 19 19:55:40.298657 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1054/2175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:39 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:40.326747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.329214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.355962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.356655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.358207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.359909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.423991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:40.576731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20679541-cab9-481c-8bfc-ef3fe347267c tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 204 len: 0 microversion: 2.1 time: 0.269276 Jul 19 19:55:40.581506 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1055/2176] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:40 2022] DELETE /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:40.589654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64344620-8a2f-4f5a-a85a-f829bf63d52c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e350dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.778470 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-64344620-8a2f-4f5a-a85a-f829bf63d52c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.195278 Jul 19 19:55:40.788642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1056/2177] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:40.799923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.801111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.814497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.815214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.816380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.817164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.257038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:41.465103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.478853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.480454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.484905 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3404b9a-233d-4509-83a5-c844d24d4971 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.694115 Jul 19 19:55:41.487367 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1057/2178] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:41.502410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:41.503783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:41.513981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.524664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.526072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.527346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.599093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4066aaf-a0ce-4d89-8966-7305905e6850 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/3168d622-ba10-4852-b237-b825619290a4" status: 202 len: 0 microversion: 2.1 time: 2.879920 Jul 19 19:55:41.600029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1122/2179] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 19:55:38 2022] DELETE /compute/v2.1/os-floating-ips/3168d622-ba10-4852-b237-b825619290a4 => generated 0 bytes in 2882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:55:41.606982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-382a4d42-b7c0-4fa4-9c17-014083807c7c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e1fb430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:41.695614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-382a4d42-b7c0-4fa4-9c17-014083807c7c tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046" status: 200 len: 784 microversion: 2.1 time: 0.091938 Jul 19 19:55:41.708472 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1123/2180] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:55:41 2022] GET /compute/v2.1/images/7cf63fb3-07fd-4965-a7a1-a7c160992046 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:41.721809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:41.722605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:41.753520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.756404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.757445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.758912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.244308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.255287 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b80d373c-108d-451d-b470-95d06824ee26 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1483 microversion: 2.1 time: 0.766524 Jul 19 19:55:42.255915 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1058/2181] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:41 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1483 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:42.277344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05ead328-d958-4eb1-bcad-4d68847fb624 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05ead328-d958-4eb1-bcad-4d68847fb624 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Request method failure captured: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action HTTP/1.1 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 34 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wvqI4inu1Rh4wQxQqJe4sphFuh7zVnHeMdK1Jcwdh2kgfsWQ1sJe9AqjmdTl6YPA1HQUsHyx6MrokvjIm16SCyg3wtl16bNf4aej5y44AwTAhuIugLaMnlrdJ8oWENX1S0za5zFI6og_husH8Is110aWdAzeO1QfDwp_aQha8WKdo4 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8414eba87cbd432fb280e4580a040e14 Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: {"addFloatingIp": {"address": ""}} Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ade257ce-d488-4823-8909-cf7f02bde948', 'body': {'addFloatingIp': {'address': ''}}} Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:55:42.281796 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:55:42.285690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.287476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05ead328-d958-4eb1-bcad-4d68847fb624 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:42.288388 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05ead328-d958-4eb1-bcad-4d68847fb624 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 400 len: 142 microversion: 2.1 time: 0.031176 Jul 19 19:55:42.294146 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1059/2182] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:42 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:42.300017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07119bc9-5c77-44e0-b974-250ef4fc3617 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d563ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.387475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.401647 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d414385e-470d-48c7-b539-37066af056f0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.691445 Jul 19 19:55:42.402271 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1124/2183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:41 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:42.414836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:42.423975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:42.439912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07119bc9-5c77-44e0-b974-250ef4fc3617 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.143516 Jul 19 19:55:42.448751 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1060/2184] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 19:55:42 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:42.457143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abc1016f-3a57-484a-b18a-3e2a3e3993a3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e41a550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.469496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.481602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.485406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.493253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.632828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Acquired lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:55:42.978551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Releasing lock "refresh_cache-ade257ce-d488-4823-8909-cf7f02bde948" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:55:42.979393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] HTTP exception thrown: floating IP not found Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Request method failure captured: Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action HTTP/1.1 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 41 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wvqI4inu1Rh4wQxQqJe4sphFuh7zVnHeMdK1Jcwdh2kgfsWQ1sJe9AqjmdTl6YPA1HQUsHyx6MrokvjIm16SCyg3wtl16bNf4aej5y44AwTAhuIugLaMnlrdJ8oWENX1S0za5zFI6og_husH8Is110aWdAzeO1QfDwp_aQha8WKdo4 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8414eba87cbd432fb280e4580a040e14 Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: exception: floating IP not found Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ade257ce-d488-4823-8909-cf7f02bde948', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 19 19:55:42.982142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 19 19:55:42.986652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:42.988419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Returning 404 to user: floating IP not found {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:42.989478 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ae100f9e-578f-4ce4-b26f-1524df84f8ea tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 404 len: 67 microversion: 2.1 time: 0.583359 Jul 19 19:55:42.990242 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1125/2185] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:42 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 67 bytes in 585 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:55:42.999290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.004172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.039977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.040704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.041691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.042301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.419229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.434226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.439156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.440979 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-835869ac-f753-4d71-93d5-7b6de29eae90 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.449539 Jul 19 19:55:43.441911 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1126/2186] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:42 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:43.446777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60fc7ced-af29-4da8-ac82-4d57d4724fbd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:43.498104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-60fc7ced-af29-4da8-ac82-4d57d4724fbd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60fc7ced-af29-4da8-ac82-4d57d4724fbd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Request method failure captured: Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action HTTP/1.1 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 44 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wvqI4inu1Rh4wQxQqJe4sphFuh7zVnHeMdK1Jcwdh2kgfsWQ1sJe9AqjmdTl6YPA1HQUsHyx6MrokvjIm16SCyg3wtl16bNf4aej5y44AwTAhuIugLaMnlrdJ8oWENX1S0za5zFI6og_husH8Is110aWdAzeO1QfDwp_aQha8WKdo4 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8414eba87cbd432fb280e4580a040e14 Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: exception: Floating IP not found for address 0.0.0.0. Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ade257ce-d488-4823-8909-cf7f02bde948', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 19 19:55:43.500731 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 19 19:55:43.504216 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:43.508794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60fc7ced-af29-4da8-ac82-4d57d4724fbd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:43.510010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60fc7ced-af29-4da8-ac82-4d57d4724fbd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action" status: 404 len: 88 microversion: 2.1 time: 0.067071 Jul 19 19:55:43.511262 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1127/2187] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:43 2022] POST /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948/action => generated 88 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:55:43.519035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.520085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.528369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.528987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.529959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.531197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.536277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:43.575590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.576521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.577322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lazy-loading 'fault' on Instance uuid ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:55:43.654615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.667988 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac9892a0-b1e2-4a3a-ab4d-bbcb30f30fc4 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 200 len: 1300 microversion: 2.1 time: 0.155048 Jul 19 19:55:43.668862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1128/2188] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:43 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:43.681743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abc1016f-3a57-484a-b18a-3e2a3e3993a3 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af" status: 204 len: 0 microversion: 2.1 time: 1.231355 Jul 19 19:55:43.683454 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1061/2189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:42 2022] DELETE /compute/v2.1/images/9c0e596c-e444-4ff5-9159-e30b967e25af => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:43.685005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-cc2237e3-b63d-4574-8a2c-6399b70813c5 req-a1b4660d-b5dd-494f-b7f9-14b94136c39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6", "name": "network-vif-deleted", "tag": "0df8d2f1-91f1-499a-9d24-437a0c4cf709"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:43.690455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.694128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.700701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cc2237e3-b63d-4574-8a2c-6399b70813c5 req-a1b4660d-b5dd-494f-b7f9-14b94136c39b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.701553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cc2237e3-b63d-4574-8a2c-6399b70813c5 req-a1b4660d-b5dd-494f-b7f9-14b94136c39b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.717176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.717176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.719097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.720031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.724887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-cc2237e3-b63d-4574-8a2c-6399b70813c5 req-a1b4660d-b5dd-494f-b7f9-14b94136c39b service nova] Creating event network-vif-deleted:0df8d2f1-91f1-499a-9d24-437a0c4cf709 for instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 on n-h2-843861-3 Jul 19 19:55:43.732697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-cc2237e3-b63d-4574-8a2c-6399b70813c5 req-a1b4660d-b5dd-494f-b7f9-14b94136c39b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061323 Jul 19 19:55:43.742754 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1129/2190] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:43.749859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.750813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.758058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.762043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.763169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.764311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.803043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:44.026918 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b395706-17bc-4307-978c-8aef017d5111 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 204 len: 0 microversion: 2.1 time: 0.282136 Jul 19 19:55:44.031436 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1130/2191] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:43 2022] DELETE /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:44.038112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a8c3c103-527d-4143-be88-6e63356ea1f7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d4e20d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.196755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:44.206671 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8813033-fe66-40dc-8bfd-1573619a5a2a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.521854 Jul 19 19:55:44.217445 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1062/2192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:43 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:44.222916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.224082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.234191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.234982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.236403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.237077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.551689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:44.572023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1672e14a-8406-41a6-b29f-6c4083678afd tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1541 microversion: 2.1 time: 0.352912 Jul 19 19:55:44.581972 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1063/2193] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1541 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:44.592577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.592577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.605732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.607189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.613795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.614402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.889144 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a8c3c103-527d-4143-be88-6e63356ea1f7 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f" status: 204 len: 0 microversion: 2.1 time: 0.856156 Jul 19 19:55:44.893532 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1131/2194] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:44 2022] DELETE /compute/v2.1/images/db026f6e-c100-4cee-9c78-a1e4aba3f53f => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:44.896999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.898049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.912589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.913974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.915048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.915703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.934054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] HTTP exception thrown: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Request method failure captured: Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 HTTP/1.1 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wn2EvQxapX-QU-e2Akni2mxz28mMkWoXNRy21t1SYOX85VfTqkbK0Pe4ZacS8w7bxFxhu0OSDJPYXh6aAw6xfeyx6G_oZ9apVdjmDIvqJKv9rmtMbRsqCXI7X3hwSV8odJbo2x9JEBPCUYuyLSTQjpQRCxcM1KyVVhzdskgdaBdtFQ Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-LiveMigrationTest-684058780 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99eac0488e77448cb55a255d49ad2c58 Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6'} Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:44.936912 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. Jul 19 19:55:44.940415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:44.942136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Returning 404 to user: Instance ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:44.943960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-825dca83-a545-4970-985c-ebf4efc45e92 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6" status: 404 len: 111 microversion: 2.1 time: 0.052762 Jul 19 19:55:44.947944 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1132/2195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/ad81aea4-f1bd-4ae7-a6d1-e84d87a617f6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:44.958133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b0479ef4-bd03-44a1-8cc5-6c22434ce2b3 req-f91d6dbc-1093-4f24-99bc-66d8b6c0f72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-plugged", "status": "completed", "tag": "a3bc80fa-7a1b-4118-b4e8-e74048ee5c93"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:44.979637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b0479ef4-bd03-44a1-8cc5-6c22434ce2b3 req-f91d6dbc-1093-4f24-99bc-66d8b6c0f72e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.980131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b0479ef4-bd03-44a1-8cc5-6c22434ce2b3 req-f91d6dbc-1093-4f24-99bc-66d8b6c0f72e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.005751 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b0479ef4-bd03-44a1-8cc5-6c22434ce2b3 req-f91d6dbc-1093-4f24-99bc-66d8b6c0f72e service nova] Creating event network-vif-plugged:a3bc80fa-7a1b-4118-b4e8-e74048ee5c93 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:45.016394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.027622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.029741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.031702 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb2ab876-4629-406d-bb1f-06871d699c26 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 0.452788 Jul 19 19:55:45.032535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1064/2196] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:45.043506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b0479ef4-bd03-44a1-8cc5-6c22434ce2b3 req-f91d6dbc-1093-4f24-99bc-66d8b6c0f72e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091811 Jul 19 19:55:45.050808 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1133/2197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:45.059213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14c577fd-3fad-4675-b656-de90b3ef5976 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88de79790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:45.076063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:45.076670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:45.112460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.113960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.115495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.118386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.221390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:45.491143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bd63d478-48c0-48c9-a940-bb79c4166ce8 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 204 len: 0 microversion: 2.1 time: 0.437275 Jul 19 19:55:45.493991 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1134/2198] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:45 2022] DELETE /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:45.505849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:45.507792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:45.518201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.521990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.523344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.525028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.321667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:46.331030 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-770405a4-0aeb-4f33-9d10-f9b7d77ce63d tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.834269 Jul 19 19:55:46.350114 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1135/2199] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:45 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:46.358280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:46.359264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:46.383626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.384456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.385489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.386137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.430806 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14c577fd-3fad-4675-b656-de90b3ef5976 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642" status: 204 len: 0 microversion: 2.1 time: 1.396995 Jul 19 19:55:46.432106 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1065/2200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:45 2022] DELETE /compute/v2.1/images/7a867d83-39a6-480d-9de9-a28801079642 => generated 0 bytes in 1399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:46.441028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:46.441910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:46.452475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.453225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.454284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.454948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.193448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.201850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98d22307-9da2-41d7-bb7d-c1688635edfb tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1499 microversion: 2.1 time: 0.847946 Jul 19 19:55:47.215514 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1136/2201] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:46 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1499 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:47.221454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.237874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.238854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8414eba87cbd432fb280e4580a040e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2096f2ea01e7491ea1cb0245a0c5dafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.251939 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dade3b05-dfb3-40ea-9cee-18aa6fbbcb3b tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 200 len: 1541 microversion: 2.1 time: 0.818387 Jul 19 19:55:47.256363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.257249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.258229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.259090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.262493 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1066/2202] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:46 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 1541 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:47.271123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.272078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.280950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.281869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.283211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.284286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.319098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:47.575520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7269df89-5d97-4d2a-a29f-f4e210b8dff8 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 204 len: 0 microversion: 2.1 time: 0.310137 Jul 19 19:55:47.578890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1067/2203] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:47 2022] DELETE /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:47.585241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facddbcd-6a00-410b-b202-18616aa36449", "name": "network-vif-plugged", "status": "completed", "tag": "5187f2ac-af93-4a99-8ab4-a7fce54661f3"}, {"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-plugged", "status": "completed", "tag": "a05aab05-ece2-4044-93d1-f9caa419e513"}, {"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-plugged", "status": "completed", "tag": "ebd78267-6306-46b7-b4be-b4429fe70de8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:47.598686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.599322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.617927 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Creating event network-vif-plugged:5187f2ac-af93-4a99-8ab4-a7fce54661f3 for instance facddbcd-6a00-410b-b202-18616aa36449 on n-h1-843861-3 Jul 19 19:55:47.619207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Creating event network-vif-plugged:a05aab05-ece2-4044-93d1-f9caa419e513 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:47.620175 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] Creating event network-vif-plugged:ebd78267-6306-46b7-b4be-b4429fe70de8 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:55:47.632076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5693d5a3-e545-456a-8529-95e0a1bafb77 req-6c9ee10a-df5d-4a46-a10e-6b6cecb610e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051179 Jul 19 19:55:47.637976 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1068/2204] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:47.646324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.647226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.655912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.656800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.657794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.658427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.242579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.273570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.289044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.291043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-46906f58-c8fe-497d-85b8-708b0d05cddd tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 1.073765 Jul 19 19:55:48.304679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1137/2205] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:47 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:48.320924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:48.322040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:48.355774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.356263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.357064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.357501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.863891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.885719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfa748c4-0b5d-49b4-80e5-c48df8d6fe06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 1.245032 Jul 19 19:55:48.890457 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1069/2206] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:47 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:48.903653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ccce687f-060b-4ec0-8ffb-a6c7165b1a56 req-88a623fd-2a3a-4e8a-8c1e-bd2062a6f4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade257ce-d488-4823-8909-cf7f02bde948", "name": "network-vif-deleted", "tag": "007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:48.914270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:48.929922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ccce687f-060b-4ec0-8ffb-a6c7165b1a56 req-88a623fd-2a3a-4e8a-8c1e-bd2062a6f4d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.938574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ccce687f-060b-4ec0-8ffb-a6c7165b1a56 req-88a623fd-2a3a-4e8a-8c1e-bd2062a6f4d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.971329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.971977 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ccce687f-060b-4ec0-8ffb-a6c7165b1a56 req-88a623fd-2a3a-4e8a-8c1e-bd2062a6f4d1 service nova] Creating event network-vif-deleted:007d4e23-b137-4d7d-ba3f-ceb12ecd2bb6 for instance ade257ce-d488-4823-8909-cf7f02bde948 on n-h2-843861-3 Jul 19 19:55:48.993068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ccce687f-060b-4ec0-8ffb-a6c7165b1a56 req-88a623fd-2a3a-4e8a-8c1e-bd2062a6f4d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095412 Jul 19 19:55:48.994550 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1070/2207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:48.996787 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fcd8598-537c-4ae6-b671-5c081294453a tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1474 microversion: 2.1 time: 0.689676 Jul 19 19:55:48.999595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1138/2208] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:48 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1474 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:49.009053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:49.010714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:49.011915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] [instance: ade257ce-d488-4823-8909-cf7f02bde948] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:49.013105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:49.032271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.033185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.036865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.037974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.038420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.040433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.042135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.043325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.107220 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] HTTP exception thrown: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Request method failure captured: Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 HTTP/1.1 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wvqI4inu1Rh4wQxQqJe4sphFuh7zVnHeMdK1Jcwdh2kgfsWQ1sJe9AqjmdTl6YPA1HQUsHyx6MrokvjIm16SCyg3wtl16bNf4aej5y44AwTAhuIugLaMnlrdJ8oWENX1S0za5zFI6og_husH8Is110aWdAzeO1QfDwp_aQha8WKdo4 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2096f2ea01e7491ea1cb0245a0c5dafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2096f2ea01e7491ea1cb0245a0c5dafb Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8414eba87cbd432fb280e4580a040e14 Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ade257ce-d488-4823-8909-cf7f02bde948'} Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. Jul 19 19:55:49.112693 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. Jul 19 19:55:49.116213 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:49.116723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] Returning 404 to user: Instance ade257ce-d488-4823-8909-cf7f02bde948 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:49.122543 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aad9fd85-b517-4754-98d9-00111832f315 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328 tempest-FloatingIPsAssociationNegativeTestJSON-2065744328-project] 10.222.0.33 "GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948" status: 404 len: 111 microversion: 2.1 time: 0.121542 Jul 19 19:55:49.123264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1139/2209] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:48 2022] GET /compute/v2.1/servers/ade257ce-d488-4823-8909-cf7f02bde948 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:49.326094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:49.327430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:49.372825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.373287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.376670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.377201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.601564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99eac0488e77448cb55a255d49ad2c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9dcbfa07ab477cafd92d9e6268c565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.613504 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00d474e5-eac2-454d-ae8d-d891437cd736 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 200 len: 1457 microversion: 2.1 time: 0.614385 Jul 19 19:55:49.614115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1071/2210] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:48 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 1457 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:50.318773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fc23054f-b442-47ae-b501-d382ac40b1df req-f2d35f29-8ed9-45e9-9171-8b975f4eb8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec386b1d-f373-4656-80b0-47a57ca6a118", "name": "network-vif-deleted", "tag": "c2cdf469-8189-434f-aba3-36b474473eb7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:50.344102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fc23054f-b442-47ae-b501-d382ac40b1df req-f2d35f29-8ed9-45e9-9171-8b975f4eb8ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.352721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fc23054f-b442-47ae-b501-d382ac40b1df req-f2d35f29-8ed9-45e9-9171-8b975f4eb8ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.380688 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fc23054f-b442-47ae-b501-d382ac40b1df req-f2d35f29-8ed9-45e9-9171-8b975f4eb8ed service nova] Creating event network-vif-deleted:c2cdf469-8189-434f-aba3-36b474473eb7 for instance ec386b1d-f373-4656-80b0-47a57ca6a118 on n-h1-843861-3 Jul 19 19:55:50.389648 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fc23054f-b442-47ae-b501-d382ac40b1df req-f2d35f29-8ed9-45e9-9171-8b975f4eb8ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.772785 Jul 19 19:55:50.390894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1072/2211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:50.406954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:50.406954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:50.421609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.422352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.423314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.423981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.998219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.013072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.023486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.025172 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e6f53b8-0d79-4814-ba0d-4a8b46aae0c7 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1359 microversion: 2.21 time: 1.704935 Jul 19 19:55:51.026016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1140/2212] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:49 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1359 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:51.031014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:51.031626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:51.044385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.044835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.045654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.053892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.102811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.124266 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4cea7d27-b021-4f62-99e1-aa3402907c42 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1354 microversion: 2.1 time: 0.731564 Jul 19 19:55:51.124873 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1073/2213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:50 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1354 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:51.138065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:51.139524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] [instance: ec386b1d-f373-4656-80b0-47a57ca6a118] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:51.152601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.153294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.154572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.155255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.167269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:51.210925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] HTTP exception thrown: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. Jul 19 19:55:51.238878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Request method failure captured: Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 HTTP/1.1 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wn2EvQxapX-QU-e2Akni2mxz28mMkWoXNRy21t1SYOX85VfTqkbK0Pe4ZacS8w7bxFxhu0OSDJPYXh6aAw6xfeyx6G_oZ9apVdjmDIvqJKv9rmtMbRsqCXI7X3hwSV8odJbo2x9JEBPCUYuyLSTQjpQRCxcM1KyVVhzdskgdaBdtFQ Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed9dcbfa07ab477cafd92d9e6268c565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveMigrationTest-684058780 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ed9dcbfa07ab477cafd92d9e6268c565 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveMigrationTest-684058780 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99eac0488e77448cb55a255d49ad2c58 Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveMigrationTest-684058780-project Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ec386b1d-f373-4656-80b0-47a57ca6a118'} Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:51.253041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. Jul 19 19:55:51.257389 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:55:51.259264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] Returning 404 to user: Instance ec386b1d-f373-4656-80b0-47a57ca6a118 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:51.261216 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4869140a-b330-4164-a50c-54b4dcac8e41 tempest-LiveMigrationTest-684058780 tempest-LiveMigrationTest-684058780-project] 10.222.0.33 "GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118" status: 404 len: 111 microversion: 2.1 time: 0.132215 Jul 19 19:55:51.262848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1074/2214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:51 2022] GET /compute/v2.1/servers/ec386b1d-f373-4656-80b0-47a57ca6a118 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:51.265999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1f4e8cc3-b05d-4e57-a656-c6d6a070e66f tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 200 len: 1432 microversion: 2.1 time: 0.238833 Jul 19 19:55:51.279563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1141/2215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:51 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 1432 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:52.055293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.056951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.083678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.101261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.104110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.105186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.142987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.143868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.156107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.156107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.156885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.164300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.796420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.805796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.813902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.815493 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea6ccccd-abf5-44ec-8f1b-23e5d9584931 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1552 microversion: 2.21 time: 0.775505 Jul 19 19:55:52.820603 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1075/2216] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1552 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:52.844514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.853060 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a66a3eb0-f107-4d93-a198-f55fd981b9bf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1805 microversion: 2.1 time: 0.715314 Jul 19 19:55:52.853682 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1142/2217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1805 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:52.869549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.870181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: 3eed787c-37b2-47db-b62c-36184e2deedf] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.897636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.898442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.915058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.916187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.977269 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] HTTP exception thrown: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Request method failure captured: Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf HTTP/1.1 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wuCTRf19vp-DZKpmCvXNGOxJcp2URFU0Up5tM8-Gt722_qSxT_-gHATISqW_lIwofIzjth3bCqHk7BJ9sxFBp5qNpFl99Fh9H2UgfQ7zr8WWvRqDIdUk2LcsonqZBtmRFezyz9GsA3DoLvUSWVQej6tunOdrtGhHZn6bGrUpy9XN3g Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a89e0608370448d6bd14438297c2d1f5 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a89e0608370448d6bd14438297c2d1f5 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ListImageFiltersTestJSON-1945470865-project Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8225eaa1e93e42b7b265fb2618b7055f Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ListImageFiltersTestJSON-1945470865-project Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3eed787c-37b2-47db-b62c-36184e2deedf'} Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:52.979273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. Jul 19 19:55:52.983067 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:55:52.984306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Returning 404 to user: Instance 3eed787c-37b2-47db-b62c-36184e2deedf could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:52.985355 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8123531-de3d-4aaa-87b6-c6879f6cdc53 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf" status: 404 len: 111 microversion: 2.1 time: 0.130747 Jul 19 19:55:52.986517 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1143/2218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/3eed787c-37b2-47db-b62c-36184e2deedf => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:53.003601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-bd9d5e88-6c56-493a-9ab8-3d2df69432ef req-0e9b694d-3065-4ad1-8093-376d0f5057d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed787c-37b2-47db-b62c-36184e2deedf", "name": "network-vif-deleted", "tag": "121c7c63-feab-412b-8930-3d950e9e63f4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:53.029067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bd9d5e88-6c56-493a-9ab8-3d2df69432ef req-0e9b694d-3065-4ad1-8093-376d0f5057d9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.030196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bd9d5e88-6c56-493a-9ab8-3d2df69432ef req-0e9b694d-3065-4ad1-8093-376d0f5057d9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.051088 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-bd9d5e88-6c56-493a-9ab8-3d2df69432ef req-0e9b694d-3065-4ad1-8093-376d0f5057d9 service nova] Creating event network-vif-deleted:121c7c63-feab-412b-8930-3d950e9e63f4 for instance 3eed787c-37b2-47db-b62c-36184e2deedf on n-h1-843861-3 Jul 19 19:55:53.057093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-bd9d5e88-6c56-493a-9ab8-3d2df69432ef req-0e9b694d-3065-4ad1-8093-376d0f5057d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069176 Jul 19 19:55:53.058227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1144/2219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:53.064918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.065694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.073527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.074159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.075130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.075717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.108700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:53.126033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:53.180499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-668700445", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:53.283090 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4f83ab9-b4ad-4e85-95a5-338e421c1c63 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "DELETE /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 204 len: 0 microversion: 2.21 time: 0.222887 Jul 19 19:55:53.287362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1145/2220] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:55:53 2022] DELETE /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:55:53.303553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.304399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.316096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.321454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:53.328318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.329565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.330357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.358952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2eeb078f-44db-4499-adca-1e3df77e01e6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483/ips" status: 200 len: 219 microversion: 2.1 time: 0.060586 Jul 19 19:55:53.360292 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1146/2221] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:55:53 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483/ips => generated 219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:53.365279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.366178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.375241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.376235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.377321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.378139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.427752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:53.589527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b1bd279-14ee-43d0-8d71-9f4e84555fe9 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 204 len: 0 microversion: 2.1 time: 0.227506 Jul 19 19:55:53.594888 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1147/2222] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:53 2022] DELETE /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:53.603713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.605555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.612745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.613553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.616883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.617726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.362602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.372857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.374967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.376418 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9abdb44-3f54-4e6f-8262-17e97bfc8a75 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1558 microversion: 2.21 time: 0.778560 Jul 19 19:55:54.381624 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1148/2223] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:53 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1558 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:54.390563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:54.391058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:54.412920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.413376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.414283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.414584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.479696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:54.481060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:54.481990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:54.483706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:54.484820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:54.485461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:54.508610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.512106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.513604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.515235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.551262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:54.558703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:54.581232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:54.585206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:54.669549 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c11ae49-66ad-41d1-9a03-1b6b13b2c8a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846327 Jul 19 19:55:54.669549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1076/2224] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:55:54.676680 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89ce75d1-2293-4dd2-bbca-40f402934d4a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 204 len: 0 microversion: 2.1 time: 0.294487 Jul 19 19:55:54.682609 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1149/2225] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:54 2022] DELETE /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:54.706595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:54.709213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:54.733498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.733952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.734988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.735439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.828060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-237590910", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d2f7db3-2088-4e72-a0d5-c0a7021e2c8b"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:54.932242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] validate_networks() for [('5d2f7db3-2088-4e72-a0d5-c0a7021e2c8b', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:55.664129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:55.673300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c0025e22-8d6d-42f6-bd7f-40a139edd489 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1474 microversion: 2.1 time: 0.989936 Jul 19 19:55:55.675604 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1150/2226] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:54 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1474 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:55.705929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26252c08-f6cb-4914-9caa-5bff8d298a6c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:55.707687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26252c08-f6cb-4914-9caa-5bff8d298a6c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:56.014051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26252c08-f6cb-4914-9caa-5bff8d298a6c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:56.040937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26252c08-f6cb-4914-9caa-5bff8d298a6c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1212 microversion: 2.1 time: 0.360245 Jul 19 19:55:56.056625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1151/2227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:55 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1212 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:56.069615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:56.072557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:56.080668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.081474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.082445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.083118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.825669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:56.836940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b3bd927-52dd-4850-9b26-f37d4e12f277 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1811 microversion: 2.1 time: 0.778263 Jul 19 19:55:56.838231 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1152/2228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:56 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1811 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:56.844976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:56.847269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:56.877890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.878354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.879157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.879607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.900137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:56.900768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:56.900933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:56.901519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:56.902090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:56.927611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.930101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.931188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.933390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:57.028623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Getting quotas for project 30387df2e69449cdb726c6e9392bacfb. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:57.039741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Getting quotas for user 48684c5137c84514b2f2d08f520f9356 and project 30387df2e69449cdb726c6e9392bacfb. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:57.088267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:57.096363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:57.183878 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9248959b-4d4f-49f3-9f85-3eb1e20ef5f8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.513133 Jul 19 19:55:57.185232 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1077/2229] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:55:57.192625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:57.193489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:57.203678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:57.204456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:57.206229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:57.206976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.659222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.662651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.667780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.669328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.671390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a01237d-37ce-4ae6-a091-15ee7dc515b3 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1558 microversion: 2.21 time: 1.831269 Jul 19 19:55:58.672003 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1153/2230] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:56 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1558 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:58.686594 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb31329b-aaa4-44f7-9cdf-1e076a102e74 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1474 microversion: 2.1 time: 1.498790 Jul 19 19:55:58.687211 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1078/2231] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:57 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1474 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:58.696750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:58.696750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:58.708654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.709104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.709894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.710354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.710944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:58.711641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:58.721750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.722222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.723165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.723829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.476279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.487599 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d723b3ef-0981-462e-8d67-73aea9745aa5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1270 microversion: 2.1 time: 0.802909 Jul 19 19:55:59.488445 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1154/2232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:58 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1270 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:59.493678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:59.494550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:59.501984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.502464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.503462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.503928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.583495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.594052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.603800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.605356 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-801ab945-1595-4184-ba93-007ca67ec0b1 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1313 microversion: 2.26 time: 0.904388 Jul 19 19:55:59.620688 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1079/2233] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:58 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:59.691650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:59.692386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:59.703729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.706613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.707661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.708163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.929389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.948595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.950302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a09d4a63c54394b4da3f41e259e816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236615ee22d84821b187cb758efb0324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.951530 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c7374f50-9518-46e6-a8d5-6c15ad07fada tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 200 len: 1344 microversion: 2.21 time: 0.266185 Jul 19 19:55:59.952151 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1080/2234] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:59 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 1344 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:59.973368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-28fe618e-6bdf-42d5-8c92-71fb7fb8bb69 req-d16a800d-97be-46bd-82bb-7ebb0e11123c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facddbcd-6a00-410b-b202-18616aa36449", "name": "network-vif-deleted", "tag": "5187f2ac-af93-4a99-8ab4-a7fce54661f3"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:59.989248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-28fe618e-6bdf-42d5-8c92-71fb7fb8bb69 req-d16a800d-97be-46bd-82bb-7ebb0e11123c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.989698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-28fe618e-6bdf-42d5-8c92-71fb7fb8bb69 req-d16a800d-97be-46bd-82bb-7ebb0e11123c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.018630 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-28fe618e-6bdf-42d5-8c92-71fb7fb8bb69 req-d16a800d-97be-46bd-82bb-7ebb0e11123c service nova] Creating event network-vif-deleted:5187f2ac-af93-4a99-8ab4-a7fce54661f3 for instance facddbcd-6a00-410b-b202-18616aa36449 on n-h1-843861-3 Jul 19 19:56:00.030639 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-28fe618e-6bdf-42d5-8c92-71fb7fb8bb69 req-d16a800d-97be-46bd-82bb-7ebb0e11123c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065759 Jul 19 19:56:00.031542 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1081/2235] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:00.037640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:00.038348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:00.045830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.046543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.048292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.048942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.012335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.031038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19d05eee-04a2-4f70-a291-e1354c41adb3 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1811 microversion: 2.1 time: 1.540748 Jul 19 19:56:01.032346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1155/2236] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:59 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1811 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:01.046812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:01.048484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:01.066063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.068305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.074238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.075859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.694145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.712556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8225eaa1e93e42b7b265fb2618b7055f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e0608370448d6bd14438297c2d1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.729805 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f655c77-246c-4267-bb32-28bd85e49853 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 200 len: 1474 microversion: 2.1 time: 1.696874 Jul 19 19:56:01.730903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1082/2237] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:00 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 1474 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:01.735279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02e67e3e-3d00-4b5f-b1a1-29a051061c72 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1270 microversion: 2.1 time: 0.698053 Jul 19 19:56:01.738436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:01.741824 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1156/2238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:01 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1270 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:01.743019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:01.806498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.808109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.811829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.815506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.151748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-faabb269-1134-44b2-8dee-4f4e6759d212 req-702a2272-1216-44f5-bade-503d155baa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-unplugged", "status": "completed", "tag": "ebd78267-6306-46b7-b4be-b4429fe70de8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:02.170669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-faabb269-1134-44b2-8dee-4f4e6759d212 req-702a2272-1216-44f5-bade-503d155baa06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.175826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-faabb269-1134-44b2-8dee-4f4e6759d212 req-702a2272-1216-44f5-bade-503d155baa06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.223576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-faabb269-1134-44b2-8dee-4f4e6759d212 req-702a2272-1216-44f5-bade-503d155baa06 service nova] Creating event network-vif-unplugged:ebd78267-6306-46b7-b4be-b4429fe70de8 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:56:02.237663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-faabb269-1134-44b2-8dee-4f4e6759d212 req-702a2272-1216-44f5-bade-503d155baa06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.493056 Jul 19 19:56:02.238880 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1157/2239] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:02.247297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.248793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.252232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:02.258055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.259119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.260435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.261051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.286617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] HTTP exception thrown: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Request method failure captured: Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 HTTP/1.1 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wwjWYKVYu48SmC2m66JOVKkiKD6RV_rM9GB62BinWoYrHLUblblj7olri4DpRlWpKV-jA18KPME-uczGXXb1nQs_s1xAI1Krt_0jWzP_YeyQk7YpTVmbsvx1Se0Qms-WxWDhAlrmwqHLzFwWAg8DTx-H2AsAI4Q1na29F7T-HspVqE Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/236615ee22d84821b187cb758efb0324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_236615ee22d84821b187cb758efb0324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 27a09d4a63c54394b4da3f41e259e816 Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'facddbcd-6a00-410b-b202-18616aa36449'} Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.291652 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:02.295986 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.297969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Returning 404 to user: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:02.300398 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-404bac7a-523b-4692-b70c-13f48ed35cd4 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 404 len: 111 microversion: 2.21 time: 0.058814 Jul 19 19:56:02.302281 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1158/2240] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:02.311892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.313380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.322818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.324208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.325278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.327438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.776909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.803017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.806408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.816604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1df5a39d-92b3-4bb7-9186-9dba94e8eabc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 1.083049 Jul 19 19:56:02.836161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1083/2241] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:01 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:02.844187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-deleted", "tag": "a05aab05-ece2-4044-93d1-f9caa419e513"}, {"server_uuid": "d3550114-0bfb-4bfd-a62a-a6c9af79644a", "name": "network-vif-deleted", "tag": "59a17f63-4b60-439f-ae0c-f6061a19383a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:02.869746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.872925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.877571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.882297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8d6267f2-c25a-41c5-9e40-f9444b485d0e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1790 microversion: 2.1 time: 0.578348 Jul 19 19:56:02.882900 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1159/2242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1790 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:02.888083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '.version_select at 0x7fb88e1fbe50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.897413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.903373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] Creating event network-vif-deleted:a05aab05-ece2-4044-93d1-f9caa419e513 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:56:02.904843 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] Creating event network-vif-deleted:59a17f63-4b60-439f-ae0c-f6061a19383a for instance d3550114-0bfb-4bfd-a62a-a6c9af79644a on n-h2-843861-3 Jul 19 19:56:02.911593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.912076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.912945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.913578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.915564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8063c5f9-6c65-41a0-8f6f-b56c70a16a83 req-ecc56680-705c-422b-a9f8-d0983a3d7f37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076730 Jul 19 19:56:02.917809 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1084/2243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:02.925005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.925960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] [instance: d3550114-0bfb-4bfd-a62a-a6c9af79644a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.935109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.937462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.951883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.952696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.988651 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] HTTP exception thrown: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Request method failure captured: Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a HTTP/1.1 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wuCTRf19vp-DZKpmCvXNGOxJcp2URFU0Up5tM8-Gt722_qSxT_-gHATISqW_lIwofIzjth3bCqHk7BJ9sxFBp5qNpFl99Fh9H2UgfQ7zr8WWvRqDIdUk2LcsonqZBtmRFezyz9GsA3DoLvUSWVQej6tunOdrtGhHZn6bGrUpy9XN3g Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a89e0608370448d6bd14438297c2d1f5 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a89e0608370448d6bd14438297c2d1f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a89e0608370448d6bd14438297c2d1f5 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1945470865 Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListImageFiltersTestJSON-1945470865-project Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8225eaa1e93e42b7b265fb2618b7055f Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListImageFiltersTestJSON-1945470865-project Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd3550114-0bfb-4bfd-a62a-a6c9af79644a'} Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:02.992248 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. Jul 19 19:56:02.996523 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.015603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Returning 404 to user: Instance d3550114-0bfb-4bfd-a62a-a6c9af79644a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:03.021153 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae1f30c3-dc19-4bcc-a623-087af3719f7e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a" status: 404 len: 111 microversion: 2.1 time: 0.101454 Jul 19 19:56:03.022055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1085/2244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/d3550114-0bfb-4bfd-a62a-a6c9af79644a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:03.041126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.042676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.061448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:03.064017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.068134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.071920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.072605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.102963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd3448de-0848-4171-954d-8021aaae0045 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.218784 Jul 19 19:56:03.103564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1160/2245] 10.222.0.33 () {60 vars in 1336 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449/os-instance-actions => generated 611 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:56:03.124698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc37ee64-b0ec-41e3-9795-e513d80d296e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88d566820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.194247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.206431 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b82f73bc-650a-4736-a905-99c2386a2bf6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1270 microversion: 2.1 time: 0.182735 Jul 19 19:56:03.207598 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1086/2246] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:03.220740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.221488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.234011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.236386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.237406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.238005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.281359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] HTTP exception thrown: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Request method failure captured: Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 HTTP/1.1 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wwjWYKVYu48SmC2m66JOVKkiKD6RV_rM9GB62BinWoYrHLUblblj7olri4DpRlWpKV-jA18KPME-uczGXXb1nQs_s1xAI1Krt_0jWzP_YeyQk7YpTVmbsvx1Se0Qms-WxWDhAlrmwqHLzFwWAg8DTx-H2AsAI4Q1na29F7T-HspVqE Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/236615ee22d84821b187cb758efb0324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_236615ee22d84821b187cb758efb0324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 27a09d4a63c54394b4da3f41e259e816 Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'facddbcd-6a00-410b-b202-18616aa36449'} Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:03.283960 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.287623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.290094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Returning 404 to user: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:03.291404 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0304cfa-fed4-431c-aa05-c7ce678724e5 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "DELETE /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 404 len: 111 microversion: 2.21 time: 0.082665 Jul 19 19:56:03.296225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1087/2247] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:03 2022] DELETE /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:03.305507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.306505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] [instance: facddbcd-6a00-410b-b202-18616aa36449] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.321963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.327476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.329586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.330596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.370296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] HTTP exception thrown: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Request method failure captured: Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 HTTP/1.1 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wwjWYKVYu48SmC2m66JOVKkiKD6RV_rM9GB62BinWoYrHLUblblj7olri4DpRlWpKV-jA18KPME-uczGXXb1nQs_s1xAI1Krt_0jWzP_YeyQk7YpTVmbsvx1Se0Qms-WxWDhAlrmwqHLzFwWAg8DTx-H2AsAI4Q1na29F7T-HspVqE Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/236615ee22d84821b187cb758efb0324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/236615ee22d84821b187cb758efb0324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_236615ee22d84821b187cb758efb0324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 236615ee22d84821b187cb758efb0324 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931628772 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 27a09d4a63c54394b4da3f41e259e816 Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931628772-project Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'facddbcd-6a00-410b-b202-18616aa36449'} Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.372527 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. Jul 19 19:56:03.376244 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:03.376705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] Returning 404 to user: Instance facddbcd-6a00-410b-b202-18616aa36449 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:03.377543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48ea7c28-e4d9-4863-acff-98e912770b72 tempest-InstanceActionsV221TestJSON-1931628772 tempest-InstanceActionsV221TestJSON-1931628772-project] 10.222.0.33 "GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449" status: 404 len: 111 microversion: 2.21 time: 0.076877 Jul 19 19:56:03.382859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1088/2248] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/facddbcd-6a00-410b-b202-18616aa36449 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:56:03.826231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e695f2f4-edc9-417a-8ccc-c2b7a4765ba3 req-6d621473-03e5-44ab-93f6-763089d37c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9346d85d-3aec-4429-902c-7b41797031e9", "tag": "ddf5c154-cd3f-4b9d-a929-a0dfd509c458"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:03.851146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e695f2f4-edc9-417a-8ccc-c2b7a4765ba3 req-6d621473-03e5-44ab-93f6-763089d37c80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.851420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e695f2f4-edc9-417a-8ccc-c2b7a4765ba3 req-6d621473-03e5-44ab-93f6-763089d37c80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.896897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e695f2f4-edc9-417a-8ccc-c2b7a4765ba3 req-6d621473-03e5-44ab-93f6-763089d37c80 service nova] Creating event network-changed:ddf5c154-cd3f-4b9d-a929-a0dfd509c458 for instance 9346d85d-3aec-4429-902c-7b41797031e9 on n-h2-843861-3 Jul 19 19:56:03.939638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e695f2f4-edc9-417a-8ccc-c2b7a4765ba3 req-6d621473-03e5-44ab-93f6-763089d37c80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106958 Jul 19 19:56:03.939638 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1089/2249] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:03.955611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.956361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.980283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.980757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.981576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.982049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.132622 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc37ee64-b0ec-41e3-9795-e513d80d296e tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7" status: 204 len: 0 microversion: 2.1 time: 1.022985 Jul 19 19:56:04.133741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1161/2250] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:03 2022] DELETE /compute/v2.1/images/f9873b56-a220-40f4-8e50-559c07607ea7 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:04.140901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.141749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:04.170965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.175177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.182347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.183068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.679273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:04.691493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:04.697933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:04.699369 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e56673d0-5d3b-40dc-ba90-0def978af250 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.760565 Jul 19 19:56:04.700633 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1090/2251] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:04.716902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8daebad7-a57e-4855-b02e-7371839f7f91 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e2ca3a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.842257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:04.854589 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c11ee7aa-069c-40ad-bd23-44f85c74fed2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1610 microversion: 2.1 time: 0.719337 Jul 19 19:56:04.858824 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1162/2252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:04 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1610 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:04.868816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.869789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:04.883428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.887569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.889329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.895434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.231349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8daebad7-a57e-4855-b02e-7371839f7f91 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a" status: 204 len: 0 microversion: 2.1 time: 0.525936 Jul 19 19:56:05.233293 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1091/2253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:04 2022] DELETE /compute/v2.1/images/55e560f6-e78c-4b88-b490-28b7d14c8c8a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:05.240258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-422b8405-19af-407c-88c6-720a70c243b8 req-a1ec76c5-93c3-4b75-b85a-5f1ec0b1eb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-unplugged", "status": "completed", "tag": "a3bc80fa-7a1b-4118-b4e8-e74048ee5c93"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:05.260034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-422b8405-19af-407c-88c6-720a70c243b8 req-a1ec76c5-93c3-4b75-b85a-5f1ec0b1eb65 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.260487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-422b8405-19af-407c-88c6-720a70c243b8 req-a1ec76c5-93c3-4b75-b85a-5f1ec0b1eb65 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.307638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-422b8405-19af-407c-88c6-720a70c243b8 req-a1ec76c5-93c3-4b75-b85a-5f1ec0b1eb65 service nova] Creating event network-vif-unplugged:a3bc80fa-7a1b-4118-b4e8-e74048ee5c93 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:56:05.321994 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-422b8405-19af-407c-88c6-720a70c243b8 req-a1ec76c5-93c3-4b75-b85a-5f1ec0b1eb65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088165 Jul 19 19:56:05.328524 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1092/2254] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:05.342007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-791f867c-5dd7-4b3f-9919-3ea025730dae req-4206c807-ade8-456b-a1c1-66dd356f2e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-deleted", "tag": "ebd78267-6306-46b7-b4be-b4429fe70de8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:05.383423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-791f867c-5dd7-4b3f-9919-3ea025730dae req-4206c807-ade8-456b-a1c1-66dd356f2e37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.384294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-791f867c-5dd7-4b3f-9919-3ea025730dae req-4206c807-ade8-456b-a1c1-66dd356f2e37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.417780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-791f867c-5dd7-4b3f-9919-3ea025730dae req-4206c807-ade8-456b-a1c1-66dd356f2e37 service nova] Creating event network-vif-deleted:ebd78267-6306-46b7-b4be-b4429fe70de8 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:56:05.423313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-791f867c-5dd7-4b3f-9919-3ea025730dae req-4206c807-ade8-456b-a1c1-66dd356f2e37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093266 Jul 19 19:56:05.424489 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1093/2255] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:05.430082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51192e8e-435b-4e55-8237-be52286ec794 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] Calling method '.version_select at 0x7fb88e2ca700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:05.841906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.867404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ecfb620-c88e-4ac5-aab7-c91241d6923e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 1.007083 Jul 19 19:56:05.870314 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1163/2256] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:04 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:05.878738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:05.886348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:05.902967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.904884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.905999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.907339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.954740 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51192e8e-435b-4e55-8237-be52286ec794 tempest-ListImageFiltersTestJSON-1945470865 tempest-ListImageFiltersTestJSON-1945470865-project] 10.222.0.33 "DELETE /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae" status: 204 len: 0 microversion: 2.1 time: 0.528216 Jul 19 19:56:05.955771 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1094/2257] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:05 2022] DELETE /compute/v2.1/images/cf76fd8d-a9f8-405f-8232-5d9dac331dae => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:05.996785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:06.000781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:06.043550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:06.087133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.087985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.094919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.098055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.269646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.270314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.270552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lazy-loading 'fault' on Instance uuid ed911d6c-54b6-4e74-81e9-7095b7553483 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:06.436132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.454229 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0a087c3-a96f-440f-97f3-f1a134f4eaa6 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 200 len: 1302 microversion: 2.1 time: 0.496876 Jul 19 19:56:06.455355 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1095/2258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:05 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 1302 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:06.745279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.783676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.785454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.786663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e7ce410-e269-4ee8-861e-a8dac68cb01c tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.915094 Jul 19 19:56:06.792249 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1164/2259] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:05 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:06.887316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:06.888596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:06.900066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.900774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.902080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.902983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.957982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:07.054123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:07.371038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.389646 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5269038f-af7d-4482-b909-00af58180025 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 0.506039 Jul 19 19:56:07.404047 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1096/2260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:06 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:07.473535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:07.474149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:07.498356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.499318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.504920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.505778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.557761 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 HTTP/1.1 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ed911d6c-54b6-4e74-81e9-7095b7553483'} Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:07.559712 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:56:07.564069 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:07.566367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:07.567965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f37fbab8-bcab-4db4-9144-4e497f540f4b tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 404 len: 111 microversion: 2.1 time: 0.098999 Jul 19 19:56:07.572354 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1165/2261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:07 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:07.651658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed911d6c-54b6-4e74-81e9-7095b7553483", "name": "network-vif-deleted", "tag": "a3bc80fa-7a1b-4118-b4e8-e74048ee5c93"}, {"name": "network-changed", "server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:07.684566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.685588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.715255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] Creating event network-vif-deleted:a3bc80fa-7a1b-4118-b4e8-e74048ee5c93 for instance ed911d6c-54b6-4e74-81e9-7095b7553483 on n-h2-843861-3 Jul 19 19:56:07.716066 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] Creating event network-changed:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h1-843861-3 Jul 19 19:56:07.736137 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7fafded4-699c-47fe-a2cb-e47975287c99 req-cc933ea3-8628-4ea1-aa34-8057ec039b4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093297 Jul 19 19:56:07.737726 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1097/2262] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:07.813690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:07.815073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:07.844373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.846837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.853570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.856232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.409026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:08.409753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:08.439412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.440667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.444814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.446203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.231092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.263380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af824337-5b9a-4990-82fb-747c8b8fdcfb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 0.852600 Jul 19 19:56:09.264989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1098/2263] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:08 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:09.352125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.366363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.372882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.374949 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e581f96a-e90e-462b-9307-019730827138 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 1.569850 Jul 19 19:56:09.379679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1166/2264] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:07 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:10.284098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:10.285121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:10.311095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.312006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.313353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.314098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.409698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:10.410464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:10.432082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.436118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.438354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.438806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.964719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:10.976274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:10.986799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33da7dc8-42ce-4b7d-98d6-c1b67706fc09 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 0.708796 Jul 19 19:56:10.987854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:10.990262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:10.992121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-faa8f3e2-84fc-46ba-8ded-41e8693a6cbc tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.588178 Jul 19 19:56:10.993683 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1167/2265] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:10 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:11.005171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1099/2266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:10 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:11.171302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc5aa63f-c7e1-4b7b-9ae6-b79af5e3c769 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88d6424c0>, body: {"keypair": {"name": "tempest-keypair-722111200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRil1nD68IEkH5/DvrMonHxg+Dos+iJbw9woS4tEt6oW9G6zilNKtDiEJVILkDsXGvMI01YAT6vQobArSdEmq8pCrHiWlUZY0YyTGdiMCDcZe2+dq6vMJC1+/2dINKlSg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.191465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dc5aa63f-c7e1-4b7b-9ae6-b79af5e3c769 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.199341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dc5aa63f-c7e1-4b7b-9ae6-b79af5e3c769 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.238842 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc5aa63f-c7e1-4b7b-9ae6-b79af5e3c769 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.243731 Jul 19 19:56:11.244370 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1168/2267] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 250 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.250103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-665fb00f-981f-423b-8d7d-44404181188f tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88dc0b160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.260644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-665fb00f-981f-423b-8d7d-44404181188f tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-722111200" status: 200 len: 512 microversion: 2.2 time: 0.014338 Jul 19 19:56:11.269078 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1100/2268] 10.222.0.33 () {60 vars in 1254 bytes} [Tue Jul 19 19:56:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-722111200 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:11.276844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa052714-32d5-4a54-92b2-16ec33b66acf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88def29d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.303360 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa052714-32d5-4a54-92b2-16ec33b66acf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722111200" status: 204 len: 0 microversion: 2.2 time: 0.033824 Jul 19 19:56:11.305444 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1169/2269] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722111200 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:11.320805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd6d0ecf-4064-4f87-b394-31f45465ca2a tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88e1f3ee0>, body: {"keypair": {"name": "tempest-keypair-880868101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzus+IyertWgmzw4TSq7PFrWdXYihUtFXni/8wnaV+rT5ONVCV0IH8aSopnDQI/d5nNQIn79+o7BfGOhh8OPfGwtGItkuyO+SSSOCPXoX4nlsWSS57N0XC090mzK/EwjA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.342777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd6d0ecf-4064-4f87-b394-31f45465ca2a tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.350299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd6d0ecf-4064-4f87-b394-31f45465ca2a tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.383696 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd6d0ecf-4064-4f87-b394-31f45465ca2a tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.070213 Jul 19 19:56:11.395940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1101/2270] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.399909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-13dab889-d4be-4e98-9a30-d291e5227ced tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d3c43a0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.433941 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-13dab889-d4be-4e98-9a30-d291e5227ced tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880868101" status: 204 len: 0 microversion: 2.2 time: 0.038285 Jul 19 19:56:11.435362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1170/2271] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880868101 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:11.445162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ecc80a4-a929-4c55-8887-7bdea2f87dcf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88e385160>, body: {"keypair": {"name": "tempest-keypair-1251914257", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.456046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:11.467900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4ecc80a4-a929-4c55-8887-7bdea2f87dcf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.477406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4ecc80a4-a929-4c55-8887-7bdea2f87dcf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.512063 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ecc80a4-a929-4c55-8887-7bdea2f87dcf tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.070522 Jul 19 19:56:11.512968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1102/2272] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:11 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.527587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb5add5c-2d77-4806-bc14-d2cd461d38bd tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d63f310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.578077 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb5add5c-2d77-4806-bc14-d2cd461d38bd tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251914257" status: 204 len: 0 microversion: 2.2 time: 0.058442 Jul 19 19:56:11.579302 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1171/2273] 10.222.0.33 () {60 vars in 1260 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251914257 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:11.592160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10b6e956-b0dd-4cb7-adad-fdbb8dcfb9af tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88dca70d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-780949348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD0YipxJFl+PlrMcQSnoID64XkGKNFwevfjG3xW6DDTucMnxsyndhCSdaC3ZJflmzzWGH+s5tQ4Ruz+f6ko954qM1BhJH3eWrzcHeEiLQjRtdCqUYWHXPdbuPJ4SRVNnA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.609179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-10b6e956-b0dd-4cb7-adad-fdbb8dcfb9af tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.615280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-10b6e956-b0dd-4cb7-adad-fdbb8dcfb9af tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.645375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10b6e956-b0dd-4cb7-adad-fdbb8dcfb9af tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.058293 Jul 19 19:56:11.647672 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1103/2274] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.661111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42689784-e2fa-48b7-bc07-4e048762f2e1 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88e670550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1843568963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWDsb469fzafQzrqrMUcxAMS5fZR1TtEYRyQ/5VKOCtfxF+NXYBMplk7kEfF+V/U64J9/B6tv51XF7VvPqzztfrb7UjHaLcg8/LneAZcLWTLQr8V+OmbdlBmXPIParI0Q=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.687894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-42689784-e2fa-48b7-bc07-4e048762f2e1 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.697711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-42689784-e2fa-48b7-bc07-4e048762f2e1 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.770675 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42689784-e2fa-48b7-bc07-4e048762f2e1 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.099733 Jul 19 19:56:11.773356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1172/2275] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.786791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfbccbe1-2740-413f-a40a-1f2c2fddf388 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88db77160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-995817142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8fTmxd1URwO70okF3jXye/L/6xHeh4FirZyd/RLkypuLhioMn7KvKTpFJxCnXL90e6/6D0Nfa1Qtp5whdZstzJRjjqPhigMqFvmPSx7Ld/tgEEd78PgYICiSuOjC078Q=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:11.802664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dfbccbe1-2740-413f-a40a-1f2c2fddf388 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:11.809356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dfbccbe1-2740-413f-a40a-1f2c2fddf388 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:11.846373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfbccbe1-2740-413f-a40a-1f2c2fddf388 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.064675 Jul 19 19:56:11.847453 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1104/2276] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:11.861621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed399294-a27c-4b04-9571-f11ce29c9830 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d4e2940>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.864854 n-d-843861-3 devstack@n-api.service[126008]: WARNING oslo_db.sqlalchemy.utils [None req-ed399294-a27c-4b04-9571-f11ce29c9830 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:56:11.887428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed399294-a27c-4b04-9571-f11ce29c9830 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.029691 Jul 19 19:56:11.888635 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1173/2277] 10.222.0.33 () {60 vars in 1176 bytes} [Tue Jul 19 19:56:11 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:11.898939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33943a87-e17f-4421-a58d-585b85b826d2 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88db77700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.930236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33943a87-e17f-4421-a58d-585b85b826d2 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-995817142" status: 204 len: 0 microversion: 2.2 time: 0.035157 Jul 19 19:56:11.931497 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1105/2278] 10.222.0.33 () {60 vars in 1317 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-995817142 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:11.939601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-634b35fd-06fb-4bcf-ba3e-e177a49fc700 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88def2dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.970423 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-634b35fd-06fb-4bcf-ba3e-e177a49fc700 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1843568963" status: 204 len: 0 microversion: 2.2 time: 0.034565 Jul 19 19:56:11.971786 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1174/2279] 10.222.0.33 () {60 vars in 1320 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1843568963 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:11.980817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe7bbe7c-f5a5-4765-a2fd-d041f38132eb tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d44a1f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.013981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.015911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:12.018284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe7bbe7c-f5a5-4765-a2fd-d041f38132eb tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-780949348" status: 204 len: 0 microversion: 2.2 time: 0.028589 Jul 19 19:56:12.021213 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1106/2280] 10.222.0.33 () {60 vars in 1317 bytes} [Tue Jul 19 19:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-780949348 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:12.032817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.034782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:12.042131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.044277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.046294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.047423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.049234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.052356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.055612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.056491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.111236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:12.464837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.465866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.476977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.478511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.479689 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a87e59de-bf55-40f6-ab84-407a457d6b46 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.472268 Jul 19 19:56:12.489699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10200d93-e3d4-4353-ac4f-bbd1601c8381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 0.466457 Jul 19 19:56:12.495576 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1107/2281] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:12.497870 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1175/2282] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:12.506782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ec3f0c49-12da-43ce-85e6-760b50e69d48 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88db6d820>, body: {"keypair": {"name": "tempest-keypair-1752060258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZAS+p4CR731+P4GVjQ7PsLBjnXQFTvggBrund27Q8MNzj4dyZ21qrDGUyOy2g73hUUU/bFMp+K8uT5T+iVr+Ppqck7NewWMkaFE5gNdkggUcBWC+kAYRzx1fs6/TVggQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:12.552614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ec3f0c49-12da-43ce-85e6-760b50e69d48 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:12.568930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ec3f0c49-12da-43ce-85e6-760b50e69d48 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:12.646322 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ec3f0c49-12da-43ce-85e6-760b50e69d48 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.149243 Jul 19 19:56:12.647370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1108/2283] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Jul 19 19:56:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:12.657817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cce53ba3-1369-44ec-834b-854efd88e4aa tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d3c4ee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.671161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cce53ba3-1369-44ec-834b-854efd88e4aa tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1752060258" status: 200 len: 513 microversion: 2.2 time: 0.017250 Jul 19 19:56:12.685639 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1176/2284] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1752060258 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:12.689228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9274c2fd-a279-418b-a466-9b10fe2c4967 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88dddbb80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.692090 n-d-843861-3 devstack@n-api.service[126007]: WARNING oslo_db.sqlalchemy.utils [None req-9274c2fd-a279-418b-a466-9b10fe2c4967 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:56:12.701942 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9274c2fd-a279-418b-a466-9b10fe2c4967 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.019205 Jul 19 19:56:12.714872 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1109/2285] 10.222.0.33 () {60 vars in 1176 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:12.723228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8fce3659-1939-41d1-9356-b59b64563f99 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88d566280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.763521 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8fce3659-1939-41d1-9356-b59b64563f99 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752060258" status: 204 len: 0 microversion: 2.2 time: 0.045260 Jul 19 19:56:12.764205 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1177/2286] 10.222.0.33 () {60 vars in 1260 bytes} [Tue Jul 19 19:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752060258 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:12.774575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Action: 'create', calling method: .version_select at 0x7fb88dd9c8b0>, body: {"keypair": {"name": "tempest-keypair-605330007", "type": "x509"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:12.804371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:12.816664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:12.858458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.processutils [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpk4xwqn5q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk4xwqn5q/temp.key -subj /CN=20f6972ffb034c5485bd13bd19130cca -extensions v3_req_client {{(pid=126007) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 19:56:13.233952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.processutils [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpk4xwqn5q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk4xwqn5q/temp.key -subj /CN=20f6972ffb034c5485bd13bd19130cca -extensions v3_req_client" returned: 0 in 0.375s {{(pid=126007) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 19:56:13.235087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.processutils [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpk4xwqn5q/temp.key -password pass: {{(pid=126007) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 19:56:13.322506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.processutils [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpk4xwqn5q/temp.key -password pass:" returned: 0 in 0.087s {{(pid=126007) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 19:56:13.401106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:13.420218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Getting quotas for user 20f6972ffb034c5485bd13bd19130cca and project ee88993c7e8446f0ad92b112dcf1f005. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:13.446590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0c878c8-91e7-4e7b-9469-873594606451 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.676455 Jul 19 19:56:13.449534 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1110/2287] 10.222.0.33 () {62 vars in 1197 bytes} [Tue Jul 19 19:56:12 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 680 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:13.461504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9894c5e8-5cae-4a23-a035-e4b3a738bf55 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88df35310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.473198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9894c5e8-5cae-4a23-a035-e4b3a738bf55 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-605330007" status: 200 len: 1533 microversion: 2.2 time: 0.018037 Jul 19 19:56:13.473869 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1178/2288] 10.222.0.33 () {60 vars in 1254 bytes} [Tue Jul 19 19:56:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-605330007 => generated 1533 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:13.486562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4628cf27-0d5c-4fb0-a2a9-5bc122a698b7 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88e264670>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.494847 n-d-843861-3 devstack@n-api.service[126007]: WARNING oslo_db.sqlalchemy.utils [None req-4628cf27-0d5c-4fb0-a2a9-5bc122a698b7 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:56:13.506620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.507239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:13.515798 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4628cf27-0d5c-4fb0-a2a9-5bc122a698b7 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.031331 Jul 19 19:56:13.521281 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1111/2289] 10.222.0.33 () {60 vars in 1176 bytes} [Tue Jul 19 19:56:13 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:13.537382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.537845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.538654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.539094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.543377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.545059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:13.570953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.581993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.583087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.583550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.455780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.472076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.473870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.476242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f8860a5-9373-4369-bfd5-6eb7ec7eef29 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.974355 Jul 19 19:56:14.477023 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1179/2290] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:13 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:14.491039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1dfea56f-6271-41a8-b890-e10e15d895a2 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] Calling method '.version_select at 0x7fb88df35af0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:14.532163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1dfea56f-6271-41a8-b890-e10e15d895a2 tempest-KeyPairsV22TestJSON-977244569 tempest-KeyPairsV22TestJSON-977244569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605330007" status: 204 len: 0 microversion: 2.2 time: 0.053186 Jul 19 19:56:14.534477 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1180/2291] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Jul 19 19:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605330007 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:14.594452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.613377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-266dbd11-3bf9-4d35-8f82-d9857c522eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 1.087893 Jul 19 19:56:14.627642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1112/2292] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:13 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:15.494752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.495372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.509699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.510365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.511323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.520381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.634554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.635897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.657509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.658351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.659403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.660124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.705966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.730326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.741252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.743838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd1ede2b-61fd-4deb-a707-479c50201aad tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 1.252542 Jul 19 19:56:16.745034 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1181/2293] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:16.761336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d70040b9-bb17-4b74-844c-9df758f5f506 req-e079b1d6-6f57-4fd3-86ab-ab7ae1d14da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9346d85d-3aec-4429-902c-7b41797031e9", "name": "network-vif-plugged", "status": "completed", "tag": "ddf5c154-cd3f-4b9d-a929-a0dfd509c458"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:16.782526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d70040b9-bb17-4b74-844c-9df758f5f506 req-e079b1d6-6f57-4fd3-86ab-ab7ae1d14da9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:16.784358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d70040b9-bb17-4b74-844c-9df758f5f506 req-e079b1d6-6f57-4fd3-86ab-ab7ae1d14da9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.819642 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d70040b9-bb17-4b74-844c-9df758f5f506 req-e079b1d6-6f57-4fd3-86ab-ab7ae1d14da9 service nova] Creating event network-vif-plugged:ddf5c154-cd3f-4b9d-a929-a0dfd509c458 for instance 9346d85d-3aec-4429-902c-7b41797031e9 on n-h2-843861-3 Jul 19 19:56:16.833901 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d70040b9-bb17-4b74-844c-9df758f5f506 req-e079b1d6-6f57-4fd3-86ab-ab7ae1d14da9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079941 Jul 19 19:56:16.834459 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1182/2294] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:16.907215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.917976 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0598347-0ce6-4d61-a5bf-e2531a023b1e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 1.287642 Jul 19 19:56:16.924129 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1113/2295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:17.764798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:17.765382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:17.778903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.779767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.781137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.782869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.942489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:17.943680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:17.959151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.959934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.965783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.966498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.671898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.685300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.687078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.690232 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e98faaf9-fea8-4963-b48e-a0966cb4bb4f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1361 microversion: 2.26 time: 0.930716 Jul 19 19:56:18.696043 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1183/2296] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:17 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1361 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:18.774335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.791473 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-394055c6-83a2-42aa-83f2-ef8dac5f6100 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 0.851899 Jul 19 19:56:18.793022 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1114/2297] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:17 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:19.073337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d7e0ee44-0c0f-4440-b034-e58143207c33 req-43362e60-ea05-4a43-9d88-dafe35dbebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "name": "network-vif-plugged", "status": "completed", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:19.102386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d7e0ee44-0c0f-4440-b034-e58143207c33 req-43362e60-ea05-4a43-9d88-dafe35dbebe4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.103360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d7e0ee44-0c0f-4440-b034-e58143207c33 req-43362e60-ea05-4a43-9d88-dafe35dbebe4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.129893 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d7e0ee44-0c0f-4440-b034-e58143207c33 req-43362e60-ea05-4a43-9d88-dafe35dbebe4 service nova] Creating event network-vif-plugged:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h1-843861-3 Jul 19 19:56:19.141452 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d7e0ee44-0c0f-4440-b034-e58143207c33 req-43362e60-ea05-4a43-9d88-dafe35dbebe4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071640 Jul 19 19:56:19.150135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1184/2298] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:19.361266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] Calling method '.version_select at 0x7fb88dd43ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:19.375523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.376318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.377313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.377944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.406058 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bcfe853-793a-4cdc-bede-40e16e2bf8fb tempest-AbsoluteLimitsTestJSON-913543817 tempest-AbsoluteLimitsTestJSON-913543817-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.301400 Jul 19 19:56:19.407233 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1115/2299] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 19 19:56:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:19.723037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:19.724320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:19.734043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.735328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.737178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.737879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.804474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1598282279", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "d4ad384f-bde6-406d-a33a-33acd71d3197"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:19.939382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] validate_networks() for [('d4ad384f-bde6-406d-a33a-33acd71d3197', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:20.803106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.819451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.823015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.831906 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7fb6c0de-13ff-4bd9-8fb5-9fefc45d000e tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1545 microversion: 2.26 time: 1.119835 Jul 19 19:56:20.833004 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1116/2300] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:19 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1545 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:20.838965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:20.839825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:20.855954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.857020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.857899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.858468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.710121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:21.940904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:21.959753 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c6c990d-f65e-458a-88f8-fea1b2bd7732 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1312 microversion: 2.1 time: 1.124398 Jul 19 19:56:21.961723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1117/2301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:20 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1312 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:21.972185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2122691278", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "571a225c-9f7a-4eb2-bb0b-87cecffa76fb"}, {"uuid": "242c7035-a8b1-45b8-a1e2-b5b2f886c16d"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:21.987499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:22.111703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] validate_networks() for [('571a225c-9f7a-4eb2-bb0b-87cecffa76fb', None, None, None, None, None), ('242c7035-a8b1-45b8-a1e2-b5b2f886c16d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:22.443021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:22.443021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:22.443665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:22.444786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:22.445447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:22.471645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.473831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.475080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.475674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.507037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Getting quotas for project 265fde847b25422b8cb68a076b96a003. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:22.514180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Getting quotas for user 5429b0615c8b477e9691fb7563f1b636 and project 265fde847b25422b8cb68a076b96a003. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:22.546024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:22.549342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:22.602455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d0c21ef-05ec-4db4-9684-ed2458d2d3c3 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.942844 Jul 19 19:56:22.603655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1185/2302] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:56:22.623689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d36c040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.632727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:22.663946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.664749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.665455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.673859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.675140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.676365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.677025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.707725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.708493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.728364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.729730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.792672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:22.920187 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f00a6f8-1c0e-4df0-a1c8-41bdda82b032 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-697924348" status: 201 len: 0 microversion: 2.26 time: 0.305547 Jul 19 19:56:22.921545 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1186/2303] 10.222.0.33 () {62 vars in 1376 bytes} [Tue Jul 19 19:56:22 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-697924348 => generated 0 bytes in 309 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 19:56:23.547985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:23.550343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.550946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.551971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.552631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.623768 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1dac871e-d838-4d2d-8889-e3dbe2e6099e tempest-AZV2TestJSON-574221119 tempest-AZV2TestJSON-574221119-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.700422 Jul 19 19:56:23.624452 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1187/2304] 10.222.0.33 () {58 vars in 1163 bytes} [Tue Jul 19 19:56:22 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:56:23.653197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:23.653835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:23.669492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.669945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.680416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.681086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.923002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:23.938928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd459fb7-b562-445c-b37e-ced34d03f2cc tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1212 microversion: 2.1 time: 0.312635 Jul 19 19:56:23.940707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1188/2305] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:23 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1212 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:23.947770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c38b0f9-a312-4dc4-b2ab-1fc8b08a65d4 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d566280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:23.959776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c38b0f9-a312-4dc4-b2ab-1fc8b08a65d4 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.961256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c38b0f9-a312-4dc4-b2ab-1fc8b08a65d4 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.017744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c38b0f9-a312-4dc4-b2ab-1fc8b08a65d4 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-697924348" status: 204 len: 0 microversion: 2.26 time: 0.074585 Jul 19 19:56:24.026855 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1189/2306] 10.222.0.33 () {60 vars in 1357 bytes} [Tue Jul 19 19:56:23 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-697924348 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:24.047159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:24.049140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:24.062400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.063324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.065458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.066807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.936815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:24.953988 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9be06acb-80fb-45a3-9800-7883741953f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1462 microversion: 2.1 time: 0.923957 Jul 19 19:56:24.970706 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1190/2307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:24 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1462 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:24.979219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88df35310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:24.990759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.991540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.992271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:25.004413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.008772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.009880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.010329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.016460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:25.067021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.067478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.086736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:25.120296 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbaedad4-7590-422f-8b87-dfb9bd37f9c3 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 204 len: 0 microversion: 2.26 time: 0.148095 Jul 19 19:56:25.123848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1191/2308] 10.222.0.33 () {60 vars in 1294 bytes} [Tue Jul 19 19:56:24 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:25.137451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:25.138081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:25.145300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.145762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.146711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.147315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.631938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:25.658142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-932df8fd-2a69-4e98-9028-6fdf3c1dc1fe tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1274 microversion: 2.1 time: 0.533024 Jul 19 19:56:25.660861 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1192/2309] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:25 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1274 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:26.233993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:26.234613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:26.242721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.243473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.244854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.245649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.326024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:26.326496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:26.326919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:26.327430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:26.329417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:26.349844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.352170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.354261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.354989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.447087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Getting quotas for project 702f2a7aa83346a39543c724e129480a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:26.459109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Getting quotas for user a59e4b2ee66540fbbb389b87a517b686 and project 702f2a7aa83346a39543c724e129480a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:26.495300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:26.502100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:26.650393 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5d45b85-02bb-42d9-8d81-66cd461fab97 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.687353 Jul 19 19:56:26.651367 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1118/2310] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:56:26.659615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c54fa565-2a47-4b8d-9c54-518beaa45b79 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88dc3caf0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:26.672461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54fa565-2a47-4b8d-9c54-518beaa45b79 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.672884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54fa565-2a47-4b8d-9c54-518beaa45b79 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.709105 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c54fa565-2a47-4b8d-9c54-518beaa45b79 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 12 microversion: 2.26 time: 0.054100 Jul 19 19:56:26.710366 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1119/2311] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:56:26 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:26.718862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf72b59a-514a-42cf-855e-a7966ccd4818 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Action: 'create', calling method: .version_select at 0x7fb88de945e0>, body: {"keypair": {"name": "tempest-keypair-1981741045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVyFDxgC/riq67h3jUdzZ62IG4nlhweR1jbnBiSt4qk48HKkGMNPJgCuqE9QO6Xqs3dfxYcBj36Nr4nkGP230fd2pX15VEe/HuHfwBh9ToWM/5GDedCuHkBvpECXU4k2g=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:26.738865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-bf72b59a-514a-42cf-855e-a7966ccd4818 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Getting quotas for project 0ef1da8f4a3f4d5c8908abcbecaf8d60. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:26.760164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-bf72b59a-514a-42cf-855e-a7966ccd4818 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Getting quotas for user 2b011b8503fa402f9d005bb1ef02261c and project 0ef1da8f4a3f4d5c8908abcbecaf8d60. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:26.813288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf72b59a-514a-42cf-855e-a7966ccd4818 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.101587 Jul 19 19:56:26.813834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1120/2312] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 19:56:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:56:26.835449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e44b1338-6265-4637-be22-7d5031c08b06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:26.837892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e44b1338-6265-4637-be22-7d5031c08b06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:27.497877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e44b1338-6265-4637-be22-7d5031c08b06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:27.540304 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e44b1338-6265-4637-be22-7d5031c08b06 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1213 microversion: 2.1 time: 0.725011 Jul 19 19:56:27.552853 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1121/2313] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:26 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1213 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:27.569317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:27.569317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:27.609884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.625879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.629756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.635128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.137818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8f594c3-6f3a-44ed-ada2-248e9e8c43d2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1613 microversion: 2.1 time: 2.474773 Jul 19 19:56:28.138418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1193/2314] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:25 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1613 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:28.160735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb89318cf70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:28.184347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.185010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.185557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:28.204538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.207053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.208190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.209129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.285014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.286527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.310115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.311609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.377428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:28.444287 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fe95816-e07a-4b1e-be62-8137c2380cb5 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1793511993" status: 201 len: 0 microversion: 2.26 time: 0.291741 Jul 19 19:56:28.444977 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1194/2315] 10.222.0.33 () {62 vars in 1379 bytes} [Tue Jul 19 19:56:28 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1793511993 => generated 0 bytes in 295 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 19:56:28.471700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:28.473413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:28.494774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.497815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.498659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.504038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.812823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '276b35b156554264ab2ae505435df509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a199ec3a0c948608712c354f4b099bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:28.813680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] flavor_id is None. Assuming migration. {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 19:56:28.814340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:56:29.193745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:29.213683 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96dd57cc-4f16-45c0-aa13-efd5f307f3dd tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 1.668674 Jul 19 19:56:29.214333 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1122/2316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:27 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:29.245387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-02e5b5b4-d88b-410a-8647-fa9a057ed54a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88dbe9280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:29.277851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e5b5b4-d88b-410a-8647-fa9a057ed54a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.286965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02e5b5b4-d88b-410a-8647-fa9a057ed54a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.337383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-02e5b5b4-d88b-410a-8647-fa9a057ed54a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 36 microversion: 2.26 time: 0.121942 Jul 19 19:56:29.354656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1123/2317] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:56:29 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 36 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:29.365797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:29.369305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:29.396836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.401164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.403103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.404236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.842459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:29.855422 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb427792-1841-4876-bbe3-cce41d5ebca2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1271 microversion: 2.1 time: 0.497086 Jul 19 19:56:29.874872 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1124/2318] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:29 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:29.881136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88db6d3a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:29.896482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.896937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.897416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:29.917797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.919120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.923331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.925237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.947129 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b3aa65f-c4b0-4821-a5c4-8eb1031742a6 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804/action" status: 202 len: 0 microversion: 2.1 time: 1.491400 Jul 19 19:56:29.949503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1195/2319] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:56:28 2022] POST /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804/action => generated 0 bytes in 1504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:56:29.994460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:29.994924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:30.052731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:30.094028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c95c740-7e28-4ea6-a9ac-14ccdac2cbf2 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1793511993" status: 204 len: 0 microversion: 2.26 time: 0.217918 Jul 19 19:56:30.096546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1125/2320] 10.222.0.33 () {60 vars in 1363 bytes} [Tue Jul 19 19:56:29 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1793511993 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:30.345237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc7585ca-14a4-4771-869b-ece31edcc1cb tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1648856136", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:30.348578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-cc7585ca-14a4-4771-869b-ece31edcc1cb tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] HTTP exception thrown: min_count must be <= max_count Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc7585ca-14a4-4771-869b-ece31edcc1cb tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Request method failure captured: Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 184 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtNUM3YVjIxsMFqU9f-NEWaB5Nyv-Aoa1Buf8_E8W6kl1U9MeJ8-MG76FHrC0XiqZ-U0oY0PxHTxYklkJFgal5OfjqBXpSJButZf3Tu-RM04H1qnU6bCNKzTay0SNrT5u6oeYGcaRCAdEaL7VT2ykM8XsHm7KF0N2rHzkeNePQ2pg Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 947a8fb440b14b908070930fcadac33e Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1648856136", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: exception: min_count must be <= max_count Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1648856136', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 19 19:56:30.354030 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:30.359140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc7585ca-14a4-4771-869b-ece31edcc1cb tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Returning 400 to user: min_count must be <= max_count {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:30.362639 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc7585ca-14a4-4771-869b-ece31edcc1cb tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.411104 Jul 19 19:56:30.363358 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1196/2321] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:29 2022] POST /compute/v2.1/servers => generated 74 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:56:30.376951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:30.377799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:30.393382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:30.395087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:30.397892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:30.398759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:30.411722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-8222221", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:30.499092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:31.593927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:31.602830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0715803e-a9e0-4b23-b735-1324c28f46f0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1471 microversion: 2.1 time: 1.236981 Jul 19 19:56:31.608249 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1197/2322] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:30 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1471 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:31.620907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f8c5339a-eddb-4534-b271-abc91fc9c216 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88df3c4c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:31.640407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8c5339a-eddb-4534-b271-abc91fc9c216 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:31.643345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8c5339a-eddb-4534-b271-abc91fc9c216 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:31.668668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f8c5339a-eddb-4534-b271-abc91fc9c216 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 12 microversion: 2.26 time: 0.059093 Jul 19 19:56:31.673453 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1198/2323] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:56:31 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:31.684281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:31.685180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:31.692115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:31.692796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:31.693666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:31.694207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.004990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:32.006251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:32.007039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:32.007880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:32.008616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:32.032191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.032691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.034321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.034787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.095643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Getting quotas for project 2ce3737accb04d11895d234c9a12d93a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:32.118010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Getting quotas for user ff8555d74017437e81b8b448ba745959 and project 2ce3737accb04d11895d234c9a12d93a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:32.142525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.154032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-03fb5eb8-3cd4-4c9f-a113-52815089f23b tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 0.478965 Jul 19 19:56:32.155844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:32.159039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:32.161508 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1199/2324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:31 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:32.184435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abb3c3a2-dba2-4c53-a13b-d25d15150aba tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-348788159", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "max_count": 0}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abb3c3a2-dba2-4c53-a13b-d25d15150aba tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Request method failure captured: Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 167 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtNUM3YVjIxsMFqU9f-NEWaB5Nyv-Aoa1Buf8_E8W6kl1U9MeJ8-MG76FHrC0XiqZ-U0oY0PxHTxYklkJFgal5OfjqBXpSJButZf3Tu-RM04H1qnU6bCNKzTay0SNrT5u6oeYGcaRCAdEaL7VT2ykM8XsHm7KF0N2rHzkeNePQ2pg Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 947a8fb440b14b908070930fcadac33e Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-348788159", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "max_count": 0}} Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-348788159', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'max_count': 0}}} Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 0 Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:56:32.189152 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:32.192806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:32.203335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abb3c3a2-dba2-4c53-a13b-d25d15150aba tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:32.206195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-abb3c3a2-dba2-4c53-a13b-d25d15150aba tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.042024 Jul 19 19:56:32.219723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1200/2325] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:32.237253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.238927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:32.250168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.253220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.254402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.255251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.327316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a1b9b44-2f1f-4982-b590-47bdb1762169 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224464 Jul 19 19:56:32.327316 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1126/2326] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:56:32.338970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88dbe9dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.362653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.364180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.365870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:32.408960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.410431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.412042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.413658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.533998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:32.541672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.542339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.587119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:32.652197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-006bca87-6599-41d1-9607-1d1b0bc82f7f tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 204 len: 0 microversion: 2.26 time: 0.325569 Jul 19 19:56:32.654111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1127/2327] 10.222.0.33 () {60 vars in 1294 bytes} [Tue Jul 19 19:56:32 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:32.664958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-221174150", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c7039b03-5362-48f7-96db-aa48441142a7"}, {"port": "9ec19e57-4422-4712-8bdb-fa8bd72353c0", "tag": "port-1"}, {"port": "62cb4254-0f56-4249-96e0-c0284ed62939", "tag": "port-2"}, {"uuid": "61b45e1f-e7d6-4887-aee1-3c65fd814393", "tag": "net-1"}, {"uuid": "61b45e1f-e7d6-4887-aee1-3c65fd814393"}, {"uuid": "1520b9b1-1bde-4a93-bb76-2bcec10f6c74", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1520b9b1-1bde-4a93-bb76-2bcec10f6c74", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "69e11e44-a0b0-4396-9245-916a43853510", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c55d1899-4a97-4e64-bef5-388a4969378d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "17192579-62c4-4fad-850f-011c87d65ecd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--593343459"}], "key_name": "tempest-keypair-1981741045", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:32.902066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] validate_networks() for [('c7039b03-5362-48f7-96db-aa48441142a7', None, None, None, None, None), (None, None, '9ec19e57-4422-4712-8bdb-fa8bd72353c0', None, None, None), (None, None, '62cb4254-0f56-4249-96e0-c0284ed62939', None, None, None), ('61b45e1f-e7d6-4887-aee1-3c65fd814393', None, None, None, None, None), ('61b45e1f-e7d6-4887-aee1-3c65fd814393', None, None, None, None, None), ('1520b9b1-1bde-4a93-bb76-2bcec10f6c74', '10.2.2.100', None, None, None, None), ('1520b9b1-1bde-4a93-bb76-2bcec10f6c74', '10.2.2.200', None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:33.151431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:33.179580 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc204a2e-477a-4d40-aec0-9d498fbc7e19 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1313 microversion: 2.1 time: 0.957008 Jul 19 19:56:33.192927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1201/2328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:33.210304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff796ee6-fd8e-4dea-9c45-04beb6f4491d tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1650687950", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "max_count": 2.5}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff796ee6-fd8e-4dea-9c45-04beb6f4491d tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Request method failure captured: Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 170 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtNUM3YVjIxsMFqU9f-NEWaB5Nyv-Aoa1Buf8_E8W6kl1U9MeJ8-MG76FHrC0XiqZ-U0oY0PxHTxYklkJFgal5OfjqBXpSJButZf3Tu-RM04H1qnU6bCNKzTay0SNrT5u6oeYGcaRCAdEaL7VT2ykM8XsHm7KF0N2rHzkeNePQ2pg Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 947a8fb440b14b908070930fcadac33e Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1650687950", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "max_count": 2.5}} Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1650687950', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'max_count': 2.5}}} Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:56:33.220750 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:33.225975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:33.228443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff796ee6-fd8e-4dea-9c45-04beb6f4491d tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:33.230971 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff796ee6-fd8e-4dea-9c45-04beb6f4491d tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033462 Jul 19 19:56:33.257598 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1202/2329] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:33.269064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5945b1ea-16fd-430a-939f-e49ea9234500 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.269766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5945b1ea-16fd-430a-939f-e49ea9234500 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.421392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5945b1ea-16fd-430a-939f-e49ea9234500 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:33.432338 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5945b1ea-16fd-430a-939f-e49ea9234500 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1216 microversion: 2.1 time: 0.172584 Jul 19 19:56:33.435115 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1203/2330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:33.444028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.447595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.462136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.463715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.469868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.480117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.597766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:35.020941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:35.034658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63590fd3-8446-40ba-9725-d15bad1f757a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1471 microversion: 2.1 time: 1.598309 Jul 19 19:56:35.040641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1204/2331] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1471 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:35.062739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88df3c4c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.100255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.101588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.102466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.112164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.112884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.114204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.114848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.169167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.169648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.182292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.182927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.215159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:35.241439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d455227f-8591-4547-b7c5-69065da3e0d8 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-2067581514" status: 201 len: 0 microversion: 2.26 time: 0.199018 Jul 19 19:56:35.250480 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1205/2332] 10.222.0.33 () {62 vars in 1379 bytes} [Tue Jul 19 19:56:35 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-2067581514 => generated 0 bytes in 209 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 19:56:35.256634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.257649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.265063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.265908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.267136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.267745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.301717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:36.424267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:36.432613 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6eb845e-7ea0-4a38-b215-191f2a53e580 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 1.180716 Jul 19 19:56:36.433195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1206/2333] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:35 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:36.446393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6fed652-bea6-4b31-b3c4-759f5c1dffb2 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1851074844", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 0}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6fed652-bea6-4b31-b3c4-759f5c1dffb2 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Request method failure captured: Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 168 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtNUM3YVjIxsMFqU9f-NEWaB5Nyv-Aoa1Buf8_E8W6kl1U9MeJ8-MG76FHrC0XiqZ-U0oY0PxHTxYklkJFgal5OfjqBXpSJButZf3Tu-RM04H1qnU6bCNKzTay0SNrT5u6oeYGcaRCAdEaL7VT2ykM8XsHm7KF0N2rHzkeNePQ2pg Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 947a8fb440b14b908070930fcadac33e Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1851074844", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 0}} Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1851074844', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'min_count': 0}}} Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 0 Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:56:36.450548 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:56:36.454568 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:36.468633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6fed652-bea6-4b31-b3c4-759f5c1dffb2 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:36.471763 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6fed652-bea6-4b31-b3c4-759f5c1dffb2 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034650 Jul 19 19:56:36.481238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1207/2334] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:36.481238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:36.486732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:36.501699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.502153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.502948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.503361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.115516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.123041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b1bf630-5b81-4726-a1d8-df6c786f6cd2 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.649176 Jul 19 19:56:37.123609 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1208/2335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:36 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:37.128019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-20b4795c-ff89-4aad-b354-f11fd0ddc37d req-b82f6e80-000f-4b11-81f7-0a34ebbbe58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3cd062-1544-477e-9ea7-81aea2483e3d", "tag": "de133b02-f807-4a45-bc60-a0ef3ec5ead0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:37.136239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-20b4795c-ff89-4aad-b354-f11fd0ddc37d req-b82f6e80-000f-4b11-81f7-0a34ebbbe58b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.136697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-20b4795c-ff89-4aad-b354-f11fd0ddc37d req-b82f6e80-000f-4b11-81f7-0a34ebbbe58b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.147998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-20b4795c-ff89-4aad-b354-f11fd0ddc37d req-b82f6e80-000f-4b11-81f7-0a34ebbbe58b service nova] Creating event network-changed:de133b02-f807-4a45-bc60-a0ef3ec5ead0 for instance 4e3cd062-1544-477e-9ea7-81aea2483e3d on n-h1-843861-3 Jul 19 19:56:37.153419 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-20b4795c-ff89-4aad-b354-f11fd0ddc37d req-b82f6e80-000f-4b11-81f7-0a34ebbbe58b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028688 Jul 19 19:56:37.154003 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1209/2336] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:37.158818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.159500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.165662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.166114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.166877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.167310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.317669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.325237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1574daaf-afa9-4bd5-b63c-9ec0a795c6c2 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1274 microversion: 2.1 time: 0.170124 Jul 19 19:56:37.326174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1210/2337] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:37 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:37.330566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c07712ff-677e-4dcc-a6bd-c00dad7a1f72 req-79712f54-bd11-4122-846f-3980df44fe8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "tag": "56276e80-31cc-4077-9aa3-4204c4ca4a68"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:37.338588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c07712ff-677e-4dcc-a6bd-c00dad7a1f72 req-79712f54-bd11-4122-846f-3980df44fe8f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.339032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c07712ff-677e-4dcc-a6bd-c00dad7a1f72 req-79712f54-bd11-4122-846f-3980df44fe8f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.350469 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c07712ff-677e-4dcc-a6bd-c00dad7a1f72 req-79712f54-bd11-4122-846f-3980df44fe8f service nova] Creating event network-changed:56276e80-31cc-4077-9aa3-4204c4ca4a68 for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:56:37.356073 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c07712ff-677e-4dcc-a6bd-c00dad7a1f72 req-79712f54-bd11-4122-846f-3980df44fe8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028266 Jul 19 19:56:37.356906 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1211/2338] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:37.365324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d295430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.375069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.375519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.376124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.381848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.382301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.383075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.383510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.408838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.409460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.419236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.419687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.443483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:37.459140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57a1edda-0f0f-47e2-892b-260a0cfa7030 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1048255950" status: 201 len: 0 microversion: 2.26 time: 0.098511 Jul 19 19:56:37.460086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1212/2339] 10.222.0.33 () {62 vars in 1379 bytes} [Tue Jul 19 19:56:37 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1048255950 => generated 0 bytes in 103 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 19:56:37.464651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.465485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.471668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.472155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.473113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.473535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.838505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.854963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ec24df16-2ebb-4435-9bc1-4d90aaae502e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1471 microversion: 2.1 time: 0.393919 Jul 19 19:56:37.856416 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1213/2340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:37 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:37.862420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb36aead-cca0-4949-8ab5-9821fdf3be78 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1109239299", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 2.5}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb36aead-cca0-4949-8ab5-9821fdf3be78 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Request method failure captured: Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 170 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtNUM3YVjIxsMFqU9f-NEWaB5Nyv-Aoa1Buf8_E8W6kl1U9MeJ8-MG76FHrC0XiqZ-U0oY0PxHTxYklkJFgal5OfjqBXpSJButZf3Tu-RM04H1qnU6bCNKzTay0SNrT5u6oeYGcaRCAdEaL7VT2ykM8XsHm7KF0N2rHzkeNePQ2pg Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9ea98e76124212b3e8bd245e8dd282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 5f9ea98e76124212b3e8bd245e8dd282 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-440783870 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 947a8fb440b14b908070930fcadac33e Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-440783870-project Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1109239299", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 2.5}} Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1109239299', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'min_count': 2.5}}} Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:56:37.866244 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:56:37.869691 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:37.872766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb36aead-cca0-4949-8ab5-9821fdf3be78 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:37.875146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb36aead-cca0-4949-8ab5-9821fdf3be78 tempest-MultipleCreateNegativeTestJSON-440783870 tempest-MultipleCreateNegativeTestJSON-440783870-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017516 Jul 19 19:56:37.881230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1214/2341] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:37.888340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.889398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.901967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.904546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.907007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.908197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.692993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:38.706064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-486b4897-64cd-4272-aa49-7fb251719c40 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 0.822461 Jul 19 19:56:38.711391 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1215/2342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:37 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:38.728046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d249af0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:38.750051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.751789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.754904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:38.767734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.768897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.770357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.771113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.807575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.808571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.837893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:38.888931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc8811a6-b7b3-4c4c-ae52-29845eef88d7 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 204 len: 0 microversion: 2.26 time: 0.175913 Jul 19 19:56:38.894430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1216/2343] 10.222.0.33 () {60 vars in 1294 bytes} [Tue Jul 19 19:56:38 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:38.906840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:38.907570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:38.914835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.915652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.916944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.917436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.528594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.551890 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66dbb5e3-0a3c-40e6-a1e4-34e426105108 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.656133 Jul 19 19:56:39.552749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1217/2344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:38 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:39.566102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:39.566923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:39.581520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.581977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.584444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.584886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.276483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:40.293121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c4959a90-b5d8-41e2-b69c-b6e4458447a3 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1316 microversion: 2.1 time: 0.738445 Jul 19 19:56:40.293731 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1218/2345] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:39 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:40.334655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:40.337512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:40.351301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.351757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.352564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.353001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.912900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:40.920776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b78cdd9-04ae-43bc-8eef-aafa90f81082 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1476 microversion: 2.1 time: 0.625959 Jul 19 19:56:40.930591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1219/2346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:40 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:40.936610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ab9a880-88ea-4847-b785-e3d0c3873211 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d357700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:40.965617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab9a880-88ea-4847-b785-e3d0c3873211 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.966056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab9a880-88ea-4847-b785-e3d0c3873211 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.983258 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ab9a880-88ea-4847-b785-e3d0c3873211 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 12 microversion: 2.26 time: 0.059880 Jul 19 19:56:40.992264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1220/2347] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:56:40 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:40.998769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-57c9006c-33ed-4238-916f-99cbb12f07d1 req-441c547e-c9c1-4511-bcd6-cda2912b77ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "tag": "aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:41.032564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-57c9006c-33ed-4238-916f-99cbb12f07d1 req-441c547e-c9c1-4511-bcd6-cda2912b77ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:41.033091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-57c9006c-33ed-4238-916f-99cbb12f07d1 req-441c547e-c9c1-4511-bcd6-cda2912b77ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:41.063693 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-57c9006c-33ed-4238-916f-99cbb12f07d1 req-441c547e-c9c1-4511-bcd6-cda2912b77ef service nova] Creating event network-changed:aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:56:41.078506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-57c9006c-33ed-4238-916f-99cbb12f07d1 req-441c547e-c9c1-4511-bcd6-cda2912b77ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084815 Jul 19 19:56:41.079482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1221/2348] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:41.084729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:41.085623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:41.100650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:41.101109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:41.101904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:41.102342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:41.860243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:41.871333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92c6a0c1-3929-4ccc-87e3-b6121acc3ad6 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 0.790050 Jul 19 19:56:41.875742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1222/2349] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:41 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:41.896343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:41.897672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:41.904605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:41.906023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:41.907459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:41.908171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.069793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:42.138528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=48 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:42.326617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:42.327048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:42.327525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:42.328190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:42.328781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:42.338434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.338910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.339909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.340340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.351586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=76,nova_cell1:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:42.362940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Getting quotas for project 0ef1da8f4a3f4d5c8908abcbecaf8d60. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:42.369310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Getting quotas for user 2b011b8503fa402f9d005bb1ef02261c and project 0ef1da8f4a3f4d5c8908abcbecaf8d60. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:42.377965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.388715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9f25962-7340-48e0-b14f-5289a18da96e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.511457 Jul 19 19:56:42.389989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1223/2350] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:41 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:42.395176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d566280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:42.404854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.405594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.406261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:42.414513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.415199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.416189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.416887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.478233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.478691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.512319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:42.537763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:42.551781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-809eb24d-981c-4544-af12-2debdaebab24 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 204 len: 0 microversion: 2.26 time: 0.159278 Jul 19 19:56:42.553001 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1224/2351] 10.222.0.33 () {60 vars in 1294 bytes} [Tue Jul 19 19:56:42 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:42.574216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:42.576828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:42.598557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.599235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.600152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.600665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.632969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:42.637979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='69e11e44-a0b0-4396-9245-916a43853510',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c55d1899-4a97-4e64-bef5-388a4969378d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17192579-62c4-4fad-850f-011c87d65ecd',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:42.904588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.913866 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d09ec8f3-461a-484b-97a2-01e9faa6d64a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1316 microversion: 2.1 time: 0.358051 Jul 19 19:56:42.914820 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1225/2352] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:42 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:42.927924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2bab4f4f-85e4-4220-80ef-67791e4c80ac req-328deeff-a256-4fda-9641-92cd4edf1a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3cd062-1544-477e-9ea7-81aea2483e3d", "name": "network-vif-plugged", "status": "completed", "tag": "de133b02-f807-4a45-bc60-a0ef3ec5ead0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:42.939562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2bab4f4f-85e4-4220-80ef-67791e4c80ac req-328deeff-a256-4fda-9641-92cd4edf1a23 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.940293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2bab4f4f-85e4-4220-80ef-67791e4c80ac req-328deeff-a256-4fda-9641-92cd4edf1a23 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.954424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2bab4f4f-85e4-4220-80ef-67791e4c80ac req-328deeff-a256-4fda-9641-92cd4edf1a23 service nova] Creating event network-vif-plugged:de133b02-f807-4a45-bc60-a0ef3ec5ead0 for instance 4e3cd062-1544-477e-9ea7-81aea2483e3d on n-h1-843861-3 Jul 19 19:56:42.960821 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2bab4f4f-85e4-4220-80ef-67791e4c80ac req-328deeff-a256-4fda-9641-92cd4edf1a23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044675 Jul 19 19:56:42.962691 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1226/2353] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:43.125356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97e08952-0d88-422b-a41f-1befbc33a29b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: .version_select at 0x7fb89318c430>, body: {"keypair": {"name": "tempest-keypair-1634667153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNe0Ec79XK6YT6LfC/0YzX8Qy/puxkRQCHOXm3f6hYd1rF8dLH/+tmo4thrlzdZzljy538N85oErrY10EJiiiqKBw/9BIoYVJGNw6Xw9vzeFWBFe05r86zA+ewIPQPSWw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:43.133410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75e12e81-68b7-4fee-b56f-10171a0a163e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.477853 Jul 19 19:56:43.135975 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1128/2354] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Jul 19 19:56:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 10481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:56:43.146138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.148523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-97e08952-0d88-422b-a41f-1befbc33a29b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:43.150293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.160969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-97e08952-0d88-422b-a41f-1befbc33a29b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:43.165926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.166387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.167274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.168303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.199884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:43.247585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97e08952-0d88-422b-a41f-1befbc33a29b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281196 Jul 19 19:56:43.252792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1227/2355] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:56:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:43.265305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0b52200c-cfb9-4da6-971b-73d34cd5a43b req-0d59be5c-b06f-48a3-93cb-fc3b84228259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac30449f-cdc3-486c-be12-80e5ba5a1435", "tag": "b6317aa3-21e7-4699-83b2-a29c292a5b99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:43.301289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b52200c-cfb9-4da6-971b-73d34cd5a43b req-0d59be5c-b06f-48a3-93cb-fc3b84228259 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.302404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b52200c-cfb9-4da6-971b-73d34cd5a43b req-0d59be5c-b06f-48a3-93cb-fc3b84228259 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.324601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0b52200c-cfb9-4da6-971b-73d34cd5a43b req-0d59be5c-b06f-48a3-93cb-fc3b84228259 service nova] Creating event network-changed:b6317aa3-21e7-4699-83b2-a29c292a5b99 for instance ac30449f-cdc3-486c-be12-80e5ba5a1435 on n-h1-843861-3 Jul 19 19:56:43.335460 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0b52200c-cfb9-4da6-971b-73d34cd5a43b req-0d59be5c-b06f-48a3-93cb-fc3b84228259 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080549 Jul 19 19:56:43.336743 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1228/2356] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:43.342457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d5cbe50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.352326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.353034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.372664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.386842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.387624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.389682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.390269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.441208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.441663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.457885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.458379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.504202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:43.521525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-958770fb-3791-4b88-a467-7d35a1129439 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1168837310" status: 201 len: 0 microversion: 2.26 time: 0.183387 Jul 19 19:56:43.526356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1229/2357] 10.222.0.33 () {62 vars in 1379 bytes} [Tue Jul 19 19:56:43 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1168837310 => generated 0 bytes in 185 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 19:56:43.528922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.529542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.537705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.538160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.538954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.539390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.694581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.720154 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-06f81a8d-63b6-404f-a1a1-b4906925ac8d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1476 microversion: 2.1 time: 0.581804 Jul 19 19:56:43.721053 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1129/2358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:43.727554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.728910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.836386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.848030 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-12b4a87f-a6e0-4253-bb67-95f3518dbf10 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 0.323417 Jul 19 19:56:43.848634 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1230/2359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:43.871105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.871991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.885148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.885593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.887024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.887482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.898327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.907032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.908590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.909736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-165dfef6-847b-47bc-9776-f50fd91a4599 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1285 microversion: 2.42 time: 0.187325 Jul 19 19:56:43.916211 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1130/2360] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:43.929396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88dad5940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.954254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.954985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.956200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.983991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.984408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.993585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.994044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.039061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.039776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.052676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.053447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.091075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:44.112569 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-567a2fbb-f76f-429a-ab57-7e4f994430a6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1058225802" status: 201 len: 0 microversion: 2.26 time: 0.191108 Jul 19 19:56:44.113686 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1131/2361] 10.222.0.33 () {62 vars in 1379 bytes} [Tue Jul 19 19:56:43 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags/tempest-tag-1058225802 => generated 0 bytes in 197 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 19:56:44.122070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.122929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.140931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.144263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.152241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.152806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.283206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:44.292913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef25f4e7-b888-43f0-b27f-0fa3635ee176 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.433790 Jul 19 19:56:44.293518 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1231/2362] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.303932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Action: 'update_all', calling method: .version_select at 0x7fb88d259b80>, body: {"tags": ["tempest-tag-973009223", "tempest-tag-442166403"]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:44.313220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.313917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.314570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.322083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.324046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.325042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.325636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.356483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.356864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.400065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:44.423961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aef0d2bb-1a02-492a-a780-95ef61a9bc93 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 60 microversion: 2.26 time: 0.129055 Jul 19 19:56:44.425455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1232/2363] 10.222.0.33 () {62 vars in 1311 bytes} [Tue Jul 19 19:56:44 2022] PUT /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 60 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.448201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca6cb811-11ae-42a8-a76e-20abd742abca tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d5cb430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.483080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6cb811-11ae-42a8-a76e-20abd742abca tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.483559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6cb811-11ae-42a8-a76e-20abd742abca tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.499000 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca6cb811-11ae-42a8-a76e-20abd742abca tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 200 len: 60 microversion: 2.26 time: 0.063494 Jul 19 19:56:44.504486 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1233/2364] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 19 19:56:44 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 60 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.509980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '.version_select at 0x7fb88d259790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.521042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.521872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.522566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.550173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.552176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.553211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.554523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.579970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:44.591225 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c36f36c-1b42-48e4-9ad9-ec2b8c47adbc tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1316 microversion: 2.1 time: 0.474198 Jul 19 19:56:44.591460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.591750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.594120 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1132/2365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:44 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.626091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lazy-loading 'flavor' on Instance uuid 9346d85d-3aec-4429-902c-7b41797031e9 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:44.649930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c01de85-9a21-4586-8a3b-941817b9a8b6 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags" status: 204 len: 0 microversion: 2.26 time: 0.143959 Jul 19 19:56:44.651323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1234/2366] 10.222.0.33 () {60 vars in 1294 bytes} [Tue Jul 19 19:56:44 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9/tags => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:44.668993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.669538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.679203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.680496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.681471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.682118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.719553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:44.738391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.739384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.775217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.776672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.790933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.793104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.856101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:44.869077 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c329fa7e-2593-495f-9b32-f44489672802 tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 204 len: 0 microversion: 2.26 time: 0.209587 Jul 19 19:56:44.874991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1133/2367] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:44 2022] DELETE /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:44.887470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.895366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.918377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.919301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.920315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.936444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.578194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:45.591023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f7981e5-7b0f-4051-aa04-686f0ca44ca7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1316 microversion: 2.1 time: 0.708456 Jul 19 19:56:45.596613 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1134/2368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:44 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:45.603469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:45.604700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:45.619146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:45.623494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.624399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.625543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.626262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.639127 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ab8497c-7f07-433e-9e9c-d89f3b04ce77 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1476 microversion: 2.1 time: 0.905022 Jul 19 19:56:45.644086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1235/2369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:44 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1476 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:45.670870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:45.673376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:45.690733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.691324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.692261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.692703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.170298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.201764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.204130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.207694 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a41fb91-5261-4a09-823f-63d0224c48ee tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1583 microversion: 2.42 time: 0.560130 Jul 19 19:56:46.210315 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1236/2370] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:45 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1583 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:46.230375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:46.233117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:46.262186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.262664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.264236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.264719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.854690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.863822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63ed4843-2c64-4a1e-89b5-ad4f5b80e118 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.652258 Jul 19 19:56:46.864415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1237/2371] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:46 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:46.879239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:46.880124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:46.890357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.894162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.895370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.896098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.706764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.716160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.724500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48684c5137c84514b2f2d08f520f9356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30387df2e69449cdb726c6e9392bacfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.725814 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-40ada3bd-d74a-4ca6-87f5-0156c022692a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 200 len: 1551 microversion: 2.26 time: 2.127685 Jul 19 19:56:47.732615 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1135/2372] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:45 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 1551 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:47.748072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-317038398", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f332934-1a7c-403c-b4ff-1c5d43cb0949"}], "security_groups": [{"name": "tempest-securitygroup--1372225953"}], "key_name": "tempest-keypair-1634667153", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:48.189808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] validate_networks() for [('2f332934-1a7c-403c-b4ff-1c5d43cb0949', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:48.294025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:48.304069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb7b710c-e630-4c18-9021-37c1201eaefb tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1316 microversion: 2.1 time: 1.438533 Jul 19 19:56:48.309431 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1238/2373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:46 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1316 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:48.314490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-620ea86b-ff57-4d4b-9624-9e1f8cd6e1c6 req-de9eb544-7ee1-4e75-91b5-cec5e53d5700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-plugged", "status": "completed", "tag": "56276e80-31cc-4077-9aa3-4204c4ca4a68"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:48.335566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-620ea86b-ff57-4d4b-9624-9e1f8cd6e1c6 req-de9eb544-7ee1-4e75-91b5-cec5e53d5700 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.338420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-620ea86b-ff57-4d4b-9624-9e1f8cd6e1c6 req-de9eb544-7ee1-4e75-91b5-cec5e53d5700 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.358162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-620ea86b-ff57-4d4b-9624-9e1f8cd6e1c6 req-de9eb544-7ee1-4e75-91b5-cec5e53d5700 service nova] Creating event network-vif-plugged:56276e80-31cc-4077-9aa3-4204c4ca4a68 for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:56:48.363310 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-620ea86b-ff57-4d4b-9624-9e1f8cd6e1c6 req-de9eb544-7ee1-4e75-91b5-cec5e53d5700 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052391 Jul 19 19:56:48.364310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1239/2374] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:48.378293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:48.379241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:48.389591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.390049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.391268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.392115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.999697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.015418 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-679c5a40-92da-4ab2-bbf9-fa958254e422 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1504 microversion: 2.1 time: 0.648060 Jul 19 19:56:49.020019 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1240/2375] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:48 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:49.042284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:49.063163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:49.111371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.112492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.114242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.115414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.832953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.835384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:49.846517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-84ef5d17-6b9a-4c08-a61e-45ff6b489d23 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1475 microversion: 2.1 time: 0.824757 Jul 19 19:56:49.850681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1241/2376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1475 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:49.863717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:49.864851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:49.875565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.878495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.879064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.879535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.274558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:50.275033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:50.275459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:50.275902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:50.276321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:50.299332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.301400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.303166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.303891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.317918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:50.327670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:50.333546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:50.341733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92ad54f8-bb43-4376-a819-c6da0492e778 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1706 microversion: 2.42 time: 0.489717 Jul 19 19:56:50.346147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1242/2377] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1706 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:50.360631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:50.368201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.368827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.369277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:50.384471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.388478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.389485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.392068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.397826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:50.406520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:50.494700 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17da4084-7362-4e84-8b1c-20010074a893 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.759466 Jul 19 19:56:50.505396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1136/2378] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 2771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:56:50.524864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.526264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] [instance: 9346d85d-3aec-4429-902c-7b41797031e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.539215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.540134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.541885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.543522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.570379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] HTTP exception thrown: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Request method failure captured: Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 HTTP/1.1 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxJRdlPDJzYSQ_8dMtxS8_ML--V0aklNKkwukf6LWi43kjdNE6AArHqVJ1FFgsbjvoqR762sRMys7IY-ctyJ39WdV7BeXNUVbHFJ1mCcOsQfbVBcecQ_85n_EsyPfWIqLIDW_U1lLKYiuVvuhgatov74r33I5hmAVTC2F9pzLrOuC4 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.26 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 30387df2e69449cdb726c6e9392bacfb Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerTagsTestJSON-863899097 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30387df2e69449cdb726c6e9392bacfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/30387df2e69449cdb726c6e9392bacfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30387df2e69449cdb726c6e9392bacfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_30387df2e69449cdb726c6e9392bacfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerTagsTestJSON-863899097 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 30387df2e69449cdb726c6e9392bacfb Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerTagsTestJSON-863899097 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerTagsTestJSON-863899097-project Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 48684c5137c84514b2f2d08f520f9356 Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerTagsTestJSON-863899097-project Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9346d85d-3aec-4429-902c-7b41797031e9'} Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:50.573854 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] Returning 404 to user: Instance 9346d85d-3aec-4429-902c-7b41797031e9 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:50.579383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f81ace20-eb48-430c-8f01-41078d180e3a tempest-ServerTagsTestJSON-863899097 tempest-ServerTagsTestJSON-863899097-project] 10.222.0.33 "GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9" status: 404 len: 111 microversion: 2.26 time: 0.067733 Jul 19 19:56:50.580531 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1137/2379] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/9346d85d-3aec-4429-902c-7b41797031e9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:50.591507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-18eae509-3229-4ee6-b581-b8ede6516483 req-b5cbbc79-ff6a-4146-b652-3fa4cabbd6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9346d85d-3aec-4429-902c-7b41797031e9", "name": "network-vif-deleted", "tag": "ddf5c154-cd3f-4b9d-a929-a0dfd509c458"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:50.604293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18eae509-3229-4ee6-b581-b8ede6516483 req-b5cbbc79-ff6a-4146-b652-3fa4cabbd6df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.608422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18eae509-3229-4ee6-b581-b8ede6516483 req-b5cbbc79-ff6a-4146-b652-3fa4cabbd6df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.642166 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-18eae509-3229-4ee6-b581-b8ede6516483 req-b5cbbc79-ff6a-4146-b652-3fa4cabbd6df service nova] Creating event network-vif-deleted:ddf5c154-cd3f-4b9d-a929-a0dfd509c458 for instance 9346d85d-3aec-4429-902c-7b41797031e9 on n-h2-843861-3 Jul 19 19:56:50.650150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-18eae509-3229-4ee6-b581-b8ede6516483 req-b5cbbc79-ff6a-4146-b652-3fa4cabbd6df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067275 Jul 19 19:56:50.651435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1138/2380] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:50.660126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.662659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.678229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.679002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.680078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.681054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.723560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:50.883653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b979fce9-cf52-466f-bd4a-3e9e1dd966ef tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 204 len: 0 microversion: 2.1 time: 0.228895 Jul 19 19:56:50.885174 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1139/2381] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:50 2022] DELETE /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:50.899663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.906411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.919558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.920447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.922278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.923498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.174113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.184651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-464fd4cd-63dd-444a-9e5c-5ae5f7696c08 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 0.837068 Jul 19 19:56:51.188565 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1243/2382] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:51.206784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-plugged", "status": "completed", "tag": "aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b"}, {"server_uuid": "ac30449f-cdc3-486c-be12-80e5ba5a1435", "name": "network-vif-plugged", "status": "completed", "tag": "b6317aa3-21e7-4699-83b2-a29c292a5b99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:51.247342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.249190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.293022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] Creating event network-vif-plugged:aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:56:51.293534 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] Creating event network-vif-plugged:b6317aa3-21e7-4699-83b2-a29c292a5b99 for instance ac30449f-cdc3-486c-be12-80e5ba5a1435 on n-h1-843861-3 Jul 19 19:56:51.336050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-598650a1-9a70-4e7b-a048-8a75e084fe39 req-5616ffe4-77a8-4372-a2e9-056d2190e93b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.142757 Jul 19 19:56:51.336985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1244/2383] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:51.354668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.355385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:51.377463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.377922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.378711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.379147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.861731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.871012 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ccf9107-d694-4c5a-8722-b92461ba4b34 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1242 microversion: 2.1 time: 0.532763 Jul 19 19:56:51.871609 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1245/2384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1242 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:51.911401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.913341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:51.922202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.923235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.936624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.937608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.144241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:52.158653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d4b6e8b-60e0-463c-a94f-c06bf7abafe0 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1316 microversion: 2.1 time: 1.270471 Jul 19 19:56:52.165589 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1140/2385] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1316 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:52.181691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.183907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:52.198320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.201022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.202360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.202878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.467297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:52.509986 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c9048cb-7707-4662-bdc2-0d082f3e4b84 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1475 microversion: 2.1 time: 0.624636 Jul 19 19:56:52.520786 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1246/2386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1475 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:52.531006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.531618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:52.553981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.554892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.555536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.556194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:53.194514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:53.349283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:53.360859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56c89229-1b3c-4911-804d-9c932c2875b8 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1510 microversion: 2.1 time: 1.194082 Jul 19 19:56:53.371998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1141/2387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:52 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1510 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:53.376926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:53.377543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:53.389174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:53.389969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:53.390946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:53.395963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.081825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:54.098141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:54.099893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:54.101208 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a30dcae9-10e4-45e9-8da4-35d2b0fc4303 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1752 microversion: 2.42 time: 1.574128 Jul 19 19:56:54.102268 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1247/2388] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:52 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1752 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:54.115661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "name": "network-vif-unplugged", "status": "completed", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}, {"name": "network-changed", "server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:54.144531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.147036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.178782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Creating event network-vif-unplugged:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h2-843861-3 Jul 19 19:56:54.187661 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Creating event network-changed:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h2-843861-3 Jul 19 19:56:54.211862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:56:54.254858 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f52fb565-4bd2-4e92-b436-3aed0eb4b8f1 req-ea0f954b-50ff-449e-b6e1-9f2c033bea7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.149612 Jul 19 19:56:54.255504 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1248/2389] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:54.263674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:54.264452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:54.289448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.289896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.290676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.291106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.441205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:54.454245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6fff45f2-e26b-4b20-bea5-0f95443009d9 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1334 microversion: 2.1 time: 1.079045 Jul 19 19:56:54.454906 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1142/2390] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:53 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1334 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:54.464841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:54.466412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:54.480303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.481040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.482423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.483013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.512758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:54.526166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eda50db4-aeab-42bc-aa7f-9d9b36e5ca1b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1296 microversion: 2.1 time: 0.266147 Jul 19 19:56:54.528154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:54.529371 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1249/2391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:54 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1296 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:54.544282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:54.545284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:54.560455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.563896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.565362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.566039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:55.231217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:55.246165 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6bed5f5-33d7-496a-bf58-1281c0c4f620 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1466 microversion: 2.1 time: 0.787303 Jul 19 19:56:55.246986 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1143/2392] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:54 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1466 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:55.251766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:55.255427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:55.274494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:55.274956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:55.275747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:55.276204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:55.764339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:55.775401 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b582118b-c830-4fcf-9cae-b506be528462 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1475 microversion: 2.1 time: 1.244662 Jul 19 19:56:55.777387 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1250/2393] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:54 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1475 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:55.853222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Action: 'create', calling method: .version_select at 0x7fb88d1c35e0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:55.869784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Getting quotas for project b2dc3bdfd9a941e7a8db2d2c51377c8e. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:55.876008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Getting quotas for user 3e3d073a1efb4ea48c2b5f5928c1ebfc and project b2dc3bdfd9a941e7a8db2d2c51377c8e. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:55.943872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Getting quotas for project b2dc3bdfd9a941e7a8db2d2c51377c8e. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:55.960291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Getting quotas for user 3e3d073a1efb4ea48c2b5f5928c1ebfc and project b2dc3bdfd9a941e7a8db2d2c51377c8e. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:55.985443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1c978ef-2c75-4013-b0ff-c483b3c83c99 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.206770 Jul 19 19:56:55.991655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1251/2394] 10.222.0.33 () {62 vars in 1213 bytes} [Tue Jul 19 19:56:55 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:56:55.997661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:55.998833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:56.013085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:56.013756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:56.014744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:56.015375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:56.500496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5429b0615c8b477e9691fb7563f1b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265fde847b25422b8cb68a076b96a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:56.517119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b33c877-0032-43fb-b091-a82192eb8eb7 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 200 len: 1510 microversion: 2.1 time: 1.268559 Jul 19 19:56:56.517768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1144/2395] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:55 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 1510 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:56.841839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-155974564", "block_migration": true, "disk_over_commit": false}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:56.843137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:56.860299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:56.863796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:56.867666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:56.870184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.199857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lazy-loading 'flavor' on Instance uuid ac30449f-cdc3-486c-be12-80e5ba5a1435 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:57.215768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Going to try to live migrate instance to tempest-host-155974564 {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:56:57.238180 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] HTTP exception thrown: Compute host tempest-host-155974564 could not be found. Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Request method failure captured: Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435/action HTTP/1.1 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 106 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxtJqMgBDSD28i_EckQIdtdgwg8s8WrvoBOKsQ_q3_OXxduy2kUzo8TdDyqZ8Gqp7US8J3jcrOUJ2N0b1IT1pKvNW71_OZDKJBZnlPx-rnXTOFk764-XruD9_Uhu5mR8Bl2CjfPD0cuGW1jlIHNUQ1dQLql2K53zmpWf228TBU8_Qw Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a9376937664e4240ade2a20b01b91bfb Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a9376937664e4240ade2a20b01b91bfb Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveMigrationNegativeTest-1719371783-project-admin Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: c70bab1407784ad3a658129b10e85d4d Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveMigrationNegativeTest-1719371783-project-admin Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: {"os-migrateLive": {"host": "tempest-host-155974564", "block_migration": true, "disk_over_commit": false}} Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: exception: Compute host tempest-host-155974564 could not be found. Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ac30449f-cdc3-486c-be12-80e5ba5a1435', 'body': {'os-migrateLive': {'host': 'tempest-host-155974564', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 19 19:56:57.252913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-155974564 could not be found. Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-155974564 could not be found. Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-155974564 could not be found. Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Returning 400 to user: Compute host tempest-host-155974564 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91ae2f67-b9bc-4caa-b06b-79e09142e1e9 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435/action" status: 400 len: 99 microversion: 2.1 time: 0.735778 Jul 19 19:56:57.256444 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1145/2396] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Jul 19 19:56:56 2022] POST /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435/action => generated 99 bytes in 737 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:56:57.268078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.268895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:57.285114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.285730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.286791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.287375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.456209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.472372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.476217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.478006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dee962d9-41af-49db-9ee8-47a0d729c789 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1844 microversion: 2.42 time: 1.485064 Jul 19 19:56:57.479628 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1252/2397] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:55 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1844 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:57.484859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.485652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:57.511786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.513159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.514109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.514688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.658100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.670649 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-573d05fa-9945-4a1e-9d57-61bae0dbbaf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1296 microversion: 2.1 time: 0.188940 Jul 19 19:56:57.671337 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1253/2398] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:57.679278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e70f2552-b84a-412a-96bb-3cc3a685ac11 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.759070 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e70f2552-b84a-412a-96bb-3cc3a685ac11 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.086070 Jul 19 19:56:57.759944 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1254/2399] 10.222.0.33 () {60 vars in 1192 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:56:57.866771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.879691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6bcb1e1c-ed62-4c43-92c0-97cee0b2aaec tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1667 microversion: 2.1 time: 0.623194 Jul 19 19:56:57.880339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1146/2400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1667 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:57.890394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.891085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:57.904366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dc43c625-8e5d-4ae7-a4bb-1f7e8f3e45aa req-bf2a047f-35d3-43af-aa22-d7cb9425efb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "10eb8c5f-4234-4b19-9634-f11411db5e67"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:57.905035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.905488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.906296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.906694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.922089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc43c625-8e5d-4ae7-a4bb-1f7e8f3e45aa req-bf2a047f-35d3-43af-aa22-d7cb9425efb9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.925439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc43c625-8e5d-4ae7-a4bb-1f7e8f3e45aa req-bf2a047f-35d3-43af-aa22-d7cb9425efb9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.954054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dc43c625-8e5d-4ae7-a4bb-1f7e8f3e45aa req-bf2a047f-35d3-43af-aa22-d7cb9425efb9 service nova] Creating event network-changed:10eb8c5f-4234-4b19-9634-f11411db5e67 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:56:57.959801 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dc43c625-8e5d-4ae7-a4bb-1f7e8f3e45aa req-bf2a047f-35d3-43af-aa22-d7cb9425efb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195642 Jul 19 19:56:57.960696 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1255/2401] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:57.967748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.968487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:57.982597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.983423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.984430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.985031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.416146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:58.425286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d9058d8-e5e2-4554-9c9d-3770e3a78f8e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1473 microversion: 2.1 time: 0.543706 Jul 19 19:56:58.426569 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1147/2402] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:58.432224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b1d8b7d8-7ad0-434f-99d5-fd20aef69088 req-401a2171-6584-415b-abaa-c893df25b6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3cd062-1544-477e-9ea7-81aea2483e3d", "name": "network-vif-deleted", "tag": "de133b02-f807-4a45-bc60-a0ef3ec5ead0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:58.441921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b1d8b7d8-7ad0-434f-99d5-fd20aef69088 req-401a2171-6584-415b-abaa-c893df25b6c3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.442591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b1d8b7d8-7ad0-434f-99d5-fd20aef69088 req-401a2171-6584-415b-abaa-c893df25b6c3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.457823 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b1d8b7d8-7ad0-434f-99d5-fd20aef69088 req-401a2171-6584-415b-abaa-c893df25b6c3 service nova] Creating event network-vif-deleted:de133b02-f807-4a45-bc60-a0ef3ec5ead0 for instance 4e3cd062-1544-477e-9ea7-81aea2483e3d on n-h1-843861-3 Jul 19 19:56:58.465287 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b1d8b7d8-7ad0-434f-99d5-fd20aef69088 req-401a2171-6584-415b-abaa-c893df25b6c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037194 Jul 19 19:56:58.466991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1148/2403] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:58.472957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.474795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.489317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.490127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.493319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.493954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.498488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:58.514532 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-21de0418-d110-42ec-b8a8-f83b8350654e tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1466 microversion: 2.1 time: 0.552420 Jul 19 19:56:58.515379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1256/2404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1466 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:58.520620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d HTTP/1.1 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4e3cd062-1544-477e-9ea7-81aea2483e3d'} Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:58.522816 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.527627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.530726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:58.532140 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d0b12dd-d5cf-4355-aa89-72736e883b97 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 404 len: 111 microversion: 2.1 time: 0.063499 Jul 19 19:56:58.533237 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1149/2405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:58.544233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cb5c3ed-5506-49d2-9a07-deb4b0340e22 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.566546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.567048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.576680 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cb5c3ed-5506-49d2-9a07-deb4b0340e22 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b" status: 200 len: 235 microversion: 2.64 time: 0.044131 Jul 19 19:56:58.578544 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1257/2406] 10.222.0.33 () {60 vars in 1303 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b => generated 235 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:56:58.582866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.583468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.584547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.585301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.599494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.612571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.626252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.627655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.629239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.629926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.639260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebfbe9b7-2389-4114-8216-828689949faf tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4/ips" status: 200 len: 177 microversion: 2.1 time: 0.104692 Jul 19 19:56:58.640320 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1150/2407] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4/ips => generated 177 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:58.646400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1567533467", "metadata": {"image_type": "test"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:58.647533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.654987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.655662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.656653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.657242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.672987 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d/action HTTP/1.1 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 112 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1567533467", "metadata": {"image_type": "test"}}} Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4e3cd062-1544-477e-9ea7-81aea2483e3d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1567533467', 'metadata': {'image_type': 'test'}}}} Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:56:58.675190 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:56:58.679423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:58.685712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:58.686903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56fcdfed-e48e-4ec5-850f-6a06e5f314d4 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "POST /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d/action" status: 404 len: 111 microversion: 2.1 time: 0.044683 Jul 19 19:56:58.688030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1151/2408] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Jul 19 19:56:58 2022] POST /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:58.692983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-770f6c58-dd7b-4d39-89ab-ca85d1237850 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.740159 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-770f6c58-dd7b-4d39-89ab-ca85d1237850 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b" status: 204 len: 0 microversion: 2.64 time: 0.050835 Jul 19 19:56:58.742911 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1152/2409] 10.222.0.33 () {60 vars in 1306 bytes} [Tue Jul 19 19:56:58 2022] DELETE /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:58.752742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.753551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.780215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.781254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.783058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.783515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.818348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:58.982851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3514d2e-9378-44d7-866c-c87f67113c6a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 204 len: 0 microversion: 2.1 time: 0.237292 Jul 19 19:56:58.988873 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1153/2410] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:58 2022] DELETE /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:58.996804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.997842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:59.017050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.017677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.018748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.019378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.372259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.403041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.412241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.414408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.416038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7181363d-89ac-47ee-9b0c-a100872e9a9a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1844 microversion: 2.42 time: 0.835257 Jul 19 19:56:59.419249 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1258/2411] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1844 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:59.425645 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5eb8082e-70be-4e08-b84f-478d07091778 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 0.435121 Jul 19 19:56:59.426994 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1154/2412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:59.435997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1997908965", "metadata": {"image_type": "test"}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:59.435997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Failed to fetch instance by id tempest-invalid-349284203 {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:56:59.435997 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance tempest-invalid-349284203 could not be found. Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/tempest-invalid-349284203/action HTTP/1.1 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 112 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1997908965", "metadata": {"image_type": "test"}}} Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance tempest-invalid-349284203 could not be found. Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'tempest-invalid-349284203', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1997908965', 'metadata': {'image_type': 'test'}}}} Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-349284203 could not be found. Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-349284203 could not be found. Jul 19 19:56:59.436665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-349284203 could not be found. Jul 19 19:56:59.440952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.443795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d2163ae-2f76-45a1-bf06-6fd6fe7fcc72 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:59.453733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance tempest-invalid-349284203 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:59.454269 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3d2163ae-2f76-45a1-bf06-6fd6fe7fcc72 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] HTTP exception thrown: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. Jul 19 19:56:59.455094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64de4926-7d9b-4138-9c68-ff3521d128de tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-349284203/action" status: 404 len: 100 microversion: 2.1 time: 0.032388 Jul 19 19:56:59.456191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1259/2413] 10.222.0.33 () {60 vars in 1245 bytes} [Tue Jul 19 19:56:59 2022] POST /compute/v2.1/servers/tempest-invalid-349284203/action => generated 100 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:59.463177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1395391214", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d2163ae-2f76-45a1-bf06-6fd6fe7fcc72 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Request method failure captured: Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b HTTP/1.1 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyGFGfT6PAvTGttjt-JdCdK_f-nJfTulOal8JMDw8r37Nyse0qC2VMG1g4Ewcgo3qI-Nuaoz8GJThYRSl4C69fjKSUGaitJy9XLiz7zeZhYGieVb6sPSEqitSJX-tVaSX2r7cBb3bQtMrKzC7UPo9Q6iXlI9h4mWTwhmr3rzKB2PQc Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.64 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: b2dc3bdfd9a941e7a8db2d2c51377c8e Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerGroup264TestJSON-1155037975 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2dc3bdfd9a941e7a8db2d2c51377c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2dc3bdfd9a941e7a8db2d2c51377c8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2dc3bdfd9a941e7a8db2d2c51377c8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2dc3bdfd9a941e7a8db2d2c51377c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerGroup264TestJSON-1155037975 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: b2dc3bdfd9a941e7a8db2d2c51377c8e Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1155037975 Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerGroup264TestJSON-1155037975-project Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3e3d073a1efb4ea48c2b5f5928c1ebfc Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerGroup264TestJSON-1155037975-project Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b'} Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.465693 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. Jul 19 19:56:59.470590 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:56:59.473480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d2163ae-2f76-45a1-bf06-6fd6fe7fcc72 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] Returning 404 to user: Instance group bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:59.474521 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d2163ae-2f76-45a1-bf06-6fd6fe7fcc72 tempest-ServerGroup264TestJSON-1155037975 tempest-ServerGroup264TestJSON-1155037975-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b" status: 404 len: 117 microversion: 2.64 time: 0.036487 Jul 19 19:56:59.475627 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1155/2414] 10.222.0.33 () {60 vars in 1306 bytes} [Tue Jul 19 19:56:59 2022] DELETE /compute/v2.1/os-server-groups/bb8c8ebf-a9a6-4381-aa9b-79fd7abd417b => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:59.496871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:59.511517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:59.544781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.545600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.546604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.547155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.549545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:59.976351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.986861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b54be4d-fb66-40b3-b0eb-76a2a4453a5e tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1673 microversion: 2.1 time: 0.509104 Jul 19 19:56:59.996891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1156/2415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:59 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1673 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:00.002748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:00.009329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:00.038092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.039357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.040488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.047603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.319274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:00.384244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=14 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:00.805140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:00.806718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:00.809488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:00.811069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:00.812479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:00.834970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.835679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.839106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.840293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.860738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:00.871587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Getting quotas for project 2ce3737accb04d11895d234c9a12d93a. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:00.894473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Getting quotas for user ff8555d74017437e81b8b448ba745959 and project 2ce3737accb04d11895d234c9a12d93a. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:00.924093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:00.928795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:00.999264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.010949 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c9f7d6b-f640-4c4f-861c-f2ccb0f42ede tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1473 microversion: 2.1 time: 1.012185 Jul 19 19:57:01.014000 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1157/2416] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:59 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1473 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:01.040902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1368882457"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:01.041498 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9845aea-4119-4729-8745-004930a9f527 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582090 Jul 19 19:57:01.042569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:57:01.043085 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:01.043868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1260/2417] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 57 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: {"createImage": {"name": "tempest-test-snap-1368882457"}} Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1368882457'}}} Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:01.056041 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:01.060052 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:01.062070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:01.062160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:01.062160 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73e7b624-cf29-4686-833a-f98619f9b05d tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.033061 Jul 19 19:57:01.062160 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1158/2418] 10.222.0.33 () {60 vars in 1274 bytes} [Tue Jul 19 19:57:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:01.062366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:01.067376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.068423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.069976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.070396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.073045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:01.073678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:01.089180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.089650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.090469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.090906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.368226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.425921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.436420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.443640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.451223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d74af82-3029-406c-b50a-3b5f8dd046e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1865 microversion: 2.42 time: 1.405834 Jul 19 19:57:02.452092 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1261/2419] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:01 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1865 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:02.457006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:02.472741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:02.481944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.482721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.483721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.484407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.485815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0672f21f-12fc-452c-8083-afd833da26d9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 1.413155 Jul 19 19:57:02.486473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1159/2420] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:01 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:02.563608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:02.565695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:02.626043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.629052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.642612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.645239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.960757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.971556 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-11f36c39-3f9d-4322-8479-bc95e4ab6bd9 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1271 microversion: 2.1 time: 0.460606 Jul 19 19:57:02.974219 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1160/2421] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:02 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1271 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:02.984715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1759116023"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:02.990228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:57:02.991103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 57 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: {"createImage": {"name": "tempest-test-snap-1759116023"}} Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1759116023'}}} Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:02.992923 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:57:02.996866 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.001394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:03.002494 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-63dd74f2-8028-45f2-8f67-08ee78144a9c tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027093 Jul 19 19:57:03.010036 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1161/2422] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Jul 19 19:57:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:03.019242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-25db6ee1-77e1-44c3-85c9-82c322d72e19 req-54b85cee-9432-4a11-bf87-dce74356bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "9ec19e57-4422-4712-8bdb-fa8bd72353c0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:03.046055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-25db6ee1-77e1-44c3-85c9-82c322d72e19 req-54b85cee-9432-4a11-bf87-dce74356bb01 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.046852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-25db6ee1-77e1-44c3-85c9-82c322d72e19 req-54b85cee-9432-4a11-bf87-dce74356bb01 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.071217 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-25db6ee1-77e1-44c3-85c9-82c322d72e19 req-54b85cee-9432-4a11-bf87-dce74356bb01 service nova] Creating event network-changed:9ec19e57-4422-4712-8bdb-fa8bd72353c0 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:03.077515 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-25db6ee1-77e1-44c3-85c9-82c322d72e19 req-54b85cee-9432-4a11-bf87-dce74356bb01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064521 Jul 19 19:57:03.078880 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1162/2423] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:03.103372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:03.104473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:03.121197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.122471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.126676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.127434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.408945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:03.429203 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a22a033-63ac-41e2-bab4-123e9341982f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1673 microversion: 2.1 time: 0.975434 Jul 19 19:57:03.439457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1262/2424] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:02 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1673 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:03.454036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:03.454779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:03.467703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.473100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.478768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.480630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.571903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d HTTP/1.1 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4e3cd062-1544-477e-9ea7-81aea2483e3d'} Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:03.574688 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65b8f965-befa-4846-a5e8-e68f5ab7f113 tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 404 len: 111 microversion: 2.1 time: 0.134729 Jul 19 19:57:03.578564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1263/2425] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:03 2022] DELETE /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:03.598848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:03.599444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:03.615970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.616456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.619537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.620650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.758276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:04.770312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8ddee42-4ad5-46b5-bbfe-9ebea6c6a775 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1470 microversion: 2.1 time: 1.689052 Jul 19 19:57:04.771615 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1163/2426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:03 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1470 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:04.776458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.777299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:04.784470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.785007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.785868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.786374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.361421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:05.380761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:05.385602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:05.391402 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-336c7995-360c-4969-8338-0fbf060ef4e8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1886 microversion: 2.42 time: 1.803401 Jul 19 19:57:05.393004 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1264/2427] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:03 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1886 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:05.422178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:05.424150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] [instance: 4e3cd062-1544-477e-9ea7-81aea2483e3d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:05.441801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.446226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.447659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.448654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.509023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] HTTP exception thrown: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Request method failure captured: Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d HTTP/1.1 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxjtfY8PQCqrk4Q6yKztHZPygsqmOzFcakdYhvyCk1rHQgugj6NhZcUor-qOr9L8-bKeaORiarahp6nVGsIwIShdGlNowes52vPqmTOc_NBdGBuiJkxTK47sCK-23FCanLdPPn_saBgCC9Pue45dzN0Y7hlyvQdkcfLmhuhKjhg_Ds Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/265fde847b25422b8cb68a076b96a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/265fde847b25422b8cb68a076b96a003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_265fde847b25422b8cb68a076b96a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 265fde847b25422b8cb68a076b96a003 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-649284190 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5429b0615c8b477e9691fb7563f1b636 Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesNegativeTestJSON-649284190-project Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4e3cd062-1544-477e-9ea7-81aea2483e3d'} Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:05.513874 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] Returning 404 to user: Instance 4e3cd062-1544-477e-9ea7-81aea2483e3d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:05.520021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a31e8b98-0189-4c76-a522-921aeccbeeec tempest-ImagesNegativeTestJSON-649284190 tempest-ImagesNegativeTestJSON-649284190-project] 10.222.0.33 "GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d" status: 404 len: 111 microversion: 2.1 time: 0.121317 Jul 19 19:57:05.524665 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1265/2428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:05 2022] GET /compute/v2.1/servers/4e3cd062-1544-477e-9ea7-81aea2483e3d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:05.536885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c0560f1d-ec19-41ce-bd0b-23446dca94d3 req-49ce77bb-5662-4a18-a53c-ba9a2faf22db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-unplugged", "status": "completed", "tag": "56276e80-31cc-4077-9aa3-4204c4ca4a68"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:05.562758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c0560f1d-ec19-41ce-bd0b-23446dca94d3 req-49ce77bb-5662-4a18-a53c-ba9a2faf22db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.563242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c0560f1d-ec19-41ce-bd0b-23446dca94d3 req-49ce77bb-5662-4a18-a53c-ba9a2faf22db service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.583273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:05.609324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c0560f1d-ec19-41ce-bd0b-23446dca94d3 req-49ce77bb-5662-4a18-a53c-ba9a2faf22db service nova] Creating event network-vif-unplugged:56276e80-31cc-4077-9aa3-4204c4ca4a68 for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:57:05.622609 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c0560f1d-ec19-41ce-bd0b-23446dca94d3 req-49ce77bb-5662-4a18-a53c-ba9a2faf22db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094421 Jul 19 19:57:05.624016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1266/2429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:05.630678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:05.631749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:05.641074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.642015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.643131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.644108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.819883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:05.828728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:05.847396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad72a45b-f16d-4a5e-ac70-d0c5646be364 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 1.074435 Jul 19 19:57:05.848600 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1164/2430] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:05.853746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:05.855220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:05.871478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.872343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.873617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.874277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.943274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:05.956893 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-556e0d81-2497-4bb4-b1b7-3e4dc3211e03 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1277 microversion: 2.1 time: 0.330992 Jul 19 19:57:05.971422 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1267/2431] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:05 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1277 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:05.983718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:05.985633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:06.005526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.006337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.007428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.008210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.147245 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07d2c30b-81a7-47f5-bc6c-991191220adf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804/action" status: 204 len: 0 microversion: 2.1 time: 0.172999 Jul 19 19:57:06.149407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1268/2432] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:57:05 2022] POST /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804/action => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:57:06.162972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "62cb4254-0f56-4249-96e0-c0284ed62939"}, {"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "25a886f2-4fc4-42a5-999f-d6df6ac837e7"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:06.189889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.196378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.246396 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] Creating event network-changed:62cb4254-0f56-4249-96e0-c0284ed62939 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:06.247878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] Creating event network-changed:25a886f2-4fc4-42a5-999f-d6df6ac837e7 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:06.260264 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c2c1d5ef-355c-4bb2-8681-eb80d2ba90d9 req-d971051b-3bdd-443b-82bb-c04dc8a35a33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.106866 Jul 19 19:57:06.262636 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1269/2433] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:06.274803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7c55bb27-90af-4807-bc2f-c9a53e60ff98 req-236e685a-5d66-476b-86a3-c3b33c2460a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-deleted", "tag": "56276e80-31cc-4077-9aa3-4204c4ca4a68"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:06.308404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c55bb27-90af-4807-bc2f-c9a53e60ff98 req-236e685a-5d66-476b-86a3-c3b33c2460a5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.308849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c55bb27-90af-4807-bc2f-c9a53e60ff98 req-236e685a-5d66-476b-86a3-c3b33c2460a5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.340465 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7c55bb27-90af-4807-bc2f-c9a53e60ff98 req-236e685a-5d66-476b-86a3-c3b33c2460a5 service nova] Creating event network-vif-deleted:56276e80-31cc-4077-9aa3-4204c4ca4a68 for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:57:06.351110 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7c55bb27-90af-4807-bc2f-c9a53e60ff98 req-236e685a-5d66-476b-86a3-c3b33c2460a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086430 Jul 19 19:57:06.352590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1270/2434] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:06.370074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:06.370877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:06.389764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.390534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.392690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.393357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.929436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:06.939858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-190eea1f-4e77-414f-8034-528200c21b0a tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1652 microversion: 2.1 time: 1.089935 Jul 19 19:57:06.951722 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1165/2435] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:05 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1652 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:06.957138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:06.957782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:06.969410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.970184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.971173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.971768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.110730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:08.121163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3ac5922-1258-43e1-9263-e23f0a76a5c7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1470 microversion: 2.1 time: 1.764829 Jul 19 19:57:08.123336 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1271/2436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:06 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1470 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:08.139123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:08.140254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:08.149133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.152484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.154408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.157062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.791907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:08.805477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:08.807173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:08.808502 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-826510bf-ecb5-4770-8151-cf603573628c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1886 microversion: 2.42 time: 1.855727 Jul 19 19:57:08.809813 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1166/2437] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:06 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1886 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:08.814963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:08.816180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:08.823705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.824720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.825879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.826514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.136076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:09.160003 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f30ae8e-0852-4ee5-a6cb-d5029335a7d4 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1277 microversion: 2.1 time: 0.348774 Jul 19 19:57:09.172546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1167/2438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:08 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:09.193077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-unplugged", "status": "completed", "tag": "aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b"}, {"server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "name": "network-vif-plugged", "status": "completed", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:09.208657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:09.232533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.238389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.289941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Creating event network-vif-unplugged:aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:57:09.290856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Creating event network-vif-plugged:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h2-843861-3 Jul 19 19:57:09.304985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:57:09.319483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-929a3a74-48c9-482b-80d1-1537c5f6301a req-7df08638-df03-4273-b43c-06cbc01b7cb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.145414 Jul 19 19:57:09.320822 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1168/2439] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:09.326231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:09.327732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:09.335399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.336279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.337225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.338680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.464308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:09.476952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7694a5d8-ccbf-4c22-9580-be27523b8712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 1.349806 Jul 19 19:57:09.477942 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1272/2440] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:09.492280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-251afdc1-0703-412d-92ae-1d844d510a7c req-82c4b5ad-344d-4690-96e1-670e69f11344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "b9c467c3-a29f-41aa-a758-bb0988ff2ffe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:09.509682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-251afdc1-0703-412d-92ae-1d844d510a7c req-82c4b5ad-344d-4690-96e1-670e69f11344 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.516435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-251afdc1-0703-412d-92ae-1d844d510a7c req-82c4b5ad-344d-4690-96e1-670e69f11344 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.542053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-251afdc1-0703-412d-92ae-1d844d510a7c req-82c4b5ad-344d-4690-96e1-670e69f11344 service nova] Creating event network-changed:b9c467c3-a29f-41aa-a758-bb0988ff2ffe for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:09.550846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-251afdc1-0703-412d-92ae-1d844d510a7c req-82c4b5ad-344d-4690-96e1-670e69f11344 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071866 Jul 19 19:57:09.551527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1273/2441] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:09.556936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-418c95a8-2f9e-47b3-83b0-95a44a4bc4d7 req-89551bb4-aadc-46e5-84fc-93dc50037cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:09.577786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-418c95a8-2f9e-47b3-83b0-95a44a4bc4d7 req-89551bb4-aadc-46e5-84fc-93dc50037cfd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.578293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-418c95a8-2f9e-47b3-83b0-95a44a4bc4d7 req-89551bb4-aadc-46e5-84fc-93dc50037cfd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.606939 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-418c95a8-2f9e-47b3-83b0-95a44a4bc4d7 req-89551bb4-aadc-46e5-84fc-93dc50037cfd service nova] Creating event network-changed:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:57:09.619224 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-418c95a8-2f9e-47b3-83b0-95a44a4bc4d7 req-89551bb4-aadc-46e5-84fc-93dc50037cfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065960 Jul 19 19:57:09.622025 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1274/2442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:09.627728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:09.628716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:09.636195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.636864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:09.637785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:09.638391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:10.855869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:10.871444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:10.883028 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-03a6ace4-53dd-4cf7-b752-3b541e5310bc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1470 microversion: 2.1 time: 1.259037 Jul 19 19:57:10.884373 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1275/2443] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:09 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1470 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:10.899443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:10.901485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:10.914425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=14 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:10.916989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:10.918180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:10.919196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:10.919876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.517048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.525574 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f9c19d3-6899-4c9a-af41-5a96b1c1272f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1496 microversion: 2.1 time: 2.203340 Jul 19 19:57:11.526180 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1169/2444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:09 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1496 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:11.532302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:11.533138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:11.540280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.540952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.541977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.542421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.780442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.850078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.856889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.871738 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc68eb4e-79ef-4a72-aee8-fa5c2ef32875 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1886 microversion: 2.42 time: 0.983192 Jul 19 19:57:11.873943 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1276/2445] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:10 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1886 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:11.881814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:11.883136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:11.894084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.897115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.899411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.900107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.447683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.463985 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36ba80b1-d613-4e5a-bdeb-1c254211de72 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 0.935198 Jul 19 19:57:12.463985 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1170/2446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:11 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:12.478544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "c2450f7b-c16c-416e-81b1-d3a77677dc49"}, {"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "2703f954-a397-43a4-9e17-81870da81876"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:12.514378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.514836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.548115 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] Creating event network-changed:c2450f7b-c16c-416e-81b1-d3a77677dc49 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:12.548772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] Creating event network-changed:2703f954-a397-43a4-9e17-81870da81876 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:57:12.565754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5a45e19f-6fa0-43c6-81e7-52f7189068a7 req-07517976-fcbd-459e-9031-2f20a6c674bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091220 Jul 19 19:57:12.566755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1171/2447] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:12.574055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:12.575294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:12.602141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.602611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.603423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.603931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.854208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.866417 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0268b359-d750-4bb4-9d5c-687af439e4fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 0.991109 Jul 19 19:57:12.867100 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1277/2448] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:11 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:12.876508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7c096886-e234-4d26-a20f-168f69969a06 req-74b2808f-a78c-4d4d-b9a8-2e3bf151c887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9412aed-8303-4a8f-ad88-4136742e0af4", "name": "network-vif-deleted", "tag": "aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:12.898631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c096886-e234-4d26-a20f-168f69969a06 req-74b2808f-a78c-4d4d-b9a8-2e3bf151c887 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.912639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c096886-e234-4d26-a20f-168f69969a06 req-74b2808f-a78c-4d4d-b9a8-2e3bf151c887 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.935731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7c096886-e234-4d26-a20f-168f69969a06 req-74b2808f-a78c-4d4d-b9a8-2e3bf151c887 service nova] Creating event network-vif-deleted:aa2810ab-7d8f-4461-bf40-fe2eb7a6e53b for instance e9412aed-8303-4a8f-ad88-4136742e0af4 on n-h2-843861-3 Jul 19 19:57:12.945364 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7c096886-e234-4d26-a20f-168f69969a06 req-74b2808f-a78c-4d4d-b9a8-2e3bf151c887 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077078 Jul 19 19:57:12.946579 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1278/2449] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:12.953603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:12.961163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:12.981233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.982027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.983744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.984407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:13.053877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:13.058953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:13.059656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lazy-loading 'fault' on Instance uuid e9412aed-8303-4a8f-ad88-4136742e0af4 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:57:13.261041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:13.266716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59e4b2ee66540fbbb389b87a517b686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f2a7aa83346a39543c724e129480a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:13.275319 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7d1107f-efe4-4569-9f21-7949a5e78779 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1470 microversion: 2.1 time: 0.706199 Jul 19 19:57:13.282817 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cfcbd06-6687-4122-9827-db5bde786f00 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 200 len: 1303 microversion: 2.1 time: 0.334788 Jul 19 19:57:13.283980 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1279/2450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:12 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 1303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:13.286882 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1172/2451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:12 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1470 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:13.290638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:13.294135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:13.309295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:13.309975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:13.310950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:13.314311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:13.480140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:13.480768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:13.491093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:13.491518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:13.492334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:13.496392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.469687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.479936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.481460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.482655 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61257d24-113b-4749-a157-f4451c9641fd tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.197587 Jul 19 19:57:14.483230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1280/2452] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:13 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:14.509446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:14.510531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:14.550423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.551288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.552822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.554774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.897020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.915324 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12a22e9e-c246-4b8a-b288-6266ad1ff2af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 1.439075 Jul 19 19:57:14.918705 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1173/2453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:13 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:14.934199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:14.936884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:14.965683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.966149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.966964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.967442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.661373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.676310 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee629a21-48f1-46ab-9c6f-890d9fcbe371 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 1.190584 Jul 19 19:57:15.678998 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1281/2454] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:14 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:15.704025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:15.706327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:15.714145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.714860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.715873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.716540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.744998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 HTTP/1.1 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e9412aed-8303-4a8f-ad88-4136742e0af4'} Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:15.746809 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5276bc3-a020-4548-9267-cc2a2835dbe0 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 404 len: 111 microversion: 2.1 time: 0.058267 Jul 19 19:57:15.753405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1282/2455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:15 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:15.756862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:15.757579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:15.764967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.766763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.767747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.770595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.869064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.882852 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a3fad90-f577-49e4-a5db-8f1fd886e27d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1462 microversion: 2.1 time: 0.958973 Jul 19 19:57:15.884214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1174/2456] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:14 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1462 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:15.904348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:15.904957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:15.912898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.913835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.914990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.916101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.573620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:16.584205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:16.593643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:16.600290 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4f3da49-1245-4a75-907f-3591431481de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.849134 Jul 19 19:57:16.601182 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1283/2457] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:15 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:16.607320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2717838-5211-4ab3-a0a9-e7ef7d964ef3 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1613 microversion: 2.1 time: 0.708270 Jul 19 19:57:16.608262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.608855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1175/2458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:15 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1613 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:16.608979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:16.630767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.631488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.632532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.633282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.802023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bf583a2-c1f4-4345-88be-c06c99632a2d tempest-ListImageFiltersNegativeTestJSON-1663268329 tempest-ListImageFiltersNegativeTestJSON-1663268329-project] Calling method '.version_select at 0x7fb88d490ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.862710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7bf583a2-c1f4-4345-88be-c06c99632a2d tempest-ListImageFiltersNegativeTestJSON-1663268329 tempest-ListImageFiltersNegativeTestJSON-1663268329-project] HTTP exception thrown: Image not found. Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bf583a2-c1f4-4345-88be-c06c99632a2d tempest-ListImageFiltersNegativeTestJSON-1663268329 tempest-ListImageFiltersNegativeTestJSON-1663268329-project] Request method failure captured: Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/images/852d26d7-9171-4220-b50f-ff29f6c65c46 HTTP/1.1 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wybouKFm_jrpYulg3mYHytLBSggpn4a2dOu-Jqq8sJpuz2ZTNGFgtjrzKtbPgUDifY_aaXZ3s9dGjvLVNnn5nWLtlLFuauNdyzfPN8lxRhaLVlw2FCD1Co9SE3DgjS0BJkbOg7sL059DY9WctsYCrG-cPvSNtqeHmnvf3Th87RnBGU Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 860f128ed4394b05a3c42e99f01ca9aa Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1663268329 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/860f128ed4394b05a3c42e99f01ca9aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/860f128ed4394b05a3c42e99f01ca9aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/860f128ed4394b05a3c42e99f01ca9aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_860f128ed4394b05a3c42e99f01ca9aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1663268329 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 860f128ed4394b05a3c42e99f01ca9aa Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1663268329 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListImageFiltersNegativeTestJSON-1663268329-project Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 14f6bfb3beb04d6e88df02e637d12ad9 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1663268329-project Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '852d26d7-9171-4220-b50f-ff29f6c65c46'} Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 852d26d7-9171-4220-b50f-ff29f6c65c46 Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:57:16.867852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 852d26d7-9171-4220-b50f-ff29f6c65c46 could not be found. Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:57:16.875742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:16.884188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bf583a2-c1f4-4345-88be-c06c99632a2d tempest-ListImageFiltersNegativeTestJSON-1663268329 tempest-ListImageFiltersNegativeTestJSON-1663268329-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:16.888619 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bf583a2-c1f4-4345-88be-c06c99632a2d tempest-ListImageFiltersNegativeTestJSON-1663268329 tempest-ListImageFiltersNegativeTestJSON-1663268329-project] 10.222.0.33 "GET /compute/v2.1/images/852d26d7-9171-4220-b50f-ff29f6c65c46" status: 404 len: 62 microversion: 2.1 time: 0.278391 Jul 19 19:57:16.893110 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1176/2459] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/images/852d26d7-9171-4220-b50f-ff29f6c65c46 => generated 62 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:57:16.905591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a95d4be5-3665-4f93-ba1d-0fbd6db4b1c5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '.version_select at 0x7fb88dbfaaf0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.938012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a95d4be5-3665-4f93-ba1d-0fbd6db4b1c5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.938878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a95d4be5-3665-4f93-ba1d-0fbd6db4b1c5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.953325 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a95d4be5-3665-4f93-ba1d-0fbd6db4b1c5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.057464 Jul 19 19:57:16.954949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1177/2460] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:16.960314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.961363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:16.990575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.993688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.996425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.997132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:17.438894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:17.451603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f95b0b78-5093-407f-bf2c-60b3b2431a2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 0.495136 Jul 19 19:57:17.460638 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1178/2461] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:17.466415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9f20dea9-0c53-4289-a2e5-12703f26ae77 req-cfc35200-ea75-4908-85fe-6d237712e081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8187b549-26ab-471b-93b7-f6da890ccf71", "tag": "8a440e73-f0cc-4392-8be2-90897122aa40"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:17.495263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9f20dea9-0c53-4289-a2e5-12703f26ae77 req-cfc35200-ea75-4908-85fe-6d237712e081 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:17.495705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9f20dea9-0c53-4289-a2e5-12703f26ae77 req-cfc35200-ea75-4908-85fe-6d237712e081 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:17.535195 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9f20dea9-0c53-4289-a2e5-12703f26ae77 req-cfc35200-ea75-4908-85fe-6d237712e081 service nova] Creating event network-changed:8a440e73-f0cc-4392-8be2-90897122aa40 for instance 8187b549-26ab-471b-93b7-f6da890ccf71 on n-h1-843861-3 Jul 19 19:57:17.558484 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9f20dea9-0c53-4289-a2e5-12703f26ae77 req-cfc35200-ea75-4908-85fe-6d237712e081 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093505 Jul 19 19:57:17.558945 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1179/2462] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:17.564855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1574944174", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:17.684652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:18.280755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.317002 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b041bfa-32e2-4c42-8f93-73d91f5c4c60 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 1.712234 Jul 19 19:57:18.329259 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1284/2463] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:18.329259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:18.329259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:18.336685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.337581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.339282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.340060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.928928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.933540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:18.943761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.953810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.955091 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c70ad64e-b4b7-4a2e-8a9f-c41ff665de3c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.630928 Jul 19 19:57:18.955960 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1285/2464] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:18 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:18.963370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:18.968420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:18.975483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.976313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.977328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.978021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.211335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:19.212599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:19.214250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:19.214931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:19.216510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:19.230540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.231489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.232693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.234261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.275512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:19.282075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:19.312229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:19.328512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:19.392084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca824bae-01e0-4e64-81d4-30a44c9a5340 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830840 Jul 19 19:57:19.394870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1180/2465] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:19.405512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:19.406382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:19.415105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.416469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.417534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.418265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.689074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:19.701902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6888f0b7-f6dd-4dea-b5fb-a4c730663f22 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 0.744588 Jul 19 19:57:19.705536 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1286/2466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:18 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:19.723209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4ca8390-66a8-4511-b5bb-a60563323e4b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:19.725413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4ca8390-66a8-4511-b5bb-a60563323e4b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:19.881325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:19.893550 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a1837631-c3e2-49bb-a015-f48aea85374a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 0.497202 Jul 19 19:57:19.905170 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1181/2467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:19 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:19.976551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:19.978095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:19.984303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4ca8390-66a8-4511-b5bb-a60563323e4b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:19.993209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4ca8390-66a8-4511-b5bb-a60563323e4b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1213 microversion: 2.1 time: 0.286327 Jul 19 19:57:19.996848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.997359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.998210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.998501 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1287/2468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:19 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:19.998653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.464979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c142719d-842e-4818-8c12-610b0eb13663 req-4255dd6e-ac45-4f74-8204-f3f03edf5991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-plugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:20.485385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c142719d-842e-4818-8c12-610b0eb13663 req-4255dd6e-ac45-4f74-8204-f3f03edf5991 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.486051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c142719d-842e-4818-8c12-610b0eb13663 req-4255dd6e-ac45-4f74-8204-f3f03edf5991 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.521912 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c142719d-842e-4818-8c12-610b0eb13663 req-4255dd6e-ac45-4f74-8204-f3f03edf5991 service nova] Creating event network-vif-plugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:57:20.542540 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c142719d-842e-4818-8c12-610b0eb13663 req-4255dd6e-ac45-4f74-8204-f3f03edf5991 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081661 Jul 19 19:57:20.544324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1288/2469] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:20.723304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:20.724208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:20.740882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.742861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.746226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.748005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:22.263177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:22.296165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:22.299179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:22.301350 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a7c43f1-4c70-47af-8047-502add28c1c0 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 2.328835 Jul 19 19:57:22.312270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1182/2470] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:19 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:22.324209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:22.325030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:22.338039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.343628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:22.344782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.345392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:22.767341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:22.812433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31d21750-77fb-4778-ab6c-2ff3eb67976f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 2.093775 Jul 19 19:57:22.824247 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1289/2471] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:20 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:22.825010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:22.827329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:22.837088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.838095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:22.839309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.840217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.149402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.175307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f75a79c-1c18-41d5-95cd-66b92237d2ac tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1271 microversion: 2.1 time: 0.349156 Jul 19 19:57:23.190638 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1290/2472] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:22 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1271 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:23.316894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.324714 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-11fa96df-d723-4883-8afa-04df9d4e75ff tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 1.010000 Jul 19 19:57:23.325315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1183/2473] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:22 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:23.326349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.327245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.335969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.337148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.341483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.346758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.354736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.355353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.373739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.374131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.374260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.374964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.382932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 HTTP/1.1 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e9412aed-8303-4a8f-ad88-4136742e0af4'} Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:23.383449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:23.387488 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9889afb2-12ec-4c5c-9c97-8265138c3ae4 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 404 len: 111 microversion: 2.1 time: 0.072210 Jul 19 19:57:23.392843 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1291/2474] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:23 2022] DELETE /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:23.401270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.401898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: e9412aed-8303-4a8f-ad88-4136742e0af4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.417665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.420149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.420970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.421416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.455940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 HTTP/1.1 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e9412aed-8303-4a8f-ad88-4136742e0af4'} Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.457507 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. Jul 19 19:57:23.461398 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.463444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance e9412aed-8303-4a8f-ad88-4136742e0af4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:23.464367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34b29a72-0f53-4bbd-85a3-066c7fd21eae tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4" status: 404 len: 111 microversion: 2.1 time: 0.067745 Jul 19 19:57:23.479963 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1292/2475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:23 2022] GET /compute/v2.1/servers/e9412aed-8303-4a8f-ad88-4136742e0af4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:23.485665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.486477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.494108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.498077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.501558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.502685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.535972 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 HTTP/1.1 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ed911d6c-54b6-4e74-81e9-7095b7553483'} Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:23.544570 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.550553 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.554186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:23.556153 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed580301-bc73-4ed2-a7e4-331f3485a30f tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 404 len: 111 microversion: 2.1 time: 0.074169 Jul 19 19:57:23.557535 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1293/2476] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:23 2022] DELETE /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:23.581476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.584640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] [instance: ed911d6c-54b6-4e74-81e9-7095b7553483] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.597871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.598782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.600125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.600807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.655267 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] HTTP exception thrown: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Request method failure captured: Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 HTTP/1.1 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wv-DXsEdHK1-N3vxiI8Qk60eqhz9k_UF3ZwvurVEgp5TH44c1E87wHBTL0zgHTfloN2wVx8Y48MN0xFl2QWKOCdUvQHWnylB9eKKimQAhbPHKRhbX5XNtXVJjhPy6EA6Pd0V_C7kQHYXSVCYLZ2q5jImipyBwhfDjgYDALvoRC8Qfk Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/702f2a7aa83346a39543c724e129480a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/702f2a7aa83346a39543c724e129480a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_702f2a7aa83346a39543c724e129480a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 702f2a7aa83346a39543c724e129480a Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestMultiNic-408515045 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: a59e4b2ee66540fbbb389b87a517b686 Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestMultiNic-408515045-project Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ed911d6c-54b6-4e74-81e9-7095b7553483'} Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:23.660211 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. Jul 19 19:57:23.667564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:23.668597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] Returning 404 to user: Instance ed911d6c-54b6-4e74-81e9-7095b7553483 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:23.668750 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6b6b785-26c9-4c79-8dea-218069121484 tempest-ServersTestMultiNic-408515045 tempest-ServersTestMultiNic-408515045-project] 10.222.0.33 "GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483" status: 404 len: 111 microversion: 2.1 time: 0.107063 Jul 19 19:57:23.669661 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1294/2477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:23 2022] GET /compute/v2.1/servers/ed911d6c-54b6-4e74-81e9-7095b7553483 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:23.786126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c55fa8a0-a0e0-43e1-af64-aebcae0571f6 req-e005bef5-e28c-4ae3-b43b-143048d7a482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8187b549-26ab-471b-93b7-f6da890ccf71", "name": "network-vif-plugged", "status": "completed", "tag": "8a440e73-f0cc-4392-8be2-90897122aa40"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:23.804078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c55fa8a0-a0e0-43e1-af64-aebcae0571f6 req-e005bef5-e28c-4ae3-b43b-143048d7a482 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.804796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c55fa8a0-a0e0-43e1-af64-aebcae0571f6 req-e005bef5-e28c-4ae3-b43b-143048d7a482 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.836426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c55fa8a0-a0e0-43e1-af64-aebcae0571f6 req-e005bef5-e28c-4ae3-b43b-143048d7a482 service nova] Creating event network-vif-plugged:8a440e73-f0cc-4392-8be2-90897122aa40 for instance 8187b549-26ab-471b-93b7-f6da890ccf71 on n-h1-843861-3 Jul 19 19:57:23.851997 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c55fa8a0-a0e0-43e1-af64-aebcae0571f6 req-e005bef5-e28c-4ae3-b43b-143048d7a482 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064609 Jul 19 19:57:23.851997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1295/2478] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:23.856769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.857634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.866598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.867250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.897660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.898564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:24.643348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:24.657031 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c74339c5-1317-4c14-8a6f-8587a27155b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1364 microversion: 2.1 time: 0.806795 Jul 19 19:57:24.661167 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1296/2479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:23 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1364 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:24.677358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:24.679946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:24.708099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:24.708886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:24.709843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:24.710384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.196073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:25.207931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:25.209961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:25.211342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fa34822-10da-455c-8aa8-6be9b8ed3920 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.861083 Jul 19 19:57:25.223358 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1184/2480] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:23 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:25.229124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:25.230004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:25.236802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.237543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.238511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.239112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.270249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:25.426343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:25.440467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df0f66e4-d584-4d02-b9fe-e0714018b86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1271 microversion: 2.1 time: 0.773047 Jul 19 19:57:25.445312 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1297/2481] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:24 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1271 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:25.678947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:25.679499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:25.691286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.691739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.692546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.696126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:26.682464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:26.710852 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09f0cfe3-c413-4024-92f2-878e9e9cb450 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1319 microversion: 2.1 time: 1.483204 Jul 19 19:57:26.711699 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1185/2482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:25 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1319 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:26.727301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:26.731221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:26.757396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:26.761596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:26.762439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:26.762875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.183171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.195670 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4d9a6b1-2997-477c-a999-41719bf29fe6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1550 microversion: 2.1 time: 1.520828 Jul 19 19:57:27.196310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1298/2483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:25 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1550 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:27.236060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:27.248389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:27.267858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:27.268321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.269109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:27.269545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.517243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.532725 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6542c87b-e495-4dfe-8c61-77f374416d24 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1271 microversion: 2.1 time: 0.335106 Jul 19 19:57:27.533323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1299/2484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:27 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:27.547909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:27.548892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:27.562043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:27.562990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.564347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:27.565160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.963543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.979736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.981658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.983593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1406dd17-e7f7-4626-ab8d-0019948a45e5 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.270179 Jul 19 19:57:27.985415 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1186/2485] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:26 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:27.990999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:28.021420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:28.042614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69e26ce2-ae3d-42a6-a6a2-8ac91c9d90b9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.498602 Jul 19 19:57:28.043521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1300/2486] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:57:27 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/os-interface => generated 284 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:28.057067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:28.057813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:28.060070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:28.064067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:28.550304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:28.550934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:28.563299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:28.563764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:28.564600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:28.565046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:28.856461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:28.870899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-080811b8-292e-4e30-bc9f-ad1fd24d2a0e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1271 microversion: 2.1 time: 0.324675 Jul 19 19:57:28.881771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1301/2487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:28 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:29.006812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:29.008078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:29.018406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.020196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.021776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.023323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.144253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:29.158938 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f93e9b0-d982-4cf1-ad14-0e81b1684dde tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1469 microversion: 2.1 time: 1.171800 Jul 19 19:57:29.159553 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1187/2488] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:27 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1469 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:29.175949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:29.176740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:29.187692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.188947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.193453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.194195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.230075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lazy-loading 'flavor' on Instance uuid 8187b549-26ab-471b-93b7-f6da890ccf71 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:57:29.260568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:29.312656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:29.360524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba75f30f-948d-45f0-ad0a-9feb1bfb67d8 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71/action" status: 202 len: 0 microversion: 2.1 time: 0.188237 Jul 19 19:57:29.366391 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1188/2489] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:57:29 2022] POST /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:57:29.380748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:29.381466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:29.402213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.402741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.407597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.409278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.991756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:30.347133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:30.362258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:30.363853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:30.369462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4462b240-b933-4aa5-a851-f12f59d076d9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.368586 Jul 19 19:57:30.370739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1302/2490] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:28 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:30.376859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:30.377877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:30.388648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:30.391876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:30.393082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:30.394571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:30.395849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:30.528574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:30.536524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6c6d567-ad6a-4469-a5ba-44cb00c772a5 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1477 microversion: 2.1 time: 1.160825 Jul 19 19:57:30.537767 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1189/2491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:29 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1477 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:31.389793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:31.394390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:31.414816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:31.415668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:31.421006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:31.423039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:32.241036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:32.253198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bd06a104-dd69-41c2-a1db-0d63d49d4aa4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 1.880537 Jul 19 19:57:32.255839 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1303/2492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:30 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:32.270879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:32.271831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:32.279229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:32.286391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:32.287498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:32.288130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:33.951595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:33.960109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:33.968938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:33.973876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:33.976642 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c179e87c-3d72-4194-876f-c91bf7d6ec2f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 2.590923 Jul 19 19:57:33.978398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1190/2493] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:31 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:33.989019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-663e831d-ccaa-4baf-bd7d-11c4cd75f9b1 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1460 microversion: 2.1 time: 1.714767 Jul 19 19:57:33.989019 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1304/2494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:32 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1460 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:33.996477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:34.004020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:34.004876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:34.005530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:34.021962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:34.022595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:34.024792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:34.026731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:34.026885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:34.028277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:34.029689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:34.030318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:35.518784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:35.532257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c97ddf4-301b-4195-8066-f15491cab982 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 1.546214 Jul 19 19:57:35.543464 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1305/2495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:33 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:35.549815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:35.550436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:35.566000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:35.566458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:35.573314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:35.573864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:36.854748 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0603d7cb-b3db-4d6a-9162-26c7557d96c2 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1611 microversion: 2.1 time: 2.854997 Jul 19 19:57:36.866331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1191/2496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:33 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1611 bytes in 2867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:36.871368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1a0caef5-ea31-44ab-893a-241ff36107af req-a5baba9f-2578-4dcb-96dc-06d92c4eebd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c396e08-1b3c-4856-8e76-b875b5c5e375", "tag": "c00054e9-66f6-4a24-b2ea-3853c0592ce8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:36.889862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a0caef5-ea31-44ab-893a-241ff36107af req-a5baba9f-2578-4dcb-96dc-06d92c4eebd9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:36.890319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a0caef5-ea31-44ab-893a-241ff36107af req-a5baba9f-2578-4dcb-96dc-06d92c4eebd9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:36.916007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1a0caef5-ea31-44ab-893a-241ff36107af req-a5baba9f-2578-4dcb-96dc-06d92c4eebd9 service nova] Creating event network-changed:c00054e9-66f6-4a24-b2ea-3853c0592ce8 for instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 on n-h2-843861-3 Jul 19 19:57:36.934531 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1a0caef5-ea31-44ab-893a-241ff36107af req-a5baba9f-2578-4dcb-96dc-06d92c4eebd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066752 Jul 19 19:57:36.935168 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1192/2497] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:36.945087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:36.945815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:36.969029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:36.970396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:36.973073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:36.974867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.111389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:37.121440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:37.130906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:37.135307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-946312da-42e6-491b-b7f7-07e9dee36866 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.587115 Jul 19 19:57:37.136155 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1306/2498] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:35 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:37.141048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:37.148235 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:57:37.148235 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 19:57:37.151715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.156029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.157761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.161855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.228269 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4dbf65ab-7a73-4b6d-856f-48e48921c5f5 tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.090852 Jul 19 19:57:37.229413 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1307/2499] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 19:57:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:37.241645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843861-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:37.246320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:37.258240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.258782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.260104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.260533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.299604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:37.472437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Lazy-loading 'flavor' on Instance uuid 8187b549-26ab-471b-93b7-f6da890ccf71 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:57:37.494543 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 8187b549-26ab-471b-93b7-f6da890ccf71 while it is in vm_state suspended Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Request method failure captured: Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71/action HTTP/1.1 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 97 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxtJqMgBDSD28i_EckQIdtdgwg8s8WrvoBOKsQ_q3_OXxduy2kUzo8TdDyqZ8Gqp7US8J3jcrOUJ2N0b1IT1pKvNW71_OZDKJBZnlPx-rnXTOFk764-XruD9_Uhu5mR8Bl2CjfPD0cuGW1jlIHNUQ1dQLql2K53zmpWf228TBU8_Qw Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a9376937664e4240ade2a20b01b91bfb Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9376937664e4240ade2a20b01b91bfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a9376937664e4240ade2a20b01b91bfb Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1719371783 Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-LiveMigrationNegativeTest-1719371783-project-admin Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: c70bab1407784ad3a658129b10e85d4d Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-LiveMigrationNegativeTest-1719371783-project-admin Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: {"os-migrateLive": {"host": "n-h2-843861-3", "block_migration": true, "disk_over_commit": false}} Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'os-migrateLive' instance 8187b549-26ab-471b-93b7-f6da890ccf71 while it is in vm_state suspended Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8187b549-26ab-471b-93b7-f6da890ccf71', 'body': {'os-migrateLive': {'host': 'n-h2-843861-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:37.500304 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 8187b549-26ab-471b-93b7-f6da890ccf71 while it is in vm_state suspended Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 8187b549-26ab-471b-93b7-f6da890ccf71 while it is in vm_state suspended Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 8187b549-26ab-471b-93b7-f6da890ccf71 while it is in vm_state suspended {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:37.505808 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-983bf6e8-8bd5-4d71-ab72-07b6fcd7175e tempest-LiveMigrationNegativeTest-1719371783 tempest-LiveMigrationNegativeTest-1719371783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71/action" status: 409 len: 155 microversion: 2.1 time: 0.264027 Jul 19 19:57:37.515238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1308/2500] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:57:37 2022] POST /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71/action => generated 155 bytes in 267 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:57:37.523908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:37.524400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:37.530516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.530965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.531742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.532208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.578928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:57:37.705250 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bfbd138d-ee70-4b5b-b8f0-0d3b30a853af tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 204 len: 0 microversion: 2.1 time: 0.188761 Jul 19 19:57:37.706902 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1309/2501] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:37 2022] DELETE /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:57:37.743961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:37.767386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bd99992-dd48-41f1-8946-e67463371556 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 0.830870 Jul 19 19:57:37.777630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1193/2502] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:36 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:37.806237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:37.812174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:37.827743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.832607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.833781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:37.843429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.986804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d247a3e4-16ad-4164-b7e6-cadc0834cb55 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: .version_select at 0x7fb88d170820>, body: {"keypair": {"name": "tempest-keypair-1461015845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMCBM9rDREDKVOClD6nrfEsBqSv1IKqOzP60Y4bZ5Xfme9e6zHS9Ra3dgFLk5QSTnXJI8FaP/zB6KRrsZociSD0xro09Bwmmc+jP9XotMCJQLqkzKO+1fY9EVvv/NzBng=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:38.026764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d247a3e4-16ad-4164-b7e6-cadc0834cb55 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:38.040861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d247a3e4-16ad-4164-b7e6-cadc0834cb55 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:38.088733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d247a3e4-16ad-4164-b7e6-cadc0834cb55 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.380054 Jul 19 19:57:38.090079 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1310/2503] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:38.160933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:38.162558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:38.178662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:38.179425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:38.180654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:38.182444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:38.965069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:38.982885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cdad581b-a847-4fc3-921c-7186c8892da6 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1466 microversion: 2.1 time: 1.203433 Jul 19 19:57:38.983953 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1194/2504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:37 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1466 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:38.992539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:38.993926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:39.013793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:39.024119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:39.027026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:39.027698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:39.234185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:39.257418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:39.259831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:39.261909 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-68c16691-34db-49ce-a431-340f637a278f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.109816 Jul 19 19:57:39.263636 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1311/2505] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:38 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:39.275523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-76441053-b702-4a0d-9157-e0bc43a72b83 req-3d930f7f-2c89-4db2-9656-18a069b31718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:39.317765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-76441053-b702-4a0d-9157-e0bc43a72b83 req-3d930f7f-2c89-4db2-9656-18a069b31718 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:39.318219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-76441053-b702-4a0d-9157-e0bc43a72b83 req-3d930f7f-2c89-4db2-9656-18a069b31718 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:39.348994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-76441053-b702-4a0d-9157-e0bc43a72b83 req-3d930f7f-2c89-4db2-9656-18a069b31718 service nova] Creating event network-changed:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:57:39.366017 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-76441053-b702-4a0d-9157-e0bc43a72b83 req-3d930f7f-2c89-4db2-9656-18a069b31718 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096611 Jul 19 19:57:39.367540 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1312/2506] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:40.001299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:40.002196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:40.009087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.009745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.010689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.011272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.172590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:40.204154 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05b4c425-c33c-476c-a470-217fdb3df7ec tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 1.218486 Jul 19 19:57:40.211102 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1195/2507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:38 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:40.289137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:40.290988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:40.298395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:40.310081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.311361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.312532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.313776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.588748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:40.624490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-636523e2-b61e-46bf-8134-da77edc9126a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1466 microversion: 2.1 time: 0.620392 Jul 19 19:57:40.625752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1313/2508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:39 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1466 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:41.152274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:41.165250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:41.167159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:41.168570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff0e69dc-3a9a-4761-972b-3f4ba8248ed8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.890929 Jul 19 19:57:41.170109 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1196/2509] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:40 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:41.229570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:41.232733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:41.266073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.266518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.284553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.286190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.645085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:41.646294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:41.653953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.654660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.655635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.656290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.020582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.031414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d957599-b59c-468d-8ec9-5ebad617e10b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 0.807125 Jul 19 19:57:42.046181 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1314/2510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:41 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:42.051613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7e330114-05cd-484f-a1d6-f4f72565be45 req-b3a170e6-f603-420b-bc81-1319d82bd15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8187b549-26ab-471b-93b7-f6da890ccf71", "name": "network-vif-deleted", "tag": "8a440e73-f0cc-4392-8be2-90897122aa40"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:42.072757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7e330114-05cd-484f-a1d6-f4f72565be45 req-b3a170e6-f603-420b-bc81-1319d82bd15d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:42.083377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7e330114-05cd-484f-a1d6-f4f72565be45 req-b3a170e6-f603-420b-bc81-1319d82bd15d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.111428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.122030 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7e330114-05cd-484f-a1d6-f4f72565be45 req-b3a170e6-f603-420b-bc81-1319d82bd15d service nova] Creating event network-vif-deleted:8a440e73-f0cc-4392-8be2-90897122aa40 for instance 8187b549-26ab-471b-93b7-f6da890ccf71 on n-h1-843861-3 Jul 19 19:57:42.123094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6893011-dee9-4720-bbea-55688961bb37 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 200 len: 1424 microversion: 2.1 time: 0.484262 Jul 19 19:57:42.132172 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1197/2511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:41 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 1424 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:42.138534 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7e330114-05cd-484f-a1d6-f4f72565be45 req-b3a170e6-f603-420b-bc81-1319d82bd15d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090671 Jul 19 19:57:42.155177 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1315/2512] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:42.188086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:42.188712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:42.198239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:42.198701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.199495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:42.199969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.709637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.733280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.735560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.737310 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba0acf28-aa35-43b7-9844-f7c1ad1d787d tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.553096 Jul 19 19:57:42.741006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1198/2513] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:42 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:43.062855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:43.076292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:43.105646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.106859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.108793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.109864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.192936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1239131139", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "8021cfef-796a-48c9-a577-3123ee4e22f7"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:43.379990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] validate_networks() for [('8021cfef-796a-48c9-a577-3123ee4e22f7', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:43.574125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:43.584116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a8644aa8-1062-4181-8ab4-51b520d8dbed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 0.528042 Jul 19 19:57:43.584734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1316/2514] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:43 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:43.596231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:43.600599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: 8187b549-26ab-471b-93b7-f6da890ccf71] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:43.628213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.629244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.632610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.633404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.668437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] HTTP exception thrown: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Request method failure captured: Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 HTTP/1.1 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxrdgMHCAj-9INz886E-5fqOa4p9q3dhbK7HMD2BxulbE9B63-egBnKuz5RqaBz7SbVAmNtERxkceK9nEgGXGLz4fN8bCQiiBWEdY4tF-o86VhkkJSdVDgzM4umIIGvJkRkQ_roH6cx-jVAsgXnZ0jEhp1G60654JIbNCW1VqGg7AI Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2ce3737accb04d11895d234c9a12d93a Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2ce3737accb04d11895d234c9a12d93a Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-LiveMigrationNegativeTest-1644788329-project Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ff8555d74017437e81b8b448ba745959 Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-LiveMigrationNegativeTest-1644788329-project Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '8187b549-26ab-471b-93b7-f6da890ccf71'} Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:43.671309 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. Jul 19 19:57:43.676063 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:57:43.690529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Returning 404 to user: Instance 8187b549-26ab-471b-93b7-f6da890ccf71 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:43.691713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed628894-ba00-4fe7-afd5-57ddf503a3ac tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71" status: 404 len: 111 microversion: 2.1 time: 0.101025 Jul 19 19:57:43.692951 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1317/2515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:43 2022] GET /compute/v2.1/servers/8187b549-26ab-471b-93b7-f6da890ccf71 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:43.700990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:43.710921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:43.733125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.736231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.738046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.739792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:43.817135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:57:43.976668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-12dcaec6-eb82-40d0-965e-84beaa5fb00d tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 204 len: 0 microversion: 2.1 time: 0.279161 Jul 19 19:57:43.977670 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1318/2516] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:43 2022] DELETE /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:57:43.982929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:43.991990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:43.999083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:43.999659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.000979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:44.001628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.875395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:44.896914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:44.907524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:44.912470 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c741d4d0-a8fe-4a5b-97c5-41f654722098 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.931910 Jul 19 19:57:44.928367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1319/2517] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:43 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:44.944782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:44.948246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:44.969486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:44.970251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.973250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:44.977491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.996577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:44.997097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:44.998204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:44.999195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:44.999879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:45.020184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.021677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.022837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.029210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.107219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Getting quotas for project a6ae7efaeea64b8ea0155d1fcad53cd2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:45.128717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Getting quotas for user 5a455f16994c436980d33005fe0ba02c and project a6ae7efaeea64b8ea0155d1fcad53cd2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:45.200012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:45.208907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:45.323607 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fab5dc9b-13d9-4922-8ded-23f85f45fdfd tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243262 Jul 19 19:57:45.324751 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1199/2518] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:45.469096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e399d538-8421-4d3d-984e-5f5f1f04e47f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Action: 'create', calling method: .version_select at 0x7fb88db75160>, body: {"keypair": {"name": "tempest-keypair-1540806213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1Q4GuYt+RbmEeFnMFR+ysx/VUM4FaxXd6xXg1xERyycLxr6MsC1zzWTfihdwgXb4JN4oa/T+My2RSEcx92DjdCPF7S180P95llRXPYAjNYpN3n3dt9kO0e8SgGYccbaA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:45.518540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e399d538-8421-4d3d-984e-5f5f1f04e47f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for project 2f5dd9f9f99448b5974c423792c88e07. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:45.531429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e399d538-8421-4d3d-984e-5f5f1f04e47f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for user 90860e756b9547909590fdb7f85dc076 and project 2f5dd9f9f99448b5974c423792c88e07. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:45.600832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e399d538-8421-4d3d-984e-5f5f1f04e47f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273581 Jul 19 19:57:45.604169 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1200/2519] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:45.625168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:45.625835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:45.665678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.670332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.671180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.674038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:46.645562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:46.659352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-172eeab8-0c4b-456a-a96e-e2bd6995a35b tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1472 microversion: 2.1 time: 1.729645 Jul 19 19:57:46.663493 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1320/2520] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:44 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1472 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:46.677161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-579639975", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81"}], "security_groups": [{"name": "tempest-securitygroup--1021733570"}], "key_name": "tempest-keypair-1461015845", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:47.181480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:47.604319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:47.619546 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfbbd84a-354e-4025-b07a-28d6c2babfd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 2.013441 Jul 19 19:57:47.622927 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1201/2521] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:45 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:47.634016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:47.637735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:47.654626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.661343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] validate_networks() for [('dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:47.670473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.671731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.676102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.931048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:47.935725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:47.948074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7203a68-8e07-4f4e-87dd-bdb988b39ac2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1286 microversion: 2.1 time: 0.323771 Jul 19 19:57:47.960820 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1202/2522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:47 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1286 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:47.971233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:47.971788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:47.989499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.993849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.994953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.996222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:48.052001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:48.966720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:48.997699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:49.004771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:49.010461 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f972b1fe-18a8-499b-883c-3d36a941aa38 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.048970 Jul 19 19:57:49.013396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1203/2523] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:47 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:49.030178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:49.032814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:49.051571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:49.052068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:49.052856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:49.053294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.599629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8555d74017437e81b8b448ba745959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce3737accb04d11895d234c9a12d93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:50.613238 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1130b87c-ade1-4e54-95ce-9a9ee04b073a tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 200 len: 1472 microversion: 2.1 time: 1.598126 Jul 19 19:57:50.613964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1204/2524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:49 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 1472 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:50.623479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:50.624566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:50.625282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:50.626302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:50.626931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:50.628112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:50.628774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:50.638147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.638893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.640054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.640913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.656685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.658186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.661380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.662151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.695185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:50.721005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:50.756048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:50.759862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:50.861087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bad3857b-5c3f-47af-99af-d6f2d4fb4006 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.194483 Jul 19 19:57:50.869868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1321/2525] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 4205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:50.881933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:50.884720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:50.892386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.899603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.903541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.904939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:51.349252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:51.369699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-358e6b3a-b25d-4482-b377-712057c5341b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 0.754771 Jul 19 19:57:51.371905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1205/2526] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:50 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:51.387526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:51.387967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:51.402088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:51.402548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:51.403335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:51.407943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:51.475021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:51.490269 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-231a8ff8-8285-4e98-ae9e-4c13b29b20bb tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 0.619090 Jul 19 19:57:51.490874 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1322/2527] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:50 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:51.621498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1079245124", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "e37e5e09-a019-4b27-ae65-9485cf3e1594"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:51.712348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] validate_networks() for [('e37e5e09-a019-4b27-ae65-9485cf3e1594', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:52.143877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:52.182464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:52.185361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:52.187607 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2572f23-55ba-4e73-b5f3-2d4d332dadb7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.813715 Jul 19 19:57:52.199298 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1206/2528] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:51 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:52.199298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ae63031f-ddb6-457c-b619-dfe069f4364b req-54520a3c-e604-4c06-a923-ffe655d97598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac30449f-cdc3-486c-be12-80e5ba5a1435", "name": "network-vif-deleted", "tag": "b6317aa3-21e7-4699-83b2-a29c292a5b99"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:52.206802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ae63031f-ddb6-457c-b619-dfe069f4364b req-54520a3c-e604-4c06-a923-ffe655d97598 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.206802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ae63031f-ddb6-457c-b619-dfe069f4364b req-54520a3c-e604-4c06-a923-ffe655d97598 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.224162 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ae63031f-ddb6-457c-b619-dfe069f4364b req-54520a3c-e604-4c06-a923-ffe655d97598 service nova] Creating event network-vif-deleted:b6317aa3-21e7-4699-83b2-a29c292a5b99 for instance ac30449f-cdc3-486c-be12-80e5ba5a1435 on n-h1-843861-3 Jul 19 19:57:52.231517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ae63031f-ddb6-457c-b619-dfe069f4364b req-54520a3c-e604-4c06-a923-ffe655d97598 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041205 Jul 19 19:57:52.232677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1207/2529] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:52.238080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:52.239260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:52.246237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.246916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.247961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.248797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.471743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:52.482198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05b87d34-c082-464a-8c49-612fbf676ccf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1301 microversion: 2.1 time: 0.248257 Jul 19 19:57:52.485030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1208/2530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:52 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1301 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:52.497655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d08752bd-2787-429a-b90c-3cf7c575827e req-bf0da94b-cec0-42a8-b2f3-f131ebe241ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c396e08-1b3c-4856-8e76-b875b5c5e375", "name": "network-vif-plugged", "status": "completed", "tag": "c00054e9-66f6-4a24-b2ea-3853c0592ce8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:52.510765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d08752bd-2787-429a-b90c-3cf7c575827e req-bf0da94b-cec0-42a8-b2f3-f131ebe241ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.511302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d08752bd-2787-429a-b90c-3cf7c575827e req-bf0da94b-cec0-42a8-b2f3-f131ebe241ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.525023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d08752bd-2787-429a-b90c-3cf7c575827e req-bf0da94b-cec0-42a8-b2f3-f131ebe241ad service nova] Creating event network-vif-plugged:c00054e9-66f6-4a24-b2ea-3853c0592ce8 for instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 on n-h2-843861-3 Jul 19 19:57:52.530999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d08752bd-2787-429a-b90c-3cf7c575827e req-bf0da94b-cec0-42a8-b2f3-f131ebe241ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044489 Jul 19 19:57:52.532412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1209/2531] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:52.541781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:52.542726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] [instance: ac30449f-cdc3-486c-be12-80e5ba5a1435] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:52.550116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.550898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.552120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.552802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.568607 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] HTTP exception thrown: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Request method failure captured: Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 HTTP/1.1 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxrdgMHCAj-9INz886E-5fqOa4p9q3dhbK7HMD2BxulbE9B63-egBnKuz5RqaBz7SbVAmNtERxkceK9nEgGXGLz4fN8bCQiiBWEdY4tF-o86VhkkJSdVDgzM4umIIGvJkRkQ_roH6cx-jVAsgXnZ0jEhp1G60654JIbNCW1VqGg7AI Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2ce3737accb04d11895d234c9a12d93a Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ce3737accb04d11895d234c9a12d93a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2ce3737accb04d11895d234c9a12d93a Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1644788329 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-LiveMigrationNegativeTest-1644788329-project Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ff8555d74017437e81b8b448ba745959 Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-LiveMigrationNegativeTest-1644788329-project Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ac30449f-cdc3-486c-be12-80e5ba5a1435'} Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:52.571459 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. Jul 19 19:57:52.576060 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:57:52.577553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] Returning 404 to user: Instance ac30449f-cdc3-486c-be12-80e5ba5a1435 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:52.579638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d20375f5-d803-4fa5-87dc-9b574c575b31 tempest-LiveMigrationNegativeTest-1644788329 tempest-LiveMigrationNegativeTest-1644788329-project] 10.222.0.33 "GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435" status: 404 len: 111 microversion: 2.1 time: 0.045550 Jul 19 19:57:52.580438 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1210/2532] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:52 2022] GET /compute/v2.1/servers/ac30449f-cdc3-486c-be12-80e5ba5a1435 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:52.590658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:52.591438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:52.598513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.598959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.599937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.600771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.119929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:53.121209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:53.121896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:53.123207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:53.123840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:53.134137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:53.150452 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17715a5b-12bd-4347-b563-3b432ed7b7d9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1313 microversion: 2.1 time: 0.564629 Jul 19 19:57:53.161337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.161891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.163321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.164036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.179127 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1211/2533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:52 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:53.188753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:53.190234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:53.195178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Getting quotas for project 6246937553c848809e78a2515e5757b0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:53.197566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.198551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.199500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.200772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Getting quotas for user 16fc7a6d0bc443c6ba2ceeb613c1f8d1 and project 6246937553c848809e78a2515e5757b0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:53.209925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.233872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:53.236281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:53.303118 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2646f03-aacb-4b79-9ea2-69fc60301eea tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799967 Jul 19 19:57:53.304397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1323/2534] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:53.312321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:53.314069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:53.331834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.332579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.333603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:53.334698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.282106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.293952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ac60198-31e7-46f5-83b6-ee3cf0a44df8 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 1.109838 Jul 19 19:57:54.296429 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1212/2535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:53 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:54.302706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:54.316857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:54.332702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.333161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.333956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.334394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.368371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.381844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.383389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.390339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-362fffce-d0cb-44aa-8f17-f6ddf7cced12 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.083973 Jul 19 19:57:54.391227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1324/2536] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:53 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:54.415486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:54.416132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:54.430782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.431242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.432087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.432526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.601434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.611719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51857126-936e-4e46-8656-bc072f10f418 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1221 microversion: 2.1 time: 0.313916 Jul 19 19:57:54.623878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1213/2537] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:54 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1221 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:54.629428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:54.630340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:54.639604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.640699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.642987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.643674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.685557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:54.703032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fd7244e-5c60-45b4-8885-c3e33f28c023 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1299 microversion: 2.1 time: 0.296265 Jul 19 19:57:54.703738 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1325/2538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:54 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1299 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:55.079405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:55.313096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:55.313732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:55.316904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:55.338956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.339415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.343729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.344299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.357898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:55.416174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:55.430259 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-adffa676-a598-4e35-a790-afac1e0b45c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1462 microversion: 2.1 time: 0.804795 Jul 19 19:57:55.432834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1214/2539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:54 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1462 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:55.447328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e2ee17da-c2c5-462b-9471-a402686a6e0c req-699027b1-e69b-4aaa-8aff-b441f4f51d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb4620a-9c62-4a75-bd48-9b49fdb22389", "tag": "c8b5e1bd-2981-414c-96be-7f184c071f15"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:55.472537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e2ee17da-c2c5-462b-9471-a402686a6e0c req-699027b1-e69b-4aaa-8aff-b441f4f51d16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.475033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e2ee17da-c2c5-462b-9471-a402686a6e0c req-699027b1-e69b-4aaa-8aff-b441f4f51d16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.516446 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e2ee17da-c2c5-462b-9471-a402686a6e0c req-699027b1-e69b-4aaa-8aff-b441f4f51d16 service nova] Creating event network-changed:c8b5e1bd-2981-414c-96be-7f184c071f15 for instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 on n-h1-843861-3 Jul 19 19:57:55.534271 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e2ee17da-c2c5-462b-9471-a402686a6e0c req-699027b1-e69b-4aaa-8aff-b441f4f51d16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097408 Jul 19 19:57:55.536601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1215/2540] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:55.543935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:55.544917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:55.553911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:55.556552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.557996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.559115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.560516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.410964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.434814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.441955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.445042 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41d1bb3e-7d12-4b33-8b59-b010680a1f5a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.906005 Jul 19 19:57:56.446234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1216/2541] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:55 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:56.472483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:56.480673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:56.493067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.494293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.495372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.496070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.534175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.542683 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-689fac33-1b93-431b-8df8-3381f64de666 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 1.234885 Jul 19 19:57:56.543854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1326/2542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:55 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:56.557897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:56.559109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:56.582898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.584182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.593966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.594745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.662069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.670527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Old instance type m1.heat2, new instance type m1.heat {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:57:56.700599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:56.701913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:56.705214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:56.707009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:56.707651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:56.956650 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0658ff39-ca06-4f04-9779-4e49aa1ecfeb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375/action" status: 202 len: 0 microversion: 2.1 time: 0.502803 Jul 19 19:57:56.958681 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1217/2543] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:57:56 2022] POST /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:57:56.963716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:56.979548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:57.004950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.005268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.008304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.010489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.020922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:57.036566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66de1dbf-00ba-438a-a75f-9363efa3af63 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1275 microversion: 2.1 time: 0.487449 Jul 19 19:57:57.038195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1327/2544] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:56 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1275 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:57.053470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:57.055640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:57.071725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.074225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.075363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.076776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.675473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:57.685303 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00c9b6af-97f9-48d3-b445-93c806f9dd50 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.725281 Jul 19 19:57:57.686466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1218/2545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:56 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:57.703481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:57.704566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:57.704709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:57.716562 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af335e9a-8d10-42f8-940a-01a6686a7074 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1471 microversion: 2.1 time: 0.674342 Jul 19 19:57:57.717648 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1328/2546] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:57 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1471 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:57.728734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.729250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.730151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.730588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.731959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:57.732783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:57.745212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.745879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:57.746839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:57.752601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.388957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:58.402617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-966290ed-d20d-41cf-8765-5bcb10d71363 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 0.683560 Jul 19 19:57:58.407608 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1329/2547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:57 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:58.518604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1736185746", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:58.536054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:58.556765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:58.560801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:58.567705 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26a8e365-bd5b-46d7-bda1-462979402c8e tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.867889 Jul 19 19:57:58.569005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1219/2548] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:57 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:58.595251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:58.598755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:58.618928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.622777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.625654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.626427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.639263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:58.640293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:58.641097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:58.641475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:58.641875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:58.661543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.668076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.676944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.677400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.700337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Getting quotas for project 4568bc7cc92a4b11b0e42e7c7e94c4d8. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:58.707040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Getting quotas for user 445de77bf5794a688411194a64c09fb3 and project 4568bc7cc92a4b11b0e42e7c7e94c4d8. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:58.741010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:58.746600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:58.827023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a2f5c156-a006-49fc-843b-6838f0b3f6c6 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.417928 Jul 19 19:57:58.827739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1330/2549] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:57:58.833494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:58.834434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:58.842037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.842977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.844249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.845315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.847178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:59.860371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d5174878-40dd-417c-a28f-ce7fd57a7f75 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 1.031170 Jul 19 19:57:59.862052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1331/2550] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:58 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:59.867671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:59.872598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:59.888392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:59.891098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.892485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:59.893840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.919394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:59.935201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:59.946297 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c13e8f9-35c4-4b9e-ac09-80d4e2cbbf01 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 1.371653 Jul 19 19:57:59.946966 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1220/2551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:58 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:59.987482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:59.995859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:00.020569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.021034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.021837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.022277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.365797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:00.381067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:00.384822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:00.398689 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-faf484a7-8817-4484-85d6-ece97ed46a41 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "PUT /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1355 microversion: 2.75 time: 0.443972 Jul 19 19:58:00.401751 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1221/2552] 10.222.0.33 () {62 vars in 1296 bytes} [Tue Jul 19 19:57:59 2022] PUT /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:00.423880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:00.425288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:00.440511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.443200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.446728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.447402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.617882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:00.628234 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ad90451-acfe-4411-92d9-b445267bb264 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1471 microversion: 2.1 time: 0.764863 Jul 19 19:58:00.630462 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1332/2553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:59 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1471 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:00.636684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:00.637539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:00.645066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.645875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.647585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.648849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.099719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.110526 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b36caca-be52-4785-bd62-87ddd9c38552 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 0.707434 Jul 19 19:58:01.114202 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1222/2554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:00 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:01.125471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:01.126397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:01.140771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.142162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.144093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.145808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.237323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.257696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.260368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.261800 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3bd25302-0af3-48bc-b4cc-ce95b9c28999 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.630180 Jul 19 19:58:01.264704 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1333/2555] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:00 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:01.273385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0026afed-3b8a-40f5-93f1-d4b6ca18e435 req-977c7f23-09ea-4fad-807a-f8d10fac21e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "10eb8c5f-4234-4b19-9634-f11411db5e67"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:01.288122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0026afed-3b8a-40f5-93f1-d4b6ca18e435 req-977c7f23-09ea-4fad-807a-f8d10fac21e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.289442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0026afed-3b8a-40f5-93f1-d4b6ca18e435 req-977c7f23-09ea-4fad-807a-f8d10fac21e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.315070 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0026afed-3b8a-40f5-93f1-d4b6ca18e435 req-977c7f23-09ea-4fad-807a-f8d10fac21e4 service nova] Creating event network-vif-plugged:10eb8c5f-4234-4b19-9634-f11411db5e67 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:01.343962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0026afed-3b8a-40f5-93f1-d4b6ca18e435 req-977c7f23-09ea-4fad-807a-f8d10fac21e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074939 Jul 19 19:58:01.349773 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1334/2556] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:01.361162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:01.362915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:01.374975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.375704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.376672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.377266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.402761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.413009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.420491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.435270 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83111e85-a79b-4739-8f7c-2e79034b0da7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1429 microversion: 2.75 time: 0.319305 Jul 19 19:58:01.436300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1223/2557] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:01 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1429 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:01.452473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:01.453191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:01.460320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.461205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.462630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.463236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.769728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.786939 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4da0e132-574b-4ca1-b3cb-17ef9f73ec58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.432662 Jul 19 19:58:01.788575 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1335/2558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:01 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:01.794222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-46e7bddf-88b7-4af2-826f-784ea8592b92 req-57b54775-b80b-44da-8036-ca5a2fd9e79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a311e8-577a-4cc7-b1c5-9778770cf03e", "tag": "bf0fb95f-edf6-450e-9803-f776b58c2b13"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:01.803445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-46e7bddf-88b7-4af2-826f-784ea8592b92 req-57b54775-b80b-44da-8036-ca5a2fd9e79d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.805142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-46e7bddf-88b7-4af2-826f-784ea8592b92 req-57b54775-b80b-44da-8036-ca5a2fd9e79d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.831246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-46e7bddf-88b7-4af2-826f-784ea8592b92 req-57b54775-b80b-44da-8036-ca5a2fd9e79d service nova] Creating event network-changed:bf0fb95f-edf6-450e-9803-f776b58c2b13 for instance 68a311e8-577a-4cc7-b1c5-9778770cf03e on n-h1-843861-3 Jul 19 19:58:01.840311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-46e7bddf-88b7-4af2-826f-784ea8592b92 req-57b54775-b80b-44da-8036-ca5a2fd9e79d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049099 Jul 19 19:58:01.842021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1336/2559] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:01.850058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:01.851121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:01.863033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.863939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.865414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.867643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.924360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.933236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc9d992d-b166-4303-b09d-f3a83760101c tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.494747 Jul 19 19:58:01.935904 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1224/2560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:01 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:02.130396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.131065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.147566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.148381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.149385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.149993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.296910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.309902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6423f8f5-c7e4-4599-a4a1-1748e9054d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.466335 Jul 19 19:58:02.321230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1337/2561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:01 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:02.328874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.329581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.338335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.338847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.340267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.340928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.601785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.615731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2726eaff-f5bb-4a56-8839-cf8d73cfb245 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 0.489033 Jul 19 19:58:02.616782 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1225/2562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:02.622437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.623220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.634434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.635488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.636512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.636976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.755525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.780602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.780806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.782121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.794043 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-881f9c25-cf66-496d-b2d0-b2a9ab0f7254 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1417 microversion: 2.75 time: 0.175098 Jul 19 19:58:02.794974 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1226/2563] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1417 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:02.795189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.796601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.797783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c138b3ed-2a12-4d8b-bebc-6a21b0d0ad85 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.475403 Jul 19 19:58:02.798348 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1338/2564] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:02.806329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.807294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.817159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.817763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.819082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.819522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.952456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.953184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.959429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.959775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.960782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.961386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.970698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.980248 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00a5304e-4a3d-475f-b753-bf4dbfdb361b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.178253 Jul 19 19:58:02.990479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1227/2565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:03.116177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:03.124838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90a5a30e-1867-4e9a-822b-24c9190f34df tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.176381 Jul 19 19:58:03.125430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1339/2566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:03.327526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:03.328765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:03.336393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.336843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.337614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.338047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.437866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-db4d9cc7-5fdc-4621-8f07-41ae5297c2fe req-5dfd1ef1-d389-4278-82e2-9aab9e82085f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb4620a-9c62-4a75-bd48-9b49fdb22389", "name": "network-vif-plugged", "status": "completed", "tag": "c8b5e1bd-2981-414c-96be-7f184c071f15"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:03.453736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-db4d9cc7-5fdc-4621-8f07-41ae5297c2fe req-5dfd1ef1-d389-4278-82e2-9aab9e82085f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.454186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-db4d9cc7-5fdc-4621-8f07-41ae5297c2fe req-5dfd1ef1-d389-4278-82e2-9aab9e82085f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.467160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-db4d9cc7-5fdc-4621-8f07-41ae5297c2fe req-5dfd1ef1-d389-4278-82e2-9aab9e82085f service nova] Creating event network-vif-plugged:c8b5e1bd-2981-414c-96be-7f184c071f15 for instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 on n-h1-843861-3 Jul 19 19:58:03.472596 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-db4d9cc7-5fdc-4621-8f07-41ae5297c2fe req-5dfd1ef1-d389-4278-82e2-9aab9e82085f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038520 Jul 19 19:58:03.477215 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1340/2567] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:03.634095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:03.635092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:03.642814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.643263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.644080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.644702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.110290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.118587 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-effadcc1-d6df-4093-be72-73aa3f992d90 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.795002 Jul 19 19:58:04.128772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1228/2568] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:03 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:04.140963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:04.142234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:04.148076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:04.150171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.150633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.151363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.151792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.301494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.310583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.310936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.312748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.318028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b354d3be-a98b-4b27-a8d3-82f482f21ef8 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1417 microversion: 2.75 time: 0.186980 Jul 19 19:58:04.319161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1229/2569] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:04 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1417 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:04.323761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:04.324395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:04.327020 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09135352-7f5b-42e6-a786-e46a4022308b tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1328 microversion: 2.1 time: 0.697409 Jul 19 19:58:04.327701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1341/2570] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:03 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1328 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:04.331206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.332215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.333152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.333745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.339965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d0dc20c8-c8a2-4828-bc59-438a7131fa34 req-3e3b1357-8000-43da-b591-e41c5c7f0e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d8973c-4945-46ce-a090-c87bb193e0fe", "tag": "38370bca-234a-48ce-b9d6-98e4a86bf8bc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:04.348344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0dc20c8-c8a2-4828-bc59-438a7131fa34 req-3e3b1357-8000-43da-b591-e41c5c7f0e79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.349023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0dc20c8-c8a2-4828-bc59-438a7131fa34 req-3e3b1357-8000-43da-b591-e41c5c7f0e79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.361788 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d0dc20c8-c8a2-4828-bc59-438a7131fa34 req-3e3b1357-8000-43da-b591-e41c5c7f0e79 service nova] Creating event network-changed:38370bca-234a-48ce-b9d6-98e4a86bf8bc for instance 63d8973c-4945-46ce-a090-c87bb193e0fe on n-h1-843861-3 Jul 19 19:58:04.367897 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d0dc20c8-c8a2-4828-bc59-438a7131fa34 req-3e3b1357-8000-43da-b591-e41c5c7f0e79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Jul 19 19:58:04.368497 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1342/2571] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:04.373651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:04.374352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:04.381721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.382205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.382992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.383431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.717799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.728820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.730709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.732380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d56f47ae-f0b5-4a58-a8b2-1281902741e3 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.412134 Jul 19 19:58:04.733021 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1230/2572] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:04 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:04.738233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.739101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:04.739707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:04.746402 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-317d2edb-e98e-4e75-b260-ed9ffabcdf1c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.376575 Jul 19 19:58:04.746710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.746983 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1343/2573] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:04 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:04.747164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.747951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.748607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.972883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.986058 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2a235a4-8fa3-4ea2-aa68-5987f89680ed tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.251661 Jul 19 19:58:04.995038 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1231/2574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:04 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:05.137634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.138525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.145571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.146546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.147546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.148305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.343793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.344589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.355860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.356768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.358125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.358799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.376785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.390017 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c81a80d-b65e-4c72-adf2-d0db21b37c27 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.258400 Jul 19 19:58:05.396989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1344/2575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:05.397365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.397963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.405305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.405880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.406675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.407114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.450411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.458745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.460299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.475526 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c3b3c6e1-eaed-4687-8830-9ebbdff5a41b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1417 microversion: 2.75 time: 0.137856 Jul 19 19:58:05.478677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1232/2576] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1417 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:05.574536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.586722 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7196a5d-eed4-49d2-be26-6f296411da8c tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1528 microversion: 2.1 time: 0.192845 Jul 19 19:58:05.587747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1345/2577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1528 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:05.605638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.606531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.619645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.620120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.620907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.621619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.753054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.753673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.762153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.762876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.763875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.764323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.769428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:05.778213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.788553 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c796589-92c1-4328-b7e4-a86868d582e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1528 microversion: 2.1 time: 0.186860 Jul 19 19:58:05.789753 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1233/2578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1528 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:05.794011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.794623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.801171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.801625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.802393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.802833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.087229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.093502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.095285 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df3ec71d-490e-4953-9156-3c8b15df78e8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.304883 Jul 19 19:58:06.095951 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1234/2579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:06.113440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.115012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.116318 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aacafce-e357-435f-8839-fcc4be87b0e1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.368355 Jul 19 19:58:06.117845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1346/2580] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:06.122300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.122903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.129016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.129464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.130503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.130938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.259430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.259970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.267397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.267875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.268655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.269092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.284538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] HTTP exception thrown: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Request method failure captured: Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 HTTP/1.1 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wy255C4bPunhEIw3kXP9PdXRZOGZbOstGQbmlQuf5ahV8zvLzhz3N8tE3MSzgHo20aAAykvQjLmcuYu6bxGBKrPSt67ty4-p5gAD6lXfSS6vP8p1js3LkIA2zknkb2RjZkcIPtNb2mTbLpltJTB_PKdjdjQMktKlUXrx9VeY7chexk Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7a68b4fe62e040a49975dbc77259b79d Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7a68b4fe62e040a49975dbc77259b79d Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestMultiTenantJSON-106024202-project Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b5b40f10002344adb5b022615407068d Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202-project Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '6cb4620a-9c62-4a75-bd48-9b49fdb22389'} Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:06.286356 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Returning 404 to user: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d79eed74-63b6-4384-a52f-25452cca3645 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 404 len: 111 microversion: 2.1 time: 0.190909 Jul 19 19:58:06.290491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1235/2581] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:58:06 2022] DELETE /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:06.297490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.298115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.305571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.306024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.306800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.307234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.423780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.433004 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1ad3cb8-5549-470d-91a6-e4e924f23d32 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.313908 Jul 19 19:58:06.434090 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1347/2582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:06.439260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.440212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.447457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.447929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.448693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.449530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.616775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.626669 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a6616ab-e89b-426d-852c-57e596d19ac9 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1528 microversion: 2.1 time: 0.332879 Jul 19 19:58:06.627526 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1236/2583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1528 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:06.643938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.644552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.651546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.652225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.653004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.653432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.725981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.735086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41b43e33-7796-46ff-9438-a71fff423a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.299855 Jul 19 19:58:06.745079 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1348/2584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:06.745079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Action: 'update', calling method: >, body: {"server": {"name": "6cb4620a-9c62-4a75-bd48-9b49fdb22389_new"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:06.745079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.750947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.751801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.752864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.753542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.762579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.769778 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] HTTP exception thrown: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Request method failure captured: Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 HTTP/1.1 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 64 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wy255C4bPunhEIw3kXP9PdXRZOGZbOstGQbmlQuf5ahV8zvLzhz3N8tE3MSzgHo20aAAykvQjLmcuYu6bxGBKrPSt67ty4-p5gAD6lXfSS6vP8p1js3LkIA2zknkb2RjZkcIPtNb2mTbLpltJTB_PKdjdjQMktKlUXrx9VeY7chexk Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7a68b4fe62e040a49975dbc77259b79d Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7a68b4fe62e040a49975dbc77259b79d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7a68b4fe62e040a49975dbc77259b79d Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202 Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestMultiTenantJSON-106024202-project Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: b5b40f10002344adb5b022615407068d Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-106024202-project Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "6cb4620a-9c62-4a75-bd48-9b49fdb22389_new"}} Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6cb4620a-9c62-4a75-bd48-9b49fdb22389', 'body': {'server': {'name': '6cb4620a-9c62-4a75-bd48-9b49fdb22389_new'}}} Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 19:58:06.771684 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] Returning 404 to user: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fe47342-5cc2-4537-bac8-f071b36533e4 tempest-ServersNegativeTestMultiTenantJSON-106024202 tempest-ServersNegativeTestMultiTenantJSON-106024202-project] 10.222.0.33 "PUT /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 404 len: 111 microversion: 2.1 time: 0.035720 Jul 19 19:58:06.775925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1349/2585] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 19:58:06 2022] PUT /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:06.783932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.784287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.784784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.785589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.791480 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ec268378-cae1-4ef9-8e93-3656cde750c0 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1417 microversion: 2.75 time: 0.151831 Jul 19 19:58:06.792289 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1237/2586] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1417 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:06.792537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.792988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.793755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.794183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.822513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:58:06.918846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-817c3aa8-6242-4d75-b863-9c9cc939e7d3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 204 len: 0 microversion: 2.1 time: 0.136918 Jul 19 19:58:06.920232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1350/2587] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:58:06 2022] DELETE /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:58:06.928145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.928783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.935468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.936149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.939354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.939862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.944982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:07.104015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.112336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.112554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2dc5776-09dc-4ec2-b427-cfa6a0717d11 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1534 microversion: 2.1 time: 0.188346 Jul 19 19:58:07.113261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1238/2588] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1534 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:07.113396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.119528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.120156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.121036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.121608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.135675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.136585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.143516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.144060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.144842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.145278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.378425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.392770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ecd9ba6-6b72-4f28-a841-c1b98df659ec tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.284626 Jul 19 19:58:07.401557 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1351/2589] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:07.401919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.409402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.411231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.412630 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4849f968-6562-44c2-b866-5edfc7fe3005 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.280768 Jul 19 19:58:07.413825 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1239/2590] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:07.451572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.452487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.460249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.461263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.462597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.463033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.629176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.640114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5397b4ce-dd91-4a9c-869c-3467cde308db tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.190857 Jul 19 19:58:07.650209 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1352/2591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:07.753937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.754627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.761116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.762469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.763268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.763708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.806843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-55b159f5-ea7f-4034-9832-828d0961b67d req-dcbd21ac-e20b-4b08-baad-4c96c1bc4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a311e8-577a-4cc7-b1c5-9778770cf03e", "name": "network-vif-plugged", "status": "completed", "tag": "bf0fb95f-edf6-450e-9803-f776b58c2b13"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:07.816981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55b159f5-ea7f-4034-9832-828d0961b67d req-dcbd21ac-e20b-4b08-baad-4c96c1bc4d58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.817657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55b159f5-ea7f-4034-9832-828d0961b67d req-dcbd21ac-e20b-4b08-baad-4c96c1bc4d58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.830845 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-55b159f5-ea7f-4034-9832-828d0961b67d req-dcbd21ac-e20b-4b08-baad-4c96c1bc4d58 service nova] Creating event network-vif-plugged:bf0fb95f-edf6-450e-9803-f776b58c2b13 for instance 68a311e8-577a-4cc7-b1c5-9778770cf03e on n-h1-843861-3 Jul 19 19:58:07.841647 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-55b159f5-ea7f-4034-9832-828d0961b67d req-dcbd21ac-e20b-4b08-baad-4c96c1bc4d58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039238 Jul 19 19:58:07.843110 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1353/2592] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:07.850029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.851711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.862245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.862810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.863707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.864367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.985516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.997717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89ff23d4-b319-42a0-9111-94e03c3379c1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.246913 Jul 19 19:58:07.999678 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1240/2593] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:08.004551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.016313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.017830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.025487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d657ae4b-366b-4363-83d8-dc4ded8fc5d5 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1438 microversion: 2.75 time: 0.180621 Jul 19 19:58:08.026563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1354/2594] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1438 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:08.045849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:08.047431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.053527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.054242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.055546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.056005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.129853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.130930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.142522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.148103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.148948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.152085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.175150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:08.175744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:08.176404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:08.177055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:08.177687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:08.268027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.275568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.276448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.277653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.278296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.392030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.399329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.402196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.403737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.409350 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96c6b35c-22d4-4df8-9059-21e76f616446 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1534 microversion: 2.1 time: 0.283952 Jul 19 19:58:08.410245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1355/2595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1534 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:08.411858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de0a2d49-7452-4673-932f-95f3c7a6053f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "POST /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a/action" status: 202 len: 1495 microversion: 2.75 time: 0.369365 Jul 19 19:58:08.423107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.423605 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1241/2596] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:58:08 2022] POST /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a/action => generated 1495 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 19:58:08.425281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.433353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.433970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.435790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.436397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.437197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.437628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.440645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.441090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.441842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.442600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.691040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:08.738632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:08.808214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.817564 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf800608-70d7-470d-ac9f-70dff3488660 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1367 microversion: 2.1 time: 0.405592 Jul 19 19:58:08.818485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1356/2597] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:08.823945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.824687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.836461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.837032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.837428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.838218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.838658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.849797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.852930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.855065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad760dee-1e23-4fcd-8af2-1aacca6b44a8 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.426253 Jul 19 19:58:08.857524 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1242/2598] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:08.864198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.864811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.871457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.872110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.872912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.873342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.955989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.964681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.966066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.972713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c4bcafab-0bad-4b7f-896d-5314932b5386 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.152906 Jul 19 19:58:08.973330 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1357/2599] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:09.017544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.018326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:09.027377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.028738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.028738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.029272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.298569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:09.314628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e47ce391-8606-463e-b34f-39ce371b5d9c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.297970 Jul 19 19:58:09.315714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1358/2600] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:09.321693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:09.333237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa79d793-4143-45be-af31-05082d881ba5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.474189 Jul 19 19:58:09.336426 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1243/2601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:09.429847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.430682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:09.446333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.450495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.452352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.454520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.556636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0620f69c-1568-4883-ba0c-d80576e655d8 req-3b032bd2-090b-4097-9e82-fa5af8828e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb4620a-9c62-4a75-bd48-9b49fdb22389", "name": "network-vif-deleted", "tag": "c8b5e1bd-2981-414c-96be-7f184c071f15"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:09.580941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0620f69c-1568-4883-ba0c-d80576e655d8 req-3b032bd2-090b-4097-9e82-fa5af8828e87 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.592489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0620f69c-1568-4883-ba0c-d80576e655d8 req-3b032bd2-090b-4097-9e82-fa5af8828e87 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.616620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0620f69c-1568-4883-ba0c-d80576e655d8 req-3b032bd2-090b-4097-9e82-fa5af8828e87 service nova] Creating event network-vif-deleted:c8b5e1bd-2981-414c-96be-7f184c071f15 for instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 on n-h1-843861-3 Jul 19 19:58:09.625074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0620f69c-1568-4883-ba0c-d80576e655d8 req-3b032bd2-090b-4097-9e82-fa5af8828e87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071126 Jul 19 19:58:09.625882 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1244/2602] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:09.835004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.836053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:09.842703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.843909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.844878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.845472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.907377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a455f16994c436980d33005fe0ba02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ae7efaeea64b8ea0155d1fcad53cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:09.921531 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4dfcb2df-fd43-46da-973a-697e934017e2 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 200 len: 1492 microversion: 2.1 time: 0.497561 Jul 19 19:58:09.923939 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1359/2603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 1492 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:09.935607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.938215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:09.948089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.948900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.950153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.950827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.105180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.136069 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1fe60d3-9284-4d9e-9282-7833010507e5 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1557 microversion: 2.1 time: 0.295807 Jul 19 19:58:10.137010 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1245/2604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:10.142155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "9ec19e57-4422-4712-8bdb-fa8bd72353c0"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "25a886f2-4fc4-42a5-999f-d6df6ac837e7"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:10.156277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.156597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.187094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] Creating event network-vif-plugged:9ec19e57-4422-4712-8bdb-fa8bd72353c0 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:10.187613 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] Creating event network-vif-plugged:25a886f2-4fc4-42a5-999f-d6df6ac837e7 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:10.193611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1ff41e25-fc68-4eb7-b4dc-640037fbeb3f req-2ba31135-5e7f-4e0a-83d6-fd456f3d477f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055054 Jul 19 19:58:10.194299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1246/2605] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:10.210174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.210916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.229424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.229868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.230644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.231070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.333830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.338139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.343401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.345213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.351403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09bd73d7-3480-43ce-b41b-3bb5b8844d23 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.154738 Jul 19 19:58:10.352276 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1247/2606] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:10.354389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.357544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.358226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.359512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.360855 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc51d7b9-2bd8-42fe-b719-e1c3b2eb3265 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.435468 Jul 19 19:58:10.365199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.365929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.366390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1360/2607] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:10.367072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.367661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.375674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.377217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.388812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.389206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.389998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.390743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.487896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fdbec81-fa62-470a-baf4-887636ae6db9 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134115 Jul 19 19:58:10.488910 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1248/2608] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:10.493528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.494151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.510670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.511130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.524032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.524589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.576954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.587246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db872e79-4963-4478-88b9-ee815a4d1c28 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.217873 Jul 19 19:58:10.588205 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1361/2609] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:10.689417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.698265 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cca7ee5-1e29-40e6-8bd9-9d289c0a7549 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.208459 Jul 19 19:58:10.699845 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1249/2610] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:10.941525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.942111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] [instance: 6cb4620a-9c62-4a75-bd48-9b49fdb22389] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.949176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.949630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.950621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.951061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.968870 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] HTTP exception thrown: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Request method failure captured: Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 HTTP/1.1 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyg-ocOeKiF8wR7qbstQcl90pLfJ7R5tXZFK7AggZqOgaHaIvlM0gn-rhEiTd70JQjzBBSQ5uZcqHMpriwp6oGUdC7pSPxRWb9Rq07fFpCu5Pa6rW5fgOltougLnWh0B5K49j_maTxxvX6JybiA0-_kRtYv4EY2_uiKw_cdf6WdurI Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a6ae7efaeea64b8ea0155d1fcad53cd2 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2043946179 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6ae7efaeea64b8ea0155d1fcad53cd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6ae7efaeea64b8ea0155d1fcad53cd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6ae7efaeea64b8ea0155d1fcad53cd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6ae7efaeea64b8ea0155d1fcad53cd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2043946179 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a6ae7efaeea64b8ea0155d1fcad53cd2 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2043946179 Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2043946179-project Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5a455f16994c436980d33005fe0ba02c Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2043946179-project Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6cb4620a-9c62-4a75-bd48-9b49fdb22389'} Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:10.970680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] Returning 404 to user: Instance 6cb4620a-9c62-4a75-bd48-9b49fdb22389 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-053f1139-55d7-4539-b2d6-8b1b5928d6e3 tempest-ServersNegativeTestMultiTenantJSON-2043946179 tempest-ServersNegativeTestMultiTenantJSON-2043946179-project] 10.222.0.33 "GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389" status: 404 len: 111 microversion: 2.1 time: 0.035504 Jul 19 19:58:10.975694 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1362/2611] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/6cb4620a-9c62-4a75-bd48-9b49fdb22389 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:11.377852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:11.396763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:11.398666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:11.399327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:11.412859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.413306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.414076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.414505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.423194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.423648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.425245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.426320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.444598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:11.638487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:11.656960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:11.657895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:11.667600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14bd14ee-8b74-4026-b96c-df21a1e3df70 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.300141 Jul 19 19:58:11.680420 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1250/2612] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:11 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:11.680420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-37cfe696-aba4-4db0-9324-c6ac4d7af746 req-4ff45886-99e2-45e8-893b-a7b223646e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a311e8-577a-4cc7-b1c5-9778770cf03e", "tag": "bf0fb95f-edf6-450e-9803-f776b58c2b13"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:11.683403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-37cfe696-aba4-4db0-9324-c6ac4d7af746 req-4ff45886-99e2-45e8-893b-a7b223646e94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.683874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-37cfe696-aba4-4db0-9324-c6ac4d7af746 req-4ff45886-99e2-45e8-893b-a7b223646e94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.696724 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-37cfe696-aba4-4db0-9324-c6ac4d7af746 req-4ff45886-99e2-45e8-893b-a7b223646e94 service nova] Creating event network-changed:bf0fb95f-edf6-450e-9803-f776b58c2b13 for instance 68a311e8-577a-4cc7-b1c5-9778770cf03e on n-h1-843861-3 Jul 19 19:58:11.701892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-37cfe696-aba4-4db0-9324-c6ac4d7af746 req-4ff45886-99e2-45e8-893b-a7b223646e94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030902 Jul 19 19:58:11.706529 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1251/2613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:11.712259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:11.712970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:11.721193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.721635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.722406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.722831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.040793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.050168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.051694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.069285 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b8154b6-7f18-4a3b-87c8-18b7ab92ad5c tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.687505 Jul 19 19:58:12.070250 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1363/2614] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:11 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:12.074790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:12.075400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:12.077345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:12.100091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.100561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.102010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.102474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.279573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.294921 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d384c8c5-a096-4c15-ac3a-7c1c6c70e5d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.586973 Jul 19 19:58:12.305855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1252/2615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:11 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:12.307991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d8973c-4945-46ce-a090-c87bb193e0fe", "name": "network-vif-plugged", "status": "completed", "tag": "38370bca-234a-48ce-b9d6-98e4a86bf8bc"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "c2450f7b-c16c-416e-81b1-d3a77677dc49"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:12.331507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.331994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.356315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] Creating event network-vif-plugged:38370bca-234a-48ce-b9d6-98e4a86bf8bc for instance 63d8973c-4945-46ce-a090-c87bb193e0fe on n-h1-843861-3 Jul 19 19:58:12.356831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] Creating event network-vif-plugged:c2450f7b-c16c-416e-81b1-d3a77677dc49 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:12.373874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-dcfca7f4-27a5-4327-8bb3-2fb9e438f324 req-f49576ff-3c4d-4ac4-954a-bc1049e6d211 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069139 Jul 19 19:58:12.374834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1253/2616] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:12.476715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.485358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6255465-e9a6-493d-9044-fc5025d2a15e tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.414048 Jul 19 19:58:12.485937 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1364/2617] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:12 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:12.690438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:12.692193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:12.711952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.712412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.713964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.716554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.823854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.842942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.849924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.862485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05235ebc-51a4-430f-aed2-77329a10b2fa tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.178190 Jul 19 19:58:12.881635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1254/2618] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:12 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:13.087718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:13.088302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:13.103738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.104216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.105009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.105448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.313945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:13.315128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:13.323629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.324234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.325210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.325710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.354482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:13.488495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.498793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.500379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.501569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c92f1680-16d0-4296-a431-deb1e10b6560 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.418299 Jul 19 19:58:13.502136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1365/2619] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:13 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:13.514121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:13.514874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:13.522032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.522606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.523668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.524237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.785629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.797520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4e6075e-dc18-4bf6-9212-9a9bc2466be2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.489509 Jul 19 19:58:13.798490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1255/2620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:13 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:13.869364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.878564 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2fa0249-b821-4e1f-b069-0920495374b1 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1317 microversion: 2.1 time: 0.369890 Jul 19 19:58:13.879321 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1366/2621] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:13 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:13.895116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:13.896124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:13.907093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.908303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.909687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.910443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.020466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:14.030469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:14.031112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:14.036792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-004703a4-c9e6-40b1-ace8-cf1f1849d87b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.148458 Jul 19 19:58:14.037599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1256/2622] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:13 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:14.398826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-04244559-07fa-4e62-a52a-fc6b43611638 req-826337dd-3577-4622-acf1-842351098326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "b9c467c3-a29f-41aa-a758-bb0988ff2ffe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:14.411577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-04244559-07fa-4e62-a52a-fc6b43611638 req-826337dd-3577-4622-acf1-842351098326 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.415145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-04244559-07fa-4e62-a52a-fc6b43611638 req-826337dd-3577-4622-acf1-842351098326 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.453103 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-04244559-07fa-4e62-a52a-fc6b43611638 req-826337dd-3577-4622-acf1-842351098326 service nova] Creating event network-vif-plugged:b9c467c3-a29f-41aa-a758-bb0988ff2ffe for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:14.464754 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-04244559-07fa-4e62-a52a-fc6b43611638 req-826337dd-3577-4622-acf1-842351098326 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070317 Jul 19 19:58:14.471678 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1367/2623] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:14.527470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:14.528140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:14.555019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.555931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.556961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.557558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.815238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:14.816000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:14.826964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.830618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.841367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.842094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.538129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.554780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.557608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.559315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b737f50-e12e-45c9-97cd-1e2f5b61c8d1 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 1.042239 Jul 19 19:58:15.561362 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1257/2624] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:14 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:15.580634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:15.581714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:15.588847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.589539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.600865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.604465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.609415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.612975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00d8edef-dc35-4450-a88f-3b03dc17299a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.802082 Jul 19 19:58:15.614190 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1368/2625] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:14 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:15.619891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:15.620821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:15.627558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.628412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.629507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.630034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.727330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.735797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.737358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.743067 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8443ba9b-a9e3-4503-8c79-2e6102f34c9f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.127619 Jul 19 19:58:15.743652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1369/2626] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:15 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:15.900850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.908403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76b6109c-a0f9-4b3b-b52c-5ea04d4274d8 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1506 microversion: 2.1 time: 0.345694 Jul 19 19:58:15.909183 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1258/2627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:15 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:15.925741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:15.926276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:15.935279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.936033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.936963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:15.937556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.974249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.975486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1cac560c-51d1-440b-9029-ae4024771ea5 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/os-instance-actions/req-b2646f03-aacb-4b79-9ea2-69fc60301eea" status: 200 len: 313 microversion: 2.1 time: 0.053762 Jul 19 19:58:15.976720 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1370/2628] 10.222.0.33 () {58 vars in 1418 bytes} [Tue Jul 19 19:58:15 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/os-instance-actions/req-b2646f03-aacb-4b79-9ea2-69fc60301eea => generated 313 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:15.991212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:15.993066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.000189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.001223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.002163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.002769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.090022 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-042f45b4-f0e0-48e9-9157-4d1b57f23aad tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "POST /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/action" status: 202 len: 0 microversion: 2.1 time: 0.102501 Jul 19 19:58:16.093776 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1259/2629] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:58:15 2022] POST /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:16.100118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.100779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.117741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.125490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.126751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.127440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.525763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "2703f954-a397-43a4-9e17-81870da81876"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-plugged", "status": "completed", "tag": "62cb4254-0f56-4249-96e0-c0284ed62939"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:16.535295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.535897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.550600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] Creating event network-vif-plugged:2703f954-a397-43a4-9e17-81870da81876 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:16.551234 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] Creating event network-vif-plugged:62cb4254-0f56-4249-96e0-c0284ed62939 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:16.560071 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e0ea5352-89a3-4626-ae0e-29424bfd3068 req-0e5ff1f9-6d7f-48f3-a5a4-dbcf6756c977 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038582 Jul 19 19:58:16.561225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1260/2630] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:16.582775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.584255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.585157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:16.592468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.593275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.594312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.595263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.595741 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5ca0909-0078-4a58-ab7b-7f5e6897b787 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1508 microversion: 2.1 time: 0.499633 Jul 19 19:58:16.599144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1371/2631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1508 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:16.630679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.631322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.645929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.646385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.647177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.648355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.012011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.015688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.024600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b7a7594-0685-455e-8152-d4fb1c9a3770 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.398208 Jul 19 19:58:17.027764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.029987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.032255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62c6f65a-f7c7-4d4d-92b4-05bb9d7eea3a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.456724 Jul 19 19:58:17.045557 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1261/2632] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:17.045792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1372/2633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:17.050287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1038609528", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1d21a13d-6ac7-4922-9252-f5a644b063cc"}], "security_groups": [{"name": "tempest-securitygroup--498535174"}], "key_name": "tempest-keypair-1540806213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4e207167-ee6d-4fea-a8de-c74063a8a8f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:17.052653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:17.053653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:17.063944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.064683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.065624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.066202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.241297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.252985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.254940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.261953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d6a48d0-10fe-4b83-aa91-db60b27bd792 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.213445 Jul 19 19:58:17.263105 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1262/2634] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:17 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:17.304436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] validate_networks() for [('1d21a13d-6ac7-4922-9252-f5a644b063cc', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:17.615113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:17.617474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:17.624163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.624889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.625889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.626678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.860050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.862799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for project 2f5dd9f9f99448b5974c423792c88e07. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:17.871449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for user 90860e756b9547909590fdb7f85dc076 and project 2f5dd9f9f99448b5974c423792c88e07. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:17.879940 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-514ad289-2124-49e7-b4dc-120058813bc0 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1513 microversion: 2.1 time: 0.268787 Jul 19 19:58:17.883090 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1263/2635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:17 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:17.886972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:17.887654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:17.889265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:17.890011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:17.890557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:17.900039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.900563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.901496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.901930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.922812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for project 2f5dd9f9f99448b5974c423792c88e07. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:17.930190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Getting quotas for user 90860e756b9547909590fdb7f85dc076 and project 2f5dd9f9f99448b5974c423792c88e07. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:18.005679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:18.007908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e207167-ee6d-4fea-a8de-c74063a8a8f2',volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:18.042844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.043569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.050814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.051264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.052285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.052759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.145336 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00f52da1-42f0-432a-862b-25feed5727d0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.099841 Jul 19 19:58:18.146618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1373/2636] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:18.152242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.153494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.164742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.165740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.166715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.168221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.398452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.407478 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a9ed8b09-d3b8-4d85-bfe4-350c018c50c8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.369214 Jul 19 19:58:18.408189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1264/2637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:18.412943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce1af7cb-1bae-4784-97f2-e77cc457b2ef tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.414132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce1af7cb-1bae-4784-97f2-e77cc457b2ef tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.494507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce1af7cb-1bae-4784-97f2-e77cc457b2ef tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.501685 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce1af7cb-1bae-4784-97f2-e77cc457b2ef tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1122 microversion: 2.1 time: 0.092174 Jul 19 19:58:18.502500 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1265/2638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1122 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:18.511555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.515434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.516970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.517097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.517606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.518126 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57993845-b5f7-4530-966f-983f8b02d2dc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1874 microversion: 2.42 time: 0.369736 Jul 19 19:58:18.518684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1374/2639] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:18.524396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.525000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.525907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.526480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.626124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.635319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.636844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:18.638718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:18.644710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-30d0b934-240e-4238-adad-4bf51975b681 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.131689 Jul 19 19:58:18.648195 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1266/2640] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:18.899263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.900033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.906486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.907018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.907883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.908406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.431283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:19.432192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:19.439343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.439908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.440877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.442076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.590205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:19.598577 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32b9f283-a7df-46fb-a633-94e31cce7c93 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1506 microversion: 2.1 time: 0.704998 Jul 19 19:58:19.606852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1375/2641] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:19.614437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:19.615066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:19.624605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.625392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.626400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.626837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.747152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:19.755797 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2dfafc64-2042-43cd-b36d-cf2b9ad61282 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1238 microversion: 2.1 time: 0.146988 Jul 19 19:58:19.756577 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1376/2642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:19 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1238 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:19.770864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:19.771712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:19.780522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.782384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.783539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.784053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.803588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:19.812310 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0fbb345c-7bbd-4b7c-b54f-4965b327922b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.390778 Jul 19 19:58:19.813096 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1267/2643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:19 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:19.817443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '.version_select at 0x7fb892fff1f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:19.824030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:19.839342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.839794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.840587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.841016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.878068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17661353-68a7-477c-9f74-cadfd87a42eb tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.064101 Jul 19 19:58:19.878654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1268/2644] 10.222.0.33 () {58 vars in 1295 bytes} [Tue Jul 19 19:58:19 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe/os-instance-actions => generated 611 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:19.883559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:19.884373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:19.891237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.891991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:19.892934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:19.893520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.075704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.086774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.088412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.095590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62049c3f-674b-4878-b010-f44652a09915 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.215558 Jul 19 19:58:20.096205 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1269/2645] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:19 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:20.101364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:20.101864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.113329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.113965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.114979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.115834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.151709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:58:20.264023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-02d073d1-7847-489f-80e0-8c638b44d197 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 204 len: 0 microversion: 2.1 time: 0.166167 Jul 19 19:58:20.265509 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1270/2646] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:58:20 2022] DELETE /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:58:20.269450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.277134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:20.278445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.279240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.281078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.282607 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b74b83a-22c7-4cdf-b85c-6268ab5803db tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2830 microversion: 2.42 time: 0.524916 Jul 19 19:58:20.283705 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1377/2647] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:19 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2830 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:20.285074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.285525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.286472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.287040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.292274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:20.305026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:20.305745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.312387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.313058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.314006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.314679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.523699 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-361da414-a6d1-407c-85e2-bd3df1a3e802 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.222855 Jul 19 19:58:20.524516 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1378/2648] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 19:58:20 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa/os-interface => generated 1830 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:20.655524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.667698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f09a90ee-f491-4d59-8875-683f761f5a16 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1512 microversion: 2.1 time: 0.396286 Jul 19 19:58:20.682088 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1271/2649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:20 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:20.775471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:20.776042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.785621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.786088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.786876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.787494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.832869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:20.834128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.846799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.849868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.851408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.853804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.942780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.952170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc18e1f1-917f-4338-b177-cfd565156a1c tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1238 microversion: 2.1 time: 0.181582 Jul 19 19:58:20.953332 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1379/2650] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:20 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1238 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:21.118705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:21.119385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:21.129687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.130451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.132073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.132673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.185167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:21.195962 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d0f1a16-2025-4049-a6e6-24f802a1b824 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.368606 Jul 19 19:58:21.208464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1272/2651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:20 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:21.295392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:21.320103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:21.326903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:21.361260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e533961e-04f8-4724-ab9e-e387c3126f26 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.249379 Jul 19 19:58:21.362465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1380/2652] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:21 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:21.687219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:21.687854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:21.700434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.703899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.704767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.705211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.777883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-978b1414-b135-4aa0-993d-da1306cdf481 req-6a54bd92-8448-4768-9f54-48b7ec07e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "tag": "10eb8c5f-4234-4b19-9634-f11411db5e67"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:21.799575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-978b1414-b135-4aa0-993d-da1306cdf481 req-6a54bd92-8448-4768-9f54-48b7ec07e0e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.803057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-978b1414-b135-4aa0-993d-da1306cdf481 req-6a54bd92-8448-4768-9f54-48b7ec07e0e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.820436 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-978b1414-b135-4aa0-993d-da1306cdf481 req-6a54bd92-8448-4768-9f54-48b7ec07e0e4 service nova] Creating event network-changed:10eb8c5f-4234-4b19-9634-f11411db5e67 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 19:58:21.827224 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-978b1414-b135-4aa0-993d-da1306cdf481 req-6a54bd92-8448-4768-9f54-48b7ec07e0e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053285 Jul 19 19:58:21.828002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1381/2653] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:21.972354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:21.973090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:21.990499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.991262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.992104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.992594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:22.003220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:22.878655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:22.892586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2df42c77-43f3-480d-be17-54eeb84c9bbc tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1512 microversion: 2.1 time: 1.209751 Jul 19 19:58:22.894440 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1273/2654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:21 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1512 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:22.901574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:22.903144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:22.915396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:22.916455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:22.917571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:22.918176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.080892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:23.090859 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f8797c4-1d0a-4451-8b35-39791931b9df tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1305 microversion: 2.1 time: 1.123881 Jul 19 19:58:23.104286 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1382/2655] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:21 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1305 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:23.132902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:23.133876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:23.149192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.149640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.150418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.150851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.331040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:23.350704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:23.355596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:23.368336 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c52418f-6fe9-48de-bec7-97b0320068fb tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.262213 Jul 19 19:58:23.370756 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1383/2656] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:23 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:23.415291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:23.426770 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d5ab53b-aa49-4d06-8b1d-9d29faa99782 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.530508 Jul 19 19:58:23.427758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1274/2657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:22 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:23.794845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c6f57525-bcb9-430f-89b5-a87e2e91f891 req-8cd55050-4db9-4dff-a7ff-5f8b1d6737f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b0e365-22d4-441d-8ff2-21248a6cfbce", "tag": "237d5b39-3e1e-4008-81ba-0e262393b8ac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:23.834584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c6f57525-bcb9-430f-89b5-a87e2e91f891 req-8cd55050-4db9-4dff-a7ff-5f8b1d6737f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.835089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c6f57525-bcb9-430f-89b5-a87e2e91f891 req-8cd55050-4db9-4dff-a7ff-5f8b1d6737f0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.874586 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c6f57525-bcb9-430f-89b5-a87e2e91f891 req-8cd55050-4db9-4dff-a7ff-5f8b1d6737f0 service nova] Creating event network-changed:237d5b39-3e1e-4008-81ba-0e262393b8ac for instance 88b0e365-22d4-441d-8ff2-21248a6cfbce on n-h1-843861-3 Jul 19 19:58:23.882121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c6f57525-bcb9-430f-89b5-a87e2e91f891 req-8cd55050-4db9-4dff-a7ff-5f8b1d6737f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091392 Jul 19 19:58:23.883173 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1384/2658] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:23.916447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:23.917071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:23.925147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.925782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.926746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.929462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.111185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:24.112140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:24.124985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16fc7a6d0bc443c6ba2ceeb613c1f8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6246937553c848809e78a2515e5757b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.134339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.134926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.136062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.139057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.161771 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-25663e06-44d4-4ded-97b0-428c9f4056e7 tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 200 len: 1470 microversion: 2.1 time: 0.248824 Jul 19 19:58:24.164893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1275/2659] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:23 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:24.393295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:24.394202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:24.406162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.406695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.407541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.408659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.517415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.527174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.528766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.535124 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-174d6d08-f586-479e-97a3-d47e376b923d tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.148573 Jul 19 19:58:24.539936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.544954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1276/2660] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:24 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:24.550517 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4367aeb0-479d-4ca8-8c3e-da34522e283d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1305 microversion: 2.1 time: 0.444127 Jul 19 19:58:24.552358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:24.552977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:24.556258 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1385/2661] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:24 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1305 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:24.566423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.566877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.567661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:24.568148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:24.826118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:24.836820 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6faa5da6-1c70-4d66-a7a7-bc8dd9d04fc1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.288479 Jul 19 19:58:24.837425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1277/2662] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:24 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:25.181248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:25.181907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] [instance: 63d8973c-4945-46ce-a090-c87bb193e0fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:25.199490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.199969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.200962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.201572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.226637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] HTTP exception thrown: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Request method failure captured: Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe HTTP/1.1 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wy-ZtXPNbyC0zADRlVPNOs7IYlX5tzJAqCpygXX9KAbWUVVkSDFcRONhKu5WKzI7kxoWPb3OU6ZW9mAuD5UpwaeMHKNQfu_yLgPL7M-3PKrui8OClsHpQOPNQ-nM-bzM70yQ0vUtAWaA6w44EvoqZpIT7dCU6Gfo7yddBQlqXsTFW0 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6246937553c848809e78a2515e5757b0 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceActionsTestJSON-2145680546 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6246937553c848809e78a2515e5757b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6246937553c848809e78a2515e5757b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6246937553c848809e78a2515e5757b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6246937553c848809e78a2515e5757b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceActionsTestJSON-2145680546 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6246937553c848809e78a2515e5757b0 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2145680546 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceActionsTestJSON-2145680546-project Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 16fc7a6d0bc443c6ba2ceeb613c1f8d1 Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceActionsTestJSON-2145680546-project Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '63d8973c-4945-46ce-a090-c87bb193e0fe'} Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:25.228550 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. Jul 19 19:58:25.233140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:25.240753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] Returning 404 to user: Instance 63d8973c-4945-46ce-a090-c87bb193e0fe could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:25.242324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd3d5754-6498-4057-9044-047c9a8f0b8a tempest-InstanceActionsTestJSON-2145680546 tempest-InstanceActionsTestJSON-2145680546-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe" status: 404 len: 111 microversion: 2.1 time: 0.065549 Jul 19 19:58:25.243309 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1386/2663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:25 2022] GET /compute/v2.1/servers/63d8973c-4945-46ce-a090-c87bb193e0fe => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:25.555177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:25.556780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:25.572719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:25.574664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:25.588045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.588720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.590423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.592063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.596604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.597724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.598702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.599304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.791666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:25.802940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:25.805355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:25.811102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c40b257-8149-4b02-a434-8f4a28856fe7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.260283 Jul 19 19:58:25.826235 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1278/2664] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:25 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:25.853514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:25.854134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:25.860678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.861135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:25.861914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:25.862354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:26.034955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:26.054928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47a80306-ccf8-4415-97c8-3c8f0a26d161 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1305 microversion: 2.1 time: 0.486414 Jul 19 19:58:26.055830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1387/2665] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:25 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1305 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:26.060861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a27255d4-f3f1-4d9b-babb-0f617629f14f req-726ee04b-e9bf-41de-9d91-eefe221299ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d8973c-4945-46ce-a090-c87bb193e0fe", "name": "network-vif-deleted", "tag": "38370bca-234a-48ce-b9d6-98e4a86bf8bc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:26.071063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a27255d4-f3f1-4d9b-babb-0f617629f14f req-726ee04b-e9bf-41de-9d91-eefe221299ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:26.072418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a27255d4-f3f1-4d9b-babb-0f617629f14f req-726ee04b-e9bf-41de-9d91-eefe221299ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:26.087603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a27255d4-f3f1-4d9b-babb-0f617629f14f req-726ee04b-e9bf-41de-9d91-eefe221299ec service nova] Creating event network-vif-deleted:38370bca-234a-48ce-b9d6-98e4a86bf8bc for instance 63d8973c-4945-46ce-a090-c87bb193e0fe on n-h1-843861-3 Jul 19 19:58:26.095876 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a27255d4-f3f1-4d9b-babb-0f617629f14f req-726ee04b-e9bf-41de-9d91-eefe221299ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 Jul 19 19:58:26.096908 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1388/2666] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:26.145987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:26.156392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67d0afef-7fc2-4360-8127-fda4935809ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.306566 Jul 19 19:58:26.157730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1279/2667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:25 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:26.836051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:26.837592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:26.846458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:26.847124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:26.848100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:26.848712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:26.922984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:26.931426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:26.933495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:26.939257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c07dec9-245f-4f36-99ab-4439e0e96385 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.108888 Jul 19 19:58:26.939873 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1389/2668] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:26 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:27.072479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:27.073222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:27.080755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.081420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:27.082193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.082618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:27.175938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:27.177935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:27.186734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.189109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:27.190140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.191289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:27.741131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:27.756225 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04812918-8383-497e-9564-aa4f88a5d795 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.687990 Jul 19 19:58:27.759458 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1280/2669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:27 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:27.834455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:27.845161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59929866-996a-4e0f-9094-84574e413c52 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.674849 Jul 19 19:58:27.855209 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1390/2670] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:27 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:27.960194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:27.961254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:27.969826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.970511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:27.972263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:27.972850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:28.055365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:28.064451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:28.066070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:28.071764 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c8f41ab-5b15-48ed-ac19-fd8bb92654a4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.115321 Jul 19 19:58:28.072682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1281/2671] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:27 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:28.780133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:28.781281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:28.784012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:28.785079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:28.804277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:28.805509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:28.807893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:28.808528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:28.863430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:28.865063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:28.869033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:28.880547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:28.889021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:28.892111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:28.893801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:29.123365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:29.135662 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab34e9aa-7946-45f7-abbd-85e7067d73f3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.364539 Jul 19 19:58:29.137549 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1391/2672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:28 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:29.145712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:29.147048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:29.155193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:29.165395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:29.166621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:29.167449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:29.291836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:29.333623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:29.338361 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17f7c370-b79f-4295-81a4-16f010954c69 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.478222 Jul 19 19:58:29.347309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:29.347925 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1282/2673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:28 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:29.349258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:29.355732 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34cb7223-4e54-46ac-800b-5932533845ad tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.215883 Jul 19 19:58:29.370138 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1392/2674] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:29 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:30.160952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:30.161573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:30.186935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.187396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.195415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.205310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.356399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:30.357723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:30.380246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.382649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.385690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.386996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.464017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:30.480873 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8029b6ff-3d59-4404-8594-66980b37bfa3 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.330433 Jul 19 19:58:30.481548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1283/2675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:30 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:30.495851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:30.510029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:30.529473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.529946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.533337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:30.533983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:30.685374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:30.698407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:30.701163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:30.714770 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c362225-2454-4f87-b775-d446a7459cbc tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.232241 Jul 19 19:58:30.716425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1284/2676] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:30 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:30.726947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:30.735620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64284aec-a95e-485f-b646-c2410c3b57d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.382978 Jul 19 19:58:30.740692 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1393/2677] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:30 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:31.489550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-47829694", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:31.498712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:31.499245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:31.507131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.507884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.508866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.509718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.549143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:31.550130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:31.550909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:31.551416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:31.551953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:31.562162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.562999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.564032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.564678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.584285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Getting quotas for project 9bbe51d895054b2c8355486b7811a015. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:31.590318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Getting quotas for user cbf7250a9e0d4b39b376b742f85ada22 and project 9bbe51d895054b2c8355486b7811a015. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:31.605290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:31.608133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:31.686377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d65177c5-bc9a-4840-b1a2-1a797ab2afdd tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.338907 Jul 19 19:58:31.689103 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1285/2678] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 19:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:58:31.704949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:31.705975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:31.710916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.739214 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2c189ac-0e6c-481d-b4db-48b6e0bd766d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.244962 Jul 19 19:58:31.747908 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1394/2679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:31 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:31.763586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:31.764611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:31.782453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.795896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.797123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.809370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.842195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.858713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.864753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.872215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2a62513-de9d-48c4-874e-8b9bc46784f2 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1279 microversion: 2.47 time: 0.174232 Jul 19 19:58:31.880997 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1286/2680] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:31 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:31.890217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:31.899142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:31.915296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.915959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.916884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:31.917398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:31.951494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.972131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.979388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:31.996702 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7028acb9-998e-460a-bebe-b4d550022713 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.247400 Jul 19 19:58:32.001474 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1395/2681] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:31 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:32.294619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:32.310440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32ddec5d-c790-4bde-b9f4-ee75f873ecef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.425087 Jul 19 19:58:32.311744 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1287/2682] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:31 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:32.757632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:32.759137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:32.768444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:32.771678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:32.772562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:32.774401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:32.775281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:32.892982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:32.893683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:32.905927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:32.906816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:32.915081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:32.917355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:33.001848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.012783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63575d2a-139b-45db-b779-0bb6c4825eab tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.260588 Jul 19 19:58:33.013374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1396/2683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:32 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:33.029038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:33.029652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:33.034780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.038209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:33.039375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:33.040218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:33.041050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:33.045635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.047373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.048895 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-92e55606-0482-4b41-9a6f-8060c31c5d52 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1331 microversion: 2.47 time: 0.160456 Jul 19 19:58:33.050128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1288/2684] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:32 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:33.179629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.196468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.206784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.227312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c754b81c-a574-4461-bee2-677641451f92 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.202586 Jul 19 19:58:33.228266 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1397/2685] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:33 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:33.329967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:33.330713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:33.342344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:33.345488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:33.346510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:33.347748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:33.405680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:33.576233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:33.585498 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5ba6874-a625-4737-881b-4dcef29b33c9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1476 microversion: 2.1 time: 0.259307 Jul 19 19:58:33.587393 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1289/2686] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:33 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:33.765303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f4aba84-b290-4bc5-b9dc-3ff3f89817fa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: .version_select at 0x7fb88d1fef70>, body: {"keypair": {"name": "tempest-keypair-1126177290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6rz5rMioVC/wR38I8m1NPFhji3EbNmifuK9UmmtaXtkiiMOJmjhTSJmDYuiMfinUot/fGw4SPJeCqx8+y8xOBYjM/552jsBUQ0YXQW1JKLEOzgAeA1rY+IOfclBNW3Bw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:33.787377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3f4aba84-b290-4bc5-b9dc-3ff3f89817fa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:33.794295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3f4aba84-b290-4bc5-b9dc-3ff3f89817fa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for user de95f85ce3714254acdb08a4004081bf and project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:33.825152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f4aba84-b290-4bc5-b9dc-3ff3f89817fa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128783 Jul 19 19:58:33.826285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1398/2687] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:58:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:34.032080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:34.032696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:34.039438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.040185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.041497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.042145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.071581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:34.072250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:34.080069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.080605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.081629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.082175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.263234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.280763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.282627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.284068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecb2d813-01b4-4dc1-8077-6e1fc368e8bb tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1337 microversion: 2.47 time: 0.218682 Jul 19 19:58:34.284793 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1399/2688] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:34 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1337 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:34.302472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:34.303649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:34.310255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.310732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.312783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.313266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.386199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.394987 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8ac29dc-41e4-441b-ac66-0e6ed127a8b4 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.368109 Jul 19 19:58:34.395897 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1290/2689] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:34 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:34.425073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.438587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.443251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.451048 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e941f1e1-0ac5-4434-b0be-3ae2fec80dc9 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.153018 Jul 19 19:58:34.451795 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1400/2690] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:34 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:34.604208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:34.604858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:34.611040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.611491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.612304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:34.612737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:34.824209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:34.835985 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33e44114-f8a6-446c-8d5b-7c494e87ec70 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1475 microversion: 2.1 time: 0.236072 Jul 19 19:58:34.846251 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1291/2691] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:34 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:35.304458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:35.305005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:35.313538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.314295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.315535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.316091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.412210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:35.413545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:35.421521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.422259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.423342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.423959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.438860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.451930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:35.455868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.458023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.464377 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b42ec4d-4aa5-4b22-92fa-67da5f421eec tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1337 microversion: 2.47 time: 0.163484 Jul 19 19:58:35.483144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1401/2692] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:35 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1337 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:35.494566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:35.495516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:35.503232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.504070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.505181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.505849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.636833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.644335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.647539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.650078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:35.653022 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16c45363-f97c-4cb2-a95a-2e387b029e2b tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.244578 Jul 19 19:58:35.654185 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1292/2693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:35 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:35.659886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1283640884", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ad74e5-94f8-432f-af88-e2a08d8f5485"}], "security_groups": [{"name": "tempest-securitygroup--1624430618"}], "key_name": "tempest-keypair-1126177290", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:35.665034 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b4d7a9d-bd99-401f-8597-bb44d12d3a73 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.175627 Jul 19 19:58:35.665775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1402/2694] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:35 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:35.744882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-98a4424c-288c-40f5-b49f-1862b1d6cf19 req-352ee7c0-35b6-455b-833f-fe054c76bb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b0e365-22d4-441d-8ff2-21248a6cfbce", "name": "network-vif-plugged", "status": "completed", "tag": "237d5b39-3e1e-4008-81ba-0e262393b8ac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:35.760880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-98a4424c-288c-40f5-b49f-1862b1d6cf19 req-352ee7c0-35b6-455b-833f-fe054c76bb51 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.762021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-98a4424c-288c-40f5-b49f-1862b1d6cf19 req-352ee7c0-35b6-455b-833f-fe054c76bb51 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.784914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] validate_networks() for [('c8ad74e5-94f8-432f-af88-e2a08d8f5485', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:35.813439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-98a4424c-288c-40f5-b49f-1862b1d6cf19 req-352ee7c0-35b6-455b-833f-fe054c76bb51 service nova] Creating event network-vif-plugged:237d5b39-3e1e-4008-81ba-0e262393b8ac for instance 88b0e365-22d4-441d-8ff2-21248a6cfbce on n-h1-843861-3 Jul 19 19:58:35.820162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-98a4424c-288c-40f5-b49f-1862b1d6cf19 req-352ee7c0-35b6-455b-833f-fe054c76bb51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080219 Jul 19 19:58:35.820950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1403/2695] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:35.855996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:35.856938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:35.867933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.869000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:35.870236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:35.871276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.149683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.158037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9eff756f-801f-4f05-b2dd-665a5f59020d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1473 microversion: 2.1 time: 0.307838 Jul 19 19:58:36.159232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1404/2696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:35 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1473 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:36.414109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:36.414682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:36.415002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:36.415414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:36.416056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:36.427663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.428138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.428951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.429395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.447598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:36.453499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for user de95f85ce3714254acdb08a4004081bf and project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:36.467963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:36.470151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:36.483373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:36.492393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:36.496727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:36.513788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.514552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.516254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.518354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.534472 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-25c6c945-f7e4-403a-b0d3-aabb9632bf2d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.878978 Jul 19 19:58:36.540107 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1293/2697] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:36.548047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fe69fbe-48d2-4893-b2bf-afad56c8d8f0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:36.548825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fe69fbe-48d2-4893-b2bf-afad56c8d8f0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:36.654030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2fe69fbe-48d2-4893-b2bf-afad56c8d8f0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.662035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fe69fbe-48d2-4893-b2bf-afad56c8d8f0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1238 microversion: 2.1 time: 0.117980 Jul 19 19:58:36.662668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1294/2698] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:36 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:36.674388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:36.675011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:36.687481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.695341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.696201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.697266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.697873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.699104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.701650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.703198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-977b37de-bd1a-4dd3-9448-cd4d30e08314 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1358 microversion: 2.47 time: 0.223011 Jul 19 19:58:36.704456 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1405/2699] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:36 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:36.709997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:36.711637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:36.729350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.729812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.730659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.731150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.859794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.871960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.873264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.879898 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-258239a4-3d9b-4392-ad5e-7277217d6052 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.173948 Jul 19 19:58:36.880813 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1406/2700] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:36 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:36.886463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1215838566"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:36.887621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:36.894682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.895137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.896207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:36.896689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:36.951418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:36.962130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49d2488f-6806-4fd0-b3f9-4059bddc6653 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1293 microversion: 2.1 time: 0.294813 Jul 19 19:58:36.962794 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1295/2701] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:36 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:37.178744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.180531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.187864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.188306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.189137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.189741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.232156 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-246fede1-53a3-47a6-bf20-de7f6b276b27 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "POST /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7/action" status: 202 len: 52 microversion: 2.47 time: 0.349373 Jul 19 19:58:37.233112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1407/2702] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:58:36 2022] POST /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7/action => generated 52 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:58:37.245162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.245536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.252915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.253370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.254199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.254638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.286349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:58:37.385877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.404250 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9d2aff5-75f2-466b-a5e2-fbf44d031fda tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1473 microversion: 2.1 time: 0.231563 Jul 19 19:58:37.404950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3eb14768-9ca3-4897-aaac-1f3aad9f1dde tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 204 len: 0 microversion: 2.47 time: 0.163194 Jul 19 19:58:37.405788 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1296/2703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:37.406368 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1408/2704] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:58:37 2022] DELETE /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:58:37.427266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.429394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.437032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.437500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.438293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.439017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.572907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.584604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.586158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.587887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6dee27c6-94f4-48d2-afc5-65fec1471542 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1364 microversion: 2.47 time: 0.164505 Jul 19 19:58:37.588548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1297/2705] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:37.683920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.685415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.694071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.694727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.695674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.696226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.816943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.825453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffe1f33b-ff7e-4cd1-9e8d-5375cf122184 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1234 microversion: 2.1 time: 0.145869 Jul 19 19:58:37.826438 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1409/2706] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1234 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:37.901259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.901901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.908527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.908980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.909752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.910189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.979754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.980401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.986846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.987301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.987679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:37.988106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.988545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.000322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.001840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.008972 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73ab8ad3-e2c3-4dc0-9483-d2bdd226d70c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.112174 Jul 19 19:58:38.009642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1298/2707] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:38.128340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.135966 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5830e29-b02d-4b9e-a04f-44ef657b0ff8 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1484 microversion: 2.1 time: 0.160186 Jul 19 19:58:38.136597 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1410/2708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1484 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:38.153287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:38.153689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:38.161426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.161426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.161426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.161870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.248314 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6640d5bb-e001-4f9f-bad9-34087dcb515a tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099102 Jul 19 19:58:38.249147 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1299/2709] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:58:38 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:38.423323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:38.424345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:38.431103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.431565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.432393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.433378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.483425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c396e08-1b3c-4856-8e76-b875b5c5e375", "name": "network-vif-unplugged", "status": "completed", "tag": "c00054e9-66f6-4a24-b2ea-3853c0592ce8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:38.493856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.494098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.509252 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] Creating event network-vif-unplugged:c00054e9-66f6-4a24-b2ea-3853c0592ce8 for instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 on n-h2-843861-3 Jul 19 19:58:38.517046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:58:38.525229 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-78819b35-d933-4053-8a11-b51628733559 req-3c0b2c33-1188-49fd-ae3e-57b0ce533788 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046564 Jul 19 19:58:38.526948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1300/2710] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:38.607943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:38.609532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:38.616349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.616886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.617733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.618249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.715263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.723092 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab1ead57-4031-4225-aba7-bda7fc92ca57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1473 microversion: 2.1 time: 0.304120 Jul 19 19:58:38.723694 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1411/2711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:38 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:38.734853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.744308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.745831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.746991 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1b38a63-7ce0-4dde-b923-199ea78f12af tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1364 microversion: 2.47 time: 0.143625 Jul 19 19:58:38.747563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1301/2712] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:38 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:38.848946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:38.849565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:38.856057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.856534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.857306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:38.857745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.962777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.970393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98d564eb-225f-45de-9b7a-aa053813fc49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1290 microversion: 2.1 time: 0.125425 Jul 19 19:58:38.970987 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1412/2713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:38 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:39.033381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:39.034378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:39.041555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.042112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.043112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.043879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.325582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.334491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.336237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.346106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c9f1e6ea-9ee7-4687-889a-e1bbd3b6f53c tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.319598 Jul 19 19:58:39.349927 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1302/2714] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:39 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:39.743849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:39.744667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:39.767195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:39.768541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:39.776231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.779403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.780463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.781614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.783778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.785605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.786312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.788522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.948375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.960340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.963625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:39.965533 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d8312f5-dcb8-4ba6-8127-4338ba085203 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1364 microversion: 2.47 time: 0.202899 Jul 19 19:58:39.966825 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1303/2715] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:39 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:39.972605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:39.975895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:39.988054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.992998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.994978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.995558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.074143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.086182 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5530334-a858-4338-92d9-7eb39b52e1c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1473 microversion: 2.1 time: 0.348444 Jul 19 19:58:40.087464 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1413/2716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:39 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:40.092590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6e5f94bd-1f2a-4101-9beb-58fc9fc9aa91 req-6d963013-7c97-4f87-8d1d-b7d6c6f2713e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b0e365-22d4-441d-8ff2-21248a6cfbce", "tag": "237d5b39-3e1e-4008-81ba-0e262393b8ac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:40.104096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6e5f94bd-1f2a-4101-9beb-58fc9fc9aa91 req-6d963013-7c97-4f87-8d1d-b7d6c6f2713e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:40.105003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6e5f94bd-1f2a-4101-9beb-58fc9fc9aa91 req-6d963013-7c97-4f87-8d1d-b7d6c6f2713e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.119351 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6e5f94bd-1f2a-4101-9beb-58fc9fc9aa91 req-6d963013-7c97-4f87-8d1d-b7d6c6f2713e service nova] Creating event network-changed:237d5b39-3e1e-4008-81ba-0e262393b8ac for instance 88b0e365-22d4-441d-8ff2-21248a6cfbce on n-h1-843861-3 Jul 19 19:58:40.125037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6e5f94bd-1f2a-4101-9beb-58fc9fc9aa91 req-6d963013-7c97-4f87-8d1d-b7d6c6f2713e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035916 Jul 19 19:58:40.126125 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1414/2717] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:40.132251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:40.133684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:40.143281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:40.143950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.145553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:40.146156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.276970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.287134 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4426ffc-a435-4bbc-9b13-ffbac2ad9dfa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1296 microversion: 2.1 time: 0.159569 Jul 19 19:58:40.288227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1415/2718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:40 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:40.335748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.345080 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a2126e1-9982-4db6-a91a-f3f9de8b7245 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1484 microversion: 2.1 time: 0.376769 Jul 19 19:58:40.346044 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1304/2719] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:39 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1484 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:40.367599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:40.368968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:40.377281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:40.377827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.378732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:40.379230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:40.488065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.492501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:40.514255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.516082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:40.524078 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a65232d7-e965-4540-bbc3-b82fc868f947 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.161157 Jul 19 19:58:40.524892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1416/2720] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:40 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:40.991781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:40.993338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:41.011439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.012760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.015978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.016897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.107748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:41.109223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:41.124694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.125415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.126151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.127172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.127932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.128627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lazy-loading 'fault' on Instance uuid 64230230-893c-4a2c-955c-92ccef5e90f7 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:58:41.129353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.330003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.339446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.341129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbf7250a9e0d4b39b376b742f85ada22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe51d895054b2c8355486b7811a015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.352490 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31e0e0d3-e863-4894-a71e-ec0327765504 tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 200 len: 1369 microversion: 2.47 time: 0.369472 Jul 19 19:58:41.352490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1305/2721] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:40 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 1369 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:41.367694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:41.369266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:41.376671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.377368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.378417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.379090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.647859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.660975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72363304-5a26-410f-9d70-ef363cdc59fb tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1473 microversion: 2.1 time: 0.557781 Jul 19 19:58:41.667378 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1417/2722] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:41 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1473 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:41.683948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:41.685732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:41.693824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.694676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.697528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:41.698248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:41.824890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.835938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.839193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.845347 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42cae226-00fa-4bf1-b2cb-f9e18248fd19 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.176353 Jul 19 19:58:41.845946 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1418/2723] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:41 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:41.852745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.861482 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d677e1f0-fbcc-4dd6-b7aa-e8db83ed3c49 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.508350 Jul 19 19:58:41.862075 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1306/2724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:41 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:42.386502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:42.393959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] [instance: 64230230-893c-4a2c-955c-92ccef5e90f7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:42.431298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.432278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.435223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.436289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.457485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] HTTP exception thrown: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Request method failure captured: Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 HTTP/1.1 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wznN3LgMf1Hg5K7Km1mXBNhDCsXJvmXB-Htu80RrE73GclYH8E9V90r9MsmobGfwxuQ5U4_56qEQVEu_6vk0kgLUoiqzO2DUc2kW-nXfJ8sOIrQpKme0bscseWp3qtQd3lB-sbd1qrLeRUDowoHxDr06aZfBowhqZI6xoi96VVjmio Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 9bbe51d895054b2c8355486b7811a015 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAaction247Test-701837856 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bbe51d895054b2c8355486b7811a015"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9bbe51d895054b2c8355486b7811a015"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bbe51d895054b2c8355486b7811a015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9bbe51d895054b2c8355486b7811a015"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAaction247Test-701837856 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 9bbe51d895054b2c8355486b7811a015 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAaction247Test-701837856 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAaction247Test-701837856-project Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: cbf7250a9e0d4b39b376b742f85ada22 Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAaction247Test-701837856-project Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '64230230-893c-4a2c-955c-92ccef5e90f7'} Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:42.459300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] Returning 404 to user: Instance 64230230-893c-4a2c-955c-92ccef5e90f7 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56768090-6ffe-4b09-b005-7c5049c4163e tempest-ServersAaction247Test-701837856 tempest-ServersAaction247Test-701837856-project] 10.222.0.33 "GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7" status: 404 len: 111 microversion: 2.47 time: 0.091920 Jul 19 19:58:42.466950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1419/2725] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:42 2022] GET /compute/v2.1/servers/64230230-893c-4a2c-955c-92ccef5e90f7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:58:42.610026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4bc391ff-e86c-4929-a346-4e29eb3b5f7d req-c60b48ad-336a-4906-ba2c-2f3daebc5fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2", "tag": "d229eab8-9f82-4b43-ad57-e72f5714c3aa"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:42.626024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4bc391ff-e86c-4929-a346-4e29eb3b5f7d req-c60b48ad-336a-4906-ba2c-2f3daebc5fa7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.631700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4bc391ff-e86c-4929-a346-4e29eb3b5f7d req-c60b48ad-336a-4906-ba2c-2f3daebc5fa7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.647152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4bc391ff-e86c-4929-a346-4e29eb3b5f7d req-c60b48ad-336a-4906-ba2c-2f3daebc5fa7 service nova] Creating event network-changed:d229eab8-9f82-4b43-ad57-e72f5714c3aa for instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 on n-h1-843861-3 Jul 19 19:58:42.653305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4bc391ff-e86c-4929-a346-4e29eb3b5f7d req-c60b48ad-336a-4906-ba2c-2f3daebc5fa7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047176 Jul 19 19:58:42.655182 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1307/2726] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:42.679422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:42.681678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:42.691091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.691933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.694263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.694716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.870158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:42.871273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:42.878714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.879165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.880163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.880799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.992612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:42.998886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:43.005145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:43.006703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:43.014620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e834b03-4009-4a75-8487-bf765dc2e136 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.151760 Jul 19 19:58:43.015801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1308/2727] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:42 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:43.016358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:43.022321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:43.022936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:43.026509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8732cf4c-b894-46d9-b1a1-f06e0a0ecea5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1470 microversion: 2.1 time: 0.351402 Jul 19 19:58:43.027691 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1420/2728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:42 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:43.030834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.031467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.032284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.033485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.045160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:43.045713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:43.053088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.053543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.054336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.055153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.128240 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f54b7de-a907-4393-9bfc-f6ecc20b23e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375/action" status: 204 len: 0 microversion: 2.1 time: 0.087009 Jul 19 19:58:43.128798 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1421/2729] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:58:43 2022] POST /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:58:43.148826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:43.149546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:43.157316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.158053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.159540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.160880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.279850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:43.291747 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-affd021d-1aea-4fae-a480-d8fb2879de1f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.274581 Jul 19 19:58:43.292559 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1309/2730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:43 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:43.410627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:43.420162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0c22374-d7c9-49b6-881f-66886b51021d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1470 microversion: 2.1 time: 0.286374 Jul 19 19:58:43.430678 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1422/2731] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:43 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:43.625212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c396e08-1b3c-4856-8e76-b875b5c5e375", "name": "network-vif-plugged", "status": "completed", "tag": "c00054e9-66f6-4a24-b2ea-3853c0592ce8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:43.642415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.643291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.657866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] Creating event network-vif-plugged:c00054e9-66f6-4a24-b2ea-3853c0592ce8 for instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 on n-h2-843861-3 Jul 19 19:58:43.667596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:58:43.675203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-46953ff3-8ef2-4766-be5e-0adc215ada76 req-fe3da7bb-23ad-4752-a2b6-64f884e192f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054141 Jul 19 19:58:43.676419 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1310/2732] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:44.038658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:44.039967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:44.044760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:44.054729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.055791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.056708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.057551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.130911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:44.140257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:44.142116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:44.147600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-247b08b2-3313-43a0-97d1-ffb5ed85d96e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.115574 Jul 19 19:58:44.148547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1423/2733] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:44 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:44.310583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:44.311297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:44.318334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.318792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.319580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.320059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.438123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:44.438752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:44.445950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.446405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.447196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:44.447642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:44.898114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:44.906290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdc2d732-c540-45f1-95ee-edb2ca42410e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.599933 Jul 19 19:58:44.906899 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1311/2734] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:44 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:45.060349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:45.071632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01e3f355-7ad5-4456-946b-124a69375381 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1470 microversion: 2.1 time: 0.638069 Jul 19 19:58:45.082034 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1424/2735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:44 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1470 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:45.168106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:45.168725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:45.175133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:45.175586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:45.176402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:45.178562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:45.273357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:45.281885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:45.283424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:45.289204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f862b8d6-a7f5-4691-8cd9-74afe3834443 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.125026 Jul 19 19:58:45.289813 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1312/2736] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:45 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:45.924186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:45.925025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:45.934815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:45.935280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:45.936288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:45.936505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.096853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:46.097613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:46.121476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.121917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.123104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.123791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.192701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.219439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f7f20cb-8796-4136-9f18-30f070834248 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.298914 Jul 19 19:58:46.221590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1425/2737] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:45 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:46.309587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:46.310219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:46.318836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.319740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.321212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.322223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.372072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.392633 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-40509d4f-6b4e-4ca0-b78a-b78a45600dd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1462 microversion: 2.1 time: 0.305137 Jul 19 19:58:46.406571 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1313/2738] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:46 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1462 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:46.411847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:46.412771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:46.419509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.420237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.421219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:46.421613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.422041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.436779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.440673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:46.441194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.450837 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c39768c4-6a95-4c17-971e-688f9047869b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.144910 Jul 19 19:58:46.453057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1426/2739] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:46 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:46.630395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.640990 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45a7ec72-1484-45e4-beb9-4ab8a056947e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1462 microversion: 2.1 time: 0.232656 Jul 19 19:58:46.642897 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1314/2740] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:46 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1462 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:46.662068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-49818e98-c43b-47c8-8d90-f2c29f4de333 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'create', calling method: .version_select at 0x7fb88d254ee0>, body: {"keypair": {"name": "tempest-keypair-434924694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ41FQG4musS+3m0lW3GIgwpKvJOyB0De86O50J+PPl3BpR9j27H+L3A2KYDx7E22k3X4SQBUKEpt74YwBB68Gmw0oUTOVJeracTm3ptA5qqzlbqXGnlZhdercFbFH+JA=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:46.677330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-49818e98-c43b-47c8-8d90-f2c29f4de333 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:46.683625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-49818e98-c43b-47c8-8d90-f2c29f4de333 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:46.686153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:46.716666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-49818e98-c43b-47c8-8d90-f2c29f4de333 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058484 Jul 19 19:58:46.721495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1427/2741] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:58:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:47.243179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:47.244081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:47.246981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:47.266425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.268079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:47.269651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.270478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:47.473451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:47.474166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:47.482182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.482772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:47.483538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.484247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:47.561827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:47.578227 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7025393-796e-4bfe-beaf-37b00b0df6fd tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.343258 Jul 19 19:58:47.578894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1315/2742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:47 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:47.619438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:47.633188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:47.635209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:47.642061 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-808f16df-c87c-4dc0-b8ff-d6c4020d8449 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.173459 Jul 19 19:58:47.643339 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1428/2743] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:47 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:48.093071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:48.093438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:48.105828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.106285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.107908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.108542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.113943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-941634fc-f0f9-4b8a-9c8c-3ea2e78e9a46 req-c2c64c9c-42d2-4ebb-a1b2-c0cb219e3ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2", "name": "network-vif-plugged", "status": "completed", "tag": "d229eab8-9f82-4b43-ad57-e72f5714c3aa"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:48.132234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-941634fc-f0f9-4b8a-9c8c-3ea2e78e9a46 req-c2c64c9c-42d2-4ebb-a1b2-c0cb219e3ae9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.132982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-941634fc-f0f9-4b8a-9c8c-3ea2e78e9a46 req-c2c64c9c-42d2-4ebb-a1b2-c0cb219e3ae9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.149642 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8bd103f-b5d5-4d2a-be68-d0257b96272a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/ips" status: 200 len: 149 microversion: 2.1 time: 0.060443 Jul 19 19:58:48.150929 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1316/2744] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:58:48 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:48.162612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-941634fc-f0f9-4b8a-9c8c-3ea2e78e9a46 req-c2c64c9c-42d2-4ebb-a1b2-c0cb219e3ae9 service nova] Creating event network-vif-plugged:d229eab8-9f82-4b43-ad57-e72f5714c3aa for instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 on n-h1-843861-3 Jul 19 19:58:48.168199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-941634fc-f0f9-4b8a-9c8c-3ea2e78e9a46 req-c2c64c9c-42d2-4ebb-a1b2-c0cb219e3ae9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058751 Jul 19 19:58:48.173201 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1429/2745] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:48.596904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:48.598026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:48.606600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.607423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.608684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.609291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.677744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:48.678969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:48.686855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.687581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.688583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.689241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.903040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:48.936525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:48.941443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:48.962838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2bce0a15-1a87-4ea6-8155-25224465c42b tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.289314 Jul 19 19:58:48.978064 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1430/2746] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:48 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:49.242632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:49.269504 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-969cfef4-b23c-48bf-b135-542bd75907e6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1364 microversion: 2.1 time: 0.674832 Jul 19 19:58:49.278266 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1317/2747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:48 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1364 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:49.991670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:49.994909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:50.007429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.007904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.008951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.009623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.131911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.146239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.148049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.155389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18663b04-e18b-4029-9d02-f1b62f3b5559 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.170314 Jul 19 19:58:50.166559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1431/2748] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:49 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:50.180009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-096850e7-31e7-42ff-a27a-4179589a58eb tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '.version_select at 0x7fb88cec1ca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.183924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-096850e7-31e7-42ff-a27a-4179589a58eb tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.184624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-096850e7-31e7-42ff-a27a-4179589a58eb tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.195061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-096850e7-31e7-42ff-a27a-4179589a58eb tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.021030 Jul 19 19:58:50.196173 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1318/2749] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:50.224139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f5cdb31-3335-4268-b855-f53b33d2606c tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.238525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f5cdb31-3335-4268-b855-f53b33d2606c tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018635 Jul 19 19:58:50.239392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1432/2750] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:50.257205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6978a58-9fdc-453f-9fa6-b42952ace604 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-175663724", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:50.259623 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:58:50.259623 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:58:50.300021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.301018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:50.323943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.326888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.327894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.330727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.333938 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6978a58-9fdc-453f-9fa6-b42952ace604 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.085069 Jul 19 19:58:50.335513 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1319/2751] 10.222.0.33 () {60 vars in 1145 bytes} [Tue Jul 19 19:58:50 2022] POST /compute/v2.1/flavors => generated 498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:50.347699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4411c14-8ecd-44c0-9b63-50e88daa54ed tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.370884 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4411c14-8ecd-44c0-9b63-50e88daa54ed tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029273 Jul 19 19:58:50.371488 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1320/2752] 10.222.0.33 () {58 vars in 1181 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:58:50.630700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.635730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1116376902", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "0cc34fd0-b2c6-460d-8f73-1f4238390f41"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:50.644365 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3317e59-3db2-47cd-8552-f4ca7bec7e2f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1550 microversion: 2.1 time: 0.348286 Jul 19 19:58:50.655510 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1433/2753] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1550 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:50.673137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.673990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:50.685252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.685710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.686560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.686997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.729853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:50.876199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3c6020d-9904-4c01-b128-06e8a7090275 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216319 Jul 19 19:58:50.877555 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1434/2754] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:50.888534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8617c0-249f-4b32-aa36-638642a789a7"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:50.890641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:50.903203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.903862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.905083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.906777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.149441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:51.319977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:51.321933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:51.322688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:51.323264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:51.324472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:51.359842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.360723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.367292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.369931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.377174 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-28160d47-e48d-4ae5-a282-3dd5b05e542a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492478 Jul 19 19:58:51.378993 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1435/2755] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:58:50 2022] POST /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:51.394747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:51.399144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:51.421425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.421882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.422694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.423126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.430748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:51.445601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:51.490672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:51.493240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:51.578804 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfef127e-644e-439b-bf2e-65e74863a6c0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949799 Jul 19 19:58:51.586669 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1321/2756] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:51.595887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:51.607705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:51.610873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:51.619731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7733c0bf-b222-451d-b060-97308ad387c7 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1447 microversion: 2.75 time: 0.234918 Jul 19 19:58:51.620582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1436/2757] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:51 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:51.634070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce6d3dae-4284-4765-87f7-1bbe1e7359d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:51.635157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce6d3dae-4284-4765-87f7-1bbe1e7359d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:51.895831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce6d3dae-4284-4765-87f7-1bbe1e7359d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:51.915861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce6d3dae-4284-4765-87f7-1bbe1e7359d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1279 microversion: 2.1 time: 0.322498 Jul 19 19:58:51.917777 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1322/2758] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:51 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1279 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:52.654101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:52.655026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:52.679661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.682251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:52.687533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.688359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:52.880285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:52.896982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:52.898744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:52.904569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2996efed-c56e-4fad-b359-9cb5e7e10a02 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1453 microversion: 2.75 time: 0.255542 Jul 19 19:58:52.905965 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1437/2759] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:52 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:58:52.937014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:52.941272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:52.954645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.963122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:52.972052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.972638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:53.115434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:53.127652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1291961330", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:53.144399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-692093a7-e6e8-4fb6-bad3-96c897291990 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1283 microversion: 2.1 time: 0.211502 Jul 19 19:58:53.147396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1438/2760] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:52 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:53.201232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:53.420007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c8b15233-1021-43ea-8be4-2b6a1b51a7d6 req-8d8efaaf-c0ac-4550-8dcf-0cbe436260b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2", "tag": "d229eab8-9f82-4b43-ad57-e72f5714c3aa"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:53.433600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c8b15233-1021-43ea-8be4-2b6a1b51a7d6 req-8d8efaaf-c0ac-4550-8dcf-0cbe436260b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:53.434163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c8b15233-1021-43ea-8be4-2b6a1b51a7d6 req-8d8efaaf-c0ac-4550-8dcf-0cbe436260b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:53.456365 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c8b15233-1021-43ea-8be4-2b6a1b51a7d6 req-8d8efaaf-c0ac-4550-8dcf-0cbe436260b9 service nova] Creating event network-changed:d229eab8-9f82-4b43-ad57-e72f5714c3aa for instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 on n-h1-843861-3 Jul 19 19:58:53.477328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c8b15233-1021-43ea-8be4-2b6a1b51a7d6 req-8d8efaaf-c0ac-4550-8dcf-0cbe436260b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060401 Jul 19 19:58:53.480511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1439/2761] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:53.929358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:53.930011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:53.942060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:53.942545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:53.943389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:53.949511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.111743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.122447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.124657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.131825 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-843fa7d4-5edf-475a-b581-86518e2f9e7e tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1453 microversion: 2.75 time: 0.208702 Jul 19 19:58:54.132664 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1440/2762] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:53 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:54.166268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:54.167599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:54.178209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:54.183233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.184433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:54.185265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.200344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:54.200824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:54.201227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:54.202066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:54.202500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:54.238734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:54.239199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.245133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:54.245787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.305511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:54.327135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:54.355396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:54.367298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:54.376631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:54.415313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.431968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92d3bd11-1b74-4ad0-848b-1efecc9d6d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1275 microversion: 2.1 time: 0.271180 Jul 19 19:58:54.433674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1441/2763] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:54 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:54.479279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b53decf-4c1e-4af5-a245-f35c4f8e667a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705705 Jul 19 19:58:54.483687 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1323/2764] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:54.490879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce0d320e-e24d-403b-beb1-19a30142d66f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:54.491613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ce0d320e-e24d-403b-beb1-19a30142d66f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:54.585886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ce0d320e-e24d-403b-beb1-19a30142d66f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.601490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ce0d320e-e24d-403b-beb1-19a30142d66f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1193 microversion: 2.1 time: 0.115023 Jul 19 19:58:54.602335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1442/2765] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:54 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:55.155135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:55.155842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:55.170251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.170703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.171502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.171968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.307610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:55.326986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:55.332841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:55.343796 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76936c16-b3f8-4eb0-a9cc-4d374a8dadde tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1453 microversion: 2.75 time: 0.194307 Jul 19 19:58:55.344423 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1324/2766] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:55 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:55.451333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:55.452001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:55.461571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.462299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.463718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.464486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.552156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:55.561059 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48bd62f2-3e89-4171-83f3-46d42fc3911d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1275 microversion: 2.1 time: 0.114205 Jul 19 19:58:55.562016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1443/2767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:55 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:55.620628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:55.621514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:55.635751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.637066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.638135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.638801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.722446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:55.730917 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c07dec34-5a94-42f1-9f8f-fc9ac55009c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1197 microversion: 2.1 time: 0.116033 Jul 19 19:58:55.732225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1325/2768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:55 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:56.368277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:56.369146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:56.376496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.376496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.377570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.378178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.502466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.516097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.519442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.527565 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15324261-c23d-4fe5-871a-d426e9af6cdf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1453 microversion: 2.75 time: 0.163245 Jul 19 19:58:56.528232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1444/2769] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:56 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:56.578965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:56.581341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:56.591855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.592485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.593419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.593988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.731708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.753533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:56.754756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:56.762654 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e064b80d-7dff-4b04-9ab2-4958d977b755 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1331 microversion: 2.1 time: 0.184657 Jul 19 19:58:56.775694 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1326/2770] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:56 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1331 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:56.780045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.780823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.782086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:56.783092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.873761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.886053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e18986f3-1c07-41c2-b10f-c4e1bc5e987d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1245 microversion: 2.1 time: 0.140038 Jul 19 19:58:56.887046 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1445/2771] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:56 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1245 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:57.557370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:57.558013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:57.566018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.566449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.567401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.568579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.649229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.660691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.664924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.671221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9b74d690-3a88-4384-a3b6-8565836b91d4 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1453 microversion: 2.75 time: 0.118473 Jul 19 19:58:57.672382 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1327/2772] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:57 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:57.786370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:57.789830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:57.800692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.801715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.803412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.804471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.903741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.905700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:57.907426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:57.913667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.914120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.914893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.915324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.915705 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-891b0807-6e98-48ab-a011-6710e51d7644 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1349 microversion: 2.1 time: 0.135752 Jul 19 19:58:57.917452 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1446/2773] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:57 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1349 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:57.986745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.995775 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c3fbc6c0-838f-498f-bd7e-f315181301d8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1253 microversion: 2.1 time: 0.094411 Jul 19 19:58:57.996425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1328/2774] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:57 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1253 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:58.696428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:58.697535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:58.721931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.722606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.726691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.727481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.878734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:58.889170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:58.892737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:58.901669 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15466d2c-67ad-493f-b4a6-9122345f4e00 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1438 microversion: 2.75 time: 0.210752 Jul 19 19:58:58.903077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1447/2775] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:58 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1438 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:58:58.954984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:58.955770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:58.971373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.971864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.972662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.973098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.171640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:59.175706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:59.177965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.183968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71167cd6-63c4-4886-881a-bc05eb89586e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1337 microversion: 2.1 time: 0.244291 Jul 19 19:58:59.185137 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1448/2776] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:58 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1337 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:59.187794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.188586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.190116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.191011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:59.191462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.191723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.199623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.200003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.201199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.201651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.318365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:59.342587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbe3f4b5-5e2f-4b0d-b18a-8443041cffcf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1251 microversion: 2.1 time: 0.155146 Jul 19 19:58:59.343084 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1449/2777] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:59 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1251 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:59.360347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:59.361182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:59.362040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:59.362868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:59.363773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:59.522545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:59.560451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.575203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.576071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.577092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.577707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.737748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:58:59.767781 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ade0e79a-3332-46af-8b2b-0656881df9ec tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a/action" status: 202 len: 1942 microversion: 2.75 time: 0.847979 Jul 19 19:58:59.769226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1329/2778] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 19:58:58 2022] POST /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a/action => generated 1942 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 19:58:59.816043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:59.817512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.846603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.849958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.852945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.855103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.105366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:00.168295 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58bd1c3b-70fa-42f2-9078-1d894679daac tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.379033 Jul 19 19:59:00.170351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1450/2779] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:58:59 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:00.202837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:00.203532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:00.229611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:00.230513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.232101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:00.233596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.360449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:00.361149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:00.367888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:00.368670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.369688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:00.370371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.556574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:00.568654 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54794809-c8a6-4765-94dc-67727aa5db76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.367036 Jul 19 19:59:00.581349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1330/2780] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:00 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:00.688374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-28163827-8e87-4f6a-8767-7fd5b993e124 req-4dd7c2a2-a0b6-484d-8b35-6dc6a8f48c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:00.699903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-28163827-8e87-4f6a-8767-7fd5b993e124 req-4dd7c2a2-a0b6-484d-8b35-6dc6a8f48c4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:00.700765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-28163827-8e87-4f6a-8767-7fd5b993e124 req-4dd7c2a2-a0b6-484d-8b35-6dc6a8f48c4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.738828 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-28163827-8e87-4f6a-8767-7fd5b993e124 req-4dd7c2a2-a0b6-484d-8b35-6dc6a8f48c4d service nova] Creating event network-changed:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 19:59:00.753826 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-28163827-8e87-4f6a-8767-7fd5b993e124 req-4dd7c2a2-a0b6-484d-8b35-6dc6a8f48c4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069222 Jul 19 19:59:00.754497 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1331/2781] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:00.838811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:00.850476 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-256ed7f5-d208-4086-ab3c-8391781d0482 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.494879 Jul 19 19:59:00.851083 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1451/2782] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:00 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:01.062372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-824eccdb-e22b-49f7-9bd5-56bfaf245d35 req-c3fbcb38-640e-4750-841f-0dafa533940a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c042270b-e0af-4d95-bc23-892e0192c6ce", "tag": "e62624b4-cd2a-4636-9bf1-14e6e22ca0b0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:01.083077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-824eccdb-e22b-49f7-9bd5-56bfaf245d35 req-c3fbcb38-640e-4750-841f-0dafa533940a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.084746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-824eccdb-e22b-49f7-9bd5-56bfaf245d35 req-c3fbcb38-640e-4750-841f-0dafa533940a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.124854 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-824eccdb-e22b-49f7-9bd5-56bfaf245d35 req-c3fbcb38-640e-4750-841f-0dafa533940a service nova] Creating event network-changed:e62624b4-cd2a-4636-9bf1-14e6e22ca0b0 for instance c042270b-e0af-4d95-bc23-892e0192c6ce on n-h2-843861-3 Jul 19 19:59:01.132351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-824eccdb-e22b-49f7-9bd5-56bfaf245d35 req-c3fbcb38-640e-4750-841f-0dafa533940a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075454 Jul 19 19:59:01.134006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1332/2783] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:01.195794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:01.197144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:01.208695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.209412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.211345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.211800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.353867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:01.373263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:01.413856 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8028bdba-87ba-46c1-8548-868edda453e0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.225634 Jul 19 19:59:01.414994 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1452/2784] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:01 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:01.590773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:01.591431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:01.598483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.599458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.600344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.600725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.868494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:01.869024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:01.876123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.876569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.877337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.877767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.026984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:02.035054 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a879ce6d-5730-4c7e-81b2-e5262149437e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.450794 Jul 19 19:59:02.035632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1333/2785] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:01 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:02.058796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:02.066567 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-823dd1a3-25a8-4935-9807-f48a10d1173f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.202318 Jul 19 19:59:02.067151 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1453/2786] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:01 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:02.434488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:02.435186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:02.441638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:02.442079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.443526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:02.443955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.517640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:02.535249 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b719ac6-1bec-4498-9787-f16fe6e4393e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.104544 Jul 19 19:59:02.535750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1334/2787] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:02 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:03.053390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:03.054010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:03.061378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.061829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.062604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.063044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.084565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:03.085193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:03.092402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.092850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.093688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.094124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.262163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:03.270142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90258bc7-0000-4105-bf70-a2901518b370 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.221615 Jul 19 19:59:03.271273 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1454/2788] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:03 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:03.288984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:03.297613 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d83622ea-2655-4d1b-9ed8-df3acb68e060 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.217022 Jul 19 19:59:03.298196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1335/2789] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:03 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:03.554558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:03.555164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:03.562331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.562784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.563542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.564007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.642748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:03.661014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab8ed656-713c-431c-ac2a-73574f65def3 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.110298 Jul 19 19:59:03.661596 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1455/2790] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:03 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:03.789292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:03.789903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:03.796011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.796456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.797210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.797647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.929946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:03.937627 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c0deaad-2348-4a9c-90b1-fb826f1c7a37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.152170 Jul 19 19:59:03.938195 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1336/2791] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:03 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:03.955558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:03.956234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:03.962293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.962749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:03.963522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:03.964004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.102599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:04.110142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1bb01115-4b38-4c42-b3d1-e909b01d5078 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.158486 Jul 19 19:59:04.110713 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1456/2792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:03 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:04.127556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:04.128192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:04.135608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.136100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.136865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.137300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.264048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:04.278514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:04.286059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96a46f35-156d-4752-b095-fa16ecb624b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.162216 Jul 19 19:59:04.287521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1337/2793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:04.288771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:04.289475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:04.296425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.296896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.297860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.298302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.303114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1024342863"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:04.304367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:04.310986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.311439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.312354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.312695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.347474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=14 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:04.463031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:04.474277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5f0fe48-cddd-439c-92eb-e10f59031cfe tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.189640 Jul 19 19:59:04.475053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1457/2794] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:04 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:04.480251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:04.481163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:04.488267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.488822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.490454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.491005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.594986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:04.656222 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-843c5863-07c0-49c8-9495-8fe9bd206aad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.357145 Jul 19 19:59:04.656385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:04.657185 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1338/2795] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:04 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 19 19:59:04.666022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c956b3af-c254-4630-922f-1ab5054a64ca tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.189658 Jul 19 19:59:04.666787 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1458/2796] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:04 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:04.681149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:04.681904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:04.689197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.689847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.690678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:04.691210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:04.834280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:04.863973 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41af354e-be53-41b6-bf5a-accac399d77e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.187244 Jul 19 19:59:04.879852 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1339/2797] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:04 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:04.967448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02e03966-9236-49b5-b7cb-678c38729634 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: .version_select at 0x7fb88f8a93a0>, body: {"keypair": {"name": "tempest-keypair-1908455230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeiTbksHtZHM4T0QrRphxSPmcmYZtj5FgSfI1I+rX/5n/BK/ReupFamXKXdHum5zLPsBKEbTHlSOyAq1tFdPPAWJyhsjh1Llgbp7F6v/RddNXGW4Bk7ytm8VzIAMKC94g=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:04.983953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-02e03966-9236-49b5-b7cb-678c38729634 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:04.991790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-02e03966-9236-49b5-b7cb-678c38729634 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:05.002008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:05.019874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02e03966-9236-49b5-b7cb-678c38729634 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056736 Jul 19 19:59:05.020613 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1459/2798] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:59:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:05.492163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:05.492963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:05.501070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.501908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:05.503066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.503688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:05.686459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:05.687392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:05.698354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.699008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:05.699838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.700380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:05.738803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:05.751219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96def00e-52f7-4e30-8727-a896ba370fcf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.262749 Jul 19 19:59:05.751996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1340/2799] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:05 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:05.888226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:05.889038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:05.897978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.898429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:05.899241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:05.899671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.002268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:06.003847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:06.015572 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6175f85d-923f-4f8b-b3b4-5fb92b2ce6f9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.335217 Jul 19 19:59:06.017186 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1460/2800] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:05 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:06.022165 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc2da2e4-3d81-4868-92e9-69b3a3cb7974 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.138114 Jul 19 19:59:06.023187 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1341/2801] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:05 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:06.695354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1140868661", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81"}], "security_groups": [{"name": "tempest-securitygroup--1116492334"}], "key_name": "tempest-keypair-1908455230", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:06.771192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:06.772754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:06.781096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.781544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.782321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.782763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.812292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] validate_networks() for [('dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:07.027615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.040184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7250edc-0a92-440c-ae93-f51625116625 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.272441 Jul 19 19:59:07.040919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1342/2802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:06 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:07.047114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.048440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:07.058930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.060330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.061201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.061585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.299474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.307236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-deb005a7-227e-49ed-b72d-7c8f261fbbe3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.265213 Jul 19 19:59:07.308067 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1343/2803] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:07.320448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.321012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:07.327062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.327514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.328315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.328754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.333919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:07.426843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:07.427369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:07.427758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:07.427947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:07.428413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:07.429007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:07.438016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.438472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.439294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.439758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.451364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f98df09-daf1-405c-b5a0-fc2dad72d421 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.134596 Jul 19 19:59:07.464596 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1344/2804] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:07.464805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:07.464805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:07.477048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:07.479361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:07.530217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-050139c9-07c7-421f-9690-a110429ed940 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.839430 Jul 19 19:59:07.531106 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1461/2805] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:59:07.541360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f23b5142-edd3-4cfe-8aad-0f3bd18114c0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.541970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f23b5142-edd3-4cfe-8aad-0f3bd18114c0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:07.606553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f23b5142-edd3-4cfe-8aad-0f3bd18114c0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.614353 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f23b5142-edd3-4cfe-8aad-0f3bd18114c0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1242 microversion: 2.1 time: 0.076769 Jul 19 19:59:07.614934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1345/2806] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:08.059077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.059835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.067895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.068387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.069206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.069649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.235493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:08.246571 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-acc94f8a-53d1-4054-840e-5285e742f20c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.192682 Jul 19 19:59:08.247181 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1462/2807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:08.325483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.326153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.335515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.336069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.336984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.337529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.473682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.475559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.482786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.483245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.484127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.485540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.487506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:08.497400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b69ee9c-ed52-4b61-be9a-f2f441a1b961 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.176524 Jul 19 19:59:08.509772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1346/2808] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:08.595488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:08.630799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f78b01fc-fea4-461a-bdb9-e3ae25d74b0e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.161564 Jul 19 19:59:08.632135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.633069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.636005 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1463/2809] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:08.649528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.649987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.651197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.651671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.774123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:08.784323 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6081771-628d-436f-b309-2d2c6c5bd128 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1302 microversion: 2.1 time: 0.155866 Jul 19 19:59:08.785020 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1347/2810] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:09.265996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:09.267080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:09.280793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.281596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.283080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.284249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.519440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:09.521244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:09.531210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.531922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.532844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.533490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.662967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:09.677612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11abc664-9732-4ac5-aebf-faf6c26bf17f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.415308 Jul 19 19:59:09.681428 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1464/2811] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:09 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:09.687043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:09.688104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:09.695515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.696299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.697277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.697867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.872107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:09.893074 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2945c96b-cd06-4a92-b544-39c41608f9d5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.210222 Jul 19 19:59:09.893671 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1465/2812] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:09 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:09.905109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:09.909037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:09.909887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:09.916561 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1d2922d-ada5-457a-a2c9-da24ba9b365e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.402510 Jul 19 19:59:09.916744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.917266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:09.922819 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1348/2813] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:09 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:09.923095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:09.923095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.250718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.259417 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ba2dcd4-59d6-43e4-88b5-1758f24892d0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.364702 Jul 19 19:59:10.260050 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1466/2814] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:09 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:10.698888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.699607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:10.708749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.709297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.710145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.710623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.899794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e145ece8-43d2-4e0b-9f0f-13e2784c0d42 req-b2831f75-fef7-4371-a986-1b77fad4a3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-plugged", "status": "completed", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:10.915347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e145ece8-43d2-4e0b-9f0f-13e2784c0d42 req-b2831f75-fef7-4371-a986-1b77fad4a3b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.916808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e145ece8-43d2-4e0b-9f0f-13e2784c0d42 req-b2831f75-fef7-4371-a986-1b77fad4a3b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.937561 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e145ece8-43d2-4e0b-9f0f-13e2784c0d42 req-b2831f75-fef7-4371-a986-1b77fad4a3b3 service nova] Creating event network-vif-plugged:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 19:59:10.944877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e145ece8-43d2-4e0b-9f0f-13e2784c0d42 req-b2831f75-fef7-4371-a986-1b77fad4a3b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049474 Jul 19 19:59:10.946627 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1467/2815] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:10.957569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.959154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:10.974825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.975533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.976476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.977023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.981242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.992847 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f08c256-f4fe-4096-8631-82bf729880ee tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.298000 Jul 19 19:59:10.994003 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1349/2816] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:10 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:11.000204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:11.001040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:11.010766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.014954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.018884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.019330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.445514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:11.465799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5775ab8-974c-4702-a6f9-22cf49a18578 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.517349 Jul 19 19:59:11.466716 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1468/2817] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:10 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:11.480773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:11.481848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:11.489009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.489617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.490487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.491256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.729058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:11.737865 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4adad7a8-817e-4c35-b7f3-01a23f9cd9c4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.742630 Jul 19 19:59:11.738473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1350/2818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:10 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:11.744326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-914b026d-c393-4bec-8fd5-b9059449acd1 req-2f35252b-d55a-45b8-b28c-dfe8d8a12d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f133e-fe86-43c4-a521-0bf8018684f4", "tag": "684c65a9-ae95-4d5c-afc4-9745180197ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:11.753222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-914b026d-c393-4bec-8fd5-b9059449acd1 req-2f35252b-d55a-45b8-b28c-dfe8d8a12d77 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.753934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-914b026d-c393-4bec-8fd5-b9059449acd1 req-2f35252b-d55a-45b8-b28c-dfe8d8a12d77 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.767675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-914b026d-c393-4bec-8fd5-b9059449acd1 req-2f35252b-d55a-45b8-b28c-dfe8d8a12d77 service nova] Creating event network-changed:684c65a9-ae95-4d5c-afc4-9745180197ca for instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 on n-h1-843861-3 Jul 19 19:59:11.773966 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-914b026d-c393-4bec-8fd5-b9059449acd1 req-2f35252b-d55a-45b8-b28c-dfe8d8a12d77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Jul 19 19:59:11.775297 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1351/2819] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:11.860705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:11.871306 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-14e774e5-74e9-4214-bd4d-e67e32d8e569 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.403148 Jul 19 19:59:11.872806 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1469/2820] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:11 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:12.012013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.012719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.020864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.021083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.022210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.023082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.234902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.245398 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22700d25-7b77-4457-b7bf-255a1620feff tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.238564 Jul 19 19:59:12.246012 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1352/2821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:12.487781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.488431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.495509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.496001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.496775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.497209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.499918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:12.570732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:12.589129 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a21d9bd4-4e1a-4ed4-9bfd-7c9439852ee7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.105072 Jul 19 19:59:12.589732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1470/2822] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:12.756741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.757497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.766429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.766881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.767663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.768138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.890536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.891855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.898747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.899335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.900272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.900808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.915796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.932067 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecf341ab-7d76-4669-9bbc-d4b338ce23e7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.180353 Jul 19 19:59:12.933020 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1353/2823] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:13.073513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:13.081261 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e56ddc0-337b-4e86-b210-27017150be41 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.195549 Jul 19 19:59:13.081846 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1471/2824] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:13.262983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:13.263660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:13.270359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.271002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.271783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.272343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.497862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:13.505718 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23a55193-c978-4cbe-98ab-5418a67fee5c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1379 microversion: 2.1 time: 0.247372 Jul 19 19:59:13.506564 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1354/2825] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:13 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1379 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:13.608941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:13.609550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:13.617128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.617571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.618331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.618760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.711260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:13.730473 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf71329c-c825-4689-84d3-3435df87df3b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.125257 Jul 19 19:59:13.731078 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1472/2826] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:13 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:13.952860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:13.953511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:13.960950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.961393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.962161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.962592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.100933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.101825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.105231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.108340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.108801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.109671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.110114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.113600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a132933b-2113-451f-8d83-9236483e0016 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.167555 Jul 19 19:59:14.114421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1355/2827] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:13 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:14.256245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.264260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-110e3be2-a4b8-455c-88b0-5f22e9488917 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.169552 Jul 19 19:59:14.265127 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1473/2828] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:14.522655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.523425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.530139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.530598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.531467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.531932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.665235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.672891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77d1ad61-593d-4fa6-95c9-73354b661040 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1529 microversion: 2.1 time: 0.154247 Jul 19 19:59:14.673474 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1356/2829] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1529 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:14.689382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.689999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.697515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.697956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.698710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.699139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.750074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.750595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.757255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.757700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.758462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.758887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.843970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:14.853489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.861318 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65c1db45-accc-4a1e-b87f-d8979439f86a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1529 microversion: 2.1 time: 0.175719 Jul 19 19:59:14.861508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f14e27dc-17de-4fbd-849f-42daea35c8e7 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.115079 Jul 19 19:59:14.861958 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1357/2830] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:14.862056 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1474/2831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1529 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:14.879387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74f7f75a-1f13-4adc-8f64-4011600cda3e tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.880293 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:59:14.880293 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 19:59:14.888461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:14.897747 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74f7f75a-1f13-4adc-8f64-4011600cda3e tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/0cc34fd0-b2c6-460d-8f73-1f4238390f41" status: 202 len: 0 microversion: 2.1 time: 0.022385 Jul 19 19:59:14.898317 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1358/2832] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:14 2022] DELETE /compute/v2.1/flavors/0cc34fd0-b2c6-460d-8f73-1f4238390f41 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:14.906213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4432f784-193f-407c-a0c8-a03412fc96d5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.926164 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4432f784-193f-407c-a0c8-a03412fc96d5 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023597 Jul 19 19:59:14.927337 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1475/2833] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:14.941983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:14.943385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.950332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.950782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.951549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.952012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.983348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.990404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Old instance type tempest-test_resize_flavor_-175663724, new instance type m1.heat {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:59:14.996676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:14.997246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:14.997892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:14.998299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:14.998708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:15.068264 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8a688699-65ce-429b-addc-de068f2b04a3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b/action" status: 202 len: 0 microversion: 2.1 time: 0.130382 Jul 19 19:59:15.068889 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1359/2834] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:14 2022] POST /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:15.077214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.077852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.084259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.084717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.085530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.086128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.130713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.131330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.137975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.138423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.139395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.140274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.275353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:15.287047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-285ed7e4-c9c4-43ec-bb6d-ad7a56aa6e39 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1538 microversion: 2.1 time: 0.212540 Jul 19 19:59:15.288253 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1476/2835] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1538 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:15.294624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.295489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.303001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.303565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.304660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.305312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.536409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:15.546257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f3a2dc1b-86e6-4dcf-b92c-c8dd34878765 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.256412 Jul 19 19:59:15.546866 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1477/2836] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:15.592910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:15.602742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b623a620-696e-4d38-9460-cd93265c3310 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.475816 Jul 19 19:59:15.603630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1360/2837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:15.883598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.884291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.899206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.899843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.900867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.901416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.910498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-af177780-82f8-4998-8a77-a34bc225b036 req-bfe32203-a231-4f7a-a4dd-5953bb40705e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f133e-fe86-43c4-a521-0bf8018684f4", "name": "network-vif-plugged", "status": "completed", "tag": "684c65a9-ae95-4d5c-afc4-9745180197ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:15.929310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-af177780-82f8-4998-8a77-a34bc225b036 req-bfe32203-a231-4f7a-a4dd-5953bb40705e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.930237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-af177780-82f8-4998-8a77-a34bc225b036 req-bfe32203-a231-4f7a-a4dd-5953bb40705e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.947968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-af177780-82f8-4998-8a77-a34bc225b036 req-bfe32203-a231-4f7a-a4dd-5953bb40705e service nova] Creating event network-vif-plugged:684c65a9-ae95-4d5c-afc4-9745180197ca for instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 on n-h1-843861-3 Jul 19 19:59:15.965383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-af177780-82f8-4998-8a77-a34bc225b036 req-bfe32203-a231-4f7a-a4dd-5953bb40705e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067927 Jul 19 19:59:15.968837 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1361/2838] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:16.016657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:16.037822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bff71110-a59d-4568-ab05-06c59d6da11d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.159722 Jul 19 19:59:16.044011 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1478/2839] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:16.305130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:16.305820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:16.313867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.314323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.315102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.315566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.320182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:16.477545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:16.487317 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8a593682-1ffd-44a7-9c39-1d20a1d262d5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1538 microversion: 2.1 time: 0.186588 Jul 19 19:59:16.487915 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1362/2840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:16 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1538 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:16.563280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:16.564248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:16.570990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.571493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.572388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.572802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.621026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:16.621658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:16.628242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.628687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.629461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.629902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.776722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:16.789645 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5af97033-7613-4dd7-aab4-49864cd8e5e3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1368 microversion: 2.1 time: 0.230839 Jul 19 19:59:16.790343 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1479/2841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:16 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:16.810693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:16.819173 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-deb1577a-5305-4765-9181-89dfd3a57481 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.202112 Jul 19 19:59:16.819750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1363/2842] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:16 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:17.060433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.061047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.071015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.071467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.072262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.072875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.151121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:17.169450 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd22667b-5a5a-47e1-ac60-fb31cf9d2e7f tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.114877 Jul 19 19:59:17.170049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1480/2843] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:17.373758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.374371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.382054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.382599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.383528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.384004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.507237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.507994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.511156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:17.512760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:17.521147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.521598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.522366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.522792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.611661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:17.743867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.753314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.755273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.756578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d34e3f4b-7f74-42ad-a1f5-d8fffe27a74f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2949 microversion: 2.42 time: 0.386874 Jul 19 19:59:17.757386 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1364/2844] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2949 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:17.776502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.777001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.783314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.783771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.784584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.785021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.822353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.830832 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34da9da1-98a1-4a3e-8711-5d4f2ddeb499 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1538 microversion: 2.1 time: 0.329400 Jul 19 19:59:17.831997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1481/2845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1538 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:17.838517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.839651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.850543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.851006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.851836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.852273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.932523 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12c522fd-8fce-439d-9a69-f7aae53e1a0b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.159760 Jul 19 19:59:17.933133 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1365/2846] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa/os-interface => generated 1830 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:17.937647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.938304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.946161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.946613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.947451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.947913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.178317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:18.189569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-84740b9d-08fd-4139-a53a-b76b5fcb401c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1558 microversion: 2.1 time: 0.356390 Jul 19 19:59:18.190377 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1482/2847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1558 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:18.195611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-plugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}, {"server_uuid": "c042270b-e0af-4d95-bc23-892e0192c6ce", "name": "network-vif-plugged", "status": "completed", "tag": "e62624b4-cd2a-4636-9bf1-14e6e22ca0b0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:18.207434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:18.213693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.216621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.219349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b853a8a-d298-4d77-a9fb-07c0786185dc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.285047 Jul 19 19:59:18.220260 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1366/2848] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:18.232633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:18.233583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:18.251140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] Creating event network-vif-plugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:59:18.251418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.252045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.252712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] Creating event network-vif-plugged:e62624b4-cd2a-4636-9bf1-14e6e22ca0b0 for instance c042270b-e0af-4d95-bc23-892e0192c6ce on n-h2-843861-3 Jul 19 19:59:18.252843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.253276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.265669 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4bb71ee9-bb5e-4651-ad32-2b8d730de544 req-64470a5d-2491-402b-98b3-cffe6e25a81c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073771 Jul 19 19:59:18.267220 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1483/2849] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:18.280653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:18.281311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:18.288377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.289109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.290264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.290859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.363228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:18.386968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7442021-5172-4944-8d4c-a963ee7736a0 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.163976 Jul 19 19:59:18.389398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1367/2850] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:18 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:18.408324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-056a31be-7038-4d38-be38-29263df35d58 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139139 Jul 19 19:59:18.409049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1484/2851] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 19:59:18 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:18.851079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:18.851741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:18.859193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.859648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.860706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.861142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.130277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.141541 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-841f95d1-d8bd-4e5c-9bb6-eb97f34d4477 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.295544 Jul 19 19:59:19.149632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1368/2852] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:18 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:19.237538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:19.239466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:19.247075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.247832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.248722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.249169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.265669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:19.269983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.271009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Searching by: {'deleted': False, 'project_id': '2f5dd9f9f99448b5974c423792c88e07'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:19.277485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.278372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.279623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.280299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.310967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:19.349825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e94ee19-a808-4bf1-8c37-4c6d99ec22f5 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.088748 Jul 19 19:59:19.351011 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1369/2853] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:19.363731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:19.367921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.368620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Searching by: {'deleted': False, 'project_id': '2f5dd9f9f99448b5974c423792c88e07'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:19.374452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.374976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.375725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.376168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.412282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:19.449693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.456220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.456673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.529243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.541273 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82157435-7ef6-4d7e-bb85-750a22d007ac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.307812 Jul 19 19:59:19.543865 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1485/2854] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:19.560668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:19.561290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:19.570923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.571509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.573452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.574869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.049823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:20.079978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4c8a26bc-d463-487b-907a-c73db66d5656 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.534350 Jul 19 19:59:20.080811 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1486/2855] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:20.088108 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0eb4ada2-ee79-4f7b-8efa-e0611601e4db tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.728266 Jul 19 19:59:20.088926 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1370/2856] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:20.108317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a46bf87c-866f-4cc0-aa0c-cf58696e4298 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.118223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a46bf87c-866f-4cc0-aa0c-cf58696e4298 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013845 Jul 19 19:59:20.126237 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1487/2857] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:59:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:20.160675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.161302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:20.173882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.174870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.175940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.176599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.346612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4c7cf2d9-9bc8-4013-a8e1-b967bed795ac req-10ad0528-0ccf-4aba-a64e-47831c548f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f133e-fe86-43c4-a521-0bf8018684f4", "tag": "684c65a9-ae95-4d5c-afc4-9745180197ca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:20.373142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4c7cf2d9-9bc8-4013-a8e1-b967bed795ac req-10ad0528-0ccf-4aba-a64e-47831c548f06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.375057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4c7cf2d9-9bc8-4013-a8e1-b967bed795ac req-10ad0528-0ccf-4aba-a64e-47831c548f06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.394943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:20.399370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4c7cf2d9-9bc8-4013-a8e1-b967bed795ac req-10ad0528-0ccf-4aba-a64e-47831c548f06 service nova] Creating event network-changed:684c65a9-ae95-4d5c-afc4-9745180197ca for instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 on n-h1-843861-3 Jul 19 19:59:20.407644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4c7cf2d9-9bc8-4013-a8e1-b967bed795ac req-10ad0528-0ccf-4aba-a64e-47831c548f06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065126 Jul 19 19:59:20.408564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1488/2858] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:20.481234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:20.495830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecdd01fa-891b-4ab3-8f43-8f275792953e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.339178 Jul 19 19:59:20.506660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1371/2859] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:20 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:20.565412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.567691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:20.593820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.596198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.597126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.599553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.023578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.038924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d263eaa2-860a-4274-ba99-204102a0801c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1293 microversion: 2.1 time: 0.479218 Jul 19 19:59:21.042324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1489/2860] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:20 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1293 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:21.105222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.106855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.114447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.114999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.115919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.116514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.119222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.119883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.135854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.136396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.137345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.138426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.203288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:21.296974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:21.344623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-37686247-748a-4714-88eb-c82c8649427b tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.243492 Jul 19 19:59:21.345319 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1372/2861] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:21.357080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:21.365299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddc9b310-2e17-4195-9acb-4e6629d9a8f1 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 204 len: 0 microversion: 2.1 time: 0.248749 Jul 19 19:59:21.365977 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1490/2862] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:21 2022] DELETE /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:59:21.374674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.375449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.383425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.388378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.389380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.390212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.518289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.519270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.534574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.534960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.537997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.538630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.700463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.710163 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96c2f703-47cc-41aa-a0ef-6931c484653f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1609 microversion: 2.1 time: 0.339593 Jul 19 19:59:21.711000 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1373/2863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1609 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:21.778732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.787477 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0588866-46a5-46d3-8986-7fb3d5ad6e83 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.274113 Jul 19 19:59:21.793632 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1491/2864] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:22.061473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:22.062813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:22.070946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.072401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.073444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.074146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.311330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:22.321697 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e5b960d-d545-4ddd-bbb4-d5b3b053115e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1474 microversion: 2.1 time: 0.265886 Jul 19 19:59:22.339994 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1374/2865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:22 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1474 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:22.376238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:22.378816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:22.387140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.387986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.389112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.390069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.417808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1529478503", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:22.490632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:22.503728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:22.513402 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db27fc6e-77a4-45ec-9566-b30b7225feff tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.142055 Jul 19 19:59:22.530187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1492/2866] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:22 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:22.732076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:22.732989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:22.740040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.740498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.741282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.741726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.016427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.028554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c5a3e61a-d07b-4d84-a056-0e3f43b73061 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1609 microversion: 2.1 time: 0.302651 Jul 19 19:59:23.030137 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1493/2867] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:22 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1609 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:23.045048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.045955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:23.054151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.054939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.055917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.056537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.138271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:23.141391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:23.142121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:23.142747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:23.143231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:23.153138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.153898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.154919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.155684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.177264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:23.183826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:23.207186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:23.209635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:23.280852 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d20c64fb-4115-438b-ba1a-4d18475d3fd6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868669 Jul 19 19:59:23.282188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1375/2868] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:59:23.295329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.296134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:23.308347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.319277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:23.328266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22294f34-8e22-43f1-8612-1910df1e506a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.295536 Jul 19 19:59:23.328865 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1494/2869] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:23.547584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.548594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:23.577013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.577451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.579956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.583489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.727022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:23.763637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d29a764a-c170-4d9a-8ec2-62455a34a735 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.229809 Jul 19 19:59:23.776318 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1495/2870] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:23.785536 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.scheduler.client.report [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Deleted allocations for instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe Jul 19 19:59:23.801171 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Instance Mapping does not exist while attempting local delete cleanup. Jul 19 19:59:23.802938 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7fab465c-4c82-4824-9e04-4e24fba8307a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe" status: 204 len: 0 microversion: 2.1 time: 0.513471 Jul 19 19:59:23.804277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1376/2871] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:23 2022] DELETE /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:59:23.813483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.814118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:23.820785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe HTTP/1.1 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3dbff8d1-2829-48d1-b77b-6a9ac2e811fe'} Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:23.822416 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-428b6a5a-4d47-4c38-9893-40ca22bbdba0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe" status: 404 len: 111 microversion: 2.1 time: 0.014231 Jul 19 19:59:23.839629 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1496/2872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:59:23.893127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-63893276", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:23.991076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:24.052334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.053571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:24.061062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.061739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.062717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.063186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.436513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.450938 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-80611d42-cee1-4903-a71c-65354ba2fd3d tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1609 microversion: 2.1 time: 0.404197 Jul 19 19:59:24.466748 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1497/2873] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1609 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:24.475194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.478160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:24.490576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.502125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.503120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.503714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.917035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.928941 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7c4cc40-9450-4077-bb4f-65759788aa2f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.460897 Jul 19 19:59:24.930013 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1498/2874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:24.937682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.939610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:24.951066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.953080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.953903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.954345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.045914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:25.046547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:25.047900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:25.048335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:25.048758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:25.069709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.074102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.075577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.076059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.093002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:25.122248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:25.132756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:25.137883 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b64dca8-3b18-4ff6-9ed8-7ee5ee3397a4 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.205657 Jul 19 19:59:25.142281 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1499/2875] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:25.148199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1bffa03a-a595-4a0f-9a37-b5d9e3c9bc26 req-fe2eecec-775b-4d56-9137-08d8ec934a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b0e365-22d4-441d-8ff2-21248a6cfbce", "name": "network-vif-deleted", "tag": "237d5b39-3e1e-4008-81ba-0e262393b8ac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:25.159430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1bffa03a-a595-4a0f-9a37-b5d9e3c9bc26 req-fe2eecec-775b-4d56-9137-08d8ec934a35 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.160130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1bffa03a-a595-4a0f-9a37-b5d9e3c9bc26 req-fe2eecec-775b-4d56-9137-08d8ec934a35 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.173439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:25.177984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:25.178905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1bffa03a-a595-4a0f-9a37-b5d9e3c9bc26 req-fe2eecec-775b-4d56-9137-08d8ec934a35 service nova] Creating event network-vif-deleted:237d5b39-3e1e-4008-81ba-0e262393b8ac for instance 88b0e365-22d4-441d-8ff2-21248a6cfbce on n-h1-843861-3 Jul 19 19:59:25.194802 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1bffa03a-a595-4a0f-9a37-b5d9e3c9bc26 req-fe2eecec-775b-4d56-9137-08d8ec934a35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051008 Jul 19 19:59:25.195748 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1500/2876] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:25.253859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73179b8f-0bcc-4501-8224-32cd8d694541 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367821 Jul 19 19:59:25.255633 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1377/2877] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:59:25.268415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94e28de7-a6c2-44ad-b027-b4ddd167f8d2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.269749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94e28de7-a6c2-44ad-b027-b4ddd167f8d2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:25.360507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-94e28de7-a6c2-44ad-b027-b4ddd167f8d2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:25.369362 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94e28de7-a6c2-44ad-b027-b4ddd167f8d2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1219 microversion: 2.1 time: 0.106771 Jul 19 19:59:25.382318 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1501/2878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:25.470709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.471447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:25.500206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.500744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.501720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.504592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.629992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:25.645697 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52763f07-16aa-4923-9126-831aeeebba7f tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1253 microversion: 2.1 time: 0.180356 Jul 19 19:59:25.647369 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1378/2879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1253 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:25.948198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.949445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:25.967219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.967675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.968675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.969308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.162593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:26.164354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:26.187060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.187737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.188956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.189408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.295681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:26.302700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:26.311951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.321390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e5546b42-8b65-43d1-942e-f4eb501de178 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.376940 Jul 19 19:59:26.321987 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1502/2880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:26.339444 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d13d26be-4ad4-4d46-92ad-e8f199819853 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.181061 Jul 19 19:59:26.364165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1379/2881] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:26 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:26.390127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:26.391017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:26.416518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.417321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.418700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.422940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.531334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.543101 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-678035ab-bef7-4f15-968e-dac9146e388c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1271 microversion: 2.1 time: 0.158100 Jul 19 19:59:26.543979 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1503/2882] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:26 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:26.663669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:26.664616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:26.672369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.673094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.674150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.674755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.754849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.769758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68e6e859-e8b8-43a7-8dd4-3c730812f791 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1253 microversion: 2.1 time: 0.110686 Jul 19 19:59:26.770638 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1380/2883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:26 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1253 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:27.339277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.340942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.351073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.351863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.353978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.354657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.362752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.365579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.379568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.380457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.385076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.388207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.585370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:27.606721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:27.612303 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-25e420be-b25f-4c39-be42-60dba9d6d662 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.253489 Jul 19 19:59:27.613223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1381/2884] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:27.618839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.619581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.628625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.630240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.631049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.631517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.991015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.005693 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a4c8854-5ed9-4471-89b0-3597145297f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1277 microversion: 2.1 time: 0.391402 Jul 19 19:59:28.007401 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1382/2885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1277 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:28.030517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:28.030940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.031615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:28.038884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.039149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-152f3499-f8ee-456a-a462-f38c65dcafb2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.704016 Jul 19 19:59:28.039577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.042615 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1504/2886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:28.051591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.052516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.178035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.191615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-609eef33-02aa-4dde-b7cf-9511924fe0bd tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1253 microversion: 2.1 time: 0.169099 Jul 19 19:59:28.205364 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1383/2887] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:28 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1253 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:28.638949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:28.643433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:28.652280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.653193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.654388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.654998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.681608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:28.816912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:28.837525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d3a6f406-ade1-4b71-91d2-a99b5ff8682c tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.206426 Jul 19 19:59:28.848971 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1505/2888] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:28 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:29.027117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.028045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.045280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.048420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.049552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.050154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.059116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.060055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.071383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.074091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.074900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.075348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.654328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.687492 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1b271fc1-2166-4762-ba0a-0d0e05538a86 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.657576 Jul 19 19:59:29.697557 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1384/2889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:29.697557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.697557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.704582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.718988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.718988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.719638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.720894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.755325 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0073196-a1de-4d71-a68b-aa2a8b7249f3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.701159 Jul 19 19:59:29.756412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1506/2890] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:29.811975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-08d98b94-a73c-47ea-b474-fca4e1a75d1f req-cf2a810b-1c4a-409d-9506-41de851fb723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad3da9e-d052-47ea-bc99-bc1c8c062cfa", "tag": "aa2c19f5-0977-4d64-85ce-7f46eb10abd5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:29.829902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08d98b94-a73c-47ea-b474-fca4e1a75d1f req-cf2a810b-1c4a-409d-9506-41de851fb723 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.830818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08d98b94-a73c-47ea-b474-fca4e1a75d1f req-cf2a810b-1c4a-409d-9506-41de851fb723 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.852755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-08d98b94-a73c-47ea-b474-fca4e1a75d1f req-cf2a810b-1c4a-409d-9506-41de851fb723 service nova] Creating event network-changed:aa2c19f5-0977-4d64-85ce-7f46eb10abd5 for instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa on n-h1-843861-3 Jul 19 19:59:29.860317 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-08d98b94-a73c-47ea-b474-fca4e1a75d1f req-cf2a810b-1c4a-409d-9506-41de851fb723 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055455 Jul 19 19:59:29.862085 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1507/2891] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:29.873155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.874061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.883119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.884027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.885053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.885922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.922430 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76419cee-ac73-4441-8bfd-f91b518d4994 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/ips" status: 200 len: 146 microversion: 2.1 time: 0.056979 Jul 19 19:59:29.924572 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1508/2892] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/ips => generated 146 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:29.930438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.931699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.940743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.941994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.943423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.944194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.033115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:30.049245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-302d483b-1103-4ec4-9772-679a0b7e0e57 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1253 microversion: 2.1 time: 0.359480 Jul 19 19:59:30.049943 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1385/2893] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1253 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:30.177829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:30.216920 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-387f3e9a-4f52-4519-a219-9b3a7e952a74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.291014 Jul 19 19:59:30.230155 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1509/2894] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:30.708877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:30.709511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:30.721005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.721820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.723454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.723951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.774180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:30.774862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:30.789751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.790339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.791469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.791594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.204111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:31.212750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6aad37a3-6ff2-47a7-8395-85d51b2b92c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.510408 Jul 19 19:59:31.219919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1386/2895] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:30 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:31.226806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:31.231399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:31.231876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:31.240328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:31.241174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.242529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:31.243672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.245502 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bd0014f1-4e94-4f15-ac12-d9f552fe7ccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.475897 Jul 19 19:59:31.258219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1510/2896] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:30 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:31.258219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:31.258219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:31.263252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:31.264240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.265517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:31.265903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.351221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:31.377400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55e68201-808c-42cb-aaae-11e1027fb2b0 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1253 microversion: 2.1 time: 0.156039 Jul 19 19:59:31.391028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1387/2897] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:31 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1253 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:31.409924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:31.451463 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e064ac5-e6d3-4d12-8ab1-d07d41b47575 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.201110 Jul 19 19:59:31.454041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1511/2898] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:31 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:32.232729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.233591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.243291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.244096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.245872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.246730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.273281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.275244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.386362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.386849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.394331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.394331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.663493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.677153 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9529df4a-6402-475a-b540-d9ab703d9730 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.448318 Jul 19 19:59:32.678119 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1388/2899] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:32.701626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.703839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.722487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.726063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.727413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.728347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.822360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.825450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.826134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lazy-loading 'fault' on Instance uuid 88b0e365-22d4-441d-8ff2-21248a6cfbce {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:32.910678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.920080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90860e756b9547909590fdb7f85dc076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5dd9f9f99448b5974c423792c88e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.938838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-690a1f04-b385-418a-92e2-5339e27ab93a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.676838 Jul 19 19:59:32.939448 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1512/2900] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:32.948425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f0e48b3-6224-4ddf-8dca-bc875f0b2c86 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 200 len: 1212 microversion: 2.1 time: 0.259142 Jul 19 19:59:32.948425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1389/2901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 1212 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:32.948714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.948714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.967289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.967747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.968573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.969015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.077452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:33.118705 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-569d08ac-c261-409d-8465-47ba65981f59 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.176065 Jul 19 19:59:33.133003 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1513/2902] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:33.634023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b99cc9d-fa90-4b52-9ed1-ba4bdb7c305d"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:33.635203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:33.643250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.643687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.644567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.645002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.696822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:33.699005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:33.708801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.709508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.710557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.711147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.016944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.040594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67312fb8-6c70-4dde-817a-b028de840b8e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.349957 Jul 19 19:59:34.041334 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1514/2903] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:33 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:34.059799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:34.060724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:34.068557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.069165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.070089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.070658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.095343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a2963169-26d1-41c3-b35f-2b0a3f4346ca tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465261 Jul 19 19:59:34.099870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1390/2904] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:59:33 2022] POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:34.158478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:34.160789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] [instance: 88b0e365-22d4-441d-8ff2-21248a6cfbce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:34.172086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.187699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.187699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.187699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.205662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] HTTP exception thrown: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Request method failure captured: Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce HTTP/1.1 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wy4jbOdegTXrh3UzasKaRAECeHABj9P2zHhKX3ijT_qoFTfUOLakYZ91VqpwWUFHeZ1KcHo1qB8TfsYuCTxeSQp-iI9B_3OH7RZg38qE5HUaAi9rjDuB7_jxaGbZ89we63gLNoKfZnNTxfRWfYMK8kChTQX5qp0g-hJYNi_MBb3rAs Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2f5dd9f9f99448b5974c423792c88e07 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestBootFromVolume-742192463 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5dd9f9f99448b5974c423792c88e07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f5dd9f9f99448b5974c423792c88e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5dd9f9f99448b5974c423792c88e07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f5dd9f9f99448b5974c423792c88e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestBootFromVolume-742192463 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2f5dd9f9f99448b5974c423792c88e07 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestBootFromVolume-742192463 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestBootFromVolume-742192463-project Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 90860e756b9547909590fdb7f85dc076 Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestBootFromVolume-742192463-project Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '88b0e365-22d4-441d-8ff2-21248a6cfbce'} Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:34.209369 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. Jul 19 19:59:34.214492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:34.215442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Returning 404 to user: Instance 88b0e365-22d4-441d-8ff2-21248a6cfbce could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:34.216124 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ac79eb9-be7b-40e2-b078-25fea40e2c15 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce" status: 404 len: 111 microversion: 2.1 time: 0.095028 Jul 19 19:59:34.217033 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1391/2905] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:34 2022] GET /compute/v2.1/servers/88b0e365-22d4-441d-8ff2-21248a6cfbce => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:59:34.230337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:34.231221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:34.238425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.239192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.240216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.240862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.382341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:34.455372 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c25b2387-db3c-4923-88ec-bf7c2a31763d tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.229561 Jul 19 19:59:34.455627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.456003 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1392/2906] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:34 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:34.471869 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67cc1e70-dcb3-4c12-b0b4-1b74f22bc763 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.428537 Jul 19 19:59:34.481948 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1515/2907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:34 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:34.482165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20654919-8245-481a-a012-fc49671ff240 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] Calling method '.version_select at 0x7fb88ce254c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:34.512583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20654919-8245-481a-a012-fc49671ff240 tempest-ServersTestBootFromVolume-742192463 tempest-ServersTestBootFromVolume-742192463-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540806213" status: 202 len: 0 microversion: 2.1 time: 0.040977 Jul 19 19:59:34.517161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1393/2908] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 19:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540806213 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:35.061157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.061805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.084097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.084548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.085379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.085818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.343000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:35.352580 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e5b22faa-3bc8-4115-af44-edadcc7bace2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.298034 Jul 19 19:59:35.353240 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1516/2909] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:35.482376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.483293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.487853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.493349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.494332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.496564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.499370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.534273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.535634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.538765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.539561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.563703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.565401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.573041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.576327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.758942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:35.797019 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42294fad-dcfe-4b41-83a3-19aec0cfff74 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.316541 Jul 19 19:59:35.799408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1394/2910] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:35.830809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.831610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.842112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.846169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.848737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.849457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.897809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.922423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:35.936135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf5a43a0-170b-4cdc-b4a1-f0e061069909 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.446697 Jul 19 19:59:35.937056 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1517/2911] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:36.105487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-bee8fe5f-8ac4-4182-88c1-e0108f981b00 req-e2572155-ae55-4052-a0f5-e57ea60bc909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad3da9e-d052-47ea-bc99-bc1c8c062cfa", "name": "network-vif-plugged", "status": "completed", "tag": "aa2c19f5-0977-4d64-85ce-7f46eb10abd5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:36.118039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bee8fe5f-8ac4-4182-88c1-e0108f981b00 req-e2572155-ae55-4052-a0f5-e57ea60bc909 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.119339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bee8fe5f-8ac4-4182-88c1-e0108f981b00 req-e2572155-ae55-4052-a0f5-e57ea60bc909 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.134044 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-bee8fe5f-8ac4-4182-88c1-e0108f981b00 req-e2572155-ae55-4052-a0f5-e57ea60bc909 service nova] Creating event network-vif-plugged:aa2c19f5-0977-4d64-85ce-7f46eb10abd5 for instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa on n-h1-843861-3 Jul 19 19:59:36.134577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.140254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-bee8fe5f-8ac4-4182-88c1-e0108f981b00 req-e2572155-ae55-4052-a0f5-e57ea60bc909 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040843 Jul 19 19:59:36.141414 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1518/2912] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:36.149103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f71bab4-0a53-4bb7-9747-4bb8d525d6d8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.329352 Jul 19 19:59:36.150336 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1395/2913] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:36.372997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:36.373962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:36.387983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.397779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.398743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.399298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.638713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.652999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8095266a-deb0-4205-b0f7-8ad12f7e3554 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1319 microversion: 2.1 time: 0.286433 Jul 19 19:59:36.662864 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1519/2914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:36 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:36.820531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:36.821790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:36.830853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.831611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.833189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.833783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.951721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:36.955052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:36.955775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:36.966090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.968916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.970136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.973046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.990500 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74c62aa4-e772-447c-a73c-5570b860dd46 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.175370 Jul 19 19:59:37.004516 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1396/2915] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:36 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:37.171265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:37.181018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:37.214121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.215051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.216508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.217270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.232940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:37.245333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9b87651-d299-40e6-b4e3-998e602c14b9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.294663 Jul 19 19:59:37.246608 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1520/2916] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:36 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:37.671939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:37.672866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:37.685331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.685921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.688723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.689341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.977434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:37.980454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:37.986703 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f09de656-7d6f-4690-a928-30ae310c7eae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.823550 Jul 19 19:59:37.987333 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1397/2917] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:37 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:37.990931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee6d410f-9eef-44d8-b1d9-4729e41d57cb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1500 microversion: 2.1 time: 0.323301 Jul 19 19:59:37.991559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1521/2918] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:37 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1500 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:38.007502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.008175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.015660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1493587452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:38.017006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.018590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.021363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.022261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.022886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.029951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.030744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.031775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.032680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.057746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:38.239166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.247780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d0c92f4-0f12-4020-813f-81de426424ae tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1500 microversion: 2.1 time: 0.244633 Jul 19 19:59:38.259210 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1522/2919] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:38.259210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.259210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.261382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.261979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.262919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.263516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.385583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:38.433195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a29761f5-5a1d-4aaa-91e2-ad36ec2820c5 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.183335 Jul 19 19:59:38.433835 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1523/2920] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:38.454669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.455965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68b1fb65-e928-46d6-824b-e57d8d9a18f7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.453376 Jul 19 19:59:38.459530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.475722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.476210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.478303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.478749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.484530 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1398/2921] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:38 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 19 19:59:38.499535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.500153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.517693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.518147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.520015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.521096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.556682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:38.746866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.769801 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5432923a-564e-4571-add8-8d4bb2c1e59b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.330190 Jul 19 19:59:38.771409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1524/2922] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:38.790293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ba7211c-a519-4c91-8cde-462c6577c416 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 204 len: 0 microversion: 2.1 time: 0.302730 Jul 19 19:59:38.793830 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1399/2923] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:38 2022] DELETE /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:59:38.802476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.803093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.811151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.811603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.817333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.817857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.002044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:39.010774 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e85676d-be58-43c8-b81b-ad86d4b3db9a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1506 microversion: 2.1 time: 0.212516 Jul 19 19:59:39.011864 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1525/2924] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:39.462748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.463554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.474362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.478622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.479991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.484565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.602093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:39.631377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc75b0f0-b756-4106-adfe-dad81aab5f23 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.172831 Jul 19 19:59:39.637591 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1400/2925] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:39 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:39.787524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.788244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.804283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.804738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.805533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.805969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.028922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:40.030327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:40.047789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.048582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.049072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.049537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.064263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:40.073232 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9146cea0-2dd7-4ae8-a25e-eaf80a386d64 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.290361 Jul 19 19:59:40.088000 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1526/2926] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:39 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:40.349181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:40.366501 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8262eb6-96e8-497c-b68a-e14aa0096efb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1506 microversion: 2.1 time: 0.341638 Jul 19 19:59:40.367427 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1401/2927] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:40 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:40.657433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:40.658049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:40.664676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.664883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.666086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.666558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.788877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:40.811461 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-28542649-543f-4425-87ad-c60ac31f3d56 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.158015 Jul 19 19:59:40.812404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1527/2928] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:40 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:41.096782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:41.100335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:41.121419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.128643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.129928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.131029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.193764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d9bf6f2e-e40e-43d6-859e-1d6d1d4ed3bc req-aada5e34-4e74-4b3d-91b6-27f2278c23b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad3da9e-d052-47ea-bc99-bc1c8c062cfa", "name": "network-vif-deleted", "tag": "aa2c19f5-0977-4d64-85ce-7f46eb10abd5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:41.206112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d9bf6f2e-e40e-43d6-859e-1d6d1d4ed3bc req-aada5e34-4e74-4b3d-91b6-27f2278c23b2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.206112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d9bf6f2e-e40e-43d6-859e-1d6d1d4ed3bc req-aada5e34-4e74-4b3d-91b6-27f2278c23b2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.233523 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d9bf6f2e-e40e-43d6-859e-1d6d1d4ed3bc req-aada5e34-4e74-4b3d-91b6-27f2278c23b2 service nova] Creating event network-vif-deleted:aa2c19f5-0977-4d64-85ce-7f46eb10abd5 for instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa on n-h1-843861-3 Jul 19 19:59:41.242675 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d9bf6f2e-e40e-43d6-859e-1d6d1d4ed3bc req-aada5e34-4e74-4b3d-91b6-27f2278c23b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052405 Jul 19 19:59:41.256059 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1528/2929] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:41.385859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:41.386583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:41.397293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:41.403311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.406111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.406957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.407400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.479800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:41.485919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.486313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.486774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lazy-loading 'fault' on Instance uuid 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:41.494557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bd751250-bab1-4b6d-9f24-54b6122387d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.400937 Jul 19 19:59:41.504062 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1402/2930] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:41 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:41.509181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7a7383fa-8339-4aa6-8f22-53194fcd427d req-ce6f7fec-b4db-4896-aa15-2b90c46e5e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:41.519918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a7383fa-8339-4aa6-8f22-53194fcd427d req-ce6f7fec-b4db-4896-aa15-2b90c46e5e46 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.520663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a7383fa-8339-4aa6-8f22-53194fcd427d req-ce6f7fec-b4db-4896-aa15-2b90c46e5e46 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.533891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7a7383fa-8339-4aa6-8f22-53194fcd427d req-ce6f7fec-b4db-4896-aa15-2b90c46e5e46 service nova] Creating event network-vif-unplugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:59:41.540104 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7a7383fa-8339-4aa6-8f22-53194fcd427d req-ce6f7fec-b4db-4896-aa15-2b90c46e5e46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034458 Jul 19 19:59:41.541093 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1403/2931] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:41.548702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:41.557196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9025151b-25ee-41fb-9cd4-885dabb73f04 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 200 len: 1309 microversion: 2.1 time: 0.178326 Jul 19 19:59:41.557873 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1529/2932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:41 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:41.832932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:41.833750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:41.842336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.842924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.843784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:41.844367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.929570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:41.951015 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3d1b3eb-b4d4-49af-9b78-0b793ed8b9ef tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1929 microversion: 2.75 time: 0.122351 Jul 19 19:59:41.951624 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1404/2933] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:41 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:42.512182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:42.513816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:42.522349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.522935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.523833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.524369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.575337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:42.576693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:42.585711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.586163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.586949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.587577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.602112 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa HTTP/1.1 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '0ad3da9e-d052-47ea-bc99-bc1c8c062cfa'} Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:42.604019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:42.608766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62e8a470-e3d5-4bbb-a47e-4f521d91e945 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 404 len: 111 microversion: 2.1 time: 0.034656 Jul 19 19:59:42.616307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1405/2934] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:42 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:59:42.621987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d60711a5-9b14-49b6-8687-b020467dda8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: .version_select at 0x7fb892feac10>, body: {"keypair": {"name": "tempest-key-1226537078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRayiz9GOvJpYe5gStC7mWqoH+ezIdc1RAJamq1Ht2qobXnMIqkXz5nMhkxagAuocMD6qccdEH2LGuR4p2uWdN8O4wnmgBCwgBnblr26g1zGqI83eGFydwqaEsXU73XVA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:42.638020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d60711a5-9b14-49b6-8687-b020467dda8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:42.645317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d60711a5-9b14-49b6-8687-b020467dda8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:42.672168 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d60711a5-9b14-49b6-8687-b020467dda8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.054348 Jul 19 19:59:42.672783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1406/2935] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:59:42 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:42.682549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ceca33e9-c768-4008-9b7d-a474f0bbe544 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '.version_select at 0x7fb892f94160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:42.685548 n-d-843861-3 devstack@n-api.service[126007]: WARNING oslo_db.sqlalchemy.utils [None req-ceca33e9-c768-4008-9b7d-a474f0bbe544 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:59:42.692758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ceca33e9-c768-4008-9b7d-a474f0bbe544 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.013978 Jul 19 19:59:42.694047 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1407/2936] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 19:59:42 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:42.769115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:42.782622 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3ab98ab-46da-45ad-b917-d9ec21336022 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.275614 Jul 19 19:59:42.783224 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1530/2937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:42 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:42.812905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1819825052", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-key-1226537078", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:42.886722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:42.970465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:42.971443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:42.977973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.978747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.979785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.980341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.084535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:43.109673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef174018-f927-4560-916d-a828e35bf341 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.142871 Jul 19 19:59:43.110274 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1531/2938] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:42 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:43.374183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:43.379413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:43.380115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:43.380812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:43.381874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:43.403362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.405287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.408064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.408801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.435595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:43.450159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:43.465438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:43.468398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:43.499247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:43.528595 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6de4af22-6139-41a8-afe4-4356ea586f3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719498 Jul 19 19:59:43.529719 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1408/2939] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:59:43.539989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e70db6a-20ec-423e-ba7e-603d353b4aa5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:43.540616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e70db6a-20ec-423e-ba7e-603d353b4aa5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:43.673651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e70db6a-20ec-423e-ba7e-603d353b4aa5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:43.685335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e70db6a-20ec-423e-ba7e-603d353b4aa5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1229 microversion: 2.1 time: 0.148527 Jul 19 19:59:43.695531 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1532/2940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:43 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1229 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:43.802364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:43.803124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:43.813628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.814255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.815313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.816606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.984997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:43.995900 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a718d7c-c619-4b66-a6eb-4f73c7e51594 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.199902 Jul 19 19:59:44.007207 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1409/2941] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:43 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:44.131759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:44.132292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:44.141798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.142318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.143182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.143924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.249033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:44.275284 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-607f4c74-5cfa-49a6-a633-ccf7287ff027 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.147571 Jul 19 19:59:44.276043 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1533/2942] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:44 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:44.705123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:44.705794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:44.713116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.713611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.714671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.715249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.826215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:44.839066 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb463d6c-e96f-4b0a-8fd7-ac81bd5a3017 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1289 microversion: 2.1 time: 0.137644 Jul 19 19:59:44.840324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1410/2943] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:44 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:45.013289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:45.014005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:45.023373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.024243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.026042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.026702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.302809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:45.303927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:45.312911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.316771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.317797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.324187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.338575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:45.347042 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-175caca3-de7a-4aa4-99b2-a142d7553906 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.337947 Jul 19 19:59:45.353848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1534/2944] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:45 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:45.485140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:45.489328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:45.513075 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf855e80-7542-4aec-b428-a8ecc9ffd08a tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.219439 Jul 19 19:59:45.527494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1411/2945] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:45 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:45.858160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:45.858793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:45.869956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.870421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.871226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.871664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:45.954361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-83a5d602-ee04-4728-bb00-a1c80fc3ad3e req-523f6123-cd0c-48d3-8b66-503a40a84574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-plugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:45.970468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-83a5d602-ee04-4728-bb00-a1c80fc3ad3e req-523f6123-cd0c-48d3-8b66-503a40a84574 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:45.974368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-83a5d602-ee04-4728-bb00-a1c80fc3ad3e req-523f6123-cd0c-48d3-8b66-503a40a84574 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.005677 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-83a5d602-ee04-4728-bb00-a1c80fc3ad3e req-523f6123-cd0c-48d3-8b66-503a40a84574 service nova] Creating event network-vif-plugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 19:59:46.020248 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-83a5d602-ee04-4728-bb00-a1c80fc3ad3e req-523f6123-cd0c-48d3-8b66-503a40a84574 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070047 Jul 19 19:59:46.021179 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1412/2946] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:46.347633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:46.373112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:46.373565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:46.376720 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2918aad0-3607-4cb7-8de6-de02d1d70e8c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.512037 Jul 19 19:59:46.388984 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1535/2947] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:45 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:46.391926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.392669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.393729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.395255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.534586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:46.535210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:46.549899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.550272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.551050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.553032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.766735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:46.834464 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3869b0f6-b13d-4752-b5b8-93c4f34eb407 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.303553 Jul 19 19:59:46.835871 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1536/2948] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:46 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:46.979683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:46.989564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8eb934e-7d70-48e7-86c8-ff160bda2dc3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.622915 Jul 19 19:59:46.994123 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1413/2949] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:46 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:47.396309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:47.396996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:47.418021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.418021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.418829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.419335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.461385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c04d36b5-db4a-41c6-a94c-eaac2aede92b req-c92dab31-7d17-444f-b9af-a2b138cbbdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac", "tag": "02d1f1ff-5aff-4623-b579-3b24f921c7ad"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:47.496373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c04d36b5-db4a-41c6-a94c-eaac2aede92b req-c92dab31-7d17-444f-b9af-a2b138cbbdf5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.499545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c04d36b5-db4a-41c6-a94c-eaac2aede92b req-c92dab31-7d17-444f-b9af-a2b138cbbdf5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.514846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c04d36b5-db4a-41c6-a94c-eaac2aede92b req-c92dab31-7d17-444f-b9af-a2b138cbbdf5 service nova] Creating event network-changed:02d1f1ff-5aff-4623-b579-3b24f921c7ad for instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac on n-h1-843861-3 Jul 19 19:59:47.524808 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c04d36b5-db4a-41c6-a94c-eaac2aede92b req-c92dab31-7d17-444f-b9af-a2b138cbbdf5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065868 Jul 19 19:59:47.526741 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1414/2950] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:47.607681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46cf4a31-e546-4f81-a6ed-d7619e136f46 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:47.615383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46cf4a31-e546-4f81-a6ed-d7619e136f46 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.616321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46cf4a31-e546-4f81-a6ed-d7619e136f46 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.652126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-46cf4a31-e546-4f81-a6ed-d7619e136f46 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:59:47.760258 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46cf4a31-e546-4f81-a6ed-d7619e136f46 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action" status: 202 len: 0 microversion: 2.1 time: 0.142524 Jul 19 19:59:47.771997 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1415/2951] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:47 2022] POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:47.781075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:47.782467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:47.797233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.797998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.799039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.800003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.962846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:47.972845 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d47b8066-82ba-4aa3-a964-74bafb79b3bb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.582236 Jul 19 19:59:47.973781 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1537/2952] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:47 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:47.979478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:47.982681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:47.996923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.997495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.998643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.999239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.203762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:48.206583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:48.219434 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db604968-c05f-45ab-914d-9f58eab0f783 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.445613 Jul 19 19:59:48.220751 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1416/2953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:47 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:48.232560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:48.239031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:48.239993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:48.247177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:48.248296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.249275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:48.250010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.257242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c516ebda-702b-4c53-b23c-7652c3aef58e tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.282376 Jul 19 19:59:48.258330 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1538/2954] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:47 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:48.502133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:48.512285 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-792edd58-3263-4af4-8759-20595f709a3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.290054 Jul 19 19:59:48.513611 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1417/2955] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:48 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:48.549183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-941f66ef-6806-4b33-9703-06ad0a960843 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Action: 'create', calling method: .version_select at 0x7fb88d36c160>, body: {"keypair": {"name": "tempest-keypair-513048969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdkjMFgCOmu9dqyzcdD2E7PGpnAOu+VjdWqTv0bmZvjGXg44io7R36g0L0h60UtRt5nKWKhFNEUO6g6uBW8uaNRvsUl7OkboiGILsnIm26JMOLUsVbZU3BWEKuUO580TA=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:48.569440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-941f66ef-6806-4b33-9703-06ad0a960843 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Getting quotas for project 53b178359f244f1489bcacedb06dfd14. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:48.579841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-941f66ef-6806-4b33-9703-06ad0a960843 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Getting quotas for user 4b467b0ce25b49dfa1d94152beae007b and project 53b178359f244f1489bcacedb06dfd14. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:48.624617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-941f66ef-6806-4b33-9703-06ad0a960843 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.272001 Jul 19 19:59:48.625838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1539/2956] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 19:59:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:48.991056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:48.991664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:48.998882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:48.999653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.000664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.001109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.236189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:49.239491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:49.240772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:49.244709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4f2a156-954c-4a1a-8150-f3ab5a314fee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.257952 Jul 19 19:59:49.246222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1418/2957] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:48 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:49.249115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.249764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.250691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.251339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.280772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:49.282183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:49.290903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.291367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.292199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.292670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.398114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:49.420958 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cbf1f36d-2a9a-4bf5-ad77-08180257ac81 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.145698 Jul 19 19:59:49.421563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1419/2958] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:49 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:49.516160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:49.532214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:49.533314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:49.539261 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f6246f9-aa9c-4e9e-8c90-6bbea38480d2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.305415 Jul 19 19:59:49.551566 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1540/2959] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:49 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:49.556204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.556905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.557710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.558148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.156333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:50.165481 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c459892-41f2-4c00-be38-3f0e9dcff2b6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.638792 Jul 19 19:59:50.166219 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1420/2960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:49 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:50.262465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:50.263348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:50.271373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.272106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.273086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.273726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.442235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:50.443670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:50.452005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.452556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.453578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.454367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.577870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:50.591516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-405e3aaa-c10f-48ca-8b37-17066a41f977 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.332801 Jul 19 19:59:50.592912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1541/2961] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:50 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:50.599565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:50.600527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:50.608810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.609719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.610758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.611413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.625941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:50.668641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e77af47-02aa-4465-bb09-4647d830fd93 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.230623 Jul 19 19:59:50.682531 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1421/2962] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:50 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:51.003781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.015339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69974dfc-1f63-48d6-b9fe-e4fd0c0e0309 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.420985 Jul 19 19:59:51.016668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1542/2963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:50 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:51.184426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:51.184964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:51.200471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.200945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.202060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.202708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.283126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "215e7a87-67ed-4a1b-ae8e-663284db1aaf"}], "security_groups": [{"name": "tempest-securitygroup--1933071102"}], "key_name": "tempest-keypair-513048969", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:51.355578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.364941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd60d389-bfc1-4f52-a1f6-5a217151d45c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.184859 Jul 19 19:59:51.365711 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1422/2964] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:51 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:51.392004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] validate_networks() for [('215e7a87-67ed-4a1b-ae8e-663284db1aaf', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:51.623365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:51.624651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:51.635231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.644486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.645748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.646447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.923713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:51.925760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:51.926409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:51.927123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:51.927849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.928198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:51.936177 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a8e9159-ee4d-46b9-ab1c-c3f79a8ffa7a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.322311 Jul 19 19:59:51.942716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.943403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.944429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.945003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.946195 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1423/2965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:51 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:51.951168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:51.952090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:51.961622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.962582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.963828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.964513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.984343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Getting quotas for project 53b178359f244f1489bcacedb06dfd14. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:52.003410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Getting quotas for user 4b467b0ce25b49dfa1d94152beae007b and project 53b178359f244f1489bcacedb06dfd14. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:52.030533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:52.032988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:52.051114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:52.074996 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a23bf278-0635-4a09-93dd-19c23563cbfd tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1935 microversion: 2.75 time: 0.125066 Jul 19 19:59:52.074996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1424/2966] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:51 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1935 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:52.084868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:52.085606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:52.096968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.097980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.098795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.099241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.137343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-abae217c-7f52-45a3-90f2-1c7f32771ec0 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.859501 Jul 19 19:59:52.139923 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1543/2967] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:59:52.153705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9a7de76-dd26-43bc-bd5a-b4be59399d82 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:52.154457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9a7de76-dd26-43bc-bd5a-b4be59399d82 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:52.309291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9a7de76-dd26-43bc-bd5a-b4be59399d82 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:52.324485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9a7de76-dd26-43bc-bd5a-b4be59399d82 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1225 microversion: 2.1 time: 0.178283 Jul 19 19:59:52.325207 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1544/2968] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:52 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:52.339720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-52bc5bb0-93e9-4478-8b14-c7ed6cf4ea80 req-977ad4c9-42b9-45f3-8ed8-d0bf80d0e028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac", "name": "network-vif-plugged", "status": "completed", "tag": "02d1f1ff-5aff-4623-b579-3b24f921c7ad"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:52.353247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-52bc5bb0-93e9-4478-8b14-c7ed6cf4ea80 req-977ad4c9-42b9-45f3-8ed8-d0bf80d0e028 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.357497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-52bc5bb0-93e9-4478-8b14-c7ed6cf4ea80 req-977ad4c9-42b9-45f3-8ed8-d0bf80d0e028 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.385255 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-52bc5bb0-93e9-4478-8b14-c7ed6cf4ea80 req-977ad4c9-42b9-45f3-8ed8-d0bf80d0e028 service nova] Creating event network-vif-plugged:02d1f1ff-5aff-4623-b579-3b24f921c7ad for instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac on n-h1-843861-3 Jul 19 19:59:52.403849 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-52bc5bb0-93e9-4478-8b14-c7ed6cf4ea80 req-977ad4c9-42b9-45f3-8ed8-d0bf80d0e028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077111 Jul 19 19:59:52.407446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1545/2969] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:52.407751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:52.418011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:52.418727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:52.421454 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c33f9a31-5d79-4a1b-80dc-b23ef113dec3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.341980 Jul 19 19:59:52.422287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1425/2970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:52 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:52.457114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.457615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.459023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.459460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.842017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:52.850667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a1809cb-68f7-4391-abea-878e0ab84346 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1543 microversion: 2.1 time: 0.441849 Jul 19 19:59:52.851574 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1546/2971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:52 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1543 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:52.953594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:52.954218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:52.961044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.961508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.962295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.962736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.102724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.103508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.118424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.119070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.121462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.122666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.292900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] Lazy-loading 'services' on Instance uuid b0ca9998-80ff-4359-949e-2743c164509a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:53.313198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e60359b-0896-4497-99cf-eefdc11f4a21 tempest-ServersAdmin275Test-1772324084 tempest-ServersAdmin275Test-1772324084-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1920 microversion: 2.75 time: 0.216066 Jul 19 19:59:53.314227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1547/2972] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1920 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:53.344023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.344591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.352594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.353042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.353834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.354476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.364164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.371784 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d460ce06-40dd-4945-adb5-8d63c5b0f2c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1329 microversion: 2.1 time: 0.422229 Jul 19 19:59:53.372755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1426/2973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:52 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1329 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:53.377653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.378178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.385031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.385635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.386661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.387211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.407728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:53.423023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:53.426232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:53.447786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.457860 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca6e554f-6154-41a9-9354-ffa8c902bbe5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1277 microversion: 2.1 time: 0.118725 Jul 19 19:59:53.459084 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1548/2974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:53.464785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.466004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:53.466273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.474509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.475283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.476605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.477345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.544370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f920b3ca-2f65-425b-a25a-9304f26312cf tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 204 len: 0 microversion: 2.75 time: 0.170066 Jul 19 19:59:53.544983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1427/2975] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 19:59:53 2022] DELETE /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:59:53.554302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.555094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.561591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.562149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.563127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.563719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.701940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.711932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.713549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.719133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f798a35-3e3e-4f81-a729-a806ae8cd40f tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1444 microversion: 2.75 time: 0.169679 Jul 19 19:59:53.719724 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1428/2976] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:53.871659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.875110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.876656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:53.902389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.906056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.906893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.907330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.909481 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf316872-6e87-4b5b-8f72-e5af568aeee8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.448734 Jul 19 19:59:53.910570 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1549/2977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:53.990983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-unplugged", "status": "completed", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:53.999179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.999626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.015406 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] Creating event network-vif-unplugged:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h1-843861-3 Jul 19 19:59:54.023833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] Instance 96c5b4f6-f56b-4899-82de-e828b094564b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:59:54.042781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ee1d8781-5c5f-40ca-9765-c9cb84628995 req-6c6164a3-c3e1-4445-ab49-08fdff36c52c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055298 Jul 19 19:59:54.044103 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1550/2978] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:54.248006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.260344 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74e0bf56-4db2-444e-a4a4-09045a98fc38 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1542 microversion: 2.1 time: 0.395154 Jul 19 19:59:54.265107 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1429/2979] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:54.390645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.392656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.405146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.405843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.407685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.408518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.478863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.479983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.499762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.501551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.504042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.509394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.679578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.689059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c79e2e0f-93d2-4336-a6a8-0cfb49dd7900 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1295 microversion: 2.1 time: 0.214786 Jul 19 19:59:54.689651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1430/2980] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1295 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:54.741649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.742508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.753985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.754719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.758951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.759642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.928001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.944828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.946883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445de77bf5794a688411194a64c09fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4568bc7cc92a4b11b0e42e7c7e94c4d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.954453 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a3fb336-985a-411f-9b27-6d7038d37918 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 200 len: 1444 microversion: 2.75 time: 0.217357 Jul 19 19:59:54.955779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1431/2981] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 1444 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:54.965247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.966439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.987551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.988292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.989849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.990449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.075020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:55.085076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c134693-af6d-49f4-841b-c42740463048 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1510 microversion: 2.1 time: 0.699741 Jul 19 19:59:55.086470 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1551/2982] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1510 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:55.104798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:55.105493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:55.112180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.112802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.113793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.114479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.795959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:55.811473 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35938d4c-0f0d-4884-9de4-7bd3d0ed0f1a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.853123 Jul 19 19:59:55.831233 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1432/2983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:55.850728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:55.851376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:55.859796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.861644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.863306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.864128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.868118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:55.888632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e1638ec-b45f-4fd3-9185-7551056eb314 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1510 microversion: 2.1 time: 0.782869 Jul 19 19:59:55.901044 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1552/2984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:55 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1510 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:55.913249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:55.914121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:55.930981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.933249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.935712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.935712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.078876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:56.087399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2355b08e-447c-4408-9943-41445639eff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1283 microversion: 2.1 time: 0.184578 Jul 19 19:59:56.113392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1553/2985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:55 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:56.124067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.124916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.135417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.136302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.137410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.138008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.238859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:56.318400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:56.332234 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-453379b7-2f97-4a25-b740-23f3eec8a61b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1542 microversion: 2.1 time: 0.495933 Jul 19 19:59:56.333286 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1433/2986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:55 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1542 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:56.339722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.341051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] [instance: b0ca9998-80ff-4359-949e-2743c164509a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.358059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.358648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.359652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.360124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.398906 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] HTTP exception thrown: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Request method failure captured: Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a HTTP/1.1 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzEH3n0NgJZGU6w3BjF99LS1o_ACD3fCKfoEInPDewmoaT5fsHRs-NH_70Izq8dfzWZfE-HFwGVIhW3RwC6P2yKrxMm3ZOXGUgrss47gHGj1Q_eptXB8MdlwCY91j5uspVSbGWvAIfyZ0KWkPAl_4FTfVAipvT9VAkreZXBn0EhiBM Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.75 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 4568bc7cc92a4b11b0e42e7c7e94c4d8 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdmin275Test-160850894 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4568bc7cc92a4b11b0e42e7c7e94c4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4568bc7cc92a4b11b0e42e7c7e94c4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4568bc7cc92a4b11b0e42e7c7e94c4d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4568bc7cc92a4b11b0e42e7c7e94c4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdmin275Test-160850894 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 4568bc7cc92a4b11b0e42e7c7e94c4d8 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdmin275Test-160850894 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdmin275Test-160850894-project Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 445de77bf5794a688411194a64c09fb3 Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdmin275Test-160850894-project Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b0ca9998-80ff-4359-949e-2743c164509a'} Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:56.400897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. Jul 19 19:59:56.405913 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:56.416735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] Returning 404 to user: Instance b0ca9998-80ff-4359-949e-2743c164509a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:56.417887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-985ddc4e-f06b-4bff-b976-856f0cf0eed2 tempest-ServersAdmin275Test-160850894 tempest-ServersAdmin275Test-160850894-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a" status: 404 len: 111 microversion: 2.75 time: 0.084197 Jul 19 19:59:56.418015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47dd4116-1df8-4747-844f-cf13c65f2afa tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 204 len: 0 microversion: 2.1 time: 0.302824 Jul 19 19:59:56.419339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1434/2987] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:56 2022] GET /compute/v2.1/servers/b0ca9998-80ff-4359-949e-2743c164509a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:59:56.426690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:56.426822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1554/2988] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:56 2022] DELETE /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:59:56.434607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.435448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.442583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:56.445105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.445549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.446452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.447149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.447861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.448903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.463854 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] Creating event network-changed:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h1-843861-3 Jul 19 19:59:56.471797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] Instance 96c5b4f6-f56b-4899-82de-e828b094564b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:59:56.485552 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bb4a3859-e93b-40c1-925e-b05d47f7ab3f req-08f12726-e57b-4e5c-8e43-cb913f646688 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064788 Jul 19 19:59:56.486729 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1435/2989] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:56.663156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:56.673854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d64a0981-5ea6-4a39-92d3-91fb5fef1601 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1516 microversion: 2.1 time: 0.245726 Jul 19 19:59:56.683758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1555/2990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:56 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:56.831750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.832541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.856231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.856770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.857646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.858167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.106440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.108866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.123730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.124739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.125831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.133266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.148754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:57.167843 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39978860-9c3b-484a-be1b-0b4ab584562e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.335257 Jul 19 19:59:57.173715 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1436/2991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:56 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:57.213813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.214776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.252409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.253871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.254758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.255506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.320856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-788134af-9946-4be3-b8da-1e9921de3515 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/ips" status: 200 len: 149 microversion: 2.1 time: 0.111379 Jul 19 19:59:57.321884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1437/2992] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 19:59:57 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/ips => generated 149 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:57.333836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8617c0-249f-4b32-aa36-638642a789a7"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:57.335502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.346308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.350348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.351275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.354063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.471360 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/os-volume_attachments HTTP/1.1 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 74 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: {"volumeAttachment": {"volumeId": "9f8617c0-249f-4b32-aa36-638642a789a7"}} Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '4a5f133e-fe86-43c4-a521-0bf8018684f4', 'body': {'volumeAttachment': {'volumeId': '9f8617c0-249f-4b32-aa36-638642a789a7'}}} Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:57.474103 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e Jul 19 19:59:57.478242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 19:59:57.481497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 400 to user: Invalid volume: volume 9f8617c0-249f-4b32-aa36-638642a789a7 is already attached to instances: 68a311e8-577a-4cc7-b1c5-9778770cf03e {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:57.482975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c621153e-55ca-48b8-abba-8a3a8c582664 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153353 Jul 19 19:59:57.484116 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1438/2993] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 19:59:57 2022] POST /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:59:57.490641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.491666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.498608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.499071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.499937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.500631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.511829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:57.525966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:57.539035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cbf0520-abc6-4cd3-8836-64123eb9a2b3 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.436377 Jul 19 19:59:57.543746 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1556/2994] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:57 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:57.552068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.553294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.567602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.568150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.568979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.569418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.614013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:57.740134 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-330fc657-c31b-47ae-b5be-b1c0724bf5af tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 204 len: 0 microversion: 2.1 time: 0.193768 Jul 19 19:59:57.740667 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1557/2995] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:57 2022] DELETE /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:59:57.746055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.746773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.756173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.757283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.784539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.788287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.057623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.068215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-994139ec-4241-4afb-91be-a168df5e7a75 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1542 microversion: 2.1 time: 0.582534 Jul 19 19:59:58.072159 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1439/2996] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:57 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1542 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:58.078632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:58.080609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:58.088465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.088922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.089702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.090174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.145578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.155355 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-12db4f50-ca0c-4ab2-9f1f-c6354b8f2e02 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1516 microversion: 2.1 time: 0.413435 Jul 19 19:59:58.156085 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1558/2997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:57 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:58.187096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:58.188211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:58.195603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.196095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.196886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.197322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.492837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.502509 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e5c451c-4364-4ea2-909a-3ff2dfe371d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1682 microversion: 2.1 time: 0.428955 Jul 19 19:59:58.503189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1440/2998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:58 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1682 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:58.557374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:58.558004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:58.566533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.567915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.571722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.572815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:58.573441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.586379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-675e91a4-00f3-43ac-a0c9-446634274d06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1725 microversion: 2.1 time: 0.403821 Jul 19 19:59:58.591315 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1559/2999] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:58 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:58.892551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.907015 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7f3bb07-e11a-4e78-97e1-28e508133941 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.353108 Jul 19 19:59:58.907627 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1441/3000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:58 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:59.088019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.088860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.123439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.124945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.125374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.125913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.176047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.177354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.210964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.211872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.213018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.214120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.705844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:59.720003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1209cf90-f6a7-46bc-9a1d-c21dd67ba3a6 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1474 microversion: 2.1 time: 0.637346 Jul 19 19:59:59.720932 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1560/3001] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1474 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:59.725775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a645173f-0f7f-4f3f-84a9-ab5fc434faa0 req-e3ceb8c8-3c0b-4ef0-8e3e-d0c96c0857a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b99e92-3087-494c-bf48-c27989526149", "tag": "c501c637-5097-490a-a8ec-03789f256b87"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:59.756539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a645173f-0f7f-4f3f-84a9-ab5fc434faa0 req-e3ceb8c8-3c0b-4ef0-8e3e-d0c96c0857a4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.759731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a645173f-0f7f-4f3f-84a9-ab5fc434faa0 req-e3ceb8c8-3c0b-4ef0-8e3e-d0c96c0857a4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.780311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a645173f-0f7f-4f3f-84a9-ab5fc434faa0 req-e3ceb8c8-3c0b-4ef0-8e3e-d0c96c0857a4 service nova] Creating event network-changed:c501c637-5097-490a-a8ec-03789f256b87 for instance c8b99e92-3087-494c-bf48-c27989526149 on n-h1-843861-3 Jul 19 19:59:59.787089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a645173f-0f7f-4f3f-84a9-ab5fc434faa0 req-e3ceb8c8-3c0b-4ef0-8e3e-d0c96c0857a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064739 Jul 19 19:59:59.788830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1561/3002] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:59.798490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.799487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.806380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:59.822798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.823586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.824897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.825761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.831898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0c8e82d-509c-4677-8db8-b0ade4d0ce37 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1516 microversion: 2.1 time: 0.659047 Jul 19 19:59:59.833257 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1442/3003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1516 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:59.852867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.854009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.861994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.868395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.869570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.870235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.138587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:00.158975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f5385db-cb52-4f97-952e-edb2f90df15e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1682 microversion: 2.1 time: 0.359337 Jul 19 20:00:00.161136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1562/3004] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:00.168479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:00.169353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:00.170188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:00.175953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:00.179196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.180035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.181409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.181943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.189950 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-571c0c78-ed41-4b1e-b2c8-f79901d1f226 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1702 microversion: 2.1 time: 0.355048 Jul 19 20:00:00.199343 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1443/3005] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1702 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:00.216258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3d3dc0d-dc9f-4400-9d54-f26469cd0ca3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:00.225722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d3dc0d-dc9f-4400-9d54-f26469cd0ca3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.226504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3d3dc0d-dc9f-4400-9d54-f26469cd0ca3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.263888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3d3dc0d-dc9f-4400-9d54-f26469cd0ca3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Going to try to start instance {{(pid=126007) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:00:00.334620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3d3dc0d-dc9f-4400-9d54-f26469cd0ca3 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action" status: 202 len: 0 microversion: 2.1 time: 0.121895 Jul 19 20:00:00.335520 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1444/3006] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:00 2022] POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:00.344636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:00.345378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:00.354597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.355511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.356360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.357008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.448666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:00.460933 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c89c022-6e55-4c9a-8164-9add89948562 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.298823 Jul 19 20:00:00.463980 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1563/3007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:00 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:00.580475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:00.597428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9b98311-56cd-488d-8047-500fd7587383 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1711 microversion: 2.1 time: 0.255949 Jul 19 20:00:00.598344 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1445/3008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:00 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1711 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:00.743115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:00.744076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:00.763573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.766954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.771453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.775263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.857816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:00.858442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:00.867532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.868041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.868835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.869747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.270400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:01.283535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9c3424f5-6b31-4610-a6bc-1a2239bd2564 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1474 microversion: 2.1 time: 0.545873 Jul 19 20:00:01.287752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1564/3009] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:00 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1474 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:01.298157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:01.299090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:01.317933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:01.318537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.319342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:01.319935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.523742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:01.535746 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5f096fc-20a2-47de-92de-6d28c22bb5f7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1516 microversion: 2.1 time: 0.683949 Jul 19 20:00:01.536378 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1446/3010] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:00 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1516 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:01.543410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:01.552766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:01.560768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:01.561590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.562606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:01.563586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.970174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:02.314231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=14 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:02.488588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:02.506598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:02.509277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e03a24f-5352-41ac-89ba-055f17f5e542 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1682 microversion: 2.1 time: 1.213586 Jul 19 20:00:02.510439 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1565/3011] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:01 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1682 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:02.524787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65b2c783-8e33-4587-8252-4867519b9e53 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.985682 Jul 19 20:00:02.527305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:02.530566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:02.534803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1447/3012] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:01 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:02.578520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.580630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.586940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.587757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.806956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:02.810779 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:02.810779 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:02.812247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.813044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.814194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.816689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.899396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:02.944527 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f6837d2-9cc4-4dc8-ab11-5d33bc43061f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.408471 Jul 19 20:00:02.946038 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1448/3013] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:00:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:02.959630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:02.961159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:02.979067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.982621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.990116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.990566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.329250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:03.340690 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a968cd70-bf70-4f33-bcbc-eab8b1561acc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1711 microversion: 2.1 time: 0.825905 Jul 19 20:00:03.352693 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1566/3014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:02 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1711 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:03.366566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.367394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:03.381992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.382718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.386274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.386990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.395983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:03.406990 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18919763-05a4-4770-9824-1861fc951c41 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1471 microversion: 2.1 time: 0.459240 Jul 19 20:00:03.408363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1449/3015] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:02 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:03.417346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.419947 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:03.419947 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:03.424145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.425510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.426988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.428082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.470329 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cda9068a-b3f1-45cf-b6b9-90ba26436d79 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-843861-3" status: 200 len: 578 microversion: 2.1 time: 0.060523 Jul 19 20:00:03.477539 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1450/3016] 10.222.0.33 () {58 vars in 1171 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/os-services?host=n-d-843861-3 => generated 578 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:03.478145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-9af6f78a-bef1-4e7e-89fe-5bf1f77be1f9 req-d350effa-d0f8-4de1-ae1b-a7fec2625a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac", "name": "network-vif-deleted", "tag": "02d1f1ff-5aff-4623-b579-3b24f921c7ad"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:03.493796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9af6f78a-bef1-4e7e-89fe-5bf1f77be1f9 req-d350effa-d0f8-4de1-ae1b-a7fec2625a1e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.494497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-9af6f78a-bef1-4e7e-89fe-5bf1f77be1f9 req-d350effa-d0f8-4de1-ae1b-a7fec2625a1e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.513309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-9af6f78a-bef1-4e7e-89fe-5bf1f77be1f9 req-d350effa-d0f8-4de1-ae1b-a7fec2625a1e service nova] Creating event network-vif-deleted:02d1f1ff-5aff-4623-b579-3b24f921c7ad for instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac on n-h1-843861-3 Jul 19 20:00:03.532413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-9af6f78a-bef1-4e7e-89fe-5bf1f77be1f9 req-d350effa-d0f8-4de1-ae1b-a7fec2625a1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059401 Jul 19 20:00:03.534987 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1451/3017] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:03.540646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d1630629-9073-4d7d-970e-4cd7107e833f req-af3a0eb9-cbd8-46c5-ba5b-427697349697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f133e-fe86-43c4-a521-0bf8018684f4", "name": "network-vif-deleted", "tag": "684c65a9-ae95-4d5c-afc4-9745180197ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:03.554250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:03.567626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97a70706-845a-4d50-aae6-99e54c4b9b66 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1474 microversion: 2.1 time: 0.213378 Jul 19 20:00:03.579631 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1567/3018] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:03.588730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:03.589554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d1630629-9073-4d7d-970e-4cd7107e833f req-af3a0eb9-cbd8-46c5-ba5b-427697349697 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.590159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d1630629-9073-4d7d-970e-4cd7107e833f req-af3a0eb9-cbd8-46c5-ba5b-427697349697 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.590737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:03.606840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.607583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.608880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.609649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.637549 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d1630629-9073-4d7d-970e-4cd7107e833f req-af3a0eb9-cbd8-46c5-ba5b-427697349697 service nova] Creating event network-vif-deleted:684c65a9-ae95-4d5c-afc4-9745180197ca for instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 on n-h1-843861-3 Jul 19 20:00:03.643152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d1630629-9073-4d7d-970e-4cd7107e833f req-af3a0eb9-cbd8-46c5-ba5b-427697349697 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106498 Jul 19 20:00:03.644957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1452/3019] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:03.650090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.651547 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:03.651547 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:03.652809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.653454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.656113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.656743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.704138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.705320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.706119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.707284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.708443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1b9619b-063c-4eea-bc76-f5588286b78f tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061986 Jul 19 20:00:03.709344 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1453/3020] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:03.724315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.725380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:03.732456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.732910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.733701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.734132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.761840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:03.775124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:03.820181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:03.836192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04a3096b-a498-48a7-83f5-b7f6d867c4c7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1614 microversion: 2.1 time: 0.125325 Jul 19 20:00:03.849156 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1454/3021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1614 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:03.857294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.858177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:03.866314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.866960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.867861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.868584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.037165 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4295d2d3-3556-44c4-a8cf-27ffe1ebb6e4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b/action" status: 202 len: 0 microversion: 2.1 time: 0.460882 Jul 19 20:00:04.042317 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1568/3022] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:03 2022] POST /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:04.050210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:04.051782 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:04.051782 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:04.053402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.054065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.055013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.055552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.105241 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-566913cf-d73d-4f5e-bbcd-cf5b0198eb40 tempest-ServicesAdminTestJSON-494550089 tempest-ServicesAdminTestJSON-494550089-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.061011 Jul 19 20:00:04.108689 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1569/3023] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:00:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:04.119663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:04.120817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:04.130585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.131252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.132768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.133397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.140941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:04.201151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:04.221034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c0ddee7-c812-4b72-a9dc-70c54d931796 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.363070 Jul 19 20:00:04.227016 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1455/3024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:04.366452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:04.368355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:04.407631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.411615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.413388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.415834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.891150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:04.904124 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-760aeafa-8a91-41d5-a79a-5b95e175acb8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1470 microversion: 2.1 time: 0.794114 Jul 19 20:00:04.904745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1570/3025] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:04 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1470 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:04.909341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:04.909943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:04.929431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.929885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.930667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.931102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.957181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:04.975870 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d67de6b1-b27a-4274-ace6-51db23d87f6a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1715 microversion: 2.1 time: 0.617539 Jul 19 20:00:04.975870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1456/3026] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:04 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1715 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:04.978717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-plugged", "status": "completed", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:05.006553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.016632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.027781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.044402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.044944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lazy-loading 'fault' on Instance uuid 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:05.071291 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] Creating event network-vif-plugged:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h1-843861-3 Jul 19 20:00:05.089254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] Instance 96c5b4f6-f56b-4899-82de-e828b094564b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:00:05.128654 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-93c8dbd2-2848-453c-88de-48de5bcd4be7 req-994fff05-b3b6-4e01-9d71-b49b35bcbac4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153414 Jul 19 20:00:05.129609 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1457/3027] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:05.145999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.146726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.159631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:05.163760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.164249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.165060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.165489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.177337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be7a2bc6-3ec3-4e1b-9604-3b3dfdb760bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 200 len: 1319 microversion: 2.1 time: 0.271369 Jul 19 20:00:05.181262 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1571/3028] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:04 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:05.245869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.246756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.256365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.257068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.257994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.258347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.258473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.258919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lazy-loading 'fault' on Instance uuid 4a5f133e-fe86-43c4-a521-0bf8018684f4 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:05.259208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.463253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:05.482568 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fbcada8-13ca-4bbb-b0d0-0449929c2b91 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 200 len: 1332 microversion: 2.1 time: 0.350876 Jul 19 20:00:05.500027 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1458/3029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 1332 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:05.722719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:05.742665 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8d3bcf0-e103-4776-a18c-bbc6f5a24fef tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.503412 Jul 19 20:00:05.745471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1572/3030] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:05.940958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.942347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.952553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.954812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.957541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.959571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.210091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:06.212819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:06.240590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.241287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.243227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.243929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.261415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac HTTP/1.1 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac'} Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.263375 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:00:06.267617 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.269768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:06.271007 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2827df40-b9bb-4536-8b67-a2898c39b41f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 404 len: 111 microversion: 2.1 time: 0.076301 Jul 19 20:00:06.272148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1573/3031] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:06 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:06.284848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71b3889a-731e-4c72-a1a9-735e4e59f448 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '.version_select at 0x7fb88e1179d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:06.321123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71b3889a-731e-4c72-a1a9-735e4e59f448 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-1226537078" status: 202 len: 0 microversion: 2.1 time: 0.044075 Jul 19 20:00:06.325175 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1574/3032] 10.222.0.33 () {58 vars in 1208 bytes} [Tue Jul 19 20:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1226537078 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:06.403351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:06.423524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-495d8fec-37c3-4727-8ea0-f28dbdc9255c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1470 microversion: 2.1 time: 0.495123 Jul 19 20:00:06.424236 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1459/3033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1470 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:06.488055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-90897554", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:06.511497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:06.512156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:06.520959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.529563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.530474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.530925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.561622 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 HTTP/1.1 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4a5f133e-fe86-43c4-a521-0bf8018684f4'} Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:06.564001 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:00:06.568648 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:06.571488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:06.572741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd9771df-9543-48e7-b7b8-2068ebc473e2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 404 len: 111 microversion: 2.1 time: 0.065891 Jul 19 20:00:06.574319 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1460/3034] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:06 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:00:06.587698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-27fdd14d-53a3-4c85-8e8e-23fec458184a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '.version_select at 0x7fb88d4bd280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:06.618705 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-27fdd14d-53a3-4c85-8e8e-23fec458184a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908455230" status: 202 len: 0 microversion: 2.1 time: 0.037212 Jul 19 20:00:06.622718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:06.623197 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1461/3035] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908455230 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:06.760754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:06.762467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:06.782706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.783642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.794559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:06.795289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.246891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:07.267392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73cd2d50-5ca9-4a2a-8d9c-b1c31740beec tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.511957 Jul 19 20:00:07.276760 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1462/3036] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:06 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:07.444562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:07.445746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:07.472742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.473338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.474313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.475097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.908130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:07.908130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:07.908130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:07.908130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:07.908130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:07.927525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.928001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.939743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.940295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.972157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:07.990049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc472718-9338-40bd-af20-2b842a342f1a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1470 microversion: 2.1 time: 0.551500 Jul 19 20:00:07.992326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:08.002667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1463/3037] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:07 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:08.004822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:08.021226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:08.024645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:08.112891 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef6d5e53-e1e6-426f-a785-3bb5da484bed tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621673 Jul 19 20:00:08.114472 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1575/3038] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:08.126352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bddb3d9b-3a20-44d3-b43e-19900afff324 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:08.126576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bddb3d9b-3a20-44d3-b43e-19900afff324 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:08.268130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bddb3d9b-3a20-44d3-b43e-19900afff324 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:08.278533 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bddb3d9b-3a20-44d3-b43e-19900afff324 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1207 microversion: 2.1 time: 0.157743 Jul 19 20:00:08.282770 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1464/3039] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:08 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1207 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:08.293668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:08.294518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:08.324020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.327741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.329153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.329825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.474542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c54c0245-8e7e-42e9-a437-70bda7f408b1 req-2c1e735c-97ed-4cb5-af42-3a3ee1424576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b99e92-3087-494c-bf48-c27989526149", "name": "network-vif-plugged", "status": "completed", "tag": "c501c637-5097-490a-a8ec-03789f256b87"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:08.509884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c54c0245-8e7e-42e9-a437-70bda7f408b1 req-2c1e735c-97ed-4cb5-af42-3a3ee1424576 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.510487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c54c0245-8e7e-42e9-a437-70bda7f408b1 req-2c1e735c-97ed-4cb5-af42-3a3ee1424576 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.569512 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c54c0245-8e7e-42e9-a437-70bda7f408b1 req-2c1e735c-97ed-4cb5-af42-3a3ee1424576 service nova] Creating event network-vif-plugged:c501c637-5097-490a-a8ec-03789f256b87 for instance c8b99e92-3087-494c-bf48-c27989526149 on n-h1-843861-3 Jul 19 20:00:08.584317 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c54c0245-8e7e-42e9-a437-70bda7f408b1 req-2c1e735c-97ed-4cb5-af42-3a3ee1424576 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113795 Jul 19 20:00:08.588594 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1465/3040] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:08.622273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:08.623194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:08.631726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.632438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.633445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.633886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.651097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:08.762171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:08.772906 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4108400d-5666-4b87-b7f6-6ee06454c19d tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.483713 Jul 19 20:00:08.784692 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1576/3041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:08 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:08.815636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lazy-loading 'services' on Instance uuid 68a311e8-577a-4cc7-b1c5-9778770cf03e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:08.984582 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6776b82b-aebd-4e74-8164-ff65d93fc6ce tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments/9f8617c0-249f-4b32-aa36-638642a789a7" status: 202 len: 0 microversion: 2.1 time: 0.371494 Jul 19 20:00:08.985639 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1466/3042] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:00:08 2022] DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments/9f8617c0-249f-4b32-aa36-638642a789a7 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:08.995517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:08.997595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:09.022680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.025513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:09.026334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.029756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:09.030033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.030596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.056380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.057300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.058478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.059127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.108446 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb7f26b6-56d2-4c6a-8d34-ca05ca956dee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117944 Jul 19 20:00:09.113384 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1577/3043] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:08 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:09.296620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:09.301358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:09.302100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:09.309082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.309706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.310649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.311330 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-797ad73c-39af-498a-a622-ca960fc84709 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1536 microversion: 2.1 time: 0.293555 Jul 19 20:00:09.311508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.312017 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1467/3044] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:09 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1536 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:09.385212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:09.393974 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a2bfa60-fd25-4c05-93a1-e97827174fdd tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1203 microversion: 2.1 time: 0.099387 Jul 19 20:00:09.396052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1578/3045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:09 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:09.692921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-unplugged", "status": "completed", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:09.709317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.712416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.734127 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] Creating event network-vif-unplugged:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 20:00:09.757648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] Instance 96c5b4f6-f56b-4899-82de-e828b094564b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:00:09.784871 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-773658af-ba3d-44c7-b2e1-bb0df9b7c179 req-4af87dc1-cb00-4fd6-a173-d01711ed40d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096152 Jul 19 20:00:09.789461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1468/3046] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:09.790716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:09.791242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:09.808854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.808854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.810915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.811410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.158733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:10.178960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a5cbe5d-ac87-49db-bdea-36b2ea563c94 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1351 microversion: 2.1 time: 0.392696 Jul 19 20:00:10.189463 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1579/3047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:09 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1351 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:10.200016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.201354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:10.236706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.236706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.238167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.238626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.340779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df13594d-1d0b-4859-bf32-92830ba48396 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149392 Jul 19 20:00:10.349414 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1580/3048] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:10.354991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.356184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:10.366064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.367014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.368623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.369383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.541392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Action: 'update', calling method: .version_select at 0x7fb8930f6280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:10.545199 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:10.545199 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:10.547089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.548997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.573470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.574940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.594238 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] HTTP exception thrown: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Request method failure captured: Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 HTTP/1.1 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 56 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1J1f8mX4uLMqieE48wIJXK5igvTTqhI6JbD7SaPbmiZgpOqSo5z8CZ0yPmscRRRBzAEacvMtOU3qTNwmn7WtCxT8cPF84TdnC2yVyE-pTxo0KxI12M6hTm0NR7HwOdaPIogy7ey93c16-Bnl4lt5L7Hk0jj2eWkIPziPB77yYU7V8 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1be3171880744e00989d98db210e1905 Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: exception: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '058ac634-994a-402a-8e4e-88257de00229', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:00:10.603086 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.607800 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.611110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Returning 404 to user: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:10.613577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e78b429d-0272-44a3-84ca-892ca60c0751 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229" status: 404 len: 110 microversion: 2.53 time: 0.491189 Jul 19 20:00:10.618875 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1469/3049] 10.222.0.33 () {62 vars in 1308 bytes} [Tue Jul 19 20:00:10 2022] PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 => generated 110 bytes in 502 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:10.632776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:10.634552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.639121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:10.644465 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c0cc771-175d-4741-ab6c-1d771be9ae4c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1536 microversion: 2.1 time: 0.293309 Jul 19 20:00:10.645400 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1581/3050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1536 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:10.651772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Action: 'update', calling method: .version_select at 0x7fb88e1f9670>, body: {"status": "disabled"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:10.653550 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:10.653550 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:10.655555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.656308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.657324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.657815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.659901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.663266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.679450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.681410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.707371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] HTTP exception thrown: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Request method failure captured: Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 HTTP/1.1 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 22 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1J1f8mX4uLMqieE48wIJXK5igvTTqhI6JbD7SaPbmiZgpOqSo5z8CZ0yPmscRRRBzAEacvMtOU3qTNwmn7WtCxT8cPF84TdnC2yVyE-pTxo0KxI12M6hTm0NR7HwOdaPIogy7ey93c16-Bnl4lt5L7Hk0jj2eWkIPziPB77yYU7V8 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1be3171880744e00989d98db210e1905 Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: {"status": "disabled"} Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: exception: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '058ac634-994a-402a-8e4e-88257de00229', 'body': {'status': 'disabled'}} Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:00:10.713212 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.719934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Returning 404 to user: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:10.722436 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb0df67f-d6dd-4bb2-b4bd-d6ef509b98fd tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229" status: 404 len: 110 microversion: 2.53 time: 0.071581 Jul 19 20:00:10.728342 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1582/3051] 10.222.0.33 () {62 vars in 1308 bytes} [Tue Jul 19 20:00:10 2022] PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 => generated 110 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:10.738379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Action: 'update', calling method: .version_select at 0x7fb88d5c7790>, body: {"status": "enabled"} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:10.761082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.761631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.772358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.781756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.801311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] HTTP exception thrown: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Request method failure captured: Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 HTTP/1.1 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 21 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1J1f8mX4uLMqieE48wIJXK5igvTTqhI6JbD7SaPbmiZgpOqSo5z8CZ0yPmscRRRBzAEacvMtOU3qTNwmn7WtCxT8cPF84TdnC2yVyE-pTxo0KxI12M6hTm0NR7HwOdaPIogy7ey93c16-Bnl4lt5L7Hk0jj2eWkIPziPB77yYU7V8 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aea6824b6c5c4e6191a5fc503d5e626e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: aea6824b6c5c4e6191a5fc503d5e626e Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1be3171880744e00989d98db210e1905 Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: {"status": "enabled"} Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: exception: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '058ac634-994a-402a-8e4e-88257de00229', 'body': {'status': 'enabled'}} Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:00:10.803132 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Returning 404 to user: Service 058ac634-994a-402a-8e4e-88257de00229 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9ee73d4-0dfd-41e5-8324-ba82a155fa80 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229" status: 404 len: 110 microversion: 2.53 time: 0.071333 Jul 19 20:00:10.809602 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1583/3052] 10.222.0.33 () {62 vars in 1308 bytes} [Tue Jul 19 20:00:10 2022] PUT /compute/v2.1/os-services/058ac634-994a-402a-8e4e-88257de00229 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:00:10.814737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.815996 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:10.815996 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:10.817212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.817664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.818471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.825802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.869762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:10.882211 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9460f7bb-35e5-4aef-a97c-923efab89da1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1267 microversion: 2.1 time: 0.261786 Jul 19 20:00:10.882997 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1470/3053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:10.890826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e97d742d-e11c-4687-9cef-c8a395ec8c20 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.079836 Jul 19 20:00:10.894213 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1584/3054] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:00:10.905611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.906874 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:10.906874 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:10.908188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.908646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.910022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.910462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.955009 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6356196e-56b0-4880-a086-c96790e06655 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.053908 Jul 19 20:00:10.964989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1471/3055] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:00:10.972841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.974496 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:10.974496 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:10.976130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.976844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.977906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.978776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.024322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:11.058369 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5c2b093-d638-4fc0-bd8f-6322fbfea4ee tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.092771 Jul 19 20:00:11.062936 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1585/3056] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:00:11.075162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.079260 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:11.079260 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:11.081944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.083194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.084223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.085096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.135630 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f519fa8-f800-4b8e-bf88-0e5f5190a335 tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-843861-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.064733 Jul 19 20:00:11.148667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1472/3057] 10.222.0.33 () {60 vars in 1234 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/os-services?host=n-d-843861-3&binary=xxx => generated 16 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:11.156127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.157465 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:11.157465 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:11.159288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.160481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.164057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.164646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.201111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.202535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.225620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.229978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.231051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.231892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fcab5044-0d50-440a-adb5-43d08e0874fe tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.080926 Jul 19 20:00:11.232484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.233429 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1586/3058] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:00:11.243990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.255705 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:11.255705 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:11.260331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.263765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.265352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.275358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.356556 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0043f363-c68b-4bfe-9d88-dc845fce3f6e tempest-ServicesAdminNegativeV253TestJSON-928954903 tempest-ServicesAdminNegativeV253TestJSON-928954903-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.106096 Jul 19 20:00:11.357958 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1587/3059] 10.222.0.33 () {60 vars in 1238 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:11.366748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.368085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.386269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.386839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.387738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.391031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.433767 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1f7e454-0b59-49be-8d81-c0356498ecdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074357 Jul 19 20:00:11.435047 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1588/3060] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:11.535400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:11.547256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-adbc4091-03ee-45f5-98b0-1f74ce5f9756 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1541 microversion: 2.1 time: 0.353567 Jul 19 20:00:11.550712 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1473/3061] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1541 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:11.569175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.569926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.581516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-060ba47a-e788-4938-b098-8a9aa04b4c8a tempest-ServicesAdminNegativeV253TestJSON-1200565949 tempest-ServicesAdminNegativeV253TestJSON-1200565949-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.584929 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:11.584929 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:00:11.586567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-060ba47a-e788-4938-b098-8a9aa04b4c8a tempest-ServicesAdminNegativeV253TestJSON-1200565949 tempest-ServicesAdminNegativeV253TestJSON-1200565949-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '33eacf205f4b49019cc272a0e491af7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151a034c71647b3a7eff91240ce8c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-060ba47a-e788-4938-b098-8a9aa04b4c8a tempest-ServicesAdminNegativeV253TestJSON-1200565949 tempest-ServicesAdminNegativeV253TestJSON-1200565949-project] Request method failure captured: Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1IQEzzccYbr3A64HGxH44A_x81RHk-w9XorPadr6qMdzQsFClIIoC67C2vuY38B4-yWRtYiHdGB1AG1tvU2LV5YbFmnzyFsKoejML0DUe_cAPMuIcjriCbCX1MvLgLf3Dv7MHy58GAVaJ4M5E85Zx3QVlnaniGkEfQ46pyJMM9E4Q Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d151a034c71647b3a7eff91240ce8c15 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1200565949 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d151a034c71647b3a7eff91240ce8c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d151a034c71647b3a7eff91240ce8c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d151a034c71647b3a7eff91240ce8c15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d151a034c71647b3a7eff91240ce8c15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1200565949 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d151a034c71647b3a7eff91240ce8c15 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1200565949 Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1200565949-project Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 33eacf205f4b49019cc272a0e491af7f Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1200565949-project Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 20:00:11.589277 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 20:00:11.594490 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:11.598472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.599091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-060ba47a-e788-4938-b098-8a9aa04b4c8a tempest-ServicesAdminNegativeV253TestJSON-1200565949 tempest-ServicesAdminNegativeV253TestJSON-1200565949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:11.599893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.600637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-060ba47a-e788-4938-b098-8a9aa04b4c8a tempest-ServicesAdminNegativeV253TestJSON-1200565949 tempest-ServicesAdminNegativeV253TestJSON-1200565949-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.163990 Jul 19 20:00:11.600766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.601183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.602100 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1589/3062] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:11.663330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.664417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.680865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.681704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.682719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.683378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.734507 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6588893-9314-4e69-8243-be5a4e241611 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171395 Jul 19 20:00:11.735656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1474/3063] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:11.839356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:11.856735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.858103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.899597 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] Creating event network-changed:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 20:00:11.921318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] Instance 96c5b4f6-f56b-4899-82de-e828b094564b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:00:11.946875 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3fa2ef15-cfd0-4ac3-9c96-7585ba6bf5bc req-83a9510c-c9bb-4707-a2e0-36684442b729 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111942 Jul 19 20:00:11.951421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1475/3064] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:11.957047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.964738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.973460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.974225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.975247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.976090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:12.193038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:12.208407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1993a543-475e-4016-9ce0-5ff934e4f670 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1265 microversion: 2.1 time: 0.255365 Jul 19 20:00:12.211272 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1476/3065] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:12.313512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:12.335291 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57c50b2c-2a56-4d8c-937c-acc1a767f5e3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1536 microversion: 2.1 time: 0.676580 Jul 19 20:00:12.339938 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1590/3066] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1536 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:12.447918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:12.449075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:12.472817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:12.473616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:12.474571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:12.476264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:12.551252 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2849982-2c48-4ec5-acbc-2b84f03b50a0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109504 Jul 19 20:00:12.555351 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1477/3067] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:12 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:13.237203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:13.238213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:13.266793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.271372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.272842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.273667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.357373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:13.358308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:13.371912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.372667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.373650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.374373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.095549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:14.110204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31303c87-e920-4a63-b64e-3b98762a65dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1536 microversion: 2.1 time: 0.754812 Jul 19 20:00:14.120939 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1478/3068] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:13 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1536 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:14.129825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:14.131757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:14.144462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.146462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.146462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.146462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.228640 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ee1a2d9-6334-4089-9b81-48f05b61171a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114579 Jul 19 20:00:14.229443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1479/3069] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:14 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:14.494839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:14.509192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-161a98d2-fa8d-4e07-ba0d-44456541ef60 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 1.276711 Jul 19 20:00:14.517165 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1591/3070] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:13 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:14.993184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a09138e7-9d5c-4c5b-a37e-abb94f000be4 req-f28c5afc-5a14-4248-bb0c-29fa49da97d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bcd0f3-1310-4acf-b254-938772549525", "tag": "d239a75b-73ed-4a41-ae7d-88ae7f72cb70"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:15.021947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a09138e7-9d5c-4c5b-a37e-abb94f000be4 req-f28c5afc-5a14-4248-bb0c-29fa49da97d5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.022673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a09138e7-9d5c-4c5b-a37e-abb94f000be4 req-f28c5afc-5a14-4248-bb0c-29fa49da97d5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.051450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a09138e7-9d5c-4c5b-a37e-abb94f000be4 req-f28c5afc-5a14-4248-bb0c-29fa49da97d5 service nova] Creating event network-changed:d239a75b-73ed-4a41-ae7d-88ae7f72cb70 for instance 26bcd0f3-1310-4acf-b254-938772549525 on n-h1-843861-3 Jul 19 20:00:15.062846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a09138e7-9d5c-4c5b-a37e-abb94f000be4 req-f28c5afc-5a14-4248-bb0c-29fa49da97d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082324 Jul 19 20:00:15.066408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1480/3071] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:15.129439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:15.130281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:15.151229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.151690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.152520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.157921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.242603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:15.246557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:15.263156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.287480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.289201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.292162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.344342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74240616-c2eb-4076-9077-003e7637e4ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107416 Jul 19 20:00:15.345717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1481/3072] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:15 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:15.535307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:15.536204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:15.548879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.551199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.553127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.556708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.572487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:15.597959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c4ecdc9b-9ba5-4ee3-9f01-7e5974b4eeed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1536 microversion: 2.1 time: 0.471078 Jul 19 20:00:15.601347 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1592/3073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:15 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1536 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:15.779498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e5cba584-d77b-4ab4-a1b1-7494b5f8f30d req-8da0d138-e9ae-4b2c-82d6-c6c8dab8dea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b99e92-3087-494c-bf48-c27989526149", "tag": "c501c637-5097-490a-a8ec-03789f256b87"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:15.818542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e5cba584-d77b-4ab4-a1b1-7494b5f8f30d req-8da0d138-e9ae-4b2c-82d6-c6c8dab8dea2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:15.818990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e5cba584-d77b-4ab4-a1b1-7494b5f8f30d req-8da0d138-e9ae-4b2c-82d6-c6c8dab8dea2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:15.852258 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e5cba584-d77b-4ab4-a1b1-7494b5f8f30d req-8da0d138-e9ae-4b2c-82d6-c6c8dab8dea2 service nova] Creating event network-changed:c501c637-5097-490a-a8ec-03789f256b87 for instance c8b99e92-3087-494c-bf48-c27989526149 on n-h1-843861-3 Jul 19 20:00:15.857854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:15.866373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c04010f8-509d-4766-8bdf-fda69bb7afd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.335914 Jul 19 20:00:15.869270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1482/3074] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:15 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:15.881593 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e5cba584-d77b-4ab4-a1b1-7494b5f8f30d req-8da0d138-e9ae-4b2c-82d6-c6c8dab8dea2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106626 Jul 19 20:00:15.882229 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1593/3075] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:16.286042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:16.287293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:16.303729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.304050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.304750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.305181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.360643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:16.365529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:16.397872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.399224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.401031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.404867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.456100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:16.480381 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26186976-ed5a-46dc-9728-9caa13350de7 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127137 Jul 19 20:00:16.487348 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1594/3076] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:16 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:16.615071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:16.617590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:16.618811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:16.627923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2dcb1e5-6350-4bae-ab72-1da7aa8074cb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.347877 Jul 19 20:00:16.629214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1483/3077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:16 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:16.631571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.632233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.633442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.633953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.890748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:16.891758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:16.903125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.903885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.905357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:16.905965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:16.945775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:16.973357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e324672-b741-466d-adc9-cc96b3ee625a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1529 microversion: 2.1 time: 0.360213 Jul 19 20:00:16.987904 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1595/3078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:16 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1529 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:16.993181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:16.994138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:17.001676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.002966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.015389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.016229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.613503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:17.633830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e339657-e2e4-4366-b630-0d4629225f61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.750706 Jul 19 20:00:17.656894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1484/3079] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:16 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:17.669684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:17.672074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:17.684880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:17.695892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18ecfc33-b073-4ae5-aaa0-f96cbf94b67f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1529 microversion: 2.1 time: 0.706478 Jul 19 20:00:17.698107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.700504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.700797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1596/3080] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:16 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1529 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:17.703670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.704330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.713569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:17.714236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:17.733778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.736408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.738050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.744459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.778584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:17.782425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4fe8563-af71-4e33-8dd6-75e35f4fdea2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123916 Jul 19 20:00:17.786029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1485/3081] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:00:17 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:00:17.803979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8526b265-fa6f-4184-a2ab-992b019a5dda tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:17.816726 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:00:17.816726 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:00:17.825174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8526b265-fa6f-4184-a2ab-992b019a5dda tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] HTTP exception thrown: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8526b265-fa6f-4184-a2ab-992b019a5dda tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Request method failure captured: Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/flavors/0cc34fd0-b2c6-460d-8f73-1f4238390f41 HTTP/1.1 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxHRUbOrOJQ6mNBgLsWy4jXgjzR-JxTpJ45m3oCIklHV-T2PUHMjjaNOly6zTjhEffjnlmhfPmlu8dRBBD80jFVgukaaKve3Rste_roo8njnsZx2xStm80pDYV6cuEp7ql15e7c3qS18pqMILkRiGNPtSFzSIPhfV-OILPFdqUaNSI Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 4a199ec3a0c948608712c354f4b099bb Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-MigrationsAdminTest-1606093926 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a199ec3a0c948608712c354f4b099bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a199ec3a0c948608712c354f4b099bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a199ec3a0c948608712c354f4b099bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a199ec3a0c948608712c354f4b099bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-MigrationsAdminTest-1606093926 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 4a199ec3a0c948608712c354f4b099bb Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-MigrationsAdminTest-1606093926 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-MigrationsAdminTest-1606093926-project-admin Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 276b35b156554264ab2ae505435df509 Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-MigrationsAdminTest-1606093926-project-admin Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: exception: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '0cc34fd0-b2c6-460d-8f73-1f4238390f41'} Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.832537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. Jul 19 20:00:17.836677 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.839622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8526b265-fa6f-4184-a2ab-992b019a5dda tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Returning 404 to user: Flavor 0cc34fd0-b2c6-460d-8f73-1f4238390f41 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:17.841034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8526b265-fa6f-4184-a2ab-992b019a5dda tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/0cc34fd0-b2c6-460d-8f73-1f4238390f41" status: 404 len: 109 microversion: 2.1 time: 0.053708 Jul 19 20:00:17.842007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1486/3082] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:17 2022] DELETE /compute/v2.1/flavors/0cc34fd0-b2c6-460d-8f73-1f4238390f41 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:17.895028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:17.895843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:17.906355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.907224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.910011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.911500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.969221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:18.015040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:18.065855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:18.082415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecbd4e5c-2905-4b51-9a4f-ddf516f9b3a1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.378779 Jul 19 20:00:18.083570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abc8db85-bc52-4ae6-85b9-a87c1840a820 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 204 len: 0 microversion: 2.1 time: 0.190852 Jul 19 20:00:18.084734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1597/3083] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:17 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:18.085148 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1487/3084] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:17 2022] DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:00:18.101460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1234684827", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:18.101890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:18.102425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.109891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.110339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.111448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.112638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.162801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:18.275256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:18.392266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:18.401164 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5f144880-e314-42be-9f70-06e16fa9a11e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1681 microversion: 2.1 time: 0.310600 Jul 19 20:00:18.401762 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1488/3085] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:18.410017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-412035908"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:18.411739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.415391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:18.420975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.421801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.423100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.425474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.532196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:18.533170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:18.533814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:18.534547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:18.535061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:18.544487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.545043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.545912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.546417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.563613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:18.569580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Getting quotas for user 11fb4996ebff47d4b98763cba171cf3b and project 8a160cebe43340e08c20f322e36c0d38. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:18.585371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:18.589261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:18.637709 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23e8d53a-8669-4d04-aee0-901d4a82402e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551488 Jul 19 20:00:18.644409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1598/3086] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:18.771617 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3fb3459-838f-4eb3-9af8-afb76e9c66be tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.364518 Jul 19 20:00:18.773515 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1489/3087] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:18 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 20:00:18.783185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c84d308d-66eb-4b9c-9494-e74e44fd4bf9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:18.784409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c84d308d-66eb-4b9c-9494-e74e44fd4bf9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.820697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25b8dc40-b852-45a2-93d5-38eebdb325f3 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T20%3A00%3A18.583924&end=2022-07-20T20%3A00%3A18.583924" status: 404 len: 112 microversion: - time: 0.174773 Jul 19 20:00:18.825757 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1599/3088] 10.222.0.33 () {58 vars in 1315 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T20%3A00%3A18.583924&end=2022-07-20T20%3A00%3A18.583924 => generated 112 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 20:00:18.826756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:18.827312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.837649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.838105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.838883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.839318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.852650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c84d308d-66eb-4b9c-9494-e74e44fd4bf9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:18.860288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c84d308d-66eb-4b9c-9494-e74e44fd4bf9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1213 microversion: 2.1 time: 0.084661 Jul 19 20:00:18.860792 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1490/3089] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:18.866005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:18.866756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.885826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.886334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.887084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.887931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.081661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:19.091912 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c24bed26-7129-486d-b61d-3f08f55cd206 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.268880 Jul 19 20:00:19.093617 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1600/3090] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:19.105391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-163a3cc5-9da6-4851-8fb2-cce848659b13 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] Calling method '.version_select at 0x7fb88e117280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:19.109522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:19.109703 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-163a3cc5-9da6-4851-8fb2-cce848659b13 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-163a3cc5-9da6-4851-8fb2-cce848659b13 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] Request method failure captured: Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-simple-tenant-usage/ca6c997f9bb24440b7715760977e76c9?start=2022-07-20T20%3A00%3A18.583924&end=2022-07-18T20%3A00%3A18.583924 HTTP/1.1 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1S56dkaQsoQYDHKm3gW0PaEEFxJapu6MjkRG58dZG8gh2UK61K5o9IyQ-k4PnxpvBcl8QePxVb5tQ1oc1752O-5XOI6cgaN6xHctqvaiGUZUxNHnUz4-TbQLnFv2A_n6zMd-wlQn6Q4i_1TEMQ9RxOKU495ikCxsd9M8GP65Hje8Q Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: f975ee36108542d4a49ea3d2da7cec06 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1654215907 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f975ee36108542d4a49ea3d2da7cec06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f975ee36108542d4a49ea3d2da7cec06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f975ee36108542d4a49ea3d2da7cec06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f975ee36108542d4a49ea3d2da7cec06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1654215907 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: f975ee36108542d4a49ea3d2da7cec06 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1654215907 Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1b802e83e742481bbbe134357958534c Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid start time. The start time cannot occur after the end time. Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ca6c997f9bb24440b7715760977e76c9'} Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 19 20:00:19.115280 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.119406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-163a3cc5-9da6-4851-8fb2-cce848659b13 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:19.119406 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-163a3cc5-9da6-4851-8fb2-cce848659b13 tempest-TenantUsagesNegativeTestJSON-1654215907 tempest-TenantUsagesNegativeTestJSON-1654215907-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/ca6c997f9bb24440b7715760977e76c9?start=2022-07-20T20%3A00%3A18.583924&end=2022-07-18T20%3A00%3A18.583924" status: 400 len: 111 microversion: 2.1 time: 0.022207 Jul 19 20:00:19.119406 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1601/3091] 10.222.0.33 () {58 vars in 1411 bytes} [Tue Jul 19 20:00:19 2022] GET /compute/v2.1/os-simple-tenant-usage/ca6c997f9bb24440b7715760977e76c9?start=2022-07-20T20%3A00%3A18.583924&end=2022-07-18T20%3A00%3A18.583924 => generated 111 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:19.119639 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b49b8ae5-3511-4b21-aed9-0c75aea340bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.256561 Jul 19 20:00:19.119639 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1491/3092] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:19.257677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5a45d67-9d0a-4558-b655-aa47767c2a47 tempest-TenantUsagesNegativeTestJSON-2072468305 tempest-TenantUsagesNegativeTestJSON-2072468305-project] Calling method '.version_select at 0x7fb88d4de280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:19.260162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e5a45d67-9d0a-4558-b655-aa47767c2a47 tempest-TenantUsagesNegativeTestJSON-2072468305 tempest-TenantUsagesNegativeTestJSON-2072468305-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0a142b044bec451c80eee571223bf497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6c997f9bb24440b7715760977e76c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5a45d67-9d0a-4558-b655-aa47767c2a47 tempest-TenantUsagesNegativeTestJSON-2072468305 tempest-TenantUsagesNegativeTestJSON-2072468305-project] Request method failure captured: Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T20%3A00%3A18.583924&end=2022-07-20T20%3A00%3A18.583924&detailed=1 HTTP/1.1 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1R0N10h-fIKVL7YAa73cGJQxgKOPqEf2U_i1wTaYk5DFytIGrhM0OPmGYI0s6FvIvbeZZKT1AvGM2P6PfkGPl-nGJu5ceI91iiUX68ICIcOBEYgcuBX8ooahZn-x7U5s3wnWhZNtURvl6Q9J4Xu00O7uE2N5cgd1q35DD09cbN9K8 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca6c997f9bb24440b7715760977e76c9 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2072468305 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca6c997f9bb24440b7715760977e76c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca6c997f9bb24440b7715760977e76c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca6c997f9bb24440b7715760977e76c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca6c997f9bb24440b7715760977e76c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2072468305 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca6c997f9bb24440b7715760977e76c9 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2072468305 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TenantUsagesNegativeTestJSON-2072468305-project Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 0a142b044bec451c80eee571223bf497 Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2072468305-project Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 20:00:19.261952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5a45d67-9d0a-4558-b655-aa47767c2a47 tempest-TenantUsagesNegativeTestJSON-2072468305 tempest-TenantUsagesNegativeTestJSON-2072468305-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e5a45d67-9d0a-4558-b655-aa47767c2a47 tempest-TenantUsagesNegativeTestJSON-2072468305 tempest-TenantUsagesNegativeTestJSON-2072468305-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T20%3A00%3A18.583924&end=2022-07-20T20%3A00%3A18.583924&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.133851 Jul 19 20:00:19.267019 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1602/3093] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Jul 19 20:00:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T20%3A00%3A18.583924&end=2022-07-20T20%3A00%3A18.583924&detailed=1 => generated 123 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:19.358199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-782e12c0-be2e-4970-9091-8b687877215c req-3d95050e-e421-446a-ad13-ad6c15352c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-plugged", "status": "completed", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:19.371452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-782e12c0-be2e-4970-9091-8b687877215c req-3d95050e-e421-446a-ad13-ad6c15352c2b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.372178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-782e12c0-be2e-4970-9091-8b687877215c req-3d95050e-e421-446a-ad13-ad6c15352c2b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.385663 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-782e12c0-be2e-4970-9091-8b687877215c req-3d95050e-e421-446a-ad13-ad6c15352c2b service nova] Creating event network-vif-plugged:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 20:00:19.392855 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-782e12c0-be2e-4970-9091-8b687877215c req-3d95050e-e421-446a-ad13-ad6c15352c2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Jul 19 20:00:19.393939 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1492/3094] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:19.421423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:19.422322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:19.430855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.431318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.433001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.433654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.630341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:19.638293 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db49d1f4-6d61-4b30-92b9-2ec1d1adb9f2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1681 microversion: 2.1 time: 0.223664 Jul 19 20:00:19.642265 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1603/3095] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:19 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:19.876890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:19.877790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:19.884504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.884960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.885834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.886459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.003149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:20.013007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebfdfdd0-4301-42aa-aa7c-50b29c134c98 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1273 microversion: 2.1 time: 0.140532 Jul 19 20:00:20.013833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1493/3096] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:19 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:20.110299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:20.111261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:20.118140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.118591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.119371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.119791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.141893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:20.144329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:20.151152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.151609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.152662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.153034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.474099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:20.487390 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ccee21e-c86a-4e75-97f2-35f5f5dbdb08 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.380643 Jul 19 20:00:20.488344 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1604/3097] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:20 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:20.522965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:20.536064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b60aba4-1b84-44d9-a3f6-f8c41d73b547 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.400754 Jul 19 20:00:20.536973 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1494/3098] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:20 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:20.669135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:20.671107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:20.686343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.687768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.689699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.690736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.023565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:21.031553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cdaec4a-d5e7-4307-917b-42d9b8ac956d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1681 microversion: 2.1 time: 0.378151 Jul 19 20:00:21.032692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:21.034183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:21.050684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1605/3099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:20 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1681 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:21.055341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.057320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.059474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.061744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.114859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:21.378310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:21.396897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ff69305-1075-4744-a7ef-befa0b60ec6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.368685 Jul 19 20:00:21.397843 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1495/3100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:21 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:21.428567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}, {"server_uuid": "26bcd0f3-1310-4acf-b254-938772549525", "name": "network-vif-plugged", "status": "completed", "tag": "d239a75b-73ed-4a41-ae7d-88ae7f72cb70"}, {"server_uuid": "68a311e8-577a-4cc7-b1c5-9778770cf03e", "name": "network-vif-unplugged", "status": "completed", "tag": "bf0fb95f-edf6-450e-9803-f776b58c2b13"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:21.447139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.448243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.470611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Creating event network-vif-unplugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 20:00:21.472366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Creating event network-vif-plugged:d239a75b-73ed-4a41-ae7d-88ae7f72cb70 for instance 26bcd0f3-1310-4acf-b254-938772549525 on n-h1-843861-3 Jul 19 20:00:21.473082 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] Creating event network-vif-unplugged:bf0fb95f-edf6-450e-9803-f776b58c2b13 for instance 68a311e8-577a-4cc7-b1c5-9778770cf03e on n-h1-843861-3 Jul 19 20:00:21.485940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-21450649-8932-4729-88ba-8c3cc184a559 req-93f689e3-2d7a-4383-8770-991c67a7071d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.065188 Jul 19 20:00:21.487499 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1606/3101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:21.511408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:21.512352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:21.539512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.540405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.541449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.542077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.566035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:21.567288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:21.581698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.584419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.585464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.587596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.869886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:21.878631 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01d5a171-7458-4f6e-845f-0a0182167662 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.318677 Jul 19 20:00:21.879655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1607/3102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:21 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:21.885666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e150754e-9221-40e2-8492-925bca61ab76 req-36a445f8-1b11-4165-92e7-06faa227b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a311e8-577a-4cc7-b1c5-9778770cf03e", "name": "network-vif-deleted", "tag": "bf0fb95f-edf6-450e-9803-f776b58c2b13"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:21.897288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e150754e-9221-40e2-8492-925bca61ab76 req-36a445f8-1b11-4165-92e7-06faa227b904 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:21.898082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e150754e-9221-40e2-8492-925bca61ab76 req-36a445f8-1b11-4165-92e7-06faa227b904 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:21.914292 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e150754e-9221-40e2-8492-925bca61ab76 req-36a445f8-1b11-4165-92e7-06faa227b904 service nova] Creating event network-vif-deleted:bf0fb95f-edf6-450e-9803-f776b58c2b13 for instance 68a311e8-577a-4cc7-b1c5-9778770cf03e on n-h1-843861-3 Jul 19 20:00:21.925884 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e150754e-9221-40e2-8492-925bca61ab76 req-36a445f8-1b11-4165-92e7-06faa227b904 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040004 Jul 19 20:00:21.927065 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1608/3103] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:21.964194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:21.974602 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4487872-957e-45e3-8bc1-8f85cb09a6f3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.473307 Jul 19 20:00:21.975754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1496/3104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:21 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:22.052331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:22.053482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:22.060459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.061853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.062909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.063562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.115168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.116285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.117211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lazy-loading 'fault' on Instance uuid 68a311e8-577a-4cc7-b1c5-9778770cf03e {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:22.181883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:22.192711 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aed17eba-7fd3-43f3-bab9-5a46e2c09c16 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 200 len: 1331 microversion: 2.1 time: 0.145603 Jul 19 20:00:22.193423 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1609/3105] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:22 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:22.419547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:22.420346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:22.440281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.441219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.443171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.444575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.727894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:22.739121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-78e8798c-1cd4-42d0-b06a-1197ff12d95d req-c4f6829f-39af-46f1-be79-ff78e349dd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:22.743728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a34b739e-100f-4a1c-9cd3-1107076cea29 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.328000 Jul 19 20:00:22.750807 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1497/3106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:22 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:22.758254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-78e8798c-1cd4-42d0-b06a-1197ff12d95d req-c4f6829f-39af-46f1-be79-ff78e349dd7b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.759305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-78e8798c-1cd4-42d0-b06a-1197ff12d95d req-c4f6829f-39af-46f1-be79-ff78e349dd7b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.784899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-78e8798c-1cd4-42d0-b06a-1197ff12d95d req-c4f6829f-39af-46f1-be79-ff78e349dd7b service nova] Creating event network-changed:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:00:22.796277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-78e8798c-1cd4-42d0-b06a-1197ff12d95d req-c4f6829f-39af-46f1-be79-ff78e349dd7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067446 Jul 19 20:00:22.799336 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1610/3107] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:22.897478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:22.898891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:22.905189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.905859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.907073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.909274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.994952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:22.995599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:23.010526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.010901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.021089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.021916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.215519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:23.232429 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4b3c467-5117-4624-90e0-9dfe6a6acf84 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.339216 Jul 19 20:00:23.235850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1498/3108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:22 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:23.239317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.239968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:23.275457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.279696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.280921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.281552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.311514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e HTTP/1.1 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '68a311e8-577a-4cc7-b1c5-9778770cf03e'} Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.313636 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:00:23.319249 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.320985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:23.322036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6f57fca-9767-4262-8374-3d5e0c2d9835 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 404 len: 111 microversion: 2.1 time: 0.086605 Jul 19 20:00:23.322838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1499/3109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:23 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:23.329711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:23.335057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af3b3e70-26d6-4509-81ae-4df607f8bee6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '.version_select at 0x7fb88dc59160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.349460 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4a96ed2-3de9-4b1d-ba77-ac558fa7ed61 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1307 microversion: 2.1 time: 0.359500 Jul 19 20:00:23.353062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1611/3110] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:22 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:23.383641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af3b3e70-26d6-4509-81ae-4df607f8bee6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461015845" status: 202 len: 0 microversion: 2.1 time: 0.053386 Jul 19 20:00:23.384573 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1500/3111] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461015845 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:23.773462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.776613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:23.795903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.797725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.800161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.801819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.867658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-40e04fee-58ab-4c9f-97c4-3b0db0c8b80a tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.214530 Jul 19 20:00:23.872425 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1612/3112] 10.222.0.33 () {58 vars in 1127 bytes} [Tue Jul 19 20:00:23 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 20:00:23.878201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc52d728-2973-44e2-8473-856850cff464 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Calling method '.version_select at 0x7fb88d68e8b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.902527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-bc52d728-2973-44e2-8473-856850cff464 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] HTTP exception thrown: Image not found. Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc52d728-2973-44e2-8473-856850cff464 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Request method failure captured: Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1XDu8DTLi2JG0psp7nXrGAMHwtgIifd_0cKvy48BBp0IFmtdgM8pAWYuhU5Ugjuq0nT0uY8vFXfWEVclH9s3VLQlYJdftsqKyVaOb9XOaSoupGFYkCmQsSUmmGpIicReyZp3-SmzwrxBuFmX3ui6CaDwNJBkoFYrGoP-hxqOX0WUY Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2d6220e170ab45a1aeda9b34ffd12e70 Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '-1'} Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.905363 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc52d728-2973-44e2-8473-856850cff464 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bc52d728-2973-44e2-8473-856850cff464 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034739 Jul 19 20:00:23.919614 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1613/3113] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 19 20:00:23 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 20:00:23.928809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8e34dcb-be02-4e79-898d-bbdd2fc32d60 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Calling method '.version_select at 0x7fb88d1145e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.954706 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d8e34dcb-be02-4e79-898d-bbdd2fc32d60 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] HTTP exception thrown: Image not found. Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8e34dcb-be02-4e79-898d-bbdd2fc32d60 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Request method failure captured: Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/6744337f-76f5-4e81-8c2a-20219444be2j HTTP/1.1 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1XDu8DTLi2JG0psp7nXrGAMHwtgIifd_0cKvy48BBp0IFmtdgM8pAWYuhU5Ugjuq0nT0uY8vFXfWEVclH9s3VLQlYJdftsqKyVaOb9XOaSoupGFYkCmQsSUmmGpIicReyZp3-SmzwrxBuFmX3ui6CaDwNJBkoFYrGoP-hxqOX0WUY Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2d6220e170ab45a1aeda9b34ffd12e70 Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '6744337f-76f5-4e81-8c2a-20219444be2j'} Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6744337f-76f5-4e81-8c2a-20219444be2j to delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6744337f-76f5-4e81-8c2a-20219444be2j could not be found. Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.956786 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8e34dcb-be02-4e79-898d-bbdd2fc32d60 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8e34dcb-be02-4e79-898d-bbdd2fc32d60 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/6744337f-76f5-4e81-8c2a-20219444be2j" status: 404 len: 62 microversion: 2.1 time: 0.040134 Jul 19 20:00:23.964056 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1614/3114] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:23 2022] DELETE /compute/v2.1/images/6744337f-76f5-4e81-8c2a-20219444be2j => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:00:23.971719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2735afd-6233-49dc-a901-776585205b5d tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Calling method '.version_select at 0x7fb88d666160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.999578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b2735afd-6233-49dc-a901-776585205b5d tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] HTTP exception thrown: Image not found. Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2735afd-6233-49dc-a901-776585205b5d tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Request method failure captured: Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/c5d2bd77-778f-4b7e-b72e-a177e4bd8add1 HTTP/1.1 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1XDu8DTLi2JG0psp7nXrGAMHwtgIifd_0cKvy48BBp0IFmtdgM8pAWYuhU5Ugjuq0nT0uY8vFXfWEVclH9s3VLQlYJdftsqKyVaOb9XOaSoupGFYkCmQsSUmmGpIicReyZp3-SmzwrxBuFmX3ui6CaDwNJBkoFYrGoP-hxqOX0WUY Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2d6220e170ab45a1aeda9b34ffd12e70 Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c5d2bd77-778f-4b7e-b72e-a177e4bd8add1'} Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c5d2bd77-778f-4b7e-b72e-a177e4bd8add1 to delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5d2bd77-778f-4b7e-b72e-a177e4bd8add1 could not be found. Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.001746 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2735afd-6233-49dc-a901-776585205b5d tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2735afd-6233-49dc-a901-776585205b5d tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/c5d2bd77-778f-4b7e-b72e-a177e4bd8add1" status: 404 len: 62 microversion: 2.1 time: 0.038956 Jul 19 20:00:24.010148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1615/3115] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:23 2022] DELETE /compute/v2.1/images/c5d2bd77-778f-4b7e-b72e-a177e4bd8add1 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:00:24.017232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-700b5a56-d737-455d-858b-2d610a121e95 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Calling method '.version_select at 0x7fb88e195700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:24.018884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:24.028764 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be43ae3b-acc2-408b-ac6d-a69bc47ac7dc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.265748 Jul 19 20:00:24.029599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1501/3116] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:23 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:24.046291 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-700b5a56-d737-455d-858b-2d610a121e95 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] HTTP exception thrown: Image not found. Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-700b5a56-d737-455d-858b-2d610a121e95 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Request method failure captured: Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/images/tempest-invalid-917040848 HTTP/1.1 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1XDu8DTLi2JG0psp7nXrGAMHwtgIifd_0cKvy48BBp0IFmtdgM8pAWYuhU5Ugjuq0nT0uY8vFXfWEVclH9s3VLQlYJdftsqKyVaOb9XOaSoupGFYkCmQsSUmmGpIicReyZp3-SmzwrxBuFmX3ui6CaDwNJBkoFYrGoP-hxqOX0WUY Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2d6220e170ab45a1aeda9b34ffd12e70 Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: exception: Image not found. Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'tempest-invalid-917040848'} Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-917040848 to delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-917040848 could not be found. Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.048219 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-700b5a56-d737-455d-858b-2d610a121e95 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Returning 404 to user: Image not found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-700b5a56-d737-455d-858b-2d610a121e95 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-917040848" status: 404 len: 62 microversion: 2.1 time: 0.040619 Jul 19 20:00:24.055976 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1616/3117] 10.222.0.33 () {58 vars in 1202 bytes} [Tue Jul 19 20:00:24 2022] DELETE /compute/v2.1/images/tempest-invalid-917040848 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:00:24.061449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e4c6b81-9ffe-48ff-9402-e84988936e70 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Calling method '.version_select at 0x7fb892f94160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:24.089375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8e4c6b81-9ffe-48ff-9402-e84988936e70 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] HTTP exception thrown: Image not found. Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e4c6b81-9ffe-48ff-9402-e84988936e70 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Request method failure captured: Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/images/99eddefd-6932-4e01-b3a4-6df81f096abe HTTP/1.1 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1XDu8DTLi2JG0psp7nXrGAMHwtgIifd_0cKvy48BBp0IFmtdgM8pAWYuhU5Ugjuq0nT0uY8vFXfWEVclH9s3VLQlYJdftsqKyVaOb9XOaSoupGFYkCmQsSUmmGpIicReyZp3-SmzwrxBuFmX3ui6CaDwNJBkoFYrGoP-hxqOX0WUY Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcfe46207f414cc7a5dc559872c9059d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: dcfe46207f414cc7a5dc559872c9059d Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 2d6220e170ab45a1aeda9b34ffd12e70 Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1176893499-project Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: exception: Image not found. Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '99eddefd-6932-4e01-b3a4-6df81f096abe'} Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 99eddefd-6932-4e01-b3a4-6df81f096abe to delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99eddefd-6932-4e01-b3a4-6df81f096abe could not be found. Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.091343 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e4c6b81-9ffe-48ff-9402-e84988936e70 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] Returning 404 to user: Image not found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:24.099108 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8e4c6b81-9ffe-48ff-9402-e84988936e70 tempest-ImagesDeleteNegativeTestJSON-1176893499 tempest-ImagesDeleteNegativeTestJSON-1176893499-project] 10.222.0.33 "DELETE /compute/v2.1/images/99eddefd-6932-4e01-b3a4-6df81f096abe" status: 404 len: 62 microversion: 2.1 time: 0.036066 Jul 19 20:00:24.102313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1502/3118] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:24 2022] DELETE /compute/v2.1/images/99eddefd-6932-4e01-b3a4-6df81f096abe => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:00:24.242318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5da4b95a-3501-4a2d-a10a-fdc25be4af9e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: .version_select at 0x7fb88e117700>, body: {"keypair": {"name": "tempest-keypair-2135082571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI6cbopokj8TNG6xFmqMDYsiDEXmRBmAA0yOYjpvzCHMP13yg1WC9+GGc+/fWZSRBPYHo8DxyLLgI+mBM1KgQjrFej7BYbCN4Y1kEad0ucq3YlAsrRz8qRgSer/DULjTw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:24.250374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:24.250666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:24.260402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.260853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:24.261750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.262255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:24.281850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5da4b95a-3501-4a2d-a10a-fdc25be4af9e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:24.301219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5da4b95a-3501-4a2d-a10a-fdc25be4af9e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:24.351763 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5da4b95a-3501-4a2d-a10a-fdc25be4af9e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112896 Jul 19 20:00:24.359218 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1617/3119] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:00:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:24.374240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:24.375255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:24.387464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.388278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:24.390928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.391885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:24.523509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:24.536288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9aa9937-ab1b-4a6d-9789-8cf8f49537da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.290358 Jul 19 20:00:24.539851 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1503/3120] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:24 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:24.638623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:24.650095 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa392706-bd3d-4212-81bb-74fcbb5cd797 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1487 microversion: 2.1 time: 0.283978 Jul 19 20:00:24.665050 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1618/3121] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:24 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1487 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:24.797973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-90897554", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:24.881842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:25.048276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:25.050107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:25.059665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.060043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.061024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.061625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.433721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:25.441900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7a78d48-27cd-4447-951c-0a23a92d5143 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.398617 Jul 19 20:00:25.452827 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1619/3122] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:25 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:25.565913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:25.567427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:25.583959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.585291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.586270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.586818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.755424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:25.757190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:25.757876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:25.760264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:25.761455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:25.774917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.775383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.776246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.776692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.797322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:25.804072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:25.811105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:25.823993 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-879f1e86-7569-4a3b-9670-c72a29e8f59f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.268765 Jul 19 20:00:25.824875 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1620/3123] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:25 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:25.831258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:25.835620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:25.888296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-219926ea-912b-4d1c-be5c-2fe53e53de03 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095569 Jul 19 20:00:25.889571 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1504/3124] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:25.901875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b00dff9-9da2-426c-ba6e-525d7d001099 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:25.902586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b00dff9-9da2-426c-ba6e-525d7d001099 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:26.014922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b00dff9-9da2-426c-ba6e-525d7d001099 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:26.024908 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b00dff9-9da2-426c-ba6e-525d7d001099 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1207 microversion: 2.1 time: 0.128865 Jul 19 20:00:26.030752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1621/3125] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:25 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1207 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:26.164930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7da1a1e4-90da-4680-ad34-b9c4f128c0ce req-766702b7-8609-4659-8382-503e7d34d568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-plugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:26.185994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7da1a1e4-90da-4680-ad34-b9c4f128c0ce req-766702b7-8609-4659-8382-503e7d34d568 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.186454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7da1a1e4-90da-4680-ad34-b9c4f128c0ce req-766702b7-8609-4659-8382-503e7d34d568 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.240517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7da1a1e4-90da-4680-ad34-b9c4f128c0ce req-766702b7-8609-4659-8382-503e7d34d568 service nova] Creating event network-vif-plugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 20:00:26.257048 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7da1a1e4-90da-4680-ad34-b9c4f128c0ce req-766702b7-8609-4659-8382-503e7d34d568 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095277 Jul 19 20:00:26.261040 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1505/3126] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:26.344671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1118682276", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81"}], "security_groups": [{"name": "tempest-securitygroup--1030612385"}], "key_name": "tempest-keypair-2135082571", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:26.461735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:26.463292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:26.472908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.473488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.474545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.475276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.504438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:26.521024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] validate_networks() for [('dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:26.819425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:26.829145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57135fd2-093c-443f-8d42-52f8f4938b42 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.372593 Jul 19 20:00:26.829884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1506/3127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:26 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:26.843897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:26.844737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:26.853645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.854399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.855385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.855860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.103459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:27.112871 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1b50b93-2396-4782-8ca3-b767534ee8f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.272894 Jul 19 20:00:27.121494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1507/3128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:26 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:27.130155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:27.131961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:27.140071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.140768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.141592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.142248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.213927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:27.214491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:27.215023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:27.216194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:27.217224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:27.231441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:27.236774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.237276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.239232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.239738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.243675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8dbc37dc-7501-47b1-bec5-d5d54491f818 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1259 microversion: 2.1 time: 0.119553 Jul 19 20:00:27.246985 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1508/3129] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:27 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:27.270855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:27.278445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:27.281363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:27.296622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:27.299601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:27.368140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8908843-0add-4782-917d-db328af7ca04 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.027619 Jul 19 20:00:27.369110 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1622/3130] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:00:27.381062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3ba1d02-ec02-41c2-99da-c31992d30532 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:27.382851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3ba1d02-ec02-41c2-99da-c31992d30532 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:27.468708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3ba1d02-ec02-41c2-99da-c31992d30532 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:27.484026 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3ba1d02-ec02-41c2-99da-c31992d30532 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1242 microversion: 2.1 time: 0.103862 Jul 19 20:00:27.497271 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1509/3131] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:27 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:27.852880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:27.853390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:27.873243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.874573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.876637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.877925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.133210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:28.134487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:28.158354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.159556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.161063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.162126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.510792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:28.520433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7260451-6eac-47fb-8173-990b07ac078a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.677519 Jul 19 20:00:28.524663 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1623/3132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:27 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:28.529887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:28.530513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:28.544694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.545143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.550671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.552362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.567174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:28.626291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:28.637068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24e6a836-cc4c-4bb9-a261-b5909047498a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.511339 Jul 19 20:00:28.643741 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1510/3133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:28 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:28.654920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:28.655553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:28.675460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.676423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.677443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.678056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.840600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:28.860039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48c1516d-c6b4-42b2-999b-025871aeb68e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1294 microversion: 2.1 time: 0.209124 Jul 19 20:00:28.872937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1511/3134] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:28 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1294 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:28.955712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:28.975746 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d4ae918-f120-4ad1-94fe-cf19d2e21495 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.447626 Jul 19 20:00:28.978734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1624/3135] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:28 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:29.545014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:29.546117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:29.567405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.575115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.576980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.583495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.658177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:29.659374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:29.668905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.669555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.670489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.671076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.089150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:30.099306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f12c23c8-ae87-4064-b7d1-aa28a6d9dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.560401 Jul 19 20:00:30.100576 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1512/3136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:29 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:30.113570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:30.114472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:30.117803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:30.126300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:30.126905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.128770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:30.130476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.150520 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d25d2300-bab4-47ce-a167-1271689c9803 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.496063 Jul 19 20:00:30.151997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1625/3137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:29 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:30.159386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:30.160272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:30.167639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:30.168443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.169653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:30.170255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.478922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:30.488894 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16fd471c-d2bb-423e-bf3b-e60c234fb68d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1300 microversion: 2.1 time: 0.386982 Jul 19 20:00:30.490491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1513/3138] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:30 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1300 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:30.493139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:30.496954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-444afba1-cfad-40b3-90d4-9c32fb0d10b9 req-f1dcee77-390b-4eab-8399-40a381c50a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56feb5b0-4e28-41e0-8381-d3413ac6ad6f", "tag": "0cdd5adb-db29-4422-8021-b40aed6b415f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:30.511726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-444afba1-cfad-40b3-90d4-9c32fb0d10b9 req-f1dcee77-390b-4eab-8399-40a381c50a11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:30.514834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-444afba1-cfad-40b3-90d4-9c32fb0d10b9 req-f1dcee77-390b-4eab-8399-40a381c50a11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:30.525941 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd3f7815-bc1f-409b-9560-5baed358e384 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.371424 Jul 19 20:00:30.529540 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1626/3139] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:30 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:30.560621 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-444afba1-cfad-40b3-90d4-9c32fb0d10b9 req-f1dcee77-390b-4eab-8399-40a381c50a11 service nova] Creating event network-changed:0cdd5adb-db29-4422-8021-b40aed6b415f for instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f on n-h1-843861-3 Jul 19 20:00:30.568795 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-444afba1-cfad-40b3-90d4-9c32fb0d10b9 req-f1dcee77-390b-4eab-8399-40a381c50a11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076279 Jul 19 20:00:30.570878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1514/3140] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:31.117248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.118058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.132204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.135790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.136990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.137525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.169875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.170587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.182280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.182732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.183509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.188620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.675306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:31.687945 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-073bb2cb-7f6b-42d3-be1d-398445d7363d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.522243 Jul 19 20:00:31.688562 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1515/3141] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:31.710749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.710749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.722510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:31.743997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.744462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.745263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.745702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.754246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0c871a2-f16c-4b34-926b-784e37653b6d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.641223 Jul 19 20:00:31.770112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1627/3142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:31.791740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.793050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.811581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.815947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.817716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.818279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.069843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:32.081699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4a447ee-a2ab-4bcb-9160-5b6296c4657b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.376612 Jul 19 20:00:32.082308 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1516/3143] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:32.279611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:32.292404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69c08d96-dddb-4316-a6cb-c66302f6d02d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.520693 Jul 19 20:00:32.295796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1628/3144] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:32.449537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-01265d26-2e13-494d-b8e9-de23f9ed3e54 req-1aab13d4-6796-4f02-8ad4-6b1fd71effeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-plugged", "status": "completed", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:32.468662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-01265d26-2e13-494d-b8e9-de23f9ed3e54 req-1aab13d4-6796-4f02-8ad4-6b1fd71effeb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.473268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-01265d26-2e13-494d-b8e9-de23f9ed3e54 req-1aab13d4-6796-4f02-8ad4-6b1fd71effeb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.503049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-01265d26-2e13-494d-b8e9-de23f9ed3e54 req-1aab13d4-6796-4f02-8ad4-6b1fd71effeb service nova] Creating event network-vif-plugged:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:00:32.515911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-01265d26-2e13-494d-b8e9-de23f9ed3e54 req-1aab13d4-6796-4f02-8ad4-6b1fd71effeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072802 Jul 19 20:00:32.516815 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1517/3145] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:32.708561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:32.709486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:32.727706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.728195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.728991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.735261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.777189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:32.777907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:32.813687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.820184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.828376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.829257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.385525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:33.396283 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-930e0ab3-62a1-4282-9120-ddcec377a1d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.694274 Jul 19 20:00:33.396891 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1629/3146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:32 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:33.403129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:33.412082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-513203d6-a0b2-4d7b-8f5a-461a663086bd req-d88b9031-a680-4769-8b79-2eb5044f1483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "002e370a-a19e-4c29-b942-1ce1e6f30a43", "tag": "a25cb0d8-988c-4119-871d-1e350b72e36a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:33.414922 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d914cd1-fc3e-4d0c-8947-118ebd849244 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.644048 Jul 19 20:00:33.423995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-513203d6-a0b2-4d7b-8f5a-461a663086bd req-d88b9031-a680-4769-8b79-2eb5044f1483 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.424721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-513203d6-a0b2-4d7b-8f5a-461a663086bd req-d88b9031-a680-4769-8b79-2eb5044f1483 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.425782 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1518/3147] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:32 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:33.431693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:33.432567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:33.442578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.443330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.445438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.446368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.462777 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-513203d6-a0b2-4d7b-8f5a-461a663086bd req-d88b9031-a680-4769-8b79-2eb5044f1483 service nova] Creating event network-changed:a25cb0d8-988c-4119-871d-1e350b72e36a for instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 on n-h2-843861-3 Jul 19 20:00:33.477672 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-513203d6-a0b2-4d7b-8f5a-461a663086bd req-d88b9031-a680-4769-8b79-2eb5044f1483 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079515 Jul 19 20:00:33.478625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1630/3148] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:33.483968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:33.484688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:33.502637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.503274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.505061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.505691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.783342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:33.793645 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bc44ca8-7500-4a7b-b812-97d4800ca228 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.366269 Jul 19 20:00:33.794529 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1519/3149] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:33 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:33.888495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:33.898443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a5e498a-3207-4b4d-8a0b-d7d20bd75a22 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.418573 Jul 19 20:00:33.899582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1631/3150] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:33 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:34.416040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:34.417398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:34.432479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:34.433100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:34.447084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.448822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.451243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.452092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.455429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.459380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.463407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.464150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.824549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:34.833395 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2fa6991-9d6b-4016-944b-65354f201a9d tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1313 microversion: 2.1 time: 0.404969 Jul 19 20:00:34.834056 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1632/3151] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:34 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:34.838838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:34.839678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:34.846849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.847633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.848742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.849373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.862380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:34.880179 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a7a981f-8f1a-47a3-becb-a084f15e1d72 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.469387 Jul 19 20:00:34.881506 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1520/3152] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:34 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:34.918202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:34.919206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:34.926706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.927495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.928723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.929419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.126838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:35.134555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3db56634-30b2-470a-80ac-2c8b64952e19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.299236 Jul 19 20:00:35.135221 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1633/3153] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:34 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:35.251747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:35.259240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7711ff05-1fd8-4f09-9380-4349f57a2504 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.347385 Jul 19 20:00:35.260709 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1521/3154] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:34 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:35.440784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5b471b1-a79f-418b-93ad-6826e56a0546 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88d01e430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-419724597", "description": "tempest-description-2020393901"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:35.605257 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5b471b1-a79f-418b-93ad-6826e56a0546 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.223091 Jul 19 20:00:35.620085 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1634/3155] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:00:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:35.620379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9b760bfd-e15f-4981-9851-3050d85d8c84 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88d4bdca0>, body: {"security_group_rule": {"parent_group_id": "89de947b-4ee9-424d-9166-b31eeb6b9da4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:35.787760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:35.833671 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9b760bfd-e15f-4981-9851-3050d85d8c84 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.218223 Jul 19 20:00:35.834438 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1522/3156] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:35.845358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e959065-790a-4b2b-962a-5099ed321418 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88d024af0>, body: {"security_group_rule": {"parent_group_id": "89de947b-4ee9-424d-9166-b31eeb6b9da4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:35.851312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:35.851969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:35.860983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.861445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.862516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.863428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.903906 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2e959065-790a-4b2b-962a-5099ed321418 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e959065-790a-4b2b-962a-5099ed321418 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 138 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: {"security_group_rule": {"parent_group_id": "89de947b-4ee9-424d-9166-b31eeb6b9da4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: exception: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'security_group_rule': {'parent_group_id': '89de947b-4ee9-424d-9166-b31eeb6b9da4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:35.905806 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e959065-790a-4b2b-962a-5099ed321418 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: This rule already exists in group 89de947b-4ee9-424d-9166-b31eeb6b9da4 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e959065-790a-4b2b-962a-5099ed321418 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.067595 Jul 19 20:00:35.911485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1635/3157] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:35 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:00:35.920759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:35.921474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:35.928511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.929177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.930073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.930563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.090921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:36.102817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-214d98af-896d-4f2c-b568-5c1cc157dfd7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1462 microversion: 2.1 time: 0.255624 Jul 19 20:00:36.104102 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1523/3158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:35 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1462 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:36.124323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0bbf5e2-04b0-494b-aa15-2e8d9bb7257b tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb892fea0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:36.134615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:36.146577 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e807e368-f25e-4c71-a67b-6768ff033f8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.230950 Jul 19 20:00:36.147370 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1636/3159] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:35 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:36.152888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:36.153839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:36.162574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.163037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.164813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.164813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.392432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24161c0b-014a-4f32-909d-2cf9a2e615b2 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1613 microversion: 2.1 time: 0.243346 Jul 19 20:00:36.393398 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1637/3160] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:36 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1613 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:36.404476 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0bbf5e2-04b0-494b-aa15-2e8d9bb7257b tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/adb5fdb3-8d44-4341-92bf-db7f2e8a040d" status: 202 len: 0 microversion: 2.1 time: 0.297575 Jul 19 20:00:36.404476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1524/3161] 10.222.0.33 () {58 vars in 1286 bytes} [Tue Jul 19 20:00:36 2022] DELETE /compute/v2.1/os-security-group-rules/adb5fdb3-8d44-4341-92bf-db7f2e8a040d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:36.411872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:36.412987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:36.422398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:36.423274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:36.426454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.427311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.428949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.429492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.441406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.442055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.443115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:36.443633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.016500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.023760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.026109 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d712d955-be79-4c9c-970d-28b044a6bc95 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.619626 Jul 19 20:00:37.026900 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1638/3162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:36 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.037100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a551739b-ffa6-4773-a275-16a3bbe31d3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.629951 Jul 19 20:00:37.037843 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1525/3163] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:36 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.042933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.043754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:37.048082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-256c0a81-f9da-4dbd-b610-eb2494eda206 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88dbe9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2045063003", "description": "tempest-description-147546034"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.051627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.052371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.053480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.054107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.100950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '276b35b156554264ab2ae505435df509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a199ec3a0c948608712c354f4b099bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.101550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] flavor_id is None. Assuming migration. {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 20:00:37.102283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:00:37.249029 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af399922-247d-43e5-9d0e-99a61ce730a4 tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86/action" status: 202 len: 0 microversion: 2.1 time: 0.209915 Jul 19 20:00:37.250243 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1639/3164] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:37.258028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0cd1080d-7952-4af2-ab48-1912f86f699c req-0b8634ba-5484-4007-9692-020fd98d39c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56feb5b0-4e28-41e0-8381-d3413ac6ad6f", "name": "network-vif-plugged", "status": "completed", "tag": "0cdd5adb-db29-4422-8021-b40aed6b415f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.282511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=23 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:37.285941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0cd1080d-7952-4af2-ab48-1912f86f699c req-0b8634ba-5484-4007-9692-020fd98d39c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.286632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0cd1080d-7952-4af2-ab48-1912f86f699c req-0b8634ba-5484-4007-9692-020fd98d39c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.292764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:37.302234 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0cd1080d-7952-4af2-ab48-1912f86f699c req-0b8634ba-5484-4007-9692-020fd98d39c0 service nova] Creating event network-vif-plugged:0cdd5adb-db29-4422-8021-b40aed6b415f for instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f on n-h1-843861-3 Jul 19 20:00:37.307647 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0cd1080d-7952-4af2-ab48-1912f86f699c req-0b8634ba-5484-4007-9692-020fd98d39c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055843 Jul 19 20:00:37.308958 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1640/3165] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:37.314576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.315604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:37.320975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-256c0a81-f9da-4dbd-b610-eb2494eda206 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.282046 Jul 19 20:00:37.321843 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1526/3166] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:37.326004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.327000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.328465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.329146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.333006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.333644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:37.360287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.360663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.362034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:37.362482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:37.480360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:37.669726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.676687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.681820 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2e9b8ae-34d7-45d1-8699-78b8c46a65a8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1687 microversion: 2.1 time: 0.371160 Jul 19 20:00:37.682754 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1641/3167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:37 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1687 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.685968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ceec195e-257a-4ae7-8064-b698a9373ac0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1471 microversion: 2.1 time: 0.362901 Jul 19 20:00:37.686847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1527/3168] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:37 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.700160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe2b0384-6df5-4577-9cca-dd267f8075e2 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88d666dc0>, body: {"security_group_rule": {"parent_group_id": "7a7cff20-80f0-4f8f-8cf1-7b2566dd16fc", "ip_protocol": "tcp", "from_port": 290120561, "to_port": 22}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.789790 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-fe2b0384-6df5-4577-9cca-dd267f8075e2 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Invalid port range 290120561:22. Former value cannot be greater than the later Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe2b0384-6df5-4577-9cca-dd267f8075e2 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 145 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: {"security_group_rule": {"parent_group_id": "7a7cff20-80f0-4f8f-8cf1-7b2566dd16fc", "ip_protocol": "tcp", "from_port": 290120561, "to_port": 22}} Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid port range 290120561:22. Former value cannot be greater than the later Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7a7cff20-80f0-4f8f-8cf1-7b2566dd16fc', 'ip_protocol': 'tcp', 'from_port': 290120561, 'to_port': 22}}} Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 290120561:22. Former value cannot be greater than the later Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 290120561:22. Former value cannot be greater than the later Jul 19 20:00:37.792860 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 290120561:22. Former value cannot be greater than the later Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.801945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe2b0384-6df5-4577-9cca-dd267f8075e2 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: Invalid port range 290120561:22. Former value cannot be greater than the later {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:37.811968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe2b0384-6df5-4577-9cca-dd267f8075e2 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.114424 Jul 19 20:00:37.813060 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1642/3169] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:37.822655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-594b7483-d768-48d2-a811-ef34e3076051 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb892fea940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1638663911", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.824498 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-594b7483-d768-48d2-a811-ef34e3076051 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Security group id should be uuid Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-594b7483-d768-48d2-a811-ef34e3076051 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 131 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1638663911", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group id should be uuid Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1638663911', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:37.828401 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:37.837158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 19 20:00:37.837158 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:37.837158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-594b7483-d768-48d2-a811-ef34e3076051 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: Security group id should be uuid {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:37.837158 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-594b7483-d768-48d2-a811-ef34e3076051 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.011397 Jul 19 20:00:37.837158 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1528/3170] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:00:37.849308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6406186d-584c-4ffe-b91f-6a42f3600086 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88d5c7790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1453146972", "description": "tempest-description-1935834566"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:38.047531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.048644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:38.063301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.067241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.068175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.068638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.078323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:38.121655 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6406186d-584c-4ffe-b91f-6a42f3600086 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.282085 Jul 19 20:00:38.123306 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1643/3171] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:38.132904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.133602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:38.155871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.156233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.157032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.164664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.187052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:38.383781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:38.407190 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-070add24-5f0e-42de-a5b8-1a5736783aac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1307 microversion: 2.1 time: 0.364621 Jul 19 20:00:38.416765 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1529/3172] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:38.442219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e76e89cd-e5b9-4947-8262-b3c292bbfb62 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88dc3c4c0>, body: {"security_group_rule": {"parent_group_id": "21f0360b-f883-450a-98ec-2f21d5ff96e7", "ip_protocol": "tempest-999-178122745", "from_port": 22, "to_port": 22}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:38.606145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:38.625752 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e76e89cd-e5b9-4947-8262-b3c292bbfb62 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Invalid IP protocol tempest-999-178122745. Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e76e89cd-e5b9-4947-8262-b3c292bbfb62 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 156 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: {"security_group_rule": {"parent_group_id": "21f0360b-f883-450a-98ec-2f21d5ff96e7", "ip_protocol": "tempest-999-178122745", "from_port": 22, "to_port": 22}} Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid IP protocol tempest-999-178122745. Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'security_group_rule': {'parent_group_id': '21f0360b-f883-450a-98ec-2f21d5ff96e7', 'ip_protocol': 'tempest-999-178122745', 'from_port': 22, 'to_port': 22}}} Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-178122745. Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-178122745. Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:38.628267 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-178122745. Jul 19 20:00:38.633112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:38.633949 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30c543b1-bd15-4075-b99b-bc0d26d5c7ee tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.505083 Jul 19 20:00:38.639997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e76e89cd-e5b9-4947-8262-b3c292bbfb62 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: Invalid IP protocol tempest-999-178122745. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:38.640857 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1644/3173] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:38.640979 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e76e89cd-e5b9-4947-8262-b3c292bbfb62 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.231064 Jul 19 20:00:38.641573 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1530/3174] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:38 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:00:38.654125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4a6c85f-2e14-4e58-a8c0-f293f8d55bb4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88cfd9e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1078135351", "description": "tempest-description-1114224079"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:38.702314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.703112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:38.739712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.746368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.747661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.750401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.006243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4a6c85f-2e14-4e58-a8c0-f293f8d55bb4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.359162 Jul 19 20:00:39.006850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1645/3175] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:00:38 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:39.019656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:39.020758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:39.029244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.029970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.031250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.034471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.239267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:39.252975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72e2eca0-d5fb-4334-ac70-2117f5520c1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.557697 Jul 19 20:00:39.253594 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1531/3176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:39.267431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1e415fa-a250-443b-8fce-3b5970580bc8 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88dd680d0>, body: {"security_group_rule": {"parent_group_id": "38704d16-21e6-4ca3-bdcb-6ca2096e4bfa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:39.372878 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c1e415fa-a250-443b-8fce-3b5970580bc8 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1e415fa-a250-443b-8fce-3b5970580bc8 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 138 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: {"security_group_rule": {"parent_group_id": "38704d16-21e6-4ca3-bdcb-6ca2096e4bfa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'security_group_rule': {'parent_group_id': '38704d16-21e6-4ca3-bdcb-6ca2096e4bfa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 20:00:39.374652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 20:00:39.379125 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.381307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1e415fa-a250-443b-8fce-3b5970580bc8 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:39.382776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1e415fa-a250-443b-8fce-3b5970580bc8 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.122741 Jul 19 20:00:39.388027 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1532/3177] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:39.393970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65201732-98bb-4fd5-9c91-4e30813d799e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88dbe9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1890871804", "description": "tempest-description-872493291"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:39.409651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:39.418910 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fcdfd78-38c8-496b-afba-b4ec675f25ca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1471 microversion: 2.1 time: 0.404556 Jul 19 20:00:39.420849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1646/3178] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:39 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:39.438046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:39.438348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:39.448723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.451046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.455902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.456651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.818992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:39.824311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65201732-98bb-4fd5-9c91-4e30813d799e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.434377 Jul 19 20:00:39.825726 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1533/3179] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:00:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:39.831664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fb84f63-23b2-418c-ab72-8ff8fe5c7e2c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1487 microversion: 2.1 time: 0.397831 Jul 19 20:00:39.832712 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1647/3180] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:39 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1487 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:39.837855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:39.838986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:39.849218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fa98890-40b8-4877-bac6-0f807d6e7dd4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88e464310>, body: {"security_group_rule": {"parent_group_id": "4ba86895-d10e-4733-8281-60fb071fb239", "ip_protocol": "tcp", "from_port": 22, "to_port": 1252027080}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:39.853285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.854643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.855733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.856421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.953528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5fa98890-40b8-4877-bac6-0f807d6e7dd4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fa98890-40b8-4877-bac6-0f807d6e7dd4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 146 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: {"security_group_rule": {"parent_group_id": "4ba86895-d10e-4733-8281-60fb071fb239", "ip_protocol": "tcp", "from_port": 22, "to_port": 1252027080}} Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ba86895-d10e-4733-8281-60fb071fb239', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1252027080}}} Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 Jul 19 20:00:39.956176 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 Jul 19 20:00:39.960655 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:39.967108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fa98890-40b8-4877-bac6-0f807d6e7dd4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 400 to user: Invalid port range 22:1252027080. Valid TCP ports should be between 1-65535 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:39.968292 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fa98890-40b8-4877-bac6-0f807d6e7dd4 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.129307 Jul 19 20:00:39.969423 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1648/3181] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:39 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:00:39.977852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:39.981932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:39.990072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.991069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.992141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.992798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.174708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.198641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e63ae73-bd9f-46b3-86bc-a55d430103b2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.370686 Jul 19 20:00:40.201961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.202944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1534/3182] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:39 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:40.210940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1eb6b469-ce75-4a5d-8437-d4e2c848cacc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1487 microversion: 2.1 time: 0.240048 Jul 19 20:00:40.212163 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1649/3183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:39 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1487 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:40.222770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Action: 'create', calling method: .version_select at 0x7fb88db75040>, body: {"security_group_rule": {"parent_group_id": "f4ecf813-8208-4529-8eb0-b4e2640d29c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:40.230351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.231393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.241671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.242456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.243471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.244186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.265583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG neutronclient.v2_0.client [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist", "detail": ""}} {{(pid=126007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 20:00:40.266335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.security_group_api [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Neutron security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 not found {{(pid=126007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 20:00:40.267118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.267118 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 138 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: {"security_group_rule": {"parent_group_id": "f4ecf813-8208-4529-8eb0-b4e2640d29c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: exception: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f4ecf813-8208-4529-8eb0-b4e2640d29c4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 20:00:40.269238 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 404 to user: Security group f4ecf813-8208-4529-8eb0-b4e2640d29c4 does not exist Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: Neutron server returns request_ids: ['req-798671ff-fc2d-4ab5-8510-e69916deaa6c'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84dc48dd-20cb-4b69-83c5-e13546e93c1e tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.066250 Jul 19 20:00:40.276049 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1535/3184] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:00:40 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:40.280253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.281154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.292201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.292949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.293955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.295117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.525222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.537029 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eaa5e640-07a7-44e8-987f-29caa9fdd8fb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1487 microversion: 2.1 time: 0.310623 Jul 19 20:00:40.549461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.551743 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1650/3185] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1487 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:40.554885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab139791-ad8f-4a43-b450-a348ed9c3ec7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.282596 Jul 19 20:00:40.555556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1536/3186] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:40.557640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb88d68e8b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.585638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.586330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.594350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.594813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.596210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 20:00:40.596383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.597309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Neutron security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 not found {{(pid=126008) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 19 20:00:40.597991 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] HTTP exception thrown: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.597991 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.598725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Request method failure captured: Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-group-rules/7e806a86-c8cf-4974-984b-f853c0657e02 HTTP/1.1 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w1jAhziOqKsDeejY2pythQKe4HlH1BmkdkZMX87oVT-U78OgzkqbPQsS1T1ZLxD24nJXVXFpuLRqTu7EjmlzdMbJqYxNIncbcaf38tdixGLt7atYLp9wrFAFU_ZBFNuT4bf8aD3ITZrr4f-BcWnD6w-KguIwsL7CYoKXRK8EX2a7Ic Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7a4f59b64f3429c81b3ae8d25c68c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d7a4f59b64f3429c81b3ae8d25c68c7a Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3193f8b6a84c4e33afb7b9c05b9419d3 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7e806a86-c8cf-4974-984b-f853c0657e02'} Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 20:00:40.602604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Returning 404 to user: Security group rule 7e806a86-c8cf-4974-984b-f853c0657e02 does not exist Jul 19 20:00:40.606623 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f102288e-0582-4ada-b7ec-001cd530bd07'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:40.613485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-262be0ef-397a-481d-97d6-971334e1672c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/7e806a86-c8cf-4974-984b-f853c0657e02" status: 404 len: 199 microversion: 2.1 time: 0.052597 Jul 19 20:00:40.613485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1651/3187] 10.222.0.33 () {58 vars in 1286 bytes} [Tue Jul 19 20:00:40 2022] DELETE /compute/v2.1/os-security-group-rules/7e806a86-c8cf-4974-984b-f853c0657e02 => generated 199 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:40.615147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.615763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.628472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.628913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.630324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.630951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.666580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:40.800136 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d89bb144-f87d-421d-bd39-fa91c4a96ba2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 204 len: 0 microversion: 2.1 time: 0.189035 Jul 19 20:00:40.801117 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1652/3188] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:40 2022] DELETE /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:40.808134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90f19f1f-8f0d-4616-9fcf-c644102c4943 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb88e464310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.848560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.860856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be4e8954-6b4f-43f8-a544-27bc113dc841 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.304154 Jul 19 20:00:40.861711 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1537/3189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:40.873466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.874095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.877329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:40.887359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.887694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.888859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.889631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.160143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:41.172748 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0f70217-7112-49d6-9155-3bd5f979b90a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1493 microversion: 2.1 time: 0.309453 Jul 19 20:00:41.177983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1538/3190] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1493 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:41.185927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90f19f1f-8f0d-4616-9fcf-c644102c4943 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4ba86895-d10e-4733-8281-60fb071fb239" status: 202 len: 0 microversion: 2.1 time: 0.383240 Jul 19 20:00:41.186586 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1653/3191] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:00:40 2022] DELETE /compute/v2.1/os-security-groups/4ba86895-d10e-4733-8281-60fb071fb239 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:41.213319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdf7f2da-1ae7-429b-a483-c578a1edba8c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb88dd68dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.233736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.235713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:41.243454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.244963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.246098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.246849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.468783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:41.478933 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4dd6a22-99ee-4aa2-8df1-0fdc0d57109c tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.249691 Jul 19 20:00:41.479999 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1654/3192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:41 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:41.528337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-84aa9034-11bc-4801-a44f-ac10c48fd9bd req-9f564454-7d23-479b-84c3-c47457109950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002e370a-a19e-4c29-b942-1ce1e6f30a43", "name": "network-vif-plugged", "status": "completed", "tag": "a25cb0d8-988c-4119-871d-1e350b72e36a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:41.540419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-84aa9034-11bc-4801-a44f-ac10c48fd9bd req-9f564454-7d23-479b-84c3-c47457109950 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.541507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-84aa9034-11bc-4801-a44f-ac10c48fd9bd req-9f564454-7d23-479b-84c3-c47457109950 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.562645 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-84aa9034-11bc-4801-a44f-ac10c48fd9bd req-9f564454-7d23-479b-84c3-c47457109950 service nova] Creating event network-vif-plugged:a25cb0d8-988c-4119-871d-1e350b72e36a for instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 on n-h2-843861-3 Jul 19 20:00:41.570755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-84aa9034-11bc-4801-a44f-ac10c48fd9bd req-9f564454-7d23-479b-84c3-c47457109950 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048557 Jul 19 20:00:41.571935 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1655/3193] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:41.572876 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdf7f2da-1ae7-429b-a483-c578a1edba8c tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/38704d16-21e6-4ca3-bdcb-6ca2096e4bfa" status: 202 len: 0 microversion: 2.1 time: 0.366937 Jul 19 20:00:41.575682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1539/3194] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:00:41 2022] DELETE /compute/v2.1/os-security-groups/38704d16-21e6-4ca3-bdcb-6ca2096e4bfa => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:41.582714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.583549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:41.583798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7c19c67-4265-45ea-be0c-0c16974bb314 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb892fea0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.611702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.611988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.612831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.613546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.882885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:41.905001 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-027b12ff-a074-454d-b2db-02b9d3ddf07d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.327670 Jul 19 20:00:41.906333 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1656/3195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:41 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:41.914524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.915709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:41.922795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.923512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.924576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.925180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.013704 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7c19c67-4265-45ea-be0c-0c16974bb314 tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/21f0360b-f883-450a-98ec-2f21d5ff96e7" status: 202 len: 0 microversion: 2.1 time: 0.435234 Jul 19 20:00:42.015226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1540/3196] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:00:41 2022] DELETE /compute/v2.1/os-security-groups/21f0360b-f883-450a-98ec-2f21d5ff96e7 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:42.025214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2209b95b-d671-4c9e-adde-80fcab048ebf tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb88db62820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.128582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.138432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f7db881-b82c-4a18-b51a-112ea543f922 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.230433 Jul 19 20:00:42.139080 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1657/3197] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:41 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:42.191678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.192390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:42.200413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.201152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.202259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.202873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.409825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2209b95b-d671-4c9e-adde-80fcab048ebf tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7a7cff20-80f0-4f8f-8cf1-7b2566dd16fc" status: 202 len: 0 microversion: 2.1 time: 0.388843 Jul 19 20:00:42.410677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1541/3198] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:00:42 2022] DELETE /compute/v2.1/os-security-groups/7a7cff20-80f0-4f8f-8cf1-7b2566dd16fc => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:42.433476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dbc6cfee-ac90-49fa-88b3-bb6ef4ef681f tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] Calling method '.version_select at 0x7fb88dad5820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.546221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.557512 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54f6f2e0-c3bf-41ba-8b24-f1f356111409 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1493 microversion: 2.1 time: 0.370091 Jul 19 20:00:42.569756 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1658/3199] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:42 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1493 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:42.575274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.576147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:42.583784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.584629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.585596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.586199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.914792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.924911 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb327ab5-ccf8-46df-bff6-62d1dec104ad tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1368 microversion: 2.1 time: 0.353621 Jul 19 20:00:42.925674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1659/3200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:42 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:42.939881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.940387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:42.947314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.948045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.949079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.949365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.063896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dbc6cfee-ac90-49fa-88b3-bb6ef4ef681f tempest-SecurityGroupRulesNegativeTestJSON-1705969411 tempest-SecurityGroupRulesNegativeTestJSON-1705969411-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/89de947b-4ee9-424d-9166-b31eeb6b9da4" status: 202 len: 0 microversion: 2.1 time: 0.646925 Jul 19 20:00:43.065738 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1542/3201] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:00:42 2022] DELETE /compute/v2.1/os-security-groups/89de947b-4ee9-424d-9166-b31eeb6b9da4 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:43.160796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.162430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.179105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.179890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.183522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.184329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.332992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:43.347098 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01522815-4e72-437e-8df8-4df65ca8ae63 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.411180 Jul 19 20:00:43.361354 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1660/3202] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:42 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.433183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.436589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.450591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.456179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.461889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.462492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.541067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:43.571051 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cd15cb5-4971-45f3-b616-e7a245d81219 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.416578 Jul 19 20:00:43.592162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1543/3203] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.599224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2f0a92ff-f79c-46b4-8497-3de7b6ff8b90 req-9466be17-c122-427f-aa3f-643385207378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56feb5b0-4e28-41e0-8381-d3413ac6ad6f", "name": "network-vif-deleted", "tag": "0cdd5adb-db29-4422-8021-b40aed6b415f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:43.632518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2f0a92ff-f79c-46b4-8497-3de7b6ff8b90 req-9466be17-c122-427f-aa3f-643385207378 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.636128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2f0a92ff-f79c-46b4-8497-3de7b6ff8b90 req-9466be17-c122-427f-aa3f-643385207378 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.671883 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2f0a92ff-f79c-46b4-8497-3de7b6ff8b90 req-9466be17-c122-427f-aa3f-643385207378 service nova] Creating event network-vif-deleted:0cdd5adb-db29-4422-8021-b40aed6b415f for instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f on n-h1-843861-3 Jul 19 20:00:43.682384 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2f0a92ff-f79c-46b4-8497-3de7b6ff8b90 req-9466be17-c122-427f-aa3f-643385207378 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088326 Jul 19 20:00:43.687596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lazy-loading 'services' on Instance uuid 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:43.688223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1544/3204] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:43.696842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.698152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.706459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.707344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.708796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.709487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.788251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.789277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.791085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lazy-loading 'fault' on Instance uuid 56feb5b0-4e28-41e0-8381-d3413ac6ad6f {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:43.921042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:43.933712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6ca0a38-b721-4f14-ac4d-30c8f1a3a7f8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments/2b99cc9d-fa90-4b52-9ed1-ba4bdb7c305d" status: 202 len: 0 microversion: 2.1 time: 0.528208 Jul 19 20:00:43.933973 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-53483b3a-dfd0-4a8a-b850-b0bc3727afb8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 200 len: 1297 microversion: 2.1 time: 0.242972 Jul 19 20:00:43.934899 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1545/3205] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 1297 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.938087 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1661/3206] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:00:43 2022] DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments/2b99cc9d-fa90-4b52-9ed1-ba4bdb7c305d => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:43.964863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.966682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.986761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.990185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.993446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.996369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.274731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:44.285743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f31b713-0932-4bf8-98ce-f47fd3e5b261 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1558 microversion: 2.1 time: 0.335903 Jul 19 20:00:44.289632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1546/3207] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1558 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:44.308546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:44.309153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:44.316647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.317522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.318531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.319139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.368057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:44.369003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:44.378565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.379027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.383739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.384451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.430460 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ceb77e81-a661-403b-a566-b61dbfa028ed tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127087 Jul 19 20:00:44.431560 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1662/3208] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:00:44 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:44.599203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:44.600324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:44.612445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.615526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.617203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.617855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.028623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:45.031490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:45.054494 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d43667a2-4379-49e3-a25f-4260ae104d6e tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.460656 Jul 19 20:00:45.058964 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1663/3209] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:44 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:45.069538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:45.072962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:45.077777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:45.093915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.097626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.098476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.098922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.100779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7f0804c-b1d8-4ad6-8eca-558d03911507 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.732816 Jul 19 20:00:45.106283 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1547/3210] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:44 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:45.136945 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f HTTP/1.1 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '56feb5b0-4e28-41e0-8381-d3413ac6ad6f'} Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:45.153955 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:00:45.159270 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:45.161066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:45.164664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c53c0a27-b0f9-4204-bf24-078e6e1a3760 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 404 len: 111 microversion: 2.1 time: 0.104360 Jul 19 20:00:45.168684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1664/3211] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:45 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:45.178036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:45.178641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:45.189835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.193414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.194794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.195437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.266575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:45.469502 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df3a9e7c-e713-4dd9-a519-dace99c0220b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 204 len: 0 microversion: 2.1 time: 0.295589 Jul 19 20:00:45.480589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:45.481218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:45.484529 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1548/3212] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:45 2022] DELETE /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:45.490545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.491001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.498817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.499443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.772829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:45.794730 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76f4a8fa-915f-41cf-bfd2-67ca4217c0d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1493 microversion: 2.1 time: 0.318078 Jul 19 20:00:45.806727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1665/3213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:45 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1493 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:46.076375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:46.077446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:46.108804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.120324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.121700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.122348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.129699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:46.131371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:46.145908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.164320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.164672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.164971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.665720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:46.678309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75dde507-39e0-4dc6-9285-0fa364bdf3a1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.608541 Jul 19 20:00:46.681444 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1549/3214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:46 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:46.816506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:46.818704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:46.841832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.843377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.844435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.845116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.915466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:46.937685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ce86c0d-75f7-4697-9636-338eb0e43e82 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.812872 Jul 19 20:00:46.946765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1666/3215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:46 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:47.266432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c3cc2494-436a-4fdb-924b-ffdd9b8c507e req-b6de8317-c1d7-4e66-b207-d82b92cc1aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "002e370a-a19e-4c29-b942-1ce1e6f30a43", "tag": "a25cb0d8-988c-4119-871d-1e350b72e36a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:47.302794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c3cc2494-436a-4fdb-924b-ffdd9b8c507e req-b6de8317-c1d7-4e66-b207-d82b92cc1aaf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.322996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c3cc2494-436a-4fdb-924b-ffdd9b8c507e req-b6de8317-c1d7-4e66-b207-d82b92cc1aaf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.365937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c3cc2494-436a-4fdb-924b-ffdd9b8c507e req-b6de8317-c1d7-4e66-b207-d82b92cc1aaf service nova] Creating event network-changed:a25cb0d8-988c-4119-871d-1e350b72e36a for instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 on n-h2-843861-3 Jul 19 20:00:47.392925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c3cc2494-436a-4fdb-924b-ffdd9b8c507e req-b6de8317-c1d7-4e66-b207-d82b92cc1aaf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130170 Jul 19 20:00:47.407605 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1667/3216] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:47.465821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:47.477166 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a570565-6243-48e3-9ff3-84818b57f92a tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1493 microversion: 2.1 time: 0.666205 Jul 19 20:00:47.479650 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1550/3217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:46 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:47.707666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:47.709132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:47.729183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.732547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.739845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.742195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.957530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:47.958966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:47.969606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.975350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.976581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.977646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:48.749535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:48.764797 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6750d9de-af4f-47a9-a9f6-fa03abc34452 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 1.066442 Jul 19 20:00:48.776681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1668/3218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:47 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:48.781726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:48.798899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:48.808941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:48.815103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:48.820470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:48.823854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.134441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:49.147889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e290a71a-1d7a-41cf-8935-8e44c6470aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 1.194810 Jul 19 20:00:49.160246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1551/3219] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:47 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:49.497911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:49.506455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0ccd801-7355-4339-a25d-81c42bc6a5a3 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 200 len: 1493 microversion: 2.1 time: 0.728547 Jul 19 20:00:49.526971 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1669/3220] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:48 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 1493 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:49.560655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-61c77a2d-8f9e-49d7-afc2-a1642c8aeb37 req-95240744-2a5e-40eb-8d35-c6a011278544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bcd0f3-1310-4acf-b254-938772549525", "name": "network-vif-deleted", "tag": "d239a75b-73ed-4a41-ae7d-88ae7f72cb70"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:49.607883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-61c77a2d-8f9e-49d7-afc2-a1642c8aeb37 req-95240744-2a5e-40eb-8d35-c6a011278544 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.608702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-61c77a2d-8f9e-49d7-afc2-a1642c8aeb37 req-95240744-2a5e-40eb-8d35-c6a011278544 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.665794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-61c77a2d-8f9e-49d7-afc2-a1642c8aeb37 req-95240744-2a5e-40eb-8d35-c6a011278544 service nova] Creating event network-vif-deleted:d239a75b-73ed-4a41-ae7d-88ae7f72cb70 for instance 26bcd0f3-1310-4acf-b254-938772549525 on n-h1-843861-3 Jul 19 20:00:49.681431 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-61c77a2d-8f9e-49d7-afc2-a1642c8aeb37 req-95240744-2a5e-40eb-8d35-c6a011278544 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125350 Jul 19 20:00:49.687780 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1552/3221] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:49.795623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:49.796288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:49.818395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.820166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.825650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.826288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.168343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:50.169176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:50.185905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.185905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.187141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.187662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.204769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:50.392665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:50.406432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc784adc-68e5-46b8-91ba-fa02f5211eb1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.627958 Jul 19 20:00:50.421932 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1670/3222] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:49 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:50.474867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:50.491239 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5353ec6-dfbf-496d-882f-ec945a72649c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.328605 Jul 19 20:00:50.494664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1553/3223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:50 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:50.543942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:50.545426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:50.566027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.566507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.567328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.567764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.607732 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 HTTP/1.1 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '26bcd0f3-1310-4acf-b254-938772549525'} Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:50.609458 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:50.615173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d94841f0-3fbb-416b-9515-6d96ea48bfe1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 404 len: 111 microversion: 2.1 time: 0.072146 Jul 19 20:00:50.619141 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1671/3224] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:50 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:50.819759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1643592674", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:50.928839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:51.441001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:51.441806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:51.460156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.461033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.464233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.464893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.839028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:51.851725 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48e238f4-d56d-4ac8-918d-752c35859d74 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.415295 Jul 19 20:00:51.854306 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1672/3225] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:51 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:51.862066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:51.863055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:51.906202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:51.908533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.912515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.916515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.917285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.950161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:51.950590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:51.950884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:51.951610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:51.952203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:51.966463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.969770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.972069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.974250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.030002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:52.043706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:52.073939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:52.078177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:52.134874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9cd5cbe6-5a32-4197-9715-6f83f1e88e67 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318991 Jul 19 20:00:52.136783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1554/3226] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:52.151181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6dbd7bba-077b-4366-818b-1673419aa0ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:52.152105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6dbd7bba-077b-4366-818b-1673419aa0ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:52.186749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:52.210632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47e81a3e-33cc-4861-b0b3-1e9d3c133dd0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.352150 Jul 19 20:00:52.211550 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1673/3227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:51 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:52.342707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6dbd7bba-077b-4366-818b-1673419aa0ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:52.361789 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6dbd7bba-077b-4366-818b-1673419aa0ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1209 microversion: 2.1 time: 0.217396 Jul 19 20:00:52.364670 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1555/3228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:52 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1209 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:52.871682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:52.873108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:52.886693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.890244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.893950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.894919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.937271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:52.938260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:52.963545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.965184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.968181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.971169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.048792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:53.242570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7540d662-a69a-47a8-ad66-2e06e44eecf1 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 204 len: 0 microversion: 2.1 time: 0.317987 Jul 19 20:00:53.243750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1556/3229] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:52 2022] DELETE /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:53.264976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72112333-6cb7-4555-b4e1-62845c3a3c4d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:53.276802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72112333-6cb7-4555-b4e1-62845c3a3c4d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.277477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72112333-6cb7-4555-b4e1-62845c3a3c4d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.314072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72112333-6cb7-4555-b4e1-62845c3a3c4d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:00:53.432446 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72112333-6cb7-4555-b4e1-62845c3a3c4d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action" status: 202 len: 0 microversion: 2.1 time: 0.183608 Jul 19 20:00:53.433062 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1557/3230] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:53 2022] POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:53.442892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.444370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:53.466793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.472117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.480562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.483238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.829798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:53.846560 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a62e32d5-c145-4505-b01d-89d4e4eec47e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.409678 Jul 19 20:00:53.859842 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1558/3231] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:53.859842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.859842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:53.879117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.880907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.882013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.882472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.913544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:53.928653 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c15d8fc-58de-4634-9d28-2699373b81cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 1.061865 Jul 19 20:00:53.931230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1674/3232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:52 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:53.943662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.944773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:53.955773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.956988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.957979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.958592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.077342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:54.087596 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2d78aa6-2004-48d2-b41c-cd60b1d21ca4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1205 microversion: 2.1 time: 0.155009 Jul 19 20:00:54.098119 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1675/3233] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1205 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:54.103276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:54.104164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:54.111405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.112154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.113118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.113721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.147709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:54.159741 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee7a1d04-e532-4ab9-af84-095ecaab091e tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1666 microversion: 2.1 time: 0.308937 Jul 19 20:00:54.176005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1559/3234] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:54.343149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:54.356941 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-513a7b62-5f02-4003-bc1e-a8568ee81e44 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.257329 Jul 19 20:00:54.381027 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1676/3235] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:54 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:54.875644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:54.877656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:54.908502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.908969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.909792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.910233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.955068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:54.956039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:54.974177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.975752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.978344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.979071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.390355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:55.408538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ece4e8ab-2d5d-4d2f-b4c3-c7408d7188e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.539371 Jul 19 20:00:55.425252 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1560/3236] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:54 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:55.437583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:55.442778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:55.457483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.462594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.464135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.465031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.574943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:55.588994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4254a364-3543-4027-bb12-80bc89737a00 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.639428 Jul 19 20:00:55.591884 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1677/3237] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:54 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:55.603343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:55.606354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:55.608418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:55.615881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.616805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.617881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.618590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.620218 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4df4586-24de-4692-a266-c3120f082b85 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1267 microversion: 2.1 time: 0.193027 Jul 19 20:00:55.622081 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1561/3238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:55 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:55.633121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:55.635571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:55.648290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.648850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:55.649734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:55.650256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.154886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:56.169377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-251af10c-0abb-4bd1-bfea-a626b41e08de tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.544860 Jul 19 20:00:56.170987 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1562/3239] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:55 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:56.298598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:56.310961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca8fcd74-d706-44a9-b504-88f026837510 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1666 microversion: 2.1 time: 0.720272 Jul 19 20:00:56.311861 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1678/3240] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:55 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1666 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:56.437543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:56.439344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:56.456835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.457558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.458541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.459131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.609244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:56.610917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:56.629684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.632845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.648234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.648967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.808837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:56.821290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33d44d58-3430-4b5b-b61b-f65bc778deaf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.388030 Jul 19 20:00:56.822120 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1563/3241] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:56 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:56.843792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:56.846657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:56.860885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.861403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.865084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.865577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.016472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:57.041082 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03f19e39-8089-4502-a0db-545d335ae2c7 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1267 microversion: 2.1 time: 0.203814 Jul 19 20:00:57.052672 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1564/3242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:56 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:57.117564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:57.141205 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15e8bd3e-ac85-4098-bb76-2c113e79ebe1 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.536987 Jul 19 20:00:57.158495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1679/3243] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:56 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:57.195492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:57.197511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:57.211100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.211926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.214211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.214919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.331642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:57.333861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:57.347831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.348898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.350167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.350905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.520829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b467b0ce25b49dfa1d94152beae007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b178359f244f1489bcacedb06dfd14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:57.531731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c33c30df-bbbc-4732-bc86-33eaa23dfd5f tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 200 len: 1598 microversion: 2.1 time: 0.205292 Jul 19 20:00:57.533732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1680/3244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:57 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 1598 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:57.703514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:57.726351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49ce2f9b-241d-41c4-9732-173bd61664c8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.535783 Jul 19 20:00:57.727621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1565/3245] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:57 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:57.849598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:57.850602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:57.877466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.881705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.883000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.884694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.174439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-322e7b8e-31aa-45f4-8096-699fbd423f34 req-879a482f-2e5d-4b7c-aef3-962943080610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b99e92-3087-494c-bf48-c27989526149", "name": "network-vif-deleted", "tag": "c501c637-5097-490a-a8ec-03789f256b87"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:58.193924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-322e7b8e-31aa-45f4-8096-699fbd423f34 req-879a482f-2e5d-4b7c-aef3-962943080610 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.194388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-322e7b8e-31aa-45f4-8096-699fbd423f34 req-879a482f-2e5d-4b7c-aef3-962943080610 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.227341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-322e7b8e-31aa-45f4-8096-699fbd423f34 req-879a482f-2e5d-4b7c-aef3-962943080610 service nova] Creating event network-vif-deleted:c501c637-5097-490a-a8ec-03789f256b87 for instance c8b99e92-3087-494c-bf48-c27989526149 on n-h1-843861-3 Jul 19 20:00:58.242233 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-322e7b8e-31aa-45f4-8096-699fbd423f34 req-879a482f-2e5d-4b7c-aef3-962943080610 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501466 Jul 19 20:00:58.243174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1681/3246] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:58.271705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.272629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.289010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.295852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.300587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.306391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.307766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a1b29e5a-544a-4348-84cc-8e7312664a4c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.467769 Jul 19 20:00:58.309803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.310283 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1566/3247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:57 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:58.319853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.323882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.344713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.345918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.347485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.348444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.535382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.561439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-012aaa6c-7d70-42ee-871f-4fe2dbc3bfef tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1267 microversion: 2.1 time: 0.311884 Jul 19 20:00:58.565885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1682/3248] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:58.588230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.589956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] [instance: c8b99e92-3087-494c-bf48-c27989526149] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.600536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.601857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.610532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.611743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.637154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:58.638796 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] HTTP exception thrown: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Request method failure captured: Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 HTTP/1.1 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w00IU81eX-tdTJu8TWRYZVoj_PufVOTHLZ1JfXQtGqRXOyt46nYlBR5fsX-YtdByfh_ahWY5TW4LrcCbQYgXv2RPLqfTnYW9Qpz1bUdpWO1xmhYfq0gvtTIYJvN8gcWMS590H2jbrMlBu0N3_8RxtTlIBlPSo4Y2W8Glynoy8Vrz5E Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 53b178359f244f1489bcacedb06dfd14 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestFqdnHostnames-62994064 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b178359f244f1489bcacedb06dfd14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b178359f244f1489bcacedb06dfd14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b178359f244f1489bcacedb06dfd14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b178359f244f1489bcacedb06dfd14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestFqdnHostnames-62994064 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 53b178359f244f1489bcacedb06dfd14 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-62994064 Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestFqdnHostnames-62994064-project Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4b467b0ce25b49dfa1d94152beae007b Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestFqdnHostnames-62994064-project Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c8b99e92-3087-494c-bf48-c27989526149'} Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:58.643998 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. Jul 19 20:00:58.648313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:00:58.650936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Returning 404 to user: Instance c8b99e92-3087-494c-bf48-c27989526149 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:58.652523 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-085c838b-3a35-40db-8cff-bb52ac472777 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149" status: 404 len: 111 microversion: 2.1 time: 0.084184 Jul 19 20:00:58.653467 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1683/3249] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/c8b99e92-3087-494c-bf48-c27989526149 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:58.677835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a74941d-b851-4f8c-af73-6cd1c70e2ff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] Calling method '.version_select at 0x7fb88cf9a160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.702926 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a74941d-b851-4f8c-af73-6cd1c70e2ff5 tempest-ServersTestFqdnHostnames-62994064 tempest-ServersTestFqdnHostnames-62994064-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513048969" status: 202 len: 0 microversion: 2.1 time: 0.038760 Jul 19 20:00:58.703888 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1684/3250] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:00:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513048969 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:58.757833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.758460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.779846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.784667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.785792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.786400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.890905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.904198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32a85182-01de-42a7-97fd-0a4f809bb91c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.588227 Jul 19 20:00:58.904876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1567/3251] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:59.104941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:59.120836 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-723884ce-c8ef-484c-b7fc-b59e8a69b348 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.375435 Jul 19 20:00:59.133498 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1685/3252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:59.332049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:59.332679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:59.345719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.346365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.347481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.348141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.583136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:59.583919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:59.603665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.604163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.604959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.605393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.212202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:00.224741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:00.242891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0fd7d316-8ac3-4b4d-8618-ef5813146532 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.914863 Jul 19 20:01:00.255451 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1568/3253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:59 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:00.270781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:00.271694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:00.308343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.308806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.309658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.311961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.357610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:00.376436 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81b9a577-8860-4078-a85b-f403ec9992ff tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.789937 Jul 19 20:01:00.392816 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1686/3254] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:59 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:00.404150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:00.404150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:00.411455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.413199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.414294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.414923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.870602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:00.886305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b354b29-83e8-47a3-bc01-4aeb7f578828 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.623820 Jul 19 20:01:00.887581 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1569/3255] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:00 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.260888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.262283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.276064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.276850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.277944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.278630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.325745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.340178 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0918eba2-c226-4f3a-8487-c3cc358658c1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.944437 Jul 19 20:01:01.341513 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1687/3256] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:00 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.398119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.399320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.413626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.419890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.422510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.428138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.562818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.578100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-21fa441d-56a9-459c-be45-d8db5f87d5ee tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.319899 Jul 19 20:01:01.589548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1570/3257] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:01.799744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.809067 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-44d712f3-023c-4180-90b8-9acbc9b7c267 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.414910 Jul 19 20:01:01.810148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1688/3258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.909104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.910107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.920232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.920909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.921923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.922526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.007501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:02.178316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:02.187978 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c24d033-11dc-4f94-b29a-b69c29b124d0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.285119 Jul 19 20:01:02.189411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1571/3259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:02.358529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:02.359119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:02.366326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.366780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.367588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.368235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.410869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d625825b-0bf3-42c8-9982-702dd2c85fb4 req-80dfddd0-2133-491a-a2ab-f0826ef17ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02933e5-79e7-4ea9-a25c-cb8af0798269", "tag": "32ff4948-ec25-4f0d-a3f2-4e8a0ac591df"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:02.419860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:02.449884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d625825b-0bf3-42c8-9982-702dd2c85fb4 req-80dfddd0-2133-491a-a2ab-f0826ef17ee5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.450343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d625825b-0bf3-42c8-9982-702dd2c85fb4 req-80dfddd0-2133-491a-a2ab-f0826ef17ee5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.473821 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d625825b-0bf3-42c8-9982-702dd2c85fb4 req-80dfddd0-2133-491a-a2ab-f0826ef17ee5 service nova] Creating event network-changed:32ff4948-ec25-4f0d-a3f2-4e8a0ac591df for instance f02933e5-79e7-4ea9-a25c-cb8af0798269 on n-h1-843861-3 Jul 19 20:01:02.479984 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d625825b-0bf3-42c8-9982-702dd2c85fb4 req-80dfddd0-2133-491a-a2ab-f0826ef17ee5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075109 Jul 19 20:01:02.482578 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1572/3260] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:02.599308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:02.600102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:02.627474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.634162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.635291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.635754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.729959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:02.738445 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1fc9a2ba-bdd5-4fac-950b-8874cfc3e4a6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.383967 Jul 19 20:01:02.739044 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1689/3261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:02 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:02.826742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:02.827366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:02.841706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.842317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.843543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.851244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.228053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:03.239769 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5cc0c755-fc01-4c3a-bc8e-f81c67d2648e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1682 microversion: 2.1 time: 0.646776 Jul 19 20:01:03.245482 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1573/3262] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:02 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1682 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:03.267800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:03.268737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:03.288324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.288783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.289570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.294894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.348068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:03.356839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f176e2e8-510d-4570-bb32-667264fadecb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.534086 Jul 19 20:01:03.364628 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1690/3263] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:02 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:03.616510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:03.624971 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8cceb7d0-d64d-4c7d-94c8-0a5b92702789 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.378204 Jul 19 20:01:03.627721 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1574/3264] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:03 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:03.754445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:03.755536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:03.766801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.771702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.772767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.774864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.096722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:04.110627 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-814d5efc-2dc2-40df-8e50-b75f0a439b27 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1679 microversion: 2.1 time: 0.355368 Jul 19 20:01:04.115087 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1691/3265] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:03 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1679 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:04.262706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.263323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.278495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.280718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.282516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.283159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.379224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.380093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.391226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.392297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.393095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.393532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.689752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:04.708316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-64d3b0ac-7f95-4d10-95b0-fe546156b3ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.449244 Jul 19 20:01:04.710066 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1575/3266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:04.717922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.719043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.736016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.736737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.738288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.738973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.846140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:04.854371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-06c13f52-eaf3-41af-99af-b9963f2d08f6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.479602 Jul 19 20:01:04.855384 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1692/3267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:04.861373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.862290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.871248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.872840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.874224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.874859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.090061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:05.121392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-224006f1-3377-4a13-8d46-51c9c8c801d2 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.404224 Jul 19 20:01:05.126758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1576/3268] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:05.136699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:05.142583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:05.166136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:05.176641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:05.183333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.183791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.184626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.185066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.196936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e1c830c-1a56-47ae-855f-d939c09e78a7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.340360 Jul 19 20:01:05.197549 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1693/3269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:05.540268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-03cc0914-9bab-4b40-a52f-a5125601497a req-0df5920b-0980-4a5f-88b6-d29a69f15187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:05.556868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-03cc0914-9bab-4b40-a52f-a5125601497a req-0df5920b-0980-4a5f-88b6-d29a69f15187 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.559261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-03cc0914-9bab-4b40-a52f-a5125601497a req-0df5920b-0980-4a5f-88b6-d29a69f15187 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.586830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-03cc0914-9bab-4b40-a52f-a5125601497a req-0df5920b-0980-4a5f-88b6-d29a69f15187 service nova] Creating event network-vif-unplugged:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 20:01:05.601329 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-03cc0914-9bab-4b40-a52f-a5125601497a req-0df5920b-0980-4a5f-88b6-d29a69f15187 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198122 Jul 19 20:01:05.603051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:05.607563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1694/3270] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:05.617469 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c54dec70-bbfa-4d82-a830-22a06016b965 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1656 microversion: 2.1 time: 0.488889 Jul 19 20:01:05.630842 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1577/3271] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:05 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1656 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:05.640460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd5193b8-bcba-4fd4-ad8f-2b0480561b59 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:05.648355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd5193b8-bcba-4fd4-ad8f-2b0480561b59 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.649373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd5193b8-bcba-4fd4-ad8f-2b0480561b59 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.731795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd5193b8-bcba-4fd4-ad8f-2b0480561b59 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Going to try to start instance {{(pid=126008) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:01:05.818561 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd5193b8-bcba-4fd4-ad8f-2b0480561b59 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action" status: 202 len: 0 microversion: 2.1 time: 0.183232 Jul 19 20:01:05.819707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1695/3272] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:05 2022] POST /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:05.830634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:05.831383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:05.843733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.845709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.847304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.849445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.873656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:05.874641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:05.890900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.892927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.895371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.897225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.373937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:06.398407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04316705-9c8d-4f95-aad7-b44f9c87697c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1665 microversion: 2.1 time: 0.574620 Jul 19 20:01:06.403134 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1578/3273] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:05 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1665 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:06.425105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.426482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:06.447863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.448471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.450553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.457146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.459922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:06.474345 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4f0c0c5-cfc7-4a4e-aa86-6a68fc4cfcee tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.600543 Jul 19 20:01:06.478611 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1696/3274] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:05 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:06.925094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.926374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:06.935078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.936534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.937526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.938209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.438800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:07.445736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:07.448647 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b66a75ac-637d-426d-8f58-bab69f1dd95f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 1.042833 Jul 19 20:01:07.450869 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1579/3275] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:06 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:07.458729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43e1cb8f-85a5-4a3a-887a-51305c8a3069 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.538183 Jul 19 20:01:07.459589 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1697/3276] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:06 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:07.464851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:07.465673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:07.502170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.503391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.504627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.505400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.578324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-436cd481-1bc6-4384-8eb8-25e152e9e4ff tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Action: 'create', calling method: .version_select at 0x7fb88e1f3820>, body: {"keypair": {"name": "tempest-keypair-2090018178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHLDIN5QCVLzQVAm8INfYA26X2C/2XtXiyHCv34TyVZNu+AP1ARUYtff9RR7ki645+Lizgp0LxogrlIKi7EDThUnPnIklzGK1uwvYiM4NnzPJ7CwRqU7jU5GmF7ft5fvQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:07.661283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-436cd481-1bc6-4384-8eb8-25e152e9e4ff tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for project c1eaf740540147f1ae072ec5b90c2481. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:07.674774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-436cd481-1bc6-4384-8eb8-25e152e9e4ff tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for user 62939ac494e447a9974c125a4396790f and project c1eaf740540147f1ae072ec5b90c2481. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:07.710536 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-436cd481-1bc6-4384-8eb8-25e152e9e4ff tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258459 Jul 19 20:01:07.720144 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1580/3277] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:01:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:07.727024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:07.728259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:07.739370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.739962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.740849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.742102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.766989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:07.775676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92b01fef-d4a9-4f67-8411-f6e6e4cde808 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1665 microversion: 2.1 time: 0.314846 Jul 19 20:01:07.784168 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1698/3278] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:07 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1665 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:07.798375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:07.799259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:07.816814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.817262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.818050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.818494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.093077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.108009 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f18a14ac-302e-4d06-aec7-bd90e3fc4791 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.393549 Jul 19 20:01:08.109640 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1581/3279] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:07 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.135369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.145081 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de0c4536-fd9a-418f-a132-3c938f7da2c0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.359561 Jul 19 20:01:08.145970 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1699/3280] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:07 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.158376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:08.159013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.165914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.166372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.167842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.168572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.384360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.395035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cdc82bfd-3c28-47e3-9628-4740a57b330d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.261767 Jul 19 20:01:08.397996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1582/3281] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.415879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:08.417508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.426194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.426644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.428215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.428988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.469611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:08.471595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.490023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.490686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.494564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.500570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.535710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:08.584626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73495335-c9ca-498c-8220-b479886e53bf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.173839 Jul 19 20:01:08.585302 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1700/3282] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:08 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:08.594744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:08.595468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.612208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.612658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.613456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.613896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.976605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.981499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.993596 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-162b6adb-e2b6-438f-beea-32c1e356b164 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1671 microversion: 2.1 time: 0.403078 Jul 19 20:01:08.994034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a8f84da-b08a-42a1-8b6d-dbb1fdf462cc tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.530353 Jul 19 20:01:08.994853 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1583/3283] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.997491 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1701/3284] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1671 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:09.008113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:09.008964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:09.018187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.018895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.019931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.020532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.021500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fb88842c-a238-4aed-afcb-de70818fe0bb req-70240e66-665b-490d-931b-3b179dcbfb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02933e5-79e7-4ea9-a25c-cb8af0798269", "name": "network-vif-plugged", "status": "completed", "tag": "32ff4948-ec25-4f0d-a3f2-4e8a0ac591df"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:09.043705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb88842c-a238-4aed-afcb-de70818fe0bb req-70240e66-665b-490d-931b-3b179dcbfb4c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.046890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb88842c-a238-4aed-afcb-de70818fe0bb req-70240e66-665b-490d-931b-3b179dcbfb4c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.078748 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fb88842c-a238-4aed-afcb-de70818fe0bb req-70240e66-665b-490d-931b-3b179dcbfb4c service nova] Creating event network-vif-plugged:32ff4948-ec25-4f0d-a3f2-4e8a0ac591df for instance f02933e5-79e7-4ea9-a25c-cb8af0798269 on n-h1-843861-3 Jul 19 20:01:09.096121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fb88842c-a238-4aed-afcb-de70818fe0bb req-70240e66-665b-490d-931b-3b179dcbfb4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079189 Jul 19 20:01:09.096956 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1702/3285] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:09.163288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:09.164822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:09.177345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.180429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.183589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.184256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.599966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:09.617094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-389dbf2c-65d1-4b71-ba44-fff37ba0a0f1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1669 microversion: 2.1 time: 0.620893 Jul 19 20:01:09.619899 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1584/3286] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1669 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:09.720246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:09.738227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddfdb75a-fc42-4042-a35c-05cc7621d38e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.579063 Jul 19 20:01:09.741459 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1703/3287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:09 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:10.015011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:10.015639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:10.025342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:10.028898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:10.031664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.032583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.033924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.034527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.057559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.060361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.065381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.066206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.460662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:10.476142 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d00de744-8e00-469d-8f05-2cd43d7537d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1676 microversion: 2.1 time: 0.461594 Jul 19 20:01:10.477433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1704/3288] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:10 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1676 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:10.498845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:10.517232 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd3db9f7-f310-4bf1-a9c7-59e0ec25b41c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.507428 Jul 19 20:01:10.518527 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1585/3289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:10 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:10.769796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:10.770562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:10.796925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.800145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.806581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.811424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.010389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:11.036557 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72f070c1-3ff7-4901-9417-ea9933d74863 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1309 microversion: 2.1 time: 0.272720 Jul 19 20:01:11.039520 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1705/3290] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:10 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:11.089605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1840953352", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f339f4b9-f0ce-442a-b9e8-7baf490add4d"}], "security_groups": [{"name": "tempest-securitygroup--1767576162"}], "key_name": "tempest-keypair-2090018178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:11.237643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] validate_networks() for [('f339f4b9-f0ce-442a-b9e8-7baf490add4d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:11.496572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:11.497282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:11.505514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.505963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.506750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.507193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.849126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:11.869501 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91e6392f-5bcb-4ffd-b4e2-ec3690b3b600 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.376806 Jul 19 20:01:11.870895 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1706/3291] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:11 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:11.876822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:11.877721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:11.885450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.886025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.887354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.888087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.163374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for project c1eaf740540147f1ae072ec5b90c2481. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:12.167540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:12.176284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for user 62939ac494e447a9974c125a4396790f and project c1eaf740540147f1ae072ec5b90c2481. Resources: dict_keys(['metadata_items']) {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:12.182324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6bd0d51-c6ea-4436-86c2-eb959fba019f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1476 microversion: 2.1 time: 0.308303 Jul 19 20:01:12.184348 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1707/3292] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:11 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:12.201575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:12.203233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:12.204927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:12.205753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:12.206439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:12.207469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:12.208471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:12.216507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.217930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.223042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.225653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.244341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.245769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.247580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.248068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.273952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for project c1eaf740540147f1ae072ec5b90c2481. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:12.284026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Getting quotas for user 62939ac494e447a9974c125a4396790f and project c1eaf740540147f1ae072ec5b90c2481. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:12.315016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:12.321888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:12.385247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2dfa68a6-3771-4882-a5cd-15d0f4802ba8 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.300548 Jul 19 20:01:12.392124 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1586/3293] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:01:12.401271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:12.401963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:12.413398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.414693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.429751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.434412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.680801 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-941d9fd8-3199-4cd7-9f72-2519bbf08297 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 200 len: 324 microversion: 2.1 time: 0.494961 Jul 19 20:01:12.686669 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1708/3294] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:12 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:12.687781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d03a3378-2f68-4371-9cfe-2e5d7fc2830e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:12.693517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d03a3378-2f68-4371-9cfe-2e5d7fc2830e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.368959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d03a3378-2f68-4371-9cfe-2e5d7fc2830e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.390584 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d03a3378-2f68-4371-9cfe-2e5d7fc2830e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1270 microversion: 2.1 time: 0.707424 Jul 19 20:01:13.392835 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1709/3295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:12 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1270 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.403799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.405782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.416756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.417241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.418099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.418599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.511724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.517158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:13.542477 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ac7c26f-54a0-4152-aaa0-d0387a08c54f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1489 microversion: 2.1 time: 1.149070 Jul 19 20:01:13.543139 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1587/3296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:12 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1489 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.564736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.565659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.572550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.573008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.573845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.574294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.878388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.886403 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2204a167-167c-440f-a54b-d2fbb7e3958f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.489386 Jul 19 20:01:13.899569 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1710/3297] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.899569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:13.899569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.901063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.901063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.901564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.902001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.973617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.980846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aeac2e01-213e-4e2b-b177-f1206c42f115 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "PUT /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1084 microversion: 2.1 time: 0.092364 Jul 19 20:01:13.981841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1711/3298] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:01:13 2022] PUT /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1084 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.987494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.988118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.996658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.996658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.996658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.997940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.002330 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5dd85e0-8286-4836-9091-6bd1720c5670 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1475 microversion: 2.1 time: 0.458076 Jul 19 20:01:14.003184 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1588/3299] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:14.008508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.009356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:14.018579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.019450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.020975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.021682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.458583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:14.466486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-243d9ceb-5803-45b7-86c0-e7072ca71469 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.483302 Jul 19 20:01:14.467092 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1712/3300] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:14.475918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:14.481784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.483835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:14.488514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59cf8772-6964-40bd-89f1-3222ef381a11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1510 microversion: 2.1 time: 0.480728 Jul 19 20:01:14.490756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1589/3301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:14.500560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.501194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:14.508155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.508851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.509820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.510429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.520336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.521948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.524029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.525828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.635449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:14.644515 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09427030-c8aa-4387-bb32-433b9a2c1dee tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1328 microversion: 2.1 time: 0.170856 Jul 19 20:01:14.645107 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1713/3302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:14.649764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.650389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:14.658514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.658957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.659996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.660590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.174898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:15.266746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:15.268036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6ba16a7-0c50-41e8-9d44-07ac4f6d73da tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.775685 Jul 19 20:01:15.284734 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1590/3303] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:15.308687 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52b77f78-9820-43ac-a908-cbb9e0583485 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1510 microversion: 2.1 time: 0.642985 Jul 19 20:01:15.310077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1714/3304] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:15.314311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-unplugged", "status": "completed", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:15.341477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.349304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:15.363246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.364723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.367620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.370546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.384210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.385440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.437374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] Creating event network-vif-unplugged:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h1-843861-3 Jul 19 20:01:15.478361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:01:15.513084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-79a1174c-6e0f-4437-9247-65de3278996c req-f11f1e6f-5d08-422a-877d-baea513e027b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230416 Jul 19 20:01:15.514883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1591/3305] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:15.526120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.527731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:15.547885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.563564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.566359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.569877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.018316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:16.027699 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48d531ba-aaa4-4a33-b834-7da4592f9bed tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1475 microversion: 2.1 time: 0.713722 Jul 19 20:01:16.028399 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1715/3306] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:15 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1475 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:16.034948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.035766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:16.045588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.046522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.049503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.050173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.086605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:16.123310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:16.140766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e1a5fe1-1a5b-494a-84c3-38fe1f120846 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.623136 Jul 19 20:01:16.141701 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1592/3307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:15 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:16.162591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.163522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:16.170726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.171446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.173088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.173779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.229474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:16.293215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6addffd-c5e6-46f8-8e1a-99953c6e0ae8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 204 len: 0 microversion: 2.1 time: 0.263005 Jul 19 20:01:16.297041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1716/3308] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:16 2022] DELETE /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:16.310433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.311624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:16.326916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.327753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.328921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.329585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.643742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:16.652832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c32775f-d3a2-4736-ab5a-d65c1f20cb23 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 0.510012 Jul 19 20:01:16.653840 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1593/3309] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:16 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:16.662763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-51917318", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "2f332934-1a7c-403c-b4ff-1c5d43cb0949"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:16.681764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:16.694716 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7975dbe6-0230-4fb6-b3f6-01910c41a581 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1516 microversion: 2.1 time: 0.391279 Jul 19 20:01:16.695487 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1717/3310] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:16 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:16.714239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-71ab0592-24fb-498a-92b2-b3f77efc5a06 req-372291da-8f3e-4138-a558-591dff8d4670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c14dbc-cbe1-4533-aa4d-c12d924473c7", "tag": "fd618230-10f3-4c65-8fa7-fca627795207"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:16.719641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:16.725132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-71ab0592-24fb-498a-92b2-b3f77efc5a06 req-372291da-8f3e-4138-a558-591dff8d4670 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.726441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-71ab0592-24fb-498a-92b2-b3f77efc5a06 req-372291da-8f3e-4138-a558-591dff8d4670 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.740635 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-71ab0592-24fb-498a-92b2-b3f77efc5a06 req-372291da-8f3e-4138-a558-591dff8d4670 service nova] Creating event network-changed:fd618230-10f3-4c65-8fa7-fca627795207 for instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 on n-h1-843861-3 Jul 19 20:01:16.750464 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-71ab0592-24fb-498a-92b2-b3f77efc5a06 req-372291da-8f3e-4138-a558-591dff8d4670 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040958 Jul 19 20:01:16.752090 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1718/3311] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:16.752804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] validate_networks() for [('2f332934-1a7c-403c-b4ff-1c5d43cb0949', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:17.047788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:17.048791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:17.057675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.058135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.058912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.059522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.727897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:17.761236 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5465455a-7ce6-4009-be00-a3b7188e6cca tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1475 microversion: 2.1 time: 0.718193 Jul 19 20:01:17.762745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1719/3312] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:17 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1475 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:17.769988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:17.785829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.786601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.802802 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] Creating event network-changed:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h1-843861-3 Jul 19 20:01:17.810934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:01:17.830304 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a160852c-9441-4b37-be71-78ce89347474 req-f608a613-f698-4f69-847a-aa752de97f0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064287 Jul 19 20:01:17.833797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1720/3313] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:17.843797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:17.845776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:17.856671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.857185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.858290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.858984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.391723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:18.393492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:18.393492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:18.393492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:18.393855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:18.406514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.407503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.409731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.410557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.474044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:18.485396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:18.511521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:18.516356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:18.531290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:18.549158 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d01cf0d-86a4-41b6-8828-85a07c080df1 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 0.712043 Jul 19 20:01:18.558934 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1721/3314] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:17 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:18.572262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:18.573615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:18.587670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.588185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.588979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.589566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.641241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-292e89de-4575-45fe-b620-c8500b0a29d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.985977 Jul 19 20:01:18.646282 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1594/3315] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:01:18.656262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-60c17d16-0931-4972-bc24-8309c8759c0f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:18.685393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-60c17d16-0931-4972-bc24-8309c8759c0f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:18.839353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-60c17d16-0931-4972-bc24-8309c8759c0f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:18.851664 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-60c17d16-0931-4972-bc24-8309c8759c0f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1213 microversion: 2.1 time: 0.198414 Jul 19 20:01:18.855863 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1595/3316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:18 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:18.870316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:18.871777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:18.883456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.884220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.886370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.887232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.287400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:19.309781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d15057cf-44b4-447e-bb34-4b7df2481177 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1516 microversion: 2.1 time: 0.747901 Jul 19 20:01:19.314067 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1722/3317] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:18 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1516 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:19.393119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:19.411488 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2036d92-6f58-4f15-aeb3-0e90abe003bf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1475 microversion: 2.1 time: 0.553560 Jul 19 20:01:19.422150 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1596/3318] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:18 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1475 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:19.571620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:19.571620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:19.599651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.600238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.601395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.602013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.875060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:19.876542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:19.903037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.903845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.904825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.905456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.245564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:20.255976 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05519f94-de6d-45f0-b82e-773824fa9ef7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1265 microversion: 2.1 time: 0.386526 Jul 19 20:01:20.257249 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1597/3319] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:19 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:20.262564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6d82a670-d7c7-499f-93d6-13d70d9b80e5 req-7515a404-5277-47b2-b8d1-e05d35846c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02933e5-79e7-4ea9-a25c-cb8af0798269", "name": "network-vif-deleted", "tag": "32ff4948-ec25-4f0d-a3f2-4e8a0ac591df"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:20.282262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6d82a670-d7c7-499f-93d6-13d70d9b80e5 req-7515a404-5277-47b2-b8d1-e05d35846c02 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.283689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6d82a670-d7c7-499f-93d6-13d70d9b80e5 req-7515a404-5277-47b2-b8d1-e05d35846c02 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.302427 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6d82a670-d7c7-499f-93d6-13d70d9b80e5 req-7515a404-5277-47b2-b8d1-e05d35846c02 service nova] Creating event network-vif-deleted:32ff4948-ec25-4f0d-a3f2-4e8a0ac591df for instance f02933e5-79e7-4ea9-a25c-cb8af0798269 on n-h1-843861-3 Jul 19 20:01:20.324146 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6d82a670-d7c7-499f-93d6-13d70d9b80e5 req-7515a404-5277-47b2-b8d1-e05d35846c02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064682 Jul 19 20:01:20.327990 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1598/3320] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:20.338594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:20.339332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:20.363238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.364120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.365263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.365929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.413792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.414566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.414945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lazy-loading 'fault' on Instance uuid f02933e5-79e7-4ea9-a25c-cb8af0798269 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:20.560023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:20.606387 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f3f67c0-1996-4ce6-94e7-6ba37790907f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 200 len: 1320 microversion: 2.1 time: 0.276145 Jul 19 20:01:20.607403 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1599/3321] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:20 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:20.632427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:20.639419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:20.648096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:20.661217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b359d2f-3df0-4c30-921e-c3643faf6228 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 1.098018 Jul 19 20:01:20.661845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1723/3322] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:19 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:20.669929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.685313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.686436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.687264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.162963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:21.179486 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a44a1e1-a093-44f0-9886-004b1de4dc3a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1475 microversion: 2.1 time: 0.564043 Jul 19 20:01:21.182486 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1600/3323] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:20 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:21.274498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:21.275493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:21.285884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.287104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.288414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.289102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.446795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:21.456322 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48b61710-be6a-42ad-bb53-21533e370e54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1271 microversion: 2.1 time: 0.185858 Jul 19 20:01:21.456942 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1724/3324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:21 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:21.636942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:21.638550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:21.648602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:21.656027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.658818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.666081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.667533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.691698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:01:21.692047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:21.692807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 HTTP/1.1 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f02933e5-79e7-4ea9-a25c-cb8af0798269'} Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:21.694919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:01:21.700185 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:21.702875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:21.704116 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3bbc7673-a071-4b59-981c-945a2acb30d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 404 len: 111 microversion: 2.1 time: 0.080721 Jul 19 20:01:21.705497 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1601/3325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:21 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:21.722097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.729009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.731096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.734622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.991030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2035168260", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "51c039ff-827c-4eb7-915b-4f549710c7d4"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:22.126122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] validate_networks() for [('51c039ff-827c-4eb7-915b-4f549710c7d4', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:22.179913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:22.202898 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d5d68508-54d2-4ace-a82d-2652c4508687 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 0.517442 Jul 19 20:01:22.204217 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1725/3326] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:21 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:22.209928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:22.210830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:22.230084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.230546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:22.231508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.231776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:22.858278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:22.869597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c6b2f0d-448c-472b-bb25-c143e9656f20 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1473 microversion: 2.1 time: 0.664033 Jul 19 20:01:22.882315 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1726/3327] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:22 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1473 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:22.888913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:22.890931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:22.899967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.900869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:22.902496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.903153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.350881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:23.360410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7d41cd4-4b2d-471a-b3da-1770c5b652af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.476340 Jul 19 20:01:23.361700 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1727/3328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:22 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:23.379725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c24b86d4-dc3f-4489-8af5-170d04ec7af4 req-f1c5a694-8755-46df-b80d-8314b406100c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de641a32-75be-4975-8d99-9a0267e7598e", "tag": "ce3c8533-fa80-4296-bc3d-6ece3c8661fc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:23.385117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:23.402915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c24b86d4-dc3f-4489-8af5-170d04ec7af4 req-f1c5a694-8755-46df-b80d-8314b406100c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.403904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c24b86d4-dc3f-4489-8af5-170d04ec7af4 req-f1c5a694-8755-46df-b80d-8314b406100c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.435217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c24b86d4-dc3f-4489-8af5-170d04ec7af4 req-f1c5a694-8755-46df-b80d-8314b406100c service nova] Creating event network-changed:ce3c8533-fa80-4296-bc3d-6ece3c8661fc for instance de641a32-75be-4975-8d99-9a0267e7598e on n-h2-843861-3 Jul 19 20:01:23.452089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c24b86d4-dc3f-4489-8af5-170d04ec7af4 req-f1c5a694-8755-46df-b80d-8314b406100c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088343 Jul 19 20:01:23.454460 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1728/3329] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:23.460816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:23.462026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:23.469933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.470666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.472064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.472666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.835288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:23.843025 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a88a6fe-0b0f-4be7-8990-a9aaca193df5 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 0.387187 Jul 19 20:01:23.843609 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1729/3330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:23 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:23.848106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4224bb42-eff0-4a98-ac60-5452ddef77df req-82b5a728-5cfb-4fb7-8668-54fc36609f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c14dbc-cbe1-4533-aa4d-c12d924473c7", "name": "network-vif-plugged", "status": "completed", "tag": "fd618230-10f3-4c65-8fa7-fca627795207"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:23.856412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4224bb42-eff0-4a98-ac60-5452ddef77df req-82b5a728-5cfb-4fb7-8668-54fc36609f38 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.856867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4224bb42-eff0-4a98-ac60-5452ddef77df req-82b5a728-5cfb-4fb7-8668-54fc36609f38 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.869107 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4224bb42-eff0-4a98-ac60-5452ddef77df req-82b5a728-5cfb-4fb7-8668-54fc36609f38 service nova] Creating event network-vif-plugged:fd618230-10f3-4c65-8fa7-fca627795207 for instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 on n-h1-843861-3 Jul 19 20:01:23.874223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4224bb42-eff0-4a98-ac60-5452ddef77df req-82b5a728-5cfb-4fb7-8668-54fc36609f38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029469 Jul 19 20:01:23.874903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:23.875896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1730/3331] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:23.876568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:23.877582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:23.878503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:23.879361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:23.892742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:23.897621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:23.905258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.905865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.906793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.907302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.912590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.913260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.915639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.916109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.957699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:23.963516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Getting quotas for user 99e6b3d5c0d3481bb972fa7cf4090040 and project eb17e655432548aabbef31726a45e823. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:23.977450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:23.980101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:24.049416 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3f234aef-40c9-4e2e-a3bd-6bae9e671bb2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066692 Jul 19 20:01:24.052319 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1602/3332] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:01:24.076910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-88774e26-c03d-4f78-9aa6-56a1279ea8d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:24.079004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-88774e26-c03d-4f78-9aa6-56a1279ea8d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.439864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-88774e26-c03d-4f78-9aa6-56a1279ea8d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:24.476100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-88774e26-c03d-4f78-9aa6-56a1279ea8d5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1209 microversion: 2.1 time: 0.417964 Jul 19 20:01:24.477618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1603/3333] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:24 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1209 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:24.552069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:24.568200 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d94aa271-e2d7-4716-9316-2060d9fdcd7c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1470 microversion: 2.1 time: 0.682647 Jul 19 20:01:24.568848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1731/3334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:23 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1470 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:24.576675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:24.577549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.595133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.596438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.598788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.599421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.674160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2068387616", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:24.743276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:24.789963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:24.799731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-909a4235-728b-4bd1-b3a1-0dca0950a99f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.228655 Jul 19 20:01:24.800396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1732/3335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:24 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:24.808388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:24.809667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.819920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.820592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.821784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.822531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.967571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:24.998682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac746d74-3f01-4b8f-ae7f-bdc50797b7a8 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "POST /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86/action" status: 202 len: 0 microversion: 2.1 time: 0.195988 Jul 19 20:01:25.000010 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1733/3336] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:24 2022] POST /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:25.009863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.010567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.018125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.018588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.019531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.020009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.268928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.289675 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1ec4d1e-61dc-4d9c-9f45-12330d743100 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1396 microversion: 2.1 time: 0.286293 Jul 19 20:01:25.292304 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1734/3337] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:25.299972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.300793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.313696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.314441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.315432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.316098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.349933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:25.350420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:25.351623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:25.353500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:25.354260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:25.387531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.391553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.393341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.394840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.425124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:25.432112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:25.449929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:25.452607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:25.520725 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-465c45db-0821-4979-8f55-2f95ca1f51c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041339 Jul 19 20:01:25.522456 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1604/3338] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:01:25.603010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.613826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64954dae-f806-4f38-8d17-5000fcdac705 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.320111 Jul 19 20:01:25.615136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1735/3339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:25.620132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.620941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.628183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.628758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.630811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.631243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.707228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.707926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.720419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.721273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.729621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.738519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.739307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.752512 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fce2db1e-a703-4c44-b9b6-c7818faf9e09 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1261 microversion: 2.1 time: 0.131307 Jul 19 20:01:25.753845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1736/3340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1261 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:25.768316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b4c5e15-4913-4252-a765-4122f75c582f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.775577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b4c5e15-4913-4252-a765-4122f75c582f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.828261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:25.874311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b4c5e15-4913-4252-a765-4122f75c582f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.894108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b4c5e15-4913-4252-a765-4122f75c582f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1215 microversion: 2.1 time: 0.136114 Jul 19 20:01:25.895020 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1737/3341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:25.905864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.914725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.938211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.942177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.944035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.944904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.049776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffc6c914-1d68-480e-b428-1c5e59feb759 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 204 len: 0 microversion: 2.42 time: 0.525014 Jul 19 20:01:26.051038 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1605/3342] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:01:25 2022] DELETE /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:01:26.063657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-plugged", "status": "completed", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:26.079512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.080281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.111858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] Creating event network-vif-plugged:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h1-843861-3 Jul 19 20:01:26.121612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:01:26.135417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-26465d6e-1f88-4bae-a843-7b7f002c0f0c req-b378fd79-b971-41ba-b431-687c82fb5f41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082013 Jul 19 20:01:26.138102 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1606/3343] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:26.152164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:26.153688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:26.176062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.177149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.178326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.178923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.669953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.677920 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-285f5dac-ef2a-4c09-b739-c507536463fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.781471 Jul 19 20:01:26.682207 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1738/3344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:26.687282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:26.687968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:26.709161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.710512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.711536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.712652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.813393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.825784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.827267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.829658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fdcd4871-c475-423a-bf69-bca4d9128453 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2955 microversion: 2.42 time: 0.689794 Jul 19 20:01:26.830239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1607/3345] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:26 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2955 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:26.835496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:26.836843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:26.844616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.845001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.849883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.850391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.871526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:27.035042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.059688 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a27d3149-7fd0-49f2-adc1-26cd08abff58 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1577 microversion: 2.1 time: 0.369216 Jul 19 20:01:27.072432 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1739/3346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:26 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1577 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.089224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.091962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.109626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.110391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.115623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.116385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.279192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.282344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.289950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f81cefde-4987-4155-8096-4a3834aa6b45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1267 microversion: 2.1 time: 0.214952 Jul 19 20:01:27.292859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55980c33-7eb7-4ca8-8e01-b8b56d516379 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.459943 Jul 19 20:01:27.293661 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1608/3347] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:26 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.306533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1740/3348] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.315345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.317642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.318512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.322069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.331584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.333604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.334295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.335293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.335976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.338061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.339107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.342220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.574311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.606401 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-503fa7c1-b1de-4b9a-998c-9cb3720ba5fb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1273 microversion: 2.1 time: 0.292850 Jul 19 20:01:27.612346 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4827f63-a973-4b00-bb83-2b45acd3db68 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300884 Jul 19 20:01:27.613663 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1741/3349] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:27.617611 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1609/3350] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.699552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.701148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.716111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.716982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.719008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.720075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.853748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.855712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.865775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.867799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.868836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.869570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.100213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.119830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d41d9006-6e4f-4bcd-a3d2-e52d9b49c8ab tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.423503 Jul 19 20:01:28.121300 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1742/3351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:28.243608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.255599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.257414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.259066 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a80f3136-fb5c-4466-9055-45e266dc4160 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2955 microversion: 2.42 time: 0.411747 Jul 19 20:01:28.260411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1610/3352] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2955 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:28.308384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:28.309002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:28.312132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:28.313309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:28.317628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.317969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.318754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.319246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.341256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.341965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.342901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.343504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.584182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.592687 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4eae851-07e2-446e-b608-105633229ec9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.288195 Jul 19 20:01:28.593796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1743/3353] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:28 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:28.616755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.627084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:28.627847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:28.628132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d62ef550-1775-4726-8e1c-d0bee9cc133b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.320892 Jul 19 20:01:28.628866 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1611/3354] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:28 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:28.634756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.635278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.636165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.636662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.792306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.800533 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0877425-b5af-4602-b23f-f23d10869a5b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1315 microversion: 2.1 time: 0.178371 Jul 19 20:01:28.801159 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1744/3355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:28 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:29.070340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:29.071955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:29.075904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e2987277-f6e1-437c-aa6d-fefc5633a117 req-dd56da74-9cc4-454c-95cc-3d4b5fc5d00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c14dbc-cbe1-4533-aa4d-c12d924473c7", "tag": "fd618230-10f3-4c65-8fa7-fca627795207"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:29.084895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e2987277-f6e1-437c-aa6d-fefc5633a117 req-dd56da74-9cc4-454c-95cc-3d4b5fc5d00b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.085344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e2987277-f6e1-437c-aa6d-fefc5633a117 req-dd56da74-9cc4-454c-95cc-3d4b5fc5d00b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.086244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.086879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.087891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.088493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.099619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e2987277-f6e1-437c-aa6d-fefc5633a117 req-dd56da74-9cc4-454c-95cc-3d4b5fc5d00b service nova] Creating event network-changed:fd618230-10f3-4c65-8fa7-fca627795207 for instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 on n-h1-843861-3 Jul 19 20:01:29.107103 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e2987277-f6e1-437c-aa6d-fefc5633a117 req-dd56da74-9cc4-454c-95cc-3d4b5fc5d00b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035680 Jul 19 20:01:29.107922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1745/3356] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:29.140302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:29.142603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:29.151278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.151943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.154257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.154896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.569134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:29.577937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:29.578927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c92573df-8119-4ff4-bad9-726033ad1820 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.443950 Jul 19 20:01:29.590071 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1746/3357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:29 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:29.595498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:29.596317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:29.617269 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0eb908f-712c-48cf-b2f5-c50ae4df5dfa tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1577 microversion: 2.1 time: 0.550708 Jul 19 20:01:29.621357 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1612/3358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:29 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1577 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:29.625746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.631504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:29.632785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.633796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.643440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.649492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:29.667544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.674049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.675177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:29.675787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.722080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:30.733660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3f0b7ed-aa08-47b2-9e5c-b43ec48823fc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 1.109763 Jul 19 20:01:30.743002 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1613/3359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:29 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:30.747456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:30.748528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:30.759193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.763493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.765574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.766670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.141743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:31.153095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:31.157099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:31.160103 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f7cd07f-3203-4375-bec7-a72da398420a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2955 microversion: 2.42 time: 1.577606 Jul 19 20:01:31.161683 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1747/3360] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:29 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2955 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:31.167556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:31.168837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:31.177679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.178808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.180527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.181236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.508033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:31.516214 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31486b6d-fd44-42cb-a37b-271da0752eaf tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.777071 Jul 19 20:01:31.516816 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1614/3361] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:30 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:31.521336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:31.522150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:31.528644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.529097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.529878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.530314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.743267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:31.756739 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52b5f3f5-8a63-4c57-a720-3e411d9da860 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1315 microversion: 2.1 time: 0.593629 Jul 19 20:01:31.762686 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1748/3362] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:31 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:31.773348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-339fa3da-5849-4ea0-b474-3ecbfe446026 req-17bbbf62-e3ac-42ae-b6b1-9f56c637f1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de641a32-75be-4975-8d99-9a0267e7598e", "name": "network-vif-plugged", "status": "completed", "tag": "ce3c8533-fa80-4296-bc3d-6ece3c8661fc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:31.788439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-339fa3da-5849-4ea0-b474-3ecbfe446026 req-17bbbf62-e3ac-42ae-b6b1-9f56c637f1f6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.788997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-339fa3da-5849-4ea0-b474-3ecbfe446026 req-17bbbf62-e3ac-42ae-b6b1-9f56c637f1f6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.802210 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-339fa3da-5849-4ea0-b474-3ecbfe446026 req-17bbbf62-e3ac-42ae-b6b1-9f56c637f1f6 service nova] Creating event network-vif-plugged:ce3c8533-fa80-4296-bc3d-6ece3c8661fc for instance de641a32-75be-4975-8d99-9a0267e7598e on n-h2-843861-3 Jul 19 20:01:31.808277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-339fa3da-5849-4ea0-b474-3ecbfe446026 req-17bbbf62-e3ac-42ae-b6b1-9f56c637f1f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044012 Jul 19 20:01:31.809044 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1749/3363] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:31.815339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8ee9ee4e-210e-432e-82b2-68d145037e27 req-6a063fbf-a5c9-43fe-a2e3-72091b77a612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049f8f4e-947f-4567-b754-6d1a023a8333", "tag": "6cc119bd-d4e7-4263-9bf3-cc5fb89edf27"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:31.824266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8ee9ee4e-210e-432e-82b2-68d145037e27 req-6a063fbf-a5c9-43fe-a2e3-72091b77a612 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.824993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8ee9ee4e-210e-432e-82b2-68d145037e27 req-6a063fbf-a5c9-43fe-a2e3-72091b77a612 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.837376 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8ee9ee4e-210e-432e-82b2-68d145037e27 req-6a063fbf-a5c9-43fe-a2e3-72091b77a612 service nova] Creating event network-changed:6cc119bd-d4e7-4263-9bf3-cc5fb89edf27 for instance 049f8f4e-947f-4567-b754-6d1a023a8333 on n-h1-843861-3 Jul 19 20:01:31.842676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8ee9ee4e-210e-432e-82b2-68d145037e27 req-6a063fbf-a5c9-43fe-a2e3-72091b77a612 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032167 Jul 19 20:01:31.843653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1750/3364] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:31.850080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:31.851026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:31.858406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.859119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.860737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.861524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.079444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.087244 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08bcdbfb-ac57-4202-aaeb-97785702f517 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.569358 Jul 19 20:01:32.087870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1615/3365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:31 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:32.092630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bc0dd794-9369-4582-9337-292b6147cc7d req-8ccd965a-0b7b-4768-8ba1-63fd7aeb336f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49c314a-241b-44db-9960-d0873117d158", "tag": "f224e94c-dc19-45db-83d1-42ecb13ab74f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:32.104608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bc0dd794-9369-4582-9337-292b6147cc7d req-8ccd965a-0b7b-4768-8ba1-63fd7aeb336f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.105293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bc0dd794-9369-4582-9337-292b6147cc7d req-8ccd965a-0b7b-4768-8ba1-63fd7aeb336f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.118119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bc0dd794-9369-4582-9337-292b6147cc7d req-8ccd965a-0b7b-4768-8ba1-63fd7aeb336f service nova] Creating event network-changed:f224e94c-dc19-45db-83d1-42ecb13ab74f for instance d49c314a-241b-44db-9960-d0873117d158 on n-h1-843861-3 Jul 19 20:01:32.123426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bc0dd794-9369-4582-9337-292b6147cc7d req-8ccd965a-0b7b-4768-8ba1-63fd7aeb336f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034374 Jul 19 20:01:32.124086 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1616/3366] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:32.182140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.182878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.189383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.189873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.190643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.191259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.221643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.231270 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4bcaac0-fd29-4302-8e68-89dba5b2f6e8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.386036 Jul 19 20:01:32.231971 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1751/3367] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:31 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:32.539526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.546975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.557499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.557975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.558778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.559308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.734787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.749269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.751914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.753937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0415408b-6269-4a3b-9e6b-7dcf1a8a09a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2955 microversion: 2.42 time: 0.576169 Jul 19 20:01:32.770188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1617/3368] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2955 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:32.782477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.783560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.793445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.794355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.795348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.796028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.657834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:33.666915 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96112b12-60d4-4edb-ab80-d8ad55f91ed9 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 1.137705 Jul 19 20:01:33.667719 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1752/3369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:33.681344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:33.682141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:33.690203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.690856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.691702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.692165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.716536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:33.719148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:33.732122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a72cdaa-ac9d-43eb-a630-041a8aa1ed2d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1315 microversion: 2.1 time: 0.956116 Jul 19 20:01:33.733046 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1618/3370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:33.748115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:33.748918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:33.774325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.774953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.775767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.778301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.216980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.232035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78191509-2178-48b8-a6c8-eccce93908cf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1313 microversion: 2.1 time: 0.562966 Jul 19 20:01:34.241226 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1753/3371] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:33 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:34.246664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.247464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.254884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.255329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.256318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.256920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.282235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.290349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1c51446-5be1-4f66-9ecb-572ab2f95d53 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.546742 Jul 19 20:01:34.291519 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1619/3372] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:33 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:34.296199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-unplugged", "status": "completed", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:34.304838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.305541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.318571 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] Creating event network-vif-unplugged:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:01:34.325735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:01:34.338693 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ad200b42-c21c-47b0-8324-edfeb44b66fa req-26172567-bc24-421a-bf5f-3f2d7ed4b433 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045714 Jul 19 20:01:34.339331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1620/3373] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:34.686244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.687047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.694951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.695683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.696703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.697324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.883889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.894101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.895663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.896965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26e9aa85-c9cd-44b4-bdaa-2e1a8b20985b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2934 microversion: 2.42 time: 0.654301 Jul 19 20:01:34.897548 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1754/3374] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2934 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:34.903144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-917fb3cc-0eb6-48d5-b40a-fad37f97e3cb req-326b863f-f13f-4fb2-9b12-f851b5b917ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f8f4e-947f-4567-b754-6d1a023a8333", "name": "network-vif-plugged", "status": "completed", "tag": "6cc119bd-d4e7-4263-9bf3-cc5fb89edf27"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:34.911534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-917fb3cc-0eb6-48d5-b40a-fad37f97e3cb req-326b863f-f13f-4fb2-9b12-f851b5b917ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.912019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-917fb3cc-0eb6-48d5-b40a-fad37f97e3cb req-326b863f-f13f-4fb2-9b12-f851b5b917ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.924054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-917fb3cc-0eb6-48d5-b40a-fad37f97e3cb req-326b863f-f13f-4fb2-9b12-f851b5b917ad service nova] Creating event network-vif-plugged:6cc119bd-d4e7-4263-9bf3-cc5fb89edf27 for instance 049f8f4e-947f-4567-b754-6d1a023a8333 on n-h1-843861-3 Jul 19 20:01:34.929409 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-917fb3cc-0eb6-48d5-b40a-fad37f97e3cb req-326b863f-f13f-4fb2-9b12-f851b5b917ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030425 Jul 19 20:01:34.929959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1755/3375] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:34.935218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.935998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.944283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.944852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.945791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.946131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.238116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.246507 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ff7a693-ebdd-4880-958a-8e5a787160ef tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.565297 Jul 19 20:01:35.247538 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1621/3376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:35.252576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.253198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:35.260469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.260935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.268650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.268650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.413032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:35.441708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:35.478966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.503789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91d76604-0403-44af-88e4-d3095f02fe58 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1315 microversion: 2.1 time: 0.572396 Jul 19 20:01:35.504430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1756/3377] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:35.520967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.521594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:35.528124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.528578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.529349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.529971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.717547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.727661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3269c57-a435-4b19-8968-61670db2ce56 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1499 microversion: 2.1 time: 0.479191 Jul 19 20:01:35.728349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1622/3378] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1499 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:35.744377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8cc2fe54-0f70-4d79-8d85-ff8ddb64dc98 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:35.751625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cc2fe54-0f70-4d79-8d85-ff8ddb64dc98 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.752095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cc2fe54-0f70-4d79-8d85-ff8ddb64dc98 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.777836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8cc2fe54-0f70-4d79-8d85-ff8ddb64dc98 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:01:35.827319 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8cc2fe54-0f70-4d79-8d85-ff8ddb64dc98 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e/action" status: 202 len: 0 microversion: 2.1 time: 0.086607 Jul 19 20:01:35.829317 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1623/3379] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:35 2022] POST /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:01:35.838497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.839764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:35.850477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.852046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.853948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.854762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.894153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:36.188792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.197109 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd46d7fe-44e1-4f2a-a4fe-c206021ed9f4 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.680547 Jul 19 20:01:36.197702 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1757/3380] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:36.202711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.203386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.209366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.210047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.211055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.211744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.513252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.524146 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-517304da-08ed-475f-97e6-4662867e0e73 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.689730 Jul 19 20:01:36.524754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1624/3381] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:36.529792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.531529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.538671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.539121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.540132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.540574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.547322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:36.573067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.585814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.587330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.588610 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9a9c176-c010-4a7c-8d50-60dccc90f8de tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2913 microversion: 2.42 time: 0.389814 Jul 19 20:01:36.589245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1758/3382] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:36 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2913 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:36.597286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:36.607729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.608582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.623821 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] Creating event network-changed:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:01:36.630345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:01:36.643783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ef585e9d-2da2-4b6c-819c-28755d69e42a req-92ef3d1a-4953-4785-a42d-52a146463c23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052871 Jul 19 20:01:36.645007 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1759/3383] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:36.650666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.651598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.658836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.659282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.660077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.660700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.827995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.837529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-713ad57b-315c-41c6-bf1b-e0c36be6bbc4 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.311412 Jul 19 20:01:36.848080 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1625/3384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:36 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:36.919327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.942326 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df85c075-5ab0-49b7-948c-fb935a277106 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1315 microversion: 2.1 time: 0.295755 Jul 19 20:01:36.943310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1760/3385] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:36 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:36.944808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "25a886f2-4fc4-42a5-999f-d6df6ac837e7"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "c2450f7b-c16c-416e-81b1-d3a77677dc49"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "2703f954-a397-43a4-9e17-81870da81876"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c467c3-a29f-41aa-a758-bb0988ff2ffe"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "10eb8c5f-4234-4b19-9634-f11411db5e67"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:36.954675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.955126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.982306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Creating event network-vif-unplugged:25a886f2-4fc4-42a5-999f-d6df6ac837e7 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:36.982829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Creating event network-vif-unplugged:c2450f7b-c16c-416e-81b1-d3a77677dc49 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:36.983343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Creating event network-vif-unplugged:2703f954-a397-43a4-9e17-81870da81876 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:36.983879 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Creating event network-vif-unplugged:b9c467c3-a29f-41aa-a758-bb0988ff2ffe for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:36.984417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] Creating event network-vif-unplugged:10eb8c5f-4234-4b19-9634-f11411db5e67 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:36.990388 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5483c073-eb21-45a5-b226-7578645f9e5c req-a721717a-c624-44ba-b055-75c2aed234ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.049245 Jul 19 20:01:36.991180 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1626/3386] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:37.213952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.214598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.227956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.228415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.229201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.230193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.431105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.439766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23b8b491-5333-4330-8582-8598e6eec742 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.229692 Jul 19 20:01:37.440591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1761/3387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:37.543830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.544555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.551081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.551758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.552555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.552998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.609458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.610661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.617693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.618149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.622150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.622150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.810730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.819036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89a95fe7-b3d0-46b6-9608-ca4eccc15ef6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.280423 Jul 19 20:01:37.819982 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1627/3388] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:37.837288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.846122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.847613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.848926 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2025c100-bd3c-4d1f-bd24-0ab547e81d6b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2867 microversion: 2.42 time: 0.243620 Jul 19 20:01:37.849515 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1762/3389] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2867 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:37.863082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.863641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.869856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.870317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.871089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.871531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.958418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.959079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.965361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.965813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.966584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.967020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.002801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.010550 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a89783e1-7dbb-4ae6-b192-39a5f9d1d4ad tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.151960 Jul 19 20:01:38.011251 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1628/3390] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:38.105097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.113353 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98bc1d18-c16b-4176-aaab-0270a995f46a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1503 microversion: 2.1 time: 0.158718 Jul 19 20:01:38.113870 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1763/3391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:38.129182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.129693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.136527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.136986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.137761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.138239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.163947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:38.241183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2907a05-2a6e-4066-a4ea-5c8efc85badf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 204 len: 0 microversion: 2.1 time: 0.115560 Jul 19 20:01:38.244978 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1629/3392] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:38 2022] DELETE /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:38.250454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.251071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.257674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.258120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.258876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.259307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.393465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.401509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-096bad1f-4f48-4b04-b5fa-5d1f0bba23af tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1509 microversion: 2.1 time: 0.155148 Jul 19 20:01:38.402093 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1764/3393] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:38.457799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.458511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.461621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:38.465806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.466297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.467006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.467440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.607451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.615093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1d5be52e-e77f-4d45-912f-b7c0686d1aaf tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.162028 Jul 19 20:01:38.615684 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1630/3394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:38.660183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dbcd4641-98b0-4799-a8d1-cc551979d1fc req-4b5d2a4d-b768-4825-bfdd-16fe932765be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-deleted", "tag": "2703f954-a397-43a4-9e17-81870da81876"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:38.665706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:38.669776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dbcd4641-98b0-4799-a8d1-cc551979d1fc req-4b5d2a4d-b768-4825-bfdd-16fe932765be service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.670226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dbcd4641-98b0-4799-a8d1-cc551979d1fc req-4b5d2a4d-b768-4825-bfdd-16fe932765be service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.684852 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dbcd4641-98b0-4799-a8d1-cc551979d1fc req-4b5d2a4d-b768-4825-bfdd-16fe932765be service nova] Creating event network-vif-deleted:2703f954-a397-43a4-9e17-81870da81876 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:38.690713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dbcd4641-98b0-4799-a8d1-cc551979d1fc req-4b5d2a4d-b768-4825-bfdd-16fe932765be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 Jul 19 20:01:38.691279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1765/3395] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:38.835838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.836461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.842556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.843089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.843940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.844375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.870380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.871155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.878273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.878722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.879500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.879975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.069941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.081207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecc12f20-c4b3-4fd0-9d1a-f4cb21ed04ea tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.249196 Jul 19 20:01:39.081803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1631/3396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:39.087619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:39.088431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:39.094729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.095211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.095636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.096144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.096498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.105001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.106530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.107750 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70007048-68bc-45d0-85fb-2213db06fbdc tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2867 microversion: 2.42 time: 0.242007 Jul 19 20:01:39.108435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1766/3397] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2867 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:39.112988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-be30ca89-40cd-465f-a54a-3f56e2ee6759 req-3214110e-54da-4e82-8153-482347c36247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49c314a-241b-44db-9960-d0873117d158", "name": "network-vif-plugged", "status": "completed", "tag": "f224e94c-dc19-45db-83d1-42ecb13ab74f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:39.121372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be30ca89-40cd-465f-a54a-3f56e2ee6759 req-3214110e-54da-4e82-8153-482347c36247 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.121819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be30ca89-40cd-465f-a54a-3f56e2ee6759 req-3214110e-54da-4e82-8153-482347c36247 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.133676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-be30ca89-40cd-465f-a54a-3f56e2ee6759 req-3214110e-54da-4e82-8153-482347c36247 service nova] Creating event network-vif-plugged:f224e94c-dc19-45db-83d1-42ecb13ab74f for instance d49c314a-241b-44db-9960-d0873117d158 on n-h1-843861-3 Jul 19 20:01:39.138554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-be30ca89-40cd-465f-a54a-3f56e2ee6759 req-3214110e-54da-4e82-8153-482347c36247 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028917 Jul 19 20:01:39.139433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1767/3398] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:39.231705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.239819 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68ca0841-2898-48d6-b292-827e9c58fe43 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1469 microversion: 2.1 time: 0.156476 Jul 19 20:01:39.240412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1632/3399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:39 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:39.420056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:39.420890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:39.427785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.428261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.429027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.429456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.616520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.624155 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8451854e-ad17-4ea6-be2c-f05493e2f527 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1509 microversion: 2.1 time: 0.208810 Jul 19 20:01:39.624928 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1768/3400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:39 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:39.632752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:39.633383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:39.640877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.641336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.642111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.642652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.772567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.783061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e337cdfb-a4c3-411f-86c6-1f4ec8ca6c30 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1309 microversion: 2.1 time: 0.154270 Jul 19 20:01:39.793220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1633/3401] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:39 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:40.099433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:40.101185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:40.108674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.109650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.111040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.111501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.130730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:40.131421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:40.144168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.144857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.147000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.147848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.741727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:40.751145 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d630fdd3-253c-4ac8-ae81-16a90bd299e5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.655641 Jul 19 20:01:40.753551 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1769/3402] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:40 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:40.760960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:40.762101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:40.767842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:40.777055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.777995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.781091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.781832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.786014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:40.788128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:40.790548 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b9972d1-7ca8-407c-bc8d-11602f6596ad tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2753 microversion: 2.42 time: 0.662517 Jul 19 20:01:40.790548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1634/3403] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:40 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2753 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:40.795281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:40.796020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:40.814682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.815317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.816190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.816634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.592845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.602396 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67529e33-f9f7-4b87-a378-22e8f6fac9f7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1462 microversion: 2.1 time: 0.848265 Jul 19 20:01:41.603108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1770/3404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:40 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1462 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:41.609248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:41.609961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.618125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.625875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.626432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.628945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.629465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.636434 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0f62b87-8104-4b3e-8fe5-e35a7d39b921 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 200 len: 1509 microversion: 2.1 time: 0.845404 Jul 19 20:01:41.649340 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1635/3405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:40 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 1509 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:41.843743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:41.844561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.854840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.855439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.856266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.860149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.090044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.097510 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3aef1d46-8ee9-4537-80ae-79812075efa2 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1489 microversion: 2.1 time: 0.493336 Jul 19 20:01:42.098115 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1771/3406] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:41 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1489 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.103274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-487ffd9c-3cc8-42c1-9eee-16318c907bdc req-79e421f1-cbda-4148-9fb6-fd61d032e15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f8f4e-947f-4567-b754-6d1a023a8333", "name": "network-vif-deleted", "tag": "6cc119bd-d4e7-4263-9bf3-cc5fb89edf27"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:42.112108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-487ffd9c-3cc8-42c1-9eee-16318c907bdc req-79e421f1-cbda-4148-9fb6-fd61d032e15a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.112640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-487ffd9c-3cc8-42c1-9eee-16318c907bdc req-79e421f1-cbda-4148-9fb6-fd61d032e15a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.123378 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-487ffd9c-3cc8-42c1-9eee-16318c907bdc req-79e421f1-cbda-4148-9fb6-fd61d032e15a service nova] Creating event network-vif-deleted:6cc119bd-d4e7-4263-9bf3-cc5fb89edf27 for instance 049f8f4e-947f-4567-b754-6d1a023a8333 on n-h1-843861-3 Jul 19 20:01:42.129283 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-487ffd9c-3cc8-42c1-9eee-16318c907bdc req-79e421f1-cbda-4148-9fb6-fd61d032e15a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029423 Jul 19 20:01:42.129893 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1772/3407] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:42.135847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.136610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.138776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b9c6959-4ee1-40d1-a9fd-fd88736bae6a tempest-MigrationsAdminTest-1606093926 tempest-MigrationsAdminTest-1606093926-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1613 microversion: 2.1 time: 0.487373 Jul 19 20:01:42.139796 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1636/3408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:41 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1613 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.144406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.144851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.145616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.146045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.146468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.147225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.150610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:42.166203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.166871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.167862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.168639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.493535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.503019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f6d9f7a-5453-40ed-ba26-b43e1e11962f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.371881 Jul 19 20:01:42.504501 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1773/3409] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.510274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.511393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-345677335"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:42.513928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.522565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.524145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.524705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.525390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.525697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.526225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.526906 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7f17a62-3931-4251-aa32-afa6b581bb3f tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2707 microversion: 2.42 time: 0.384920 Jul 19 20:01:42.527662 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1637/3410] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2707 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:42.545458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.546177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.553506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.554205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.555187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.555793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.588917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:42.604232 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddcc4dfb-ebde-4deb-babc-8d6a08159731 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "PUT /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1073 microversion: 2.1 time: 0.098288 Jul 19 20:01:42.614299 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1774/3411] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:01:42 2022] PUT /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1073 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.632862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.635989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.650453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.651069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.652655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.653368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.726218 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-075700a7-c397-4024-85af-d3dfc5769c7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "DELETE /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 204 len: 0 microversion: 2.1 time: 0.184454 Jul 19 20:01:42.727203 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1638/3412] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:42 2022] DELETE /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:42.736326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.737219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.743841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.744562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.745615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.746214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.750971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:42.762630 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 HTTP/1.1 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '049f8f4e-947f-4567-b754-6d1a023a8333'} Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:42.765293 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:01:42.770065 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:42.771525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:42.773118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c257ad5a-ab0b-49bb-98e0-8d5472c7f81f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 404 len: 111 microversion: 2.1 time: 0.044199 Jul 19 20:01:42.773911 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1639/3413] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:42.780537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.782150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.804703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.808412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.812512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.813760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.925819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.934227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9bdd75b-c700-455c-9e4a-aa3b5ee21a92 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1499 microversion: 2.1 time: 0.314988 Jul 19 20:01:42.936018 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1775/3414] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1499 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.940776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1255919698", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:42.995647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:43.137628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.153122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a97e347-ef3e-4a3c-91cf-3bbbe261f9cd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1468 microversion: 2.1 time: 0.376416 Jul 19 20:01:43.163442 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1640/3415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:43.163442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-543a0dd6-d857-41af-9f1a-462de44a936b req-1bcb10e5-aa1b-4564-9363-e2cb9b7b50ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-plugged", "status": "completed", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:43.170288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-543a0dd6-d857-41af-9f1a-462de44a936b req-1bcb10e5-aa1b-4564-9363-e2cb9b7b50ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.170801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-543a0dd6-d857-41af-9f1a-462de44a936b req-1bcb10e5-aa1b-4564-9363-e2cb9b7b50ec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.184309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-543a0dd6-d857-41af-9f1a-462de44a936b req-1bcb10e5-aa1b-4564-9363-e2cb9b7b50ec service nova] Creating event network-vif-plugged:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:01:43.190091 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-543a0dd6-d857-41af-9f1a-462de44a936b req-1bcb10e5-aa1b-4564-9363-e2cb9b7b50ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034459 Jul 19 20:01:43.191034 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1641/3416] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:43.200111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.200964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.209618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.210188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.211254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.211603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.545688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.562467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-655faab4-e0d6-455f-a558-08330dcf6955 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1499 microversion: 2.1 time: 0.366758 Jul 19 20:01:43.563671 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1642/3417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1499 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:43.628198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.628858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.636971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.637340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.638313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.638918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.681916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:43.683084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:43.685188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:43.685715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:43.686251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:43.700209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.700764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.701665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.702178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.726181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:43.731871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:43.762239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:43.765342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:43.816120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.821055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d953c10e-3432-48cc-b9ef-80fdd7f47107 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883759 Jul 19 20:01:43.827405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1776/3418] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:01:43.827405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.827734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.834144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f91b135b-96d3-4e5b-a6b1-9bd8d74c8599 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.268847 Jul 19 20:01:43.834403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.834671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.835465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.835766 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1643/3419] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:43.843865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.845209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.845988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.854493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.854944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.855723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.856185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.890421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77bf3636-c594-46b7-b943-0a37bab8260f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053069 Jul 19 20:01:43.895763 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1644/3420] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:43.902377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbaf67b9-cc3f-4dac-bd27-19858ccdbe19 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:43.908808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbaf67b9-cc3f-4dac-bd27-19858ccdbe19 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.909406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbaf67b9-cc3f-4dac-bd27-19858ccdbe19 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.937840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fbaf67b9-cc3f-4dac-bd27-19858ccdbe19 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:01:43.994890 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbaf67b9-cc3f-4dac-bd27-19858ccdbe19 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "POST /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158/action" status: 202 len: 0 microversion: 2.1 time: 0.102579 Jul 19 20:01:43.995920 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1645/3421] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:43 2022] POST /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:44.002642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c59b1f4-632d-417e-9fc7-4223e5d1c14e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.003359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c59b1f4-632d-417e-9fc7-4223e5d1c14e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.066535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.076973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.078753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.080325 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11e74dd8-fb4c-4535-ae56-e04d54b93b08 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2661 microversion: 2.42 time: 0.257346 Jul 19 20:01:44.081289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1777/3422] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2661 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:44.087550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.088448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.095130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c59b1f4-632d-417e-9fc7-4223e5d1c14e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.096638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.097335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.098333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.098959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.112523 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c59b1f4-632d-417e-9fc7-4223e5d1c14e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1215 microversion: 2.1 time: 0.115533 Jul 19 20:01:44.113562 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1646/3423] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.127413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.128444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.138536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.140366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.141904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.142510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.147991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:44.262764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c26fb66-bc1e-4167-999d-5e8ae4762862 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 204 len: 0 microversion: 2.1 time: 0.176772 Jul 19 20:01:44.263487 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1778/3424] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:44 2022] DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:44.270796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-deleted", "tag": "10eb8c5f-4234-4b19-9634-f11411db5e67"}, {"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-deleted", "tag": "c2450f7b-c16c-416e-81b1-d3a77677dc49"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:44.279955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.280397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.295901 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] Creating event network-vif-deleted:10eb8c5f-4234-4b19-9634-f11411db5e67 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:44.297738 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] Creating event network-vif-deleted:c2450f7b-c16c-416e-81b1-d3a77677dc49 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:44.303139 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5dec523d-6cd3-4252-81e8-6fd2a05a0eec req-6ec88499-6d00-4e13-9dc0-264133b25b15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037552 Jul 19 20:01:44.303747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1779/3425] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:44.308934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.309627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.316099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.316538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.318288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.318288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.471755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.480407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d15a0250-11ca-4a2c-9b9b-7c1dad0dd0a1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.359668 Jul 19 20:01:44.481107 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1647/3426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.486857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.487588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.494666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.495214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.496239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.496763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.637951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.647683 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-10c656d0-0db5-43cf-8b87-124f47011576 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1468 microversion: 2.1 time: 0.342613 Jul 19 20:01:44.648289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1780/3427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1468 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.835563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.846813 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4596038d-dad5-491a-a678-e2ded6116284 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1675 microversion: 2.1 time: 0.362854 Jul 19 20:01:44.847101 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1648/3428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1675 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.852081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.852700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.861895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.862340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.863130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.863560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.100087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.101083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.108284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.109075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.110167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.110840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.561545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.572354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.582407 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60e9e932-20df-4929-84df-c557600eeada tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.734172 Jul 19 20:01:45.584101 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1781/3429] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:45.589312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.590316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.593540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.595795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.597343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76413a19-68a1-4c39-b5a8-0f65b23eb37a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 2166 microversion: 2.42 time: 0.501277 Jul 19 20:01:45.598090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.598541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.599764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.600479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.610675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1649/3430] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 2166 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:45.616847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.617827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.626714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.627459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.628470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.629272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.708857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.718361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a8c29ab3-2f2f-47d5-8a30-68a2102f1e68 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1219 microversion: 2.1 time: 0.132717 Jul 19 20:01:45.728144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1782/3431] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:45.728144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.728144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.732625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.733131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.734041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.734817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.120177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.129810 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f7c7e59-727a-425d-8095-0f36484a33b0 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 200 len: 1298 microversion: 2.1 time: 0.409747 Jul 19 20:01:46.130727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1783/3432] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 1298 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:46.135670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.136449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.142908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.143435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.144434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.144874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.253626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.262614 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa79e732-ce14-4a8c-9b7f-80181be917cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.650203 Jul 19 20:01:46.263668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1650/3433] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:46.332886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-deleted", "tag": "25a886f2-4fc4-42a5-999f-d6df6ac837e7"}, {"server_uuid": "806949c3-4412-4489-8dc2-e93bd9a4bf86", "name": "network-vif-deleted", "tag": "9861656e-d1af-4be6-96b9-daa7328fdf6a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:46.346923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.347767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.391243 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] Creating event network-vif-deleted:25a886f2-4fc4-42a5-999f-d6df6ac837e7 for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:46.392270 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] Creating event network-vif-deleted:9861656e-d1af-4be6-96b9-daa7328fdf6a for instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 on n-h2-843861-3 Jul 19 20:01:46.404870 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-afe59142-6d47-4fc3-bd36-9fe59745c9d2 req-bc37ad32-e6b0-441c-95ec-0290f2372b12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072085 Jul 19 20:01:46.406436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1651/3434] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:46.478990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.488093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-695424ae-ad79-4bd9-85ce-0ad57e803f58 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1675 microversion: 2.1 time: 0.356242 Jul 19 20:01:46.488671 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1784/3435] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1675 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:46.601142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.601662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.607979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.608678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.610281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.610485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.617185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.617815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.626159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.626159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.626989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.627451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.733933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.747200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.749434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.752350 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9096b934-19de-4b1a-b3d9-0ce6441254ed tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.138806 Jul 19 20:01:46.755493 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1785/3436] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:46.761210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.762185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.772908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.773842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.775498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.776830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.952014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.961795 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c711e623-51e8-410e-9f17-f2b857e0f3c2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1275 microversion: 2.1 time: 0.204553 Jul 19 20:01:46.973148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1786/3437] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:47.038518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.047887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f47169de-772c-4882-ae3d-8f03f6bb6253 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.451082 Jul 19 20:01:47.048755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1652/3438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:47.147898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.149291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 806949c3-4412-4489-8dc2-e93bd9a4bf86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.156626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.157355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.158137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.158592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.175074 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] HTTP exception thrown: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Request method failure captured: Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 HTTP/1.1 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxGzLp5PdAE6yQNUpZ9SRdHZQTNGohlKPotlC57_FvJ0fQ6m-m5q3f6vJwNSijHizzeXBJNucOSun1PbdjAhm3L_hYJTc8ZmqfH1WrhO3SRLgN7bTB_umgD88IaXk3-1cf4HXj_5AIowmUVZRmqrEynLq7-512QdLoD7dCKwRJAHsM Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 11fb4996ebff47d4b98763cba171cf3b Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '806949c3-4412-4489-8dc2-e93bd9a4bf86'} Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:47.176799 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Returning 404 to user: Instance 806949c3-4412-4489-8dc2-e93bd9a4bf86 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:47.183878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5af88b50-ae68-422d-9789-2ea88a2b43a7 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86" status: 404 len: 111 microversion: 2.1 time: 0.034439 Jul 19 20:01:47.188037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.188338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.195209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.195667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.196487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.197305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.201279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1787/3439] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/806949c3-4412-4489-8dc2-e93bd9a4bf86 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:47.241297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:47.281436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.282551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.294479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.295227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.296351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.296993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.392903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a63ebbd1-4a80-48ed-bf3f-e28f29eeb36c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 204 len: 0 microversion: 2.1 time: 0.209423 Jul 19 20:01:47.393948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1653/3440] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:47 2022] DELETE /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:47.402499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.403198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.409525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.410062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.410839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.411295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.694513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.703086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e39623b5-0293-4a75-91cc-e9c2fb044dc6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.426017 Jul 19 20:01:47.704238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1788/3441] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:47.710890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.711669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.718747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.719240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.720277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.720797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.746277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:47.824365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.834210 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-833d0d36-b244-4e78-9b07-9a5e1f1f126c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1535 microversion: 2.1 time: 0.435870 Jul 19 20:01:47.837422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1654/3442] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1535 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:47.841573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.842558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.850721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.851345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.852176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.852821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.946603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.957633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.959910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.961575 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e1c5420e-b7d6-4e0e-973f-cb1ee45fd8ae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.125304 Jul 19 20:01:47.968299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1655/3443] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:47.980802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.981785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.989110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.989709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.990589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.991265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.996410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:48.041884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.053169 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7694bda1-b2a4-4acc-95a8-9d1dbccc9be1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1675 microversion: 2.1 time: 0.347482 Jul 19 20:01:48.053920 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1789/3444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1675 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:48.067483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.068513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.075433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.076307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.077366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.078496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.107725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.119169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ce56184-ea27-406b-a158-22799a2a817a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1273 microversion: 2.1 time: 0.142416 Jul 19 20:01:48.120671 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1656/3445] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:48.418485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.430944 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe721f33-011c-4b45-9755-f6111244a617 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.366951 Jul 19 20:01:48.434014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d3c2597b-bf08-48b2-a4a9-20e738f09caf req-b4f44830-9b94-4fca-b51e-1f4ad8ce1e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd66404-0efb-4d91-9f53-5f7119dca9fa", "name": "network-vif-deleted", "tag": "b9c467c3-a29f-41aa-a758-bb0988ff2ffe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:48.438769 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1790/3446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:48.454721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d3c2597b-bf08-48b2-a4a9-20e738f09caf req-b4f44830-9b94-4fca-b51e-1f4ad8ce1e4e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.455461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d3c2597b-bf08-48b2-a4a9-20e738f09caf req-b4f44830-9b94-4fca-b51e-1f4ad8ce1e4e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.471031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d3c2597b-bf08-48b2-a4a9-20e738f09caf req-b4f44830-9b94-4fca-b51e-1f4ad8ce1e4e service nova] Creating event network-vif-deleted:b9c467c3-a29f-41aa-a758-bb0988ff2ffe for instance dbd66404-0efb-4d91-9f53-5f7119dca9fa on n-h2-843861-3 Jul 19 20:01:48.477130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d3c2597b-bf08-48b2-a4a9-20e738f09caf req-b4f44830-9b94-4fca-b51e-1f4ad8ce1e4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049099 Jul 19 20:01:48.478383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1657/3447] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:48.726088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.727000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.737307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.738280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.741447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.742498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.856474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.857480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.876342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.877131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.878559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.879478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.092700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.110239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d886dce3-ae85-4e1f-b389-598f3d05d532 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.392779 Jul 19 20:01:49.111504 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1791/3448] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:49.117035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.117865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.134973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.135431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.136249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.136689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.287612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.305138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fd7e91d-4755-4af8-bf24-ffc8f7ffeccd tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1535 microversion: 2.1 time: 0.454694 Jul 19 20:01:49.307227 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1658/3449] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1535 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:49.316173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.317090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.325830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.328800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.330644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.332105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.381242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.401251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.403288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.404573 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b01027a-65bd-4afd-a612-45a33d8f04f9 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.291316 Jul 19 20:01:49.405420 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1792/3450] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:49.411384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.412299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.422007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.423345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.424442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.425117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.433003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.433811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.434587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lazy-loading 'fault' on Instance uuid 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:49.576020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.594110 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32eed7e3-7a0a-4027-87cc-ff9e19a0b27f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 200 len: 1328 microversion: 2.1 time: 0.283867 Jul 19 20:01:49.595651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1659/3451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 1328 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:49.611136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.613479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.632109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.632989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.638342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.639877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.185405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.195923 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25b2d373-722b-46e9-8149-54a12242c981 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.788758 Jul 19 20:01:50.196614 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1793/3452] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:50.240619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.242127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:50.250887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.251336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.252366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.252971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.285751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.304831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5d5b19f-3db3-4c34-85dc-6d7987fa6528 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.707077 Jul 19 20:01:50.307863 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1660/3453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:50.324898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.325681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:50.335623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.336007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.337659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.337893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.733916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.747741 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-791af380-65b3-4702-8091-8ac98be98d6c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.539060 Jul 19 20:01:50.758634 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1794/3454] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:50 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:50.764144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.769098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.776736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:50.784894 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdf929dc-19f4-4e24-848f-2c58340aeb57 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1535 microversion: 2.1 time: 0.465694 Jul 19 20:01:50.785372 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1661/3455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:50 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1535 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:50.791030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.791489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.796933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d2df7190-0f89-40dd-9da3-0cbe0b83ab24 req-f5d45206-dc49-4b40-b394-570bc02a2460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2", "name": "network-vif-deleted", "tag": "d229eab8-9f82-4b43-ad57-e72f5714c3aa"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:50.797386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.802587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.814475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d2df7190-0f89-40dd-9da3-0cbe0b83ab24 req-f5d45206-dc49-4b40-b394-570bc02a2460 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.814913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d2df7190-0f89-40dd-9da3-0cbe0b83ab24 req-f5d45206-dc49-4b40-b394-570bc02a2460 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.854683 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d2df7190-0f89-40dd-9da3-0cbe0b83ab24 req-f5d45206-dc49-4b40-b394-570bc02a2460 service nova] Creating event network-vif-deleted:d229eab8-9f82-4b43-ad57-e72f5714c3aa for instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 on n-h1-843861-3 Jul 19 20:01:50.859930 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d2df7190-0f89-40dd-9da3-0cbe0b83ab24 req-f5d45206-dc49-4b40-b394-570bc02a2460 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066502 Jul 19 20:01:50.860839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1662/3456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:50.876698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.877792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:50.886760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.887440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.888364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.888860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.907082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.917618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.919452 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:01:50.919945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.921446 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c068eca1-2dcb-4000-b8f4-af094ed04cae tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.161423 Jul 19 20:01:50.922282 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1795/3457] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:50 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 HTTP/1.1 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2'} Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:50.924149 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:01:50.928699 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:50.931108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:50.932378 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b78ece9b-0be2-4768-83a9-279c6358bef0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 404 len: 111 microversion: 2.1 time: 0.069520 Jul 19 20:01:50.937527 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1663/3458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:50 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:50.942883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15048aa2-7e8c-45b5-8823-a49134e683b1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '.version_select at 0x7fb88ce83ee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.962291 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15048aa2-7e8c-45b5-8823-a49134e683b1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126177290" status: 202 len: 0 microversion: 2.1 time: 0.023218 Jul 19 20:01:50.963045 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1796/3459] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126177290 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:51.215409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:51.216476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:51.231675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.232515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.234357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.235235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.331391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:51.332079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:51.364201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.364895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.365941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.366608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.749092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:51.764479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91687528-b8b2-4fc0-9d5d-485119ebcbf3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.550994 Jul 19 20:01:51.778246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1664/3460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:51.788926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:51.790930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:51.796942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:51.810323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.810783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.811846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.815199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4bf0b3d2-3a96-46af-b538-4f726aa5fd25 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.488593 Jul 19 20:01:51.816612 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1797/3461] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:51.821413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:51.822030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:51.831171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.840405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.841018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.842190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.842881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.897626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.898569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.899260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lazy-loading 'fault' on Instance uuid 96c5b4f6-f56b-4899-82de-e828b094564b {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:52.013469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.025207 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6bb9293-960a-4b59-bf78-6725512b101a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 200 len: 1369 microversion: 2.1 time: 0.207350 Jul 19 20:01:52.025946 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1798/3462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 1369 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:52.032799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.033767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.041658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.042216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.043104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.043710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.129142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.139698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.141805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.143202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-785356d6-cd97-4155-8ccc-8961cbac8428 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.115898 Jul 19 20:01:52.145815 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1799/3463] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:52.151555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd2eba2e-0197-45c0-9cb1-923bdacb23fb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: .version_select at 0x7fb88cf1e040>, body: {"keypair": {"name": "tempest-keypair-975337155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHe4xuFXj94PuMVA5YaoLZxUUqKEcolVrPL/Tye7oest4aHHiEKIVgQVm3J7OE7xIThKnkPdhco+JfsHbhV4kN+Niv8nNpeNGyXH7oVxGeihESy/riPhW/HW7B9HV83+w=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:52.168925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dd2eba2e-0197-45c0-9cb1-923bdacb23fb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:52.174571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dd2eba2e-0197-45c0-9cb1-923bdacb23fb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for user de95f85ce3714254acdb08a4004081bf and project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:52.177277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:52.204259 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd2eba2e-0197-45c0-9cb1-923bdacb23fb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059326 Jul 19 20:01:52.210628 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1800/3464] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:01:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:52.216456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.233739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08bc8f6c-197e-4d80-b1c7-eb4439a649a5 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.454125 Jul 19 20:01:52.235301 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1665/3465] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:52.785234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.785907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.792507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.793053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.793928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.794432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.834089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.835420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.842049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.842756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.843736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.844401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.106551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.116104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a121815c-0fc5-4b0a-a923-8bd40c90a745 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.335316 Jul 19 20:01:53.117188 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1801/3466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:53.122155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5b4f6-f56b-4899-82de-e828b094564b", "name": "network-vif-deleted", "tag": "6b3b6b00-581e-498a-b174-2ef6ab09a637"}, {"name": "network-changed", "server_uuid": "033f5746-9dcb-4f5a-b714-89bf3fbc8aa1", "tag": "ae04f861-4195-4b40-9cf9-666f16208358"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:53.133217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.133703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.147516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] Creating event network-vif-deleted:6b3b6b00-581e-498a-b174-2ef6ab09a637 for instance 96c5b4f6-f56b-4899-82de-e828b094564b on n-h2-843861-3 Jul 19 20:01:53.148064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] Creating event network-changed:ae04f861-4195-4b40-9cf9-666f16208358 for instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 on n-h1-843861-3 Jul 19 20:01:53.157931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-be914bf2-a7af-4bb9-ad0c-3bc5cbe87da1 req-65fa7d0b-c397-4570-8ec0-223551ed1504 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039438 Jul 19 20:01:53.158187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.159261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1802/3467] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:53.164678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.166545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 96c5b4f6-f56b-4899-82de-e828b094564b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.173346 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bd1896f-361c-4416-879c-77b873551921 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.343052 Jul 19 20:01:53.173898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.174487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.174865 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1666/3468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:53.179822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.180665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.185105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.185653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.187646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.188384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.189372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.189967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.201877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] HTTP exception thrown: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Request method failure captured: Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b HTTP/1.1 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wxGzLp5PdAE6yQNUpZ9SRdHZQTNGohlKPotlC57_FvJ0fQ6m-m5q3f6vJwNSijHizzeXBJNucOSun1PbdjAhm3L_hYJTc8ZmqfH1WrhO3SRLgN7bTB_umgD88IaXk3-1cf4HXj_5AIowmUVZRmqrEynLq7-512QdLoD7dCKwRJAHsM Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 11fb4996ebff47d4b98763cba171cf3b Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '96c5b4f6-f56b-4899-82de-e828b094564b'} Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:53.203680 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Returning 404 to user: Instance 96c5b4f6-f56b-4899-82de-e828b094564b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:53.208717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ae15a744-8fc8-44b0-8695-ef7ac03da2c3 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b" status: 404 len: 111 microversion: 2.1 time: 0.044733 Jul 19 20:01:53.209613 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1803/3469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/96c5b4f6-f56b-4899-82de-e828b094564b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:53.226294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-851eb9d0-97fd-4956-b30e-4404285c1a7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '.version_select at 0x7fb88cf9aee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.269785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-851eb9d0-97fd-4956-b30e-4404285c1a7a tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434924694" status: 202 len: 0 microversion: 2.1 time: 0.059150 Jul 19 20:01:53.270775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1804/3470] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434924694 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:53.280173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.281389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.296145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.305026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.305506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.308470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.309856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.311907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.318635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.321583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a1977e35-2958-4c48-b2d4-0dad476b19ff tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.144908 Jul 19 20:01:53.322192 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1667/3471] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:53.641825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.658539 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d856446-38ec-40e1-8062-0227e6cbde65 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.382396 Jul 19 20:01:53.659754 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1805/3472] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:54.119575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.120373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.125613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:54.130740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.131491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.133136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.133959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.137596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.138325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.141791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:54.161874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.162739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.163698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.164417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.174382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:54.281942 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b4391fa-dff2-450c-97cc-e50aabe04b94 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 204 len: 0 microversion: 2.1 time: 0.166020 Jul 19 20:01:54.287229 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1668/3473] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:54 2022] DELETE /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:54.293415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.294318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.301070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:54.303068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.303614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.304593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.305051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.969870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:54.979324 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5904a5ec-c398-49e4-a3f4-0863d0fbb463 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.691243 Jul 19 20:01:54.980754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1669/3474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:54 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:54.986671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.987479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.995317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.995936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.996817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.997482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.026691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.042259 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a735ba55-086d-4921-95d9-74b787630fc2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.911811 Jul 19 20:01:55.042860 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1806/3475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:54 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:55.057072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:55.057697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:55.066160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.066860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.068037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.068624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.170625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.199648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.201694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.203560 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9907357b-d0cf-4e33-8d3d-5d562a5a0f20 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.152284 Jul 19 20:01:55.204387 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1807/3476] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:55 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:55.214134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:55.215253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:55.222322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.223250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.224382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.225015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.279479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.291939 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f917335-9c3b-4542-bf2e-6b46271f4e6f tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1468 microversion: 2.1 time: 0.309667 Jul 19 20:01:55.293268 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1670/3477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:54 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1468 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:55.390225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1929458021", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ad74e5-94f8-432f-af88-e2a08d8f5485"}], "security_groups": [{"name": "tempest-securitygroup--1300729210"}], "key_name": "tempest-keypair-975337155", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:55.408835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.417004 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e71d6609-ed52-47e4-a2fc-5b40763c6e5d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.211187 Jul 19 20:01:55.417765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1808/3478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:55 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:55.574746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] validate_networks() for [('c8ad74e5-94f8-432f-af88-e2a08d8f5485', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:55.998103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:55.998731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.005748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.006207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.007136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.007785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.317726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.327714 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-acd26f87-ecf0-458c-b5c1-56f322e3297b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.333436 Jul 19 20:01:56.329572 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1809/3479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:55 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:56.335639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.336476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.345065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.345581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.346366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.346839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.353850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:56.363280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:56.364054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:56.364856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:56.365492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:56.366020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:56.378849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.379495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.380493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.381080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.415420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:56.427450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Getting quotas for user de95f85ce3714254acdb08a4004081bf and project 7d80827178dd426d92e131b50cf2cb3c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:56.449510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:56.453645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:56.521246 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65daafdb-5bfa-43d8-a3d0-6096c5ccbbee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.135546 Jul 19 20:01:56.522227 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1671/3480] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:01:56.531851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.533156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.542618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.543459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.544744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.545344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.649382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.667854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fab9c9ad-ec36-4f2f-ba42-2d0e1ac624ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.336228 Jul 19 20:01:56.674156 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1810/3481] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:56.678385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.691200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.692440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.703601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.704410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.705600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.706209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.706526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.710884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.712379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-99a04a58-e873-4771-a463-f1a9fdd7c6a7 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.188555 Jul 19 20:01:56.728489 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1672/3482] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:56.743102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.745618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.772758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.776340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.777666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.781770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.829713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:57.098331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.121237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c67f966e-545e-4751-b131-784fe39c5e18 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1468 microversion: 2.1 time: 0.443848 Jul 19 20:01:57.135688 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1811/3483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:57.143107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c4dd75c5-60a4-426f-825d-a56c2eb1cb06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:57.144183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c4dd75c5-60a4-426f-825d-a56c2eb1cb06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:57.247221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.254988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4dd75c5-60a4-426f-825d-a56c2eb1cb06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.262611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a9f09a3-c4a8-4a50-8ade-88a605356a64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.532085 Jul 19 20:01:57.263927 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1673/3484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:57.272641 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c4dd75c5-60a4-426f-825d-a56c2eb1cb06 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1237 microversion: 2.1 time: 0.148743 Jul 19 20:01:57.274200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0601460e-3f7d-4019-b4ff-955927a73b89 req-ba8c950c-74c0-40d9-aba8-ea2406b8ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033f5746-9dcb-4f5a-b714-89bf3fbc8aa1", "name": "network-vif-plugged", "status": "completed", "tag": "ae04f861-4195-4b40-9cf9-666f16208358"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:57.276151 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1812/3485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:57 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:57.287484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0601460e-3f7d-4019-b4ff-955927a73b89 req-ba8c950c-74c0-40d9-aba8-ea2406b8ce1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.288155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0601460e-3f7d-4019-b4ff-955927a73b89 req-ba8c950c-74c0-40d9-aba8-ea2406b8ce1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.305465 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0601460e-3f7d-4019-b4ff-955927a73b89 req-ba8c950c-74c0-40d9-aba8-ea2406b8ce1f service nova] Creating event network-vif-plugged:ae04f861-4195-4b40-9cf9-666f16208358 for instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 on n-h1-843861-3 Jul 19 20:01:57.311866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0601460e-3f7d-4019-b4ff-955927a73b89 req-ba8c950c-74c0-40d9-aba8-ea2406b8ce1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042515 Jul 19 20:01:57.316195 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1674/3486] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:57.353595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:57.360376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:57.400452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.401356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.405773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.407190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.698922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:57.701889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:57.724953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.726466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.730984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.737213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.808966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.819297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff8390e3-5716-485d-82e4-1fb58101c215 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.473138 Jul 19 20:01:57.821472 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1813/3487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:57 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:57.826994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:57.828442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:57.835630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.836412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.837401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.838141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.965871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.976745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.978594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.980316 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2820f4c-b5b0-4bb7-af81-8331edce8d0a tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.157233 Jul 19 20:01:57.981013 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1814/3488] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:57 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:57.986738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9e534359-0363-48ba-8e9e-c2d8e66f9303 req-d2aa4162-cd00-4f03-8abf-076064e97c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c396e08-1b3c-4856-8e76-b875b5c5e375", "name": "network-vif-deleted", "tag": "c00054e9-66f6-4a24-b2ea-3853c0592ce8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:57.997922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9e534359-0363-48ba-8e9e-c2d8e66f9303 req-d2aa4162-cd00-4f03-8abf-076064e97c15 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.004771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9e534359-0363-48ba-8e9e-c2d8e66f9303 req-d2aa4162-cd00-4f03-8abf-076064e97c15 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.018158 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9e534359-0363-48ba-8e9e-c2d8e66f9303 req-d2aa4162-cd00-4f03-8abf-076064e97c15 service nova] Creating event network-vif-deleted:c00054e9-66f6-4a24-b2ea-3853c0592ce8 for instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 on n-h2-843861-3 Jul 19 20:01:58.024771 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9e534359-0363-48ba-8e9e-c2d8e66f9303 req-d2aa4162-cd00-4f03-8abf-076064e97c15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042108 Jul 19 20:01:58.025940 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1815/3489] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:58.064825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.073578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22274a84-e27c-4b21-832d-65ac3d3bb56f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1315 microversion: 2.1 time: 0.388682 Jul 19 20:01:58.075074 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1675/3490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:57 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.143619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.144713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.152344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.153080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.154118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.154814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.191200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.191724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.192260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lazy-loading 'fault' on Instance uuid 1c396e08-1b3c-4856-8e76-b875b5c5e375 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:58.247586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.256698 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-731a8731-06f4-4731-b438-529ea739acfa tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 200 len: 1303 microversion: 2.1 time: 0.117087 Jul 19 20:01:58.266414 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1816/3491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.287963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.287963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.298916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.299243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.299731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.300663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.303630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.304219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.312415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.313382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.314328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.314854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.410209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.419209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6da79d1-6bac-4671-b9aa-23ff6580ccf8 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1297 microversion: 2.1 time: 0.126618 Jul 19 20:01:58.419796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1817/3492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.480873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.489623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5553161-c496-4857-961d-823e6f045555 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.210726 Jul 19 20:01:58.500182 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1676/3493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.849511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.850872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.859206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.860180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.861003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.861448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.004802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.005540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.022066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.024056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.026688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.027844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.132180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.152207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.157123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a0ccbc3-1911-4de8-ad6e-8fb9b99ed058 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.313634 Jul 19 20:01:59.162656 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1818/3494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:59.182164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.183226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.187243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.190602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.192791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-016c898d-d718-433c-849a-d9c46995e42b tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.193706 Jul 19 20:01:59.194989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1677/3495] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:59.199276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.200647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.203474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.206368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.279309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.281620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 1c396e08-1b3c-4856-8e76-b875b5c5e375] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.296844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.297958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.299374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.300603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.336637 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] HTTP exception thrown: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Request method failure captured: Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 HTTP/1.1 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxGzLp5PdAE6yQNUpZ9SRdHZQTNGohlKPotlC57_FvJ0fQ6m-m5q3f6vJwNSijHizzeXBJNucOSun1PbdjAhm3L_hYJTc8ZmqfH1WrhO3SRLgN7bTB_umgD88IaXk3-1cf4HXj_5AIowmUVZRmqrEynLq7-512QdLoD7dCKwRJAHsM Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 11fb4996ebff47d4b98763cba171cf3b Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-MigrationsAdminTest-348090573-project Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c396e08-1b3c-4856-8e76-b875b5c5e375'} Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:59.339919 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:01:59.344112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Returning 404 to user: Instance 1c396e08-1b3c-4856-8e76-b875b5c5e375 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:59.344647 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c5dd957-2cf6-4b94-b371-4ffc29106d76 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375" status: 404 len: 111 microversion: 2.1 time: 0.073268 Jul 19 20:01:59.352279 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1678/3496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:59 2022] GET /compute/v2.1/servers/1c396e08-1b3c-4856-8e76-b875b5c5e375 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:59.362285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.363509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.376536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.377103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.378048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.378524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.408094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:59.498907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.509081 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6976c252-a7e8-4a1c-b055-722c4f4de8d6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1502 microversion: 2.1 time: 0.344875 Jul 19 20:01:59.509662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1819/3497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:59 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:59.522684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.523769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.530592 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a97bdcb-e15f-48a5-b362-7ba7ad7e1cd5 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 204 len: 0 microversion: 2.1 time: 0.175941 Jul 19 20:01:59.534317 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1679/3498] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:59 2022] DELETE /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:01:59.543563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.544044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.544829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.545265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.548046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.549508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.557820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.558564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.559766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.560520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.744151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.757185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3e8427f-6eb4-4807-8d73-a290e8bc6ba6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1295 microversion: 2.1 time: 0.237709 Jul 19 20:01:59.759193 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1820/3499] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:59 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:59.768241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:59.770247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:59.792637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.793476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.795891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:59.796826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:59.874460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:59.883343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc5ade85-5e03-4ddc-8e4d-d018c70b872f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.342198 Jul 19 20:01:59.883964 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1680/3500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:59 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:00.188366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.189776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.214757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.215799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.216938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.217560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.250963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.265397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc64dfce-475f-4bc6-8a70-3d8897d59105 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1468 microversion: 2.1 time: 0.502113 Jul 19 20:02:00.266819 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1821/3501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:59 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:00.279063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.281931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.294975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.296550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.299881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.300663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.423991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.456376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.458512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.478074 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ea26b54-0cc7-4502-801a-bf06c9a71d30 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.195758 Jul 19 20:02:00.480465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1822/3502] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:00.687011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.708681 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9647cf9-60df-450f-bf3b-1a9140964e01 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.526125 Jul 19 20:02:00.719821 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1681/3503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:00.786703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.790708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.802401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.803270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.805923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.807644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.902706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.903870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.911219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.912197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.913518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.914192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.626789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.637435 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-737e8cbd-0ebd-4e37-a506-6d36af559728 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.863215 Jul 19 20:02:01.638515 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1823/3504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:01.645814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:01.647360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:01.655245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.656385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.657178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.657614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.671292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.687751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4918037-c232-4de3-a36b-823acb13d19d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.788975 Jul 19 20:02:01.689325 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1682/3505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:01.709539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:01.710816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:01.722333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.722919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.724024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.724474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.914346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.929948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.932330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.935658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9aef9560-d71d-4e27-ae2a-8fa8a86c8b84 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1604 microversion: 2.42 time: 0.243976 Jul 19 20:02:01.937007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1683/3506] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:01 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:01.942910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:01.944003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:01.953920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.954694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.955795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.956533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.128447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.141916 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29eb1950-a499-4651-9e27-c160b144747c tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1468 microversion: 2.1 time: 0.501670 Jul 19 20:02:02.143478 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1824/3507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:01 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1468 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:02.238996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94bbaaaf-084c-4c58-8794-58d56e03bc55"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:02.240191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.250422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.251021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.252077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.252752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.400373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.419256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-877944eb-d1d9-4e4b-b6b9-6c3f4b2ff816 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.480103 Jul 19 20:02:02.420447 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1684/3508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:01 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:02.520992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f5dc9de0-4a55-429b-896b-c34f7e261d3b req-a7a4238b-96d5-4af6-b849-1f7f9de8ee10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0cf971-1805-4c1d-958d-9a858ef09804", "name": "network-vif-deleted", "tag": "b80d5586-692a-4174-b9ca-d031e3168e47"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:02.546343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5dc9de0-4a55-429b-896b-c34f7e261d3b req-a7a4238b-96d5-4af6-b849-1f7f9de8ee10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.547067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5dc9de0-4a55-429b-896b-c34f7e261d3b req-a7a4238b-96d5-4af6-b849-1f7f9de8ee10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.568365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f5dc9de0-4a55-429b-896b-c34f7e261d3b req-a7a4238b-96d5-4af6-b849-1f7f9de8ee10 service nova] Creating event network-vif-deleted:b80d5586-692a-4174-b9ca-d031e3168e47 for instance 3d0cf971-1805-4c1d-958d-9a858ef09804 on n-h2-843861-3 Jul 19 20:02:02.575529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f5dc9de0-4a55-429b-896b-c34f7e261d3b req-a7a4238b-96d5-4af6-b849-1f7f9de8ee10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063040 Jul 19 20:02:02.576498 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1685/3509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:02.656782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:02.658318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.659514 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b142986e-7f53-4a10-87ec-e04b2ddf8829 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426073 Jul 19 20:02:02.660333 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1825/3510] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:02 2022] POST /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:02.667211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.667760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.668802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.669324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.709259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:02.710805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.719365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.720158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.721205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.722163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.044947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.057627 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b388416-2b68-4187-a2a4-ec7ed15736cf tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.405770 Jul 19 20:02:03.065349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1686/3511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:02 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:03.065899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.069237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:03.073268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:03.074345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:03.081012 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e9f4f80-7859-46e7-8477-988b0eff4cf6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.378170 Jul 19 20:02:03.082211 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1826/3512] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:02 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:03.083010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.083529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.085062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.085551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.127909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.128364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.128840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lazy-loading 'fault' on Instance uuid dbd66404-0efb-4d91-9f53-5f7119dca9fa {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:03.169209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:03.171447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:03.181872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.183179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.183605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.184142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.185599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.199534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.201534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b011b8503fa402f9d005bb1ef02261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef1da8f4a3f4d5c8908abcbecaf8d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.202849 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-21d79947-5035-436e-a93a-f77da4d85c99 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 200 len: 1609 microversion: 2.42 time: 0.135023 Jul 19 20:02:03.203425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1687/3513] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:03 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 1609 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:03.241530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.242530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.243350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lazy-loading 'fault' on Instance uuid 3d0cf971-1805-4c1d-958d-9a858ef09804 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:03.318209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11fb4996ebff47d4b98763cba171cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a160cebe43340e08c20f322e36c0d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.326464 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dffa747b-57bf-4483-8684-ab10dae67e99 tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 200 len: 1302 microversion: 2.1 time: 0.163195 Jul 19 20:02:03.327170 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1827/3514] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:03 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:03.439521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:03.440686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:03.451029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.451029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.451910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.452799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.708759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.717081 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66592236-371f-456a-a7d4-93ba700522fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.282275 Jul 19 20:02:03.718355 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1688/3515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:03 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:04.076443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.077286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.085085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.085548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.086336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.086781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.100905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.101868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.110024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.110578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.111673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.112202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.305168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:04.312441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:04.320046 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c6316b5-2b13-487c-ab42-89d35a145836 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.247909 Jul 19 20:02:04.320403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-821d7784-fc38-4d69-997d-c160310133cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.223572 Jul 19 20:02:04.321239 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1828/3516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:04.321381 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1689/3517] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:04.327049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.327665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.333932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.334387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.335166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.335605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.343280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.344075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] [instance: 3d0cf971-1805-4c1d-958d-9a858ef09804] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.350442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.351021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.351721 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] HTTP exception thrown: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:04.352033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.352568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Request method failure captured: Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa HTTP/1.1 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wwhRHzZTvyzUb0xoGtfaiu7YNOGBTN_AF2FXEOWQbwa2fxdoeNQxWwpvWQq7ygP1a-WxVjOWiKarV3fFVzOq_3mfb0qeUSplBXZqPoAqAAlArnM0OliCFpYUgkJwPTMbGA-VQ6SGQCATEhpFDstkyqS1cKzXyqti-hcE4nWSXefKQ0 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2b011b8503fa402f9d005bb1ef02261c Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'dbd66404-0efb-4d91-9f53-5f7119dca9fa'} Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.353446 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Returning 404 to user: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-517f648f-0917-4d7f-98fa-c2a3d14b5460 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 404 len: 111 microversion: 2.42 time: 0.032220 Jul 19 20:02:04.359021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1829/3518] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:04.364577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6e2765a-309c-4faa-a01a-8965fb1a8442 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '.version_select at 0x7fb88cebbca0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.373013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:04.374818 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] HTTP exception thrown: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Request method failure captured: Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 HTTP/1.1 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wxGzLp5PdAE6yQNUpZ9SRdHZQTNGohlKPotlC57_FvJ0fQ6m-m5q3f6vJwNSijHizzeXBJNucOSun1PbdjAhm3L_hYJTc8ZmqfH1WrhO3SRLgN7bTB_umgD88IaXk3-1cf4HXj_5AIowmUVZRmqrEynLq7-512QdLoD7dCKwRJAHsM Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a160cebe43340e08c20f322e36c0d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-MigrationsAdminTest-348090573 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8a160cebe43340e08c20f322e36c0d38 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-MigrationsAdminTest-348090573 Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-MigrationsAdminTest-348090573-project Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 11fb4996ebff47d4b98763cba171cf3b Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-MigrationsAdminTest-348090573-project Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3d0cf971-1805-4c1d-958d-9a858ef09804'} Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:04.376469 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] Returning 404 to user: Instance 3d0cf971-1805-4c1d-958d-9a858ef09804 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:04.381316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3efe9e37-a006-427b-8fd0-4766b4004b0b tempest-MigrationsAdminTest-348090573 tempest-MigrationsAdminTest-348090573-project] 10.222.0.33 "GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804" status: 404 len: 111 microversion: 2.1 time: 0.039138 Jul 19 20:02:04.384724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6e2765a-309c-4faa-a01a-8965fb1a8442 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981741045" status: 204 len: 0 microversion: 2.42 time: 0.023862 Jul 19 20:02:04.386425 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1830/3520] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Jul 19 20:02:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981741045 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 20:02:04.386590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1690/3520] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/3d0cf971-1805-4c1d-958d-9a858ef09804 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:02:04.623013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fa8d4576-d410-4df2-afee-c8949e383e8c req-9aeb4d98-c404-43ac-bb55-ea6ff354975d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6f6742-1a02-45c1-a039-f44afeea52c7", "tag": "c516bb10-233a-49d8-9c92-7678f47e1a99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:04.645144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa8d4576-d410-4df2-afee-c8949e383e8c req-9aeb4d98-c404-43ac-bb55-ea6ff354975d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.645595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa8d4576-d410-4df2-afee-c8949e383e8c req-9aeb4d98-c404-43ac-bb55-ea6ff354975d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.665807 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fa8d4576-d410-4df2-afee-c8949e383e8c req-9aeb4d98-c404-43ac-bb55-ea6ff354975d service nova] Creating event network-changed:c516bb10-233a-49d8-9c92-7678f47e1a99 for instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 on n-h2-843861-3 Jul 19 20:02:04.671417 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fa8d4576-d410-4df2-afee-c8949e383e8c req-9aeb4d98-c404-43ac-bb55-ea6ff354975d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052585 Jul 19 20:02:04.672624 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1831/3521] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:04.737166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.737880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.746762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.747470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.748578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.750735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.998299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.015483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bed8704e-f6a0-46ab-b6fb-9b6d87d6d85c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.284541 Jul 19 20:02:05.016510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1691/3522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:05.345208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:05.346674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:05.348004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:05.351207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:05.364467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.366945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.367848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.368750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.370316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.372033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.372973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.373697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.748523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.759005 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b65f1a6-0d95-42a0-851b-954ade3da11f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.424457 Jul 19 20:02:05.764134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.773944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1692/3523] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:05 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:05.786955 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63b6b52b-bd4c-49f4-8a5e-357168ef0029 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.447804 Jul 19 20:02:05.788101 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1832/3524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:05 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:06.036214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.037314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:06.044620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.045409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.046820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.047453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.380651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.397902 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a1b270b-b4fb-4462-bae9-a8f268a37ee8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1509 microversion: 2.1 time: 0.365449 Jul 19 20:02:06.399989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1693/3525] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:06.433485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.441165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.441984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Searching by: {'deleted': False, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:02:06.449742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.450296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.464613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.465493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.565315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:02:06.660342 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6bd1a4d9-03c6-41be-8d45-506c49739e08 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.235643 Jul 19 20:02:06.660989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1833/3526] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers => generated 334 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:06.674546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.678638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.680249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Searching by: {'deleted': False, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:02:06.684699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:06.686025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:06.690459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.691185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.692726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.693741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.737042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:02:06.787108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.788706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:06.791531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.801946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.802690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.806469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.807012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.807883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.808397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.261249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:07.325620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfe804d5-8068-4b17-93fa-b28679bde547 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.657055 Jul 19 20:02:07.329311 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1694/3527] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:07.340961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.355238 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f3641841-cbe2-4e96-8754-391eda392662 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.577976 Jul 19 20:02:07.355878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1834/3528] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:07.360403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.366696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63a47501-21dd-4022-a075-38235239fb05 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.382039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63a47501-21dd-4022-a075-38235239fb05 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025024 Jul 19 20:02:07.387214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.388581 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1835/3529] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:02:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:07.406942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.407396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.418629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.419258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.424033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.424433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.431039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.431478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.432316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.432752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.836644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.846598 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e64212df-e954-4be8-b0b3-e40be5228bfe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1486 microversion: 2.1 time: 0.431833 Jul 19 20:02:07.851392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1836/3530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:07 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1486 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:07.865157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.865768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.881676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.882487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.883488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.884061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.911461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.928093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7edc2ad6-a154-4068-a76a-d80459eccb7d tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.597347 Jul 19 20:02:07.929993 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1695/3531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:07 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:07.937836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:07.938930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.954636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:07.980501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.987485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.988702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.990696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.079068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3255654d-f73a-4131-9939-6a94cced371e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 204 len: 0 microversion: 2.1 time: 0.224972 Jul 19 20:02:08.080435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1837/3532] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:07 2022] DELETE /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:08.098544 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24b594a3-8730-4121-a39e-7563ada27618 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 200 len: 195 microversion: 2.1 time: 0.166633 Jul 19 20:02:08.101163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1696/3533] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:07 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 195 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:08.103776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.109958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.111194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.116521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.124735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.130475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.131453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.132247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.133447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.134492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.135174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.136379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.860748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.880800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-732abe4a-5318-4cfe-9b07-11803717a678 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.775187 Jul 19 20:02:08.881421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1697/3534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:08.886284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.886825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.901741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.902130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.902998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.903448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.122570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.136199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34d3dce7-8b89-4cfb-9785-bdfcdb2e893b tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1701 microversion: 2.1 time: 1.049244 Jul 19 20:02:09.137238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1838/3535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1701 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:09.152912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:09.153875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:09.162252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.163071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.164068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.164861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.323887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.346254 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8b77143-be9f-4615-8b81-af757aec198e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.463240 Jul 19 20:02:09.347895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1698/3536] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:09.361022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:09.361974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:09.378526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.379352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.380600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.381304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.747914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.758910 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-858fb544-71d0-4d87-9a60-9ababd937101 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.620105 Jul 19 20:02:09.759799 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1839/3537] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:09 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:09.781574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:09.782271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:09.789327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:09.791649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.791649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.792595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.793068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.918543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.927299 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23b799dc-46a0-4726-a98a-b4895106de85 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.578055 Jul 19 20:02:09.927960 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1699/3538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:09 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:10.158649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.159612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.167034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:10.177409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.178232 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-272a0db3-b7ce-44a0-823e-f76baf5e52c8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.402727 Jul 19 20:02:10.178823 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1840/3539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:09 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:10.178972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.181804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.182557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.184004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.184510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.201319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.203191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.205024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.205615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.232688 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] HTTP exception thrown: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Request method failure captured: Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa HTTP/1.1 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wwhRHzZTvyzUb0xoGtfaiu7YNOGBTN_AF2FXEOWQbwa2fxdoeNQxWwpvWQq7ygP1a-WxVjOWiKarV3fFVzOq_3mfb0qeUSplBXZqPoAqAAlArnM0OliCFpYUgkJwPTMbGA-VQ6SGQCATEhpFDstkyqS1cKzXyqti-hcE4nWSXefKQ0 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2b011b8503fa402f9d005bb1ef02261c Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'dbd66404-0efb-4d91-9f53-5f7119dca9fa'} Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:10.234487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Returning 404 to user: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0257ec72-3735-4185-a582-35a9646ef891 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 404 len: 111 microversion: 2.42 time: 0.055847 Jul 19 20:02:10.242009 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1841/3540] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:02:10 2022] DELETE /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:10.244497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.245141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.254507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.255753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.256986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.258006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.628649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:10.637329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:10.652611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5978dff-64bc-41d3-8f1d-6569e45552f6 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1701 microversion: 2.1 time: 0.499338 Jul 19 20:02:10.653748 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71c1b32a-c3e4-43c5-8b9f-2860eafbdbcd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.415223 Jul 19 20:02:10.654734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1842/3541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:10.663747 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1700/3542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1701 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:10.672119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.672119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] [instance: dbd66404-0efb-4d91-9f53-5f7119dca9fa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.674229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.674963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.684209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.684673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.688035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.688492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.688619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.688980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.689763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.690200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.706003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] HTTP exception thrown: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Request method failure captured: Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa HTTP/1.1 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wwhRHzZTvyzUb0xoGtfaiu7YNOGBTN_AF2FXEOWQbwa2fxdoeNQxWwpvWQq7ygP1a-WxVjOWiKarV3fFVzOq_3mfb0qeUSplBXZqPoAqAAlArnM0OliCFpYUgkJwPTMbGA-VQ6SGQCATEhpFDstkyqS1cKzXyqti-hcE4nWSXefKQ0 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ef1da8f4a3f4d5c8908abcbecaf8d60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0ef1da8f4a3f4d5c8908abcbecaf8d60 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-439958315 Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2b011b8503fa402f9d005bb1ef02261c Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TaggedBootDevicesTest_v242-439958315-project Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'dbd66404-0efb-4d91-9f53-5f7119dca9fa'} Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.707534 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] Returning 404 to user: Instance dbd66404-0efb-4d91-9f53-5f7119dca9fa could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51122beb-1e81-42fb-b1dd-9a82d7ac6a69 tempest-TaggedBootDevicesTest_v242-439958315 tempest-TaggedBootDevicesTest_v242-439958315-project] 10.222.0.33 "GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa" status: 404 len: 111 microversion: 2.42 time: 0.052677 Jul 19 20:02:10.713537 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1843/3543] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/dbd66404-0efb-4d91-9f53-5f7119dca9fa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:10.843858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-590446023", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "2f332934-1a7c-403c-b4ff-1c5d43cb0949"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:10.944742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] validate_networks() for [('2f332934-1a7c-403c-b4ff-1c5d43cb0949', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:11.091753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.105396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2375f52d-e63b-4cf3-bbf9-87e35d75dfd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.436481 Jul 19 20:02:11.106852 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1701/3544] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:11.115790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:11.116746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.130618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.131249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.132523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.133258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.529708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.551155 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-97780d41-d274-4d11-882e-1ffea7a31afa tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.441293 Jul 19 20:02:11.556310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1702/3545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:11 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:11.569722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-66fcffa7-c024-4dce-9c41-d3d991626d59 req-1674efd7-3bbc-457f-946a-69bb85a9d30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6f6742-1a02-45c1-a039-f44afeea52c7", "name": "network-vif-plugged", "status": "completed", "tag": "c516bb10-233a-49d8-9c92-7678f47e1a99"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:11.597395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-66fcffa7-c024-4dce-9c41-d3d991626d59 req-1674efd7-3bbc-457f-946a-69bb85a9d30d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.597903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-66fcffa7-c024-4dce-9c41-d3d991626d59 req-1674efd7-3bbc-457f-946a-69bb85a9d30d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.619256 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-66fcffa7-c024-4dce-9c41-d3d991626d59 req-1674efd7-3bbc-457f-946a-69bb85a9d30d service nova] Creating event network-vif-plugged:c516bb10-233a-49d8-9c92-7678f47e1a99 for instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 on n-h2-843861-3 Jul 19 20:02:11.629815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-66fcffa7-c024-4dce-9c41-d3d991626d59 req-1674efd7-3bbc-457f-946a-69bb85a9d30d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070556 Jul 19 20:02:11.630438 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1703/3546] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:11.677070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:11.679056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.698752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.699372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.700461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.701128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.959996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.973854 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7806c913-47f2-4a72-b1dd-ba7704b8ad35 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1633 microversion: 2.1 time: 0.303005 Jul 19 20:02:11.974537 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1704/3547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:11 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1633 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:12.127536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.128227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.142601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.143291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.144461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.147436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.540680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:12.541405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:12.542231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:12.543429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:12.543965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:12.560357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.560805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.566753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.568405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.602102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:12.614037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:12.637503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:12.641635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:12.645344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.659652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a567c30-e025-4a86-a454-4a00b9b7ead9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.537018 Jul 19 20:02:12.660806 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1705/3548] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:12.667039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e3ae0514-3615-49f9-8a82-0651e6582dd1 req-48f50711-6d7a-4b02-bf6b-759e0269a77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c14dbc-cbe1-4533-aa4d-c12d924473c7", "name": "network-vif-deleted", "tag": "fd618230-10f3-4c65-8fa7-fca627795207"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:12.681539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:12.691956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e3ae0514-3615-49f9-8a82-0651e6582dd1 req-48f50711-6d7a-4b02-bf6b-759e0269a77b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.692921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e3ae0514-3615-49f9-8a82-0651e6582dd1 req-48f50711-6d7a-4b02-bf6b-759e0269a77b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.723609 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81d0929b-22e5-4caf-8caf-64931bc53ea6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884242 Jul 19 20:02:12.736181 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e3ae0514-3615-49f9-8a82-0651e6582dd1 req-48f50711-6d7a-4b02-bf6b-759e0269a77b service nova] Creating event network-vif-deleted:fd618230-10f3-4c65-8fa7-fca627795207 for instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 on n-h1-843861-3 Jul 19 20:02:12.739777 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1844/3549] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:02:12.754282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.756410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.759740 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e3ae0514-3615-49f9-8a82-0651e6582dd1 req-48f50711-6d7a-4b02-bf6b-759e0269a77b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096952 Jul 19 20:02:12.764011 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1706/3550] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:12.778097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.784184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdef32f3-2187-4265-a43e-dcacc928b732 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.785110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.786757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.787609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.793332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdef32f3-2187-4265-a43e-dcacc928b732 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.918655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bdef32f3-2187-4265-a43e-dcacc928b732 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.927025 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdef32f3-2187-4265-a43e-dcacc928b732 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1214 microversion: 2.1 time: 0.158934 Jul 19 20:02:12.935234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1707/3551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:12.991273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.991932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:13.003524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.006413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.009534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.010881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.120337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.121951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.122602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lazy-loading 'fault' on Instance uuid b2c14dbc-cbe1-4533-aa4d-c12d924473c7 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:13.277088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62939ac494e447a9974c125a4396790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eaf740540147f1ae072ec5b90c2481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.312296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5d8c2d7-27da-4e6d-95b0-27e13cf53f45 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 200 len: 1360 microversion: 2.1 time: 0.324782 Jul 19 20:02:13.317554 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1708/3552] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 1360 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:13.318684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.329996 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-039663e8-1cb0-40b1-ad98-eed82665df24 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1363 microversion: 2.1 time: 0.588581 Jul 19 20:02:13.333814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1845/3553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1363 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:13.681438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:13.682424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:13.699393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.699898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.700801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.701364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.748665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:13.809149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-977995348", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:13.913770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:14.126626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:14.137946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b587e3fd-00ee-4436-b911-aeb66034605e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1509 microversion: 2.1 time: 0.460803 Jul 19 20:02:14.139545 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1846/3554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:13 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:14.144831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.145958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.155778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.156674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.173114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.174109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.341109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:14.341931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:14.342302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:14.342937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:14.343564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:14.348319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:14.357612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.358212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.359134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.360123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.362586 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9772205f-660f-431e-accb-8f2e612d01ec tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1210 microversion: 2.1 time: 0.221565 Jul 19 20:02:14.369371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:14.371393 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1847/3555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1210 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:14.386667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.387243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] [instance: b2c14dbc-cbe1-4533-aa4d-c12d924473c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.395494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:14.396066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.396526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.397308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.397931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.404730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for user 24d88c1036be473096fdc2b64fbc9641 and project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:14.419975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] HTTP exception thrown: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Request method failure captured: Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 HTTP/1.1 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2CscIiC75B3AfqLuVh7SC3tHjRFJV5CeH8_SVWIhO_YxoyrBbJcuZ8HmXX7oXRjiYGiYLs2QQftEq3XwfavI3U4CVsKng81M5SiYhO_oEuA-7zpqBgGu0tQ-kF5HijtAadfi7A3YDq4dJ3MyBRcbpRKIq4n10rnxYhqdUa5VP7Znw Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c1eaf740540147f1ae072ec5b90c2481 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-91145722 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1eaf740540147f1ae072ec5b90c2481"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c1eaf740540147f1ae072ec5b90c2481"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1eaf740540147f1ae072ec5b90c2481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c1eaf740540147f1ae072ec5b90c2481"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-91145722 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c1eaf740540147f1ae072ec5b90c2481 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-91145722 Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-91145722-project Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 62939ac494e447a9974c125a4396790f Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-91145722-project Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'b2c14dbc-cbe1-4533-aa4d-c12d924473c7'} Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.422430 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. Jul 19 20:02:14.436814 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.439413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:14.439625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Returning 404 to user: Instance b2c14dbc-cbe1-4533-aa4d-c12d924473c7 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:14.439625 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6133979-e48b-4cc5-9531-d978a461f73e tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7" status: 404 len: 111 microversion: 2.1 time: 0.041819 Jul 19 20:02:14.439625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1848/3556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/b2c14dbc-cbe1-4533-aa4d-c12d924473c7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:14.440416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.440782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.512420 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4570fb7-733d-4fe9-a8f4-620de9ffdc51 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946982 Jul 19 20:02:14.514024 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1709/3557] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:02:14.521728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-438f0510-92f5-4f61-914c-adbad600fa52 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] Calling method '.version_select at 0x7fb88cd5b310>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.549197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-438f0510-92f5-4f61-914c-adbad600fa52 tempest-ServersTestJSON-91145722 tempest-ServersTestJSON-91145722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090018178" status: 202 len: 0 microversion: 2.1 time: 0.033283 Jul 19 20:02:14.551888 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1710/3558] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:02:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090018178 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:14.609858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1794372564", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:14.699451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:14.920634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:14.933097 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f435494-459b-4502-be29-8f3e82dcc55f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1549 microversion: 2.1 time: 0.507255 Jul 19 20:02:14.933735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1849/3559] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1549 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:14.958635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.959165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.977737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.978201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.979005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.979442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:15.707621 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d5a5c54-6e99-427f-9e38-33cec9c724d0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.760870 Jul 19 20:02:15.709689 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1850/3560] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-interface => generated 284 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:15.720202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:15.721109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:15.738616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:15.741449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:15.742332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:15.743194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.126545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:16.127638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:16.128444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:16.129178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:16.129841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:16.159645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.160467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.161836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.162560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.259797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:16.267712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for user 24d88c1036be473096fdc2b64fbc9641 and project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:16.296691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:16.299613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:16.390518 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43b9482b-c835-4e08-b360-52b15ea6cc1f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787788 Jul 19 20:02:16.396475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1711/3561] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:02:16.402244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:16.403175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:16.424798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.425943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.427901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.429333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.015324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:17.016651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:17.025443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-412ae2b4-95d7-4635-9d57-19c0c5464c66 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1272 microversion: 2.1 time: 0.627286 Jul 19 20:02:17.030672 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d8d8823-c5c0-4b5b-85ea-0bf13f5357e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1486 microversion: 2.1 time: 1.319188 Jul 19 20:02:17.031653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1851/3562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:15 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1486 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:17.038534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:17.040088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.043310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1712/3563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:16 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1272 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:17.053867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.054655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.055962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.056957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.058882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:17.059391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.066965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.078862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.080502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.081326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.116320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3620d994-8ae6-42d5-8730-dbd961426287 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/ips" status: 200 len: 150 microversion: 2.1 time: 0.082992 Jul 19 20:02:17.117812 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1852/3564] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:02:17 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:17.133326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:17.151564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ef9caa1-3f3d-4a19-9cf9-d40b48dff511 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:17.156302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ef9caa1-3f3d-4a19-9cf9-d40b48dff511 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.427289 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e571fb57-bfc9-4126-a20f-28bc4229f783 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 204 len: 0 microversion: 2.1 time: 0.375808 Jul 19 20:02:17.431467 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1713/3565] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:17 2022] DELETE /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:17.473657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1153531481"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:17.474962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.491341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.491919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.492700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.493069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.709945 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-169f0393-51a1-462d-9cdc-fd53d496c74c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "PUT /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1060 microversion: 2.1 time: 0.266976 Jul 19 20:02:17.721279 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1714/3566] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:02:17 2022] PUT /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1060 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:17.729616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:17.731335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.738672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.739391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.740679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.741779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.939633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ef9caa1-3f3d-4a19-9cf9-d40b48dff511 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:17.946937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ef9caa1-3f3d-4a19-9cf9-d40b48dff511 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1214 microversion: 2.1 time: 0.827006 Jul 19 20:02:17.947738 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1853/3567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:17 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1214 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:17.963481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:17.964222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:17.975341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.976101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.981231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.981861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.326401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.361025 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-37b7aa87-9c85-4b49-b795-526075d76d28 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1554 microversion: 2.1 time: 0.629154 Jul 19 20:02:18.362449 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1715/3568] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:17 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1554 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:18.377794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.382845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.404786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.407059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.408453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.414644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.868770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.896034 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f3604b7d-69a3-4fc1-bcea-2a5abef8abd8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1487 microversion: 2.1 time: 0.936439 Jul 19 20:02:18.911840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1854/3569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:17 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1487 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:18.925245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.925892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.979526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.981599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.990732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.995193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.441263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.449766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ead58cf8-37b8-46a1-b4bc-6018098527fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 1.085356 Jul 19 20:02:19.450358 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1716/3570] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:18 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:19.465484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.466460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.474211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.474939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.476716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.477459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.710547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.736654 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5843b224-59e1-4fd2-9cc4-fd5371d56323 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1274 microversion: 2.1 time: 0.270629 Jul 19 20:02:19.737462 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1717/3571] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:19 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:19.751178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.752964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.769869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.770323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.771108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.771546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.865381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.879991 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e34e2125-1c1b-4802-a391-4a9086aef55e tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1487 microversion: 2.1 time: 0.960719 Jul 19 20:02:19.891849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1855/3572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:18 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1487 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:19.898860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.899464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.915751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.916270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.917118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.917554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.976336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:20.134016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76b599c7-c02d-419d-ac08-df37ca78dc05 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 204 len: 0 microversion: 2.1 time: 0.239182 Jul 19 20:02:20.135018 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1856/3573] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:19 2022] DELETE /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:20.147657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:20.149041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:20.160193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:20.161049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:20.162173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:20.162903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.383709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:21.396605 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42dd48c0-cf9a-4229-8a02-cf71265df1c6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1554 microversion: 2.1 time: 1.657916 Jul 19 20:02:21.397436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1718/3574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:19 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1554 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:21.413578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca0dd12-194e-4a18-ac5a-e035bdb5749e"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:21.415439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.427012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.428327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.429374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.430200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.517953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:21.526147 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4df7252f-3cb6-4824-ba8e-5d79798e02cc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1493 microversion: 2.1 time: 1.385059 Jul 19 20:02:21.531251 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1857/3575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:20 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1493 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:21.544548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:21.545501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.555758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.556502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.557524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.558160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.903026 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a82d0c5c-88d2-4d4b-8d32-6fcb6a86bae2 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502619 Jul 19 20:02:21.903920 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1719/3576] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:21 2022] POST /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:21.925682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:21.943430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.966956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.969363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.970319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.970876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.577970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:22.625638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.644845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3fc1e5d-356d-4f08-a450-a616379c6583 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1272 microversion: 2.1 time: 0.738778 Jul 19 20:02:22.646296 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1720/3577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:21 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1272 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:22.662850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:22.663215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:22.683777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.684257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.685156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.685769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.413207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:23.422843 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7b2dbda-2311-4a83-a5de-165db5b96d6b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.771737 Jul 19 20:02:23.430222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1721/3578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:22 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:23.440869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-39e2014c-c28b-4a87-b2dc-9b65cc65c7e0 req-48be9b02-089c-405f-812b-e6fca135d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033f5746-9dcb-4f5a-b714-89bf3fbc8aa1", "name": "network-vif-deleted", "tag": "ae04f861-4195-4b40-9cf9-666f16208358"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:23.468923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-39e2014c-c28b-4a87-b2dc-9b65cc65c7e0 req-48be9b02-089c-405f-812b-e6fca135d2aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.470506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-39e2014c-c28b-4a87-b2dc-9b65cc65c7e0 req-48be9b02-089c-405f-812b-e6fca135d2aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.526623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-39e2014c-c28b-4a87-b2dc-9b65cc65c7e0 req-48be9b02-089c-405f-812b-e6fca135d2aa service nova] Creating event network-vif-deleted:ae04f861-4195-4b40-9cf9-666f16208358 for instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 on n-h1-843861-3 Jul 19 20:02:23.540076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-39e2014c-c28b-4a87-b2dc-9b65cc65c7e0 req-48be9b02-089c-405f-812b-e6fca135d2aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108124 Jul 19 20:02:23.546618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1722/3579] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:23.560699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:23.562879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:23.581392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.582273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.585375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.586280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.643944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:23.664265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f3d7520-0a5d-4e94-9887-59aef23a80bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 2.131349 Jul 19 20:02:23.669192 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1858/3580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:21 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:23.679862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:23.682300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:23.709273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.715420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.716922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.718246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.042790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:24.053134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bd5a6d07-2a1f-460b-a723-8062e4b9713d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 200 len: 1451 microversion: 2.1 time: 0.504546 Jul 19 20:02:24.064556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1723/3581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:23 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 1451 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:24.193936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3c7d429c-5ce5-4ce0-8b36-c15887a2223c req-a2b10b9c-d5cd-47ea-a708-a14bad4c8a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49c314a-241b-44db-9960-d0873117d158", "name": "network-vif-deleted", "tag": "f224e94c-dc19-45db-83d1-42ecb13ab74f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:24.221395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3c7d429c-5ce5-4ce0-8b36-c15887a2223c req-a2b10b9c-d5cd-47ea-a708-a14bad4c8a9f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.222113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3c7d429c-5ce5-4ce0-8b36-c15887a2223c req-a2b10b9c-d5cd-47ea-a708-a14bad4c8a9f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.241725 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3c7d429c-5ce5-4ce0-8b36-c15887a2223c req-a2b10b9c-d5cd-47ea-a708-a14bad4c8a9f service nova] Creating event network-vif-deleted:f224e94c-dc19-45db-83d1-42ecb13ab74f for instance d49c314a-241b-44db-9960-d0873117d158 on n-h1-843861-3 Jul 19 20:02:24.247673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3c7d429c-5ce5-4ce0-8b36-c15887a2223c req-a2b10b9c-d5cd-47ea-a708-a14bad4c8a9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181360 Jul 19 20:02:24.249239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1724/3582] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:24.451061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:24.453599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:24.468060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.470065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.471290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.471954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.635468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:24.651435 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eeec4082-ba2b-41e1-9dd8-c504df1e8a5b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 0.975800 Jul 19 20:02:24.652232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1859/3583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:23 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:24.683153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:24.687189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:24.688135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:24.691093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:24.704707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bef873d-639c-42b5-a38e-34954ea1f15c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.260952 Jul 19 20:02:24.705685 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1725/3584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:24 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:24.709194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.712621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.715669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.718489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.070971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.072336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.083141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.089684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.090944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.091706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.138134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 HTTP/1.1 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd49c314a-241b-44db-9960-d0873117d158'} Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.143754 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.148348 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.165549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.166791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-360c376e-9eb2-470c-9c50-d230399b5163 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 404 len: 111 microversion: 2.1 time: 0.099921 Jul 19 20:02:25.168880 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1726/3585] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.192677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.193530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.210341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.211111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.212185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.212859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.251997 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 HTTP/1.1 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd49c314a-241b-44db-9960-d0873117d158'} Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.257768 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.261994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.269308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.270453 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-85377fb3-0915-47b0-b486-32573e75b5c6 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 404 len: 111 microversion: 2.1 time: 0.082502 Jul 19 20:02:25.276092 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1727/3586] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:25 2022] DELETE /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.286022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.290539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: d49c314a-241b-44db-9960-d0873117d158] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.305411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.306009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.306909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.314593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.344682 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 HTTP/1.1 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd49c314a-241b-44db-9960-d0873117d158'} Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.356352 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.362051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance d49c314a-241b-44db-9960-d0873117d158 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.363570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a89a5a6f-8171-494f-8ed2-c3751c50ff11 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158" status: 404 len: 111 microversion: 2.1 time: 0.085619 Jul 19 20:02:25.364302 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1728/3587] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/d49c314a-241b-44db-9960-d0873117d158 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.372759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.384587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.392086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.392709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.393608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.394143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.430280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 HTTP/1.1 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f02933e5-79e7-4ea9-a25c-cb8af0798269'} Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.432580 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.437478 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.443836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.443836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c0e7ee6-745d-4a75-9e50-f05668293411 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 404 len: 111 microversion: 2.1 time: 0.070632 Jul 19 20:02:25.445044 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1729/3588] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:25 2022] DELETE /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:02:25.450146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.458195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: f02933e5-79e7-4ea9-a25c-cb8af0798269] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.469363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.470168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.473337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.475333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.523396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 HTTP/1.1 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f02933e5-79e7-4ea9-a25c-cb8af0798269'} Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.527712 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance f02933e5-79e7-4ea9-a25c-cb8af0798269 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6bb9291e-95ef-4815-81ba-ed7056575ff1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269" status: 404 len: 111 microversion: 2.1 time: 0.082875 Jul 19 20:02:25.532850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1730/3589] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/f02933e5-79e7-4ea9-a25c-cb8af0798269 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.547522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.548060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.568081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.568545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.569346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.569785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.614012 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f HTTP/1.1 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '56feb5b0-4e28-41e0-8381-d3413ac6ad6f'} Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.628429 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.632680 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f368f25-6be8-4ffc-9bde-337880a2f3b8 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 404 len: 111 microversion: 2.1 time: 0.092079 Jul 19 20:02:25.641036 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1731/3590] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:25 2022] DELETE /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.649541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.650165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 56feb5b0-4e28-41e0-8381-d3413ac6ad6f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.678561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.679036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.685541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.686257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.738021 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f HTTP/1.1 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '56feb5b0-4e28-41e0-8381-d3413ac6ad6f'} Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.739604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. Jul 19 20:02:25.745422 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.753861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 56feb5b0-4e28-41e0-8381-d3413ac6ad6f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.754632 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c35f4f5c-bb94-41c7-baa4-e3c72fd4f3e0 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f" status: 404 len: 111 microversion: 2.1 time: 0.109302 Jul 19 20:02:25.755220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1732/3591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/56feb5b0-4e28-41e0-8381-d3413ac6ad6f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:02:25.775718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.777502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.798583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.799044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.799857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.800302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.917784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:25.926885 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7dbecb50-f0c5-4b36-b16f-039b30adf712 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 1.244845 Jul 19 20:02:25.930619 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1860/3592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:24 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:25.937546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6f6742-1a02-45c1-a039-f44afeea52c7", "tag": "c516bb10-233a-49d8-9c92-7678f47e1a99"}, {"name": "network-changed", "server_uuid": "7da99f6b-0da4-4c76-8b12-755e4d441d74", "tag": "6ddb17b1-06f6-4b10-b81c-2443d8753283"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:25.984743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.985452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.013393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] Creating event network-changed:c516bb10-233a-49d8-9c92-7678f47e1a99 for instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 on n-h2-843861-3 Jul 19 20:02:26.030418 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] Creating event network-changed:6ddb17b1-06f6-4b10-b81c-2443d8753283 for instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 on n-h2-843861-3 Jul 19 20:02:26.040015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1b2ce011-d40b-4ad4-a735-ac73d7e03448 req-14997375-a084-4c0d-9f02-aae0e41368ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105166 Jul 19 20:02:26.041420 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1861/3593] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:26.049710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.050649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.059232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.060062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.062408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.064310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.172048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:26.278612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:26.494911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:26.507516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bce8cf09-62a2-4ed6-9a4f-8b225e3db762 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.463342 Jul 19 20:02:26.509418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1862/3594] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:26.523367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.526808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.534366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.535284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.536524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.537188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.577810 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 HTTP/1.1 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '26bcd0f3-1310-4acf-b254-938772549525'} Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:26.586282 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.591335 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.595208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:26.596367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-780e2a83-9c67-492a-a465-637ec9731a3b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 404 len: 111 microversion: 2.1 time: 0.085205 Jul 19 20:02:26.597195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1863/3595] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:26 2022] DELETE /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:26.605678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-88beb852-7c65-445e-b30a-77527236618c req-88809845-5fe5-473f-a6e8-05db9aa1adcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ac3037-7be4-472c-9f92-0b39d2d0a4bd", "tag": "9176e1ae-6b92-489b-9dc3-f74613fbed21"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:26.640215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-88beb852-7c65-445e-b30a-77527236618c req-88809845-5fe5-473f-a6e8-05db9aa1adcc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.648121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-88beb852-7c65-445e-b30a-77527236618c req-88809845-5fe5-473f-a6e8-05db9aa1adcc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.674193 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-88beb852-7c65-445e-b30a-77527236618c req-88809845-5fe5-473f-a6e8-05db9aa1adcc service nova] Creating event network-changed:9176e1ae-6b92-489b-9dc3-f74613fbed21 for instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd on n-h1-843861-3 Jul 19 20:02:26.687948 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-88beb852-7c65-445e-b30a-77527236618c req-88809845-5fe5-473f-a6e8-05db9aa1adcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087676 Jul 19 20:02:26.688857 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1864/3596] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:26.701696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.702899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 26bcd0f3-1310-4acf-b254-938772549525] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.720381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.721160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.722209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.723895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.758452 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 HTTP/1.1 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '26bcd0f3-1310-4acf-b254-938772549525'} Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.760178 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. Jul 19 20:02:26.766554 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.772436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 26bcd0f3-1310-4acf-b254-938772549525 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:26.774162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d433365-d0f7-4cf0-8e10-36791e2421f1 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525" status: 404 len: 111 microversion: 2.1 time: 0.083027 Jul 19 20:02:26.777351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1865/3597] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/26bcd0f3-1310-4acf-b254-938772549525 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:26.783227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.783731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.802148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.802694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.803541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.804021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.835451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac HTTP/1.1 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac'} Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:26.847418 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.852251 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.853886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:26.854991 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-956d56b4-e218-4d40-86ec-4384b35cde64 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 404 len: 111 microversion: 2.1 time: 0.076647 Jul 19 20:02:26.855788 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1866/3598] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:26 2022] DELETE /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:26.868128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.869233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.880837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.882745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.884869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.891686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.897629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:26.925900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac HTTP/1.1 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac'} Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.928081 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-46b60384-da74-467d-b942-b54dffc2718c tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac" status: 404 len: 111 microversion: 2.1 time: 0.069946 Jul 19 20:02:26.935150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1867/3599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/7ce952c8-3f04-4e5e-b446-9edf5ed1f6ac => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:26.944384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.945255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.965095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.968402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.969665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.970403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.017966 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa HTTP/1.1 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '0ad3da9e-d052-47ea-bc99-bc1c8c062cfa'} Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:27.019577 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-45199605-8ec8-402b-a701-7bf8aa913dbb tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 404 len: 111 microversion: 2.1 time: 0.085042 Jul 19 20:02:27.025840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1868/3600] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:26 2022] DELETE /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:27.026687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.027115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.052617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.053254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.054335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.054999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.138613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:27.153591 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a5cb73f-ac69-4d30-aa02-bd93c0231bed tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 1.395840 Jul 19 20:02:27.159337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1733/3601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:27.170868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.171514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.192849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.193860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.194097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.194717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.247139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa HTTP/1.1 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '0ad3da9e-d052-47ea-bc99-bc1c8c062cfa'} Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.248781 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. Jul 19 20:02:27.253787 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.258805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 0ad3da9e-d052-47ea-bc99-bc1c8c062cfa could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:27.259688 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-641e5e17-228d-4305-acaa-44ebdcc3162f tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa" status: 404 len: 111 microversion: 2.1 time: 0.098508 Jul 19 20:02:27.268677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1734/3602] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/0ad3da9e-d052-47ea-bc99-bc1c8c062cfa => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:27.293176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.293701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.312586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe HTTP/1.1 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3dbff8d1-2829-48d1-b77b-6a9ac2e811fe'} Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.314250 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.319982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:27.321373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6484fcd5-ba11-4d87-b5e6-a7ee54942f45 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe" status: 404 len: 111 microversion: 2.1 time: 0.043787 Jul 19 20:02:27.322453 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1735/3603] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:27 2022] DELETE /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:27.336709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.337397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.347281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:27.358135 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe HTTP/1.1 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3dbff8d1-2829-48d1-b77b-6a9ac2e811fe'} Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.362569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.368791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:27.368791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:27.368791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. Jul 19 20:02:27.368791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.368791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance 3dbff8d1-2829-48d1-b77b-6a9ac2e811fe could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:27.371012 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c4a53c9-739f-4cc5-b258-8430eb8c9a57 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe" status: 404 len: 111 microversion: 2.1 time: 0.038749 Jul 19 20:02:27.374017 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1736/3604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/3dbff8d1-2829-48d1-b77b-6a9ac2e811fe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:27.399116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.401282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.415183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.416831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.418238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.419123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.494225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:27.601910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:27.616836 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2d59602-42e0-4d16-9681-ef011de328b3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 0.593720 Jul 19 20:02:27.618061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1869/3605] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:27.628346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.629338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.636916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.637786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.639777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.640636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.665516 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1aaf1d1-7e1b-4003-9ddb-02c3cad44eac tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 204 len: 0 microversion: 2.1 time: 0.286235 Jul 19 20:02:27.668670 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1737/3606] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:27 2022] DELETE /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:27.680545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.684824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.702378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.703084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.704270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.705553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.828251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:27.839035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a368749-008f-4d69-a12a-d3d23a9dc738 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.218250 Jul 19 20:02:27.839558 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1870/3607] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:28.052892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:28.068965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9793f6ba-6cf5-4131-9bd1-62bdfa187a8d tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1480 microversion: 2.1 time: 0.394940 Jul 19 20:02:28.080765 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1738/3608] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1480 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:28.107014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:28.111165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-335936bb-fd02-45ac-b866-cdf9e5f4dfa2 req-78bad064-19af-4e49-80ec-3ddc623b525d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88d10dd-f023-4440-9c9f-a8075ad83fac", "tag": "35e99701-2d9d-41f4-9bca-aa5a3be5cc85"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:28.122440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-335936bb-fd02-45ac-b866-cdf9e5f4dfa2 req-78bad064-19af-4e49-80ec-3ddc623b525d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.122977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-335936bb-fd02-45ac-b866-cdf9e5f4dfa2 req-78bad064-19af-4e49-80ec-3ddc623b525d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.138470 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-335936bb-fd02-45ac-b866-cdf9e5f4dfa2 req-78bad064-19af-4e49-80ec-3ddc623b525d service nova] Creating event network-changed:35e99701-2d9d-41f4-9bca-aa5a3be5cc85 for instance c88d10dd-f023-4440-9c9f-a8075ad83fac on n-h1-843861-3 Jul 19 20:02:28.144534 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-335936bb-fd02-45ac-b866-cdf9e5f4dfa2 req-78bad064-19af-4e49-80ec-3ddc623b525d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038466 Jul 19 20:02:28.145632 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1871/3609] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:28.177054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.177809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.188951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.189412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.190202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.190643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.635061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.636103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.645830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.659359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:28.660571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.661539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.662444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.674095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-575346b7-285f-4ec8-862f-c6b4ef906233 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 0.501869 Jul 19 20:02:28.674712 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1739/3610] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:28.856748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.857387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.877660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.878028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.878836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.879280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.236474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.253507 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43111d8a-ae8a-4b4b-b305-ca62f06a053e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.400574 Jul 19 20:02:29.266071 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1740/3611] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:29.266071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:29.271124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.277342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.277795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.278817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.279473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.499352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.510794 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d352001-f834-45d0-8708-cf05a931c342 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 0.880029 Jul 19 20:02:29.515499 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1872/3612] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:29.687507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.693998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:29.695466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.700660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b457053b-e558-4f07-afc1-2c02b9c9a0b9 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1480 microversion: 2.1 time: 0.445048 Jul 19 20:02:29.701305 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1741/3613] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:29 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1480 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:29.731671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.732156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.733469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.733904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.030363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:30.040277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8c0f925-d21c-42e3-80cd-c6724d01ef61 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 0.353039 Jul 19 20:02:30.047629 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1873/3614] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:29 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:30.273331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:30.273954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:30.282633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.283367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.284190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.284637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.406350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:30.415426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f88de7c4-e17d-4af4-9864-ec8eb97d3565 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.145890 Jul 19 20:02:30.417046 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1742/3615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:30 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:30.533714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:30.534481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:30.545998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.550726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.552282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.553039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.717778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:30.718392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:30.729523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.730298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.731243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:30.731882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.000988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.015281 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d09ea46-af96-4eb3-a05f-8a9dbbaf773f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 0.484847 Jul 19 20:02:31.039922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1874/3616] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:30 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:31.058452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:31.059330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:31.073888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.074546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.078993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.080796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.081459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.086399 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc320a88-7db2-47ec-899d-e53947e7fb80 tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1480 microversion: 2.1 time: 0.370877 Jul 19 20:02:31.089224 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1743/3617] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:30 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1480 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:31.439221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:31.442817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:31.456037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.458339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.462073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.463982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.494580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.506612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da049a5b-327d-4b15-b774-8b262cf88c95 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 0.453143 Jul 19 20:02:31.507236 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1875/3618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:31 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:31.533867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5093b2bb-9dec-4908-bc51-8c57fb9bd023 req-9afce0e1-47c4-4e84-b49c-95e3c039e59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ac3037-7be4-472c-9f92-0b39d2d0a4bd", "name": "network-vif-plugged", "status": "completed", "tag": "9176e1ae-6b92-489b-9dc3-f74613fbed21"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:31.560450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5093b2bb-9dec-4908-bc51-8c57fb9bd023 req-9afce0e1-47c4-4e84-b49c-95e3c039e59c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.564617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5093b2bb-9dec-4908-bc51-8c57fb9bd023 req-9afce0e1-47c4-4e84-b49c-95e3c039e59c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.599651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5093b2bb-9dec-4908-bc51-8c57fb9bd023 req-9afce0e1-47c4-4e84-b49c-95e3c039e59c service nova] Creating event network-vif-plugged:9176e1ae-6b92-489b-9dc3-f74613fbed21 for instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd on n-h1-843861-3 Jul 19 20:02:31.621594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5093b2bb-9dec-4908-bc51-8c57fb9bd023 req-9afce0e1-47c4-4e84-b49c-95e3c039e59c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096350 Jul 19 20:02:31.622239 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1876/3619] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:31.729789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.742183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bacc24cf-b592-4bb6-8c71-a46171338dd9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 200 len: 1346 microversion: 2.1 time: 0.313287 Jul 19 20:02:31.747082 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1744/3620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:31 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 1346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:32.042384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:32.043160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:32.065731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.068743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.072538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.073555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.109394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:32.110112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:32.124486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.126944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.130965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.134273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.428484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e6b3d5c0d3481bb972fa7cf4090040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17e655432548aabbef31726a45e823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:32.436667 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e37b0737-1325-45d2-a6b7-5deee721f7bc tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 200 len: 1438 microversion: 2.1 time: 0.333677 Jul 19 20:02:32.437267 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1745/3621] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:32 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 1438 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:32.525643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:32.526543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:32.540871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.541738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.544110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.546181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.786490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:32.805830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de8c8f23-aa09-47f0-b9a6-13aa2d94f0e7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 0.768527 Jul 19 20:02:32.818791 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1877/3622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:32 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:32.830829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b4dbf4fd-84da-47d2-8050-8a25e7d1f0a7 req-f0fa025d-4031-402f-8ab3-b638a518fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c042270b-e0af-4d95-bc23-892e0192c6ce", "name": "network-vif-deleted", "tag": "e62624b4-cd2a-4636-9bf1-14e6e22ca0b0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:32.866955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b4dbf4fd-84da-47d2-8050-8a25e7d1f0a7 req-f0fa025d-4031-402f-8ab3-b638a518fe1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.867769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b4dbf4fd-84da-47d2-8050-8a25e7d1f0a7 req-f0fa025d-4031-402f-8ab3-b638a518fe1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.897607 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b4dbf4fd-84da-47d2-8050-8a25e7d1f0a7 req-f0fa025d-4031-402f-8ab3-b638a518fe1a service nova] Creating event network-vif-deleted:e62624b4-cd2a-4636-9bf1-14e6e22ca0b0 for instance c042270b-e0af-4d95-bc23-892e0192c6ce on n-h2-843861-3 Jul 19 20:02:32.913199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b4dbf4fd-84da-47d2-8050-8a25e7d1f0a7 req-f0fa025d-4031-402f-8ab3-b638a518fe1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092732 Jul 19 20:02:32.915919 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1878/3623] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:32.935243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:32.937653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:32.941193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:32.957433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.958469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.959537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.960894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.014771 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 HTTP/1.1 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '033f5746-9dcb-4f5a-b714-89bf3fbc8aa1'} Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.023186 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.028235 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.030528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:33.034667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-528e0944-a911-4826-8411-674ca79064a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 404 len: 111 microversion: 2.1 time: 0.117390 Jul 19 20:02:33.037860 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1879/3624] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:32 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:33.120754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:33.133508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b17d2046-fd8b-4a4c-b6f3-7b4b92943c8e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1314 microversion: 2.1 time: 0.612589 Jul 19 20:02:33.137683 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1746/3625] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:32 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:33.216420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.217655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.231601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.234333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.235337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.237964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.297917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1/os-volume_attachments HTTP/1.1 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '033f5746-9dcb-4f5a-b714-89bf3fbc8aa1'} Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:33.299936 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9468f89b-b0da-4218-ae13-c773856275e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.089365 Jul 19 20:02:33.304925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1880/3626] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:33.455710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.456409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] [instance: c042270b-e0af-4d95-bc23-892e0192c6ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.465337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.465788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.470908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.471976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.515680 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] HTTP exception thrown: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Request method failure captured: Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce HTTP/1.1 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wz8kMDiKd4L3x5PDRxDXgkvwxpdG2-CHyMFcq6wMF9E5s9Jm7QqmhN6GwdRqboJB2JG2iazGXdDjNnBbJQRp4OstZgGcKzmRRUzFKJWZgHhYA37EbFkdpoQuu-85ew2wuLa2kTNQfHDrfv3py847aFZ9PDqoR5kYH7uzNxnssNAGro Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb17e655432548aabbef31726a45e823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb17e655432548aabbef31726a45e823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb17e655432548aabbef31726a45e823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersTestJSON-1306891194 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: eb17e655432548aabbef31726a45e823 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersTestJSON-1306891194 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 99e6b3d5c0d3481bb972fa7cf4090040 Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersTestJSON-1306891194-project Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c042270b-e0af-4d95-bc23-892e0192c6ce'} Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.519027 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. Jul 19 20:02:33.525269 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.529949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] Returning 404 to user: Instance c042270b-e0af-4d95-bc23-892e0192c6ce could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:33.536064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e3f080b-d8d4-4840-90eb-340facd6dc8b tempest-ServersTestJSON-1306891194 tempest-ServersTestJSON-1306891194-project] 10.222.0.33 "GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce" status: 404 len: 111 microversion: 2.1 time: 0.084802 Jul 19 20:02:33.540623 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1747/3627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/c042270b-e0af-4d95-bc23-892e0192c6ce => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:33.725039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1163371535", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:33.768314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8da9eea3-fdfd-4c7e-ae7b-d5a3a3d76202 req-e35b240f-820e-447a-ac6f-f13a4c15fbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88d10dd-f023-4440-9c9f-a8075ad83fac", "name": "network-vif-plugged", "status": "completed", "tag": "35e99701-2d9d-41f4-9bca-aa5a3be5cc85"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:33.786537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8da9eea3-fdfd-4c7e-ae7b-d5a3a3d76202 req-e35b240f-820e-447a-ac6f-f13a4c15fbec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.787349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8da9eea3-fdfd-4c7e-ae7b-d5a3a3d76202 req-e35b240f-820e-447a-ac6f-f13a4c15fbec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.823670 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8da9eea3-fdfd-4c7e-ae7b-d5a3a3d76202 req-e35b240f-820e-447a-ac6f-f13a4c15fbec service nova] Creating event network-vif-plugged:35e99701-2d9d-41f4-9bca-aa5a3be5cc85 for instance c88d10dd-f023-4440-9c9f-a8075ad83fac on n-h1-843861-3 Jul 19 20:02:33.834193 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8da9eea3-fdfd-4c7e-ae7b-d5a3a3d76202 req-e35b240f-820e-447a-ac6f-f13a4c15fbec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071046 Jul 19 20:02:33.839331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1748/3628] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:33.865984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.869384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.888112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.890152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.892196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.895574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.898688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:33.949517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:35.249022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:35.261839 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55ae62d9-f23c-4a78-98ed-4d1ddde6ac54 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 1.420518 Jul 19 20:02:35.262553 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1749/3629] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:35.271597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:35.276696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:35.290976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.291744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.292757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.293385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.724731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:35.738675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e50c7d1-9b1a-4fbc-940d-c40311d98a4f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1464 microversion: 2.1 time: 0.474622 Jul 19 20:02:35.739574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1750/3630] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:35 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1464 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:35.756211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:35.756928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:35.768534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.769097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.773108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.773563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.181952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:36.195067 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e726e21-5801-478a-bb85-b9784930c248 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1313 microversion: 2.1 time: 0.442954 Jul 19 20:02:36.200370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1751/3631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:35 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:36.209065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-49b0eaf9-6154-4a23-8fa5-1a21957c4407 req-42f34ec9-917b-4822-85ba-dc51a23082ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da99f6b-0da4-4c76-8b12-755e4d441d74", "name": "network-vif-plugged", "status": "completed", "tag": "6ddb17b1-06f6-4b10-b81c-2443d8753283"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:36.245412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-49b0eaf9-6154-4a23-8fa5-1a21957c4407 req-42f34ec9-917b-4822-85ba-dc51a23082ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.247733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-49b0eaf9-6154-4a23-8fa5-1a21957c4407 req-42f34ec9-917b-4822-85ba-dc51a23082ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.282333 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-49b0eaf9-6154-4a23-8fa5-1a21957c4407 req-42f34ec9-917b-4822-85ba-dc51a23082ed service nova] Creating event network-vif-plugged:6ddb17b1-06f6-4b10-b81c-2443d8753283 for instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 on n-h2-843861-3 Jul 19 20:02:36.296184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-49b0eaf9-6154-4a23-8fa5-1a21957c4407 req-42f34ec9-917b-4822-85ba-dc51a23082ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093297 Jul 19 20:02:36.299106 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1752/3632] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:36.315565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:36.317430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:36.333584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.334931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.335796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.337523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.918365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:36.919380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:36.920705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:36.921333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:36.922097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:36.952187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.953209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.954342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.960417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.035924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:37.057647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:37.098807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:37.101954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:37.214819 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd533478-dc6b-4661-96a8-2b117174f348 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.499645 Jul 19 20:02:37.226744 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1881/3633] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:02:37.240059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.240975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.257153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.262762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.264661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.265297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.312707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:37.327364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19f3fcad-e631-4986-b89c-f61fce0b7f6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1314 microversion: 2.1 time: 1.025012 Jul 19 20:02:37.345473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1753/3634] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:36 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:37.347539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a61de4c6-4c86-4bfb-8d91-91aa16b4a48c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.357101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a61de4c6-4c86-4bfb-8d91-91aa16b4a48c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.598516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a61de4c6-4c86-4bfb-8d91-91aa16b4a48c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:37.613837 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a61de4c6-4c86-4bfb-8d91-91aa16b4a48c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72" status: 200 len: 1215 microversion: 2.1 time: 0.273194 Jul 19 20:02:37.614496 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1754/3635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:37.632071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3db5d26f-56eb-4f50-850d-0ebd6b3a0aeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.632935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3db5d26f-56eb-4f50-850d-0ebd6b3a0aeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.673290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3db5d26f-56eb-4f50-850d-0ebd6b3a0aeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:37.821356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:37.837488 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-86ecc087-ea14-4f77-8219-b52deba48b27 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1463 microversion: 2.1 time: 0.606828 Jul 19 20:02:37.839257 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1882/3636] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1463 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:37.868305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3db5d26f-56eb-4f50-850d-0ebd6b3a0aeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72" status: 204 len: 0 microversion: 2.1 time: 0.241234 Jul 19 20:02:37.869264 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1755/3637] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:37 2022] DELETE /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:37.898333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.898975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.951173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 HTTP/1.1 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '48b5a834-eb08-4118-84a0-a3886b5ddf72'} Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:37.970760 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:37.978298 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e259bfe2-f05e-405d-abaa-08b5ce7638cb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72" status: 404 len: 111 microversion: 2.1 time: 0.093845 Jul 19 20:02:37.990742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1883/3638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:38.040608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1665589901", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:38.163519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-415415306", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c88d10dd-f023-4440-9c9f-a8075ad83fac"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:38.185867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:38.280580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:39.302759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:39.305062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:39.306411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:39.307438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:39.308056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:39.345635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.346622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.347886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.349158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.403224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:39.418763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Getting quotas for user 24d88c1036be473096fdc2b64fbc9641 and project 7966f3d8fa06454ba3e7b879174509f6. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:39.461996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:39.467635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:39.569091 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-afe9f876-fc17-4f99-ba70-082e216424ea tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416297 Jul 19 20:02:39.577523 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1884/3639] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:02:39.593974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:39.595779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:39.605064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.607458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.609930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.610690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.535997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:40.536492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:40.536890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:40.537300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:40.537715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:40.556676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.557336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.558322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.559766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.605260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:40.613521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:40.628618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:40.631396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:40.692599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80ad9ffc-1fca-46d2-8e81-379d46b2202c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.657600 Jul 19 20:02:40.693508 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1756/3640] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:02:40.702954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:40.703876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:40.712532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.713383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.714273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.714926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.752984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:40.760541 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e243a448-db44-435d-8400-a5c6845076ed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1501 microversion: 2.1 time: 1.181429 Jul 19 20:02:40.773156 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1885/3641] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:39 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1501 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:40.872490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:40.886995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3f15356-2178-42f0-9d1d-97219987fd08 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1265 microversion: 2.1 time: 0.188533 Jul 19 20:02:40.889915 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1757/3642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:40 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:40.902864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-539cec11-0818-4b24-a4bc-ef5401bcafd1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:40.907047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-539cec11-0818-4b24-a4bc-ef5401bcafd1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:41.038854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1737211451", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "5f7f9aa6-6ea2-4a72-86a4-55d91ac21ad3"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:41.173411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] validate_networks() for [('5f7f9aa6-6ea2-4a72-86a4-55d91ac21ad3', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:41.314256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-539cec11-0818-4b24-a4bc-ef5401bcafd1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:41.335744 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-539cec11-0818-4b24-a4bc-ef5401bcafd1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1215 microversion: 2.1 time: 0.444386 Jul 19 20:02:41.340370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1758/3643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:40 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1215 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:41.352218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:41.353305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:41.367712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.368191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.369385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.369993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.434345 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5ec86c5-5d02-4dca-a405-b2952b9b7640 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.092570 Jul 19 20:02:41.442849 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1759/3644] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:41 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:41.906547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:41.908048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:41.928179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.930956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.933364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.936371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.087766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:42.111644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d99e7c3c-e449-4c3c-b216-effedd9633df tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1271 microversion: 2.1 time: 0.210533 Jul 19 20:02:42.114772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1760/3645] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:41 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:42.356422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:42.357043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:42.367406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.368802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.369875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.370490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.578054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:42.593754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7119fec4-c206-4af0-905a-3fb522e31734 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1285 microversion: 2.1 time: 0.241961 Jul 19 20:02:42.594350 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1761/3646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:42 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:42.599295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:42.613152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:42.629431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.636413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.637446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.638045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.756779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62b8c9f5-f86e-4b09-b7fc-8201c75b1eb1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.160815 Jul 19 20:02:42.757651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1762/3647] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:42 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:42.870898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:42.872166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:42.873274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:42.874394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:42.875162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:42.894767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.896096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.901753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.903588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.956047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Getting quotas for project 1651d3eff9ad4b0bae1fec9a6092be85. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:42.972178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Getting quotas for user e80091859a434c8aab4edefbb784f8c8 and project 1651d3eff9ad4b0bae1fec9a6092be85. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:43.012612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Going to run 3 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:43.015639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:43.083500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=f5b02d83-7482-4c78-85b6-2c7622bf435b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:43.128090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:43.132332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.133643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.145716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.148329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.149503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.150667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.300079 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0b3d462-9eae-439c-88d0-0b9dcd3d317b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525640 Jul 19 20:02:43.301371 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1886/3648] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:02:43.312620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.314097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:43.324590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:43.325797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:02:43.327961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae7c5c13-c8e2-4233-abd6-532e98646a28 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1271 microversion: 2.1 time: 0.196298 Jul 19 20:02:43.336013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1763/3649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:43.358519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.359898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.360734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.361174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.406785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-042d2e5e-6f90-41d3-9ea5-4912be9abb16 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.098666 Jul 19 20:02:43.410113 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1887/3650] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers => generated 1018 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:43.423075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5524c8e-3997-487f-b2ca-c1287b03eb1f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.423866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b5524c8e-3997-487f-b2ca-c1287b03eb1f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.576055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b5524c8e-3997-487f-b2ca-c1287b03eb1f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:43.588338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5524c8e-3997-487f-b2ca-c1287b03eb1f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1223 microversion: 2.1 time: 0.170675 Jul 19 20:02:43.589620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1764/3651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1223 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:43.615149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.617128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.640715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.641554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.642420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.642868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.769499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:43.770453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.786519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.786863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.787863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.788466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.809330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:43.824755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-427f6acf-c38c-4121-9e4c-8ef47fb55d74 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1273 microversion: 2.1 time: 0.217890 Jul 19 20:02:43.832677 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1888/3652] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:43.853770 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5e680c1-7aae-4244-8c24-71e25477d487 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.088417 Jul 19 20:02:43.854864 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1765/3653] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:43 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:02:44.346518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:44.347171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:44.371565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:44.373686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:44.374431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:44.374877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:44.609253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-21e0b5fc-d3bc-49c0-8094-fd2683390bd0 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:44.610167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-21e0b5fc-d3bc-49c0-8094-fd2683390bd0 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:44.645492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:45.420445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21e0b5fc-d3bc-49c0-8094-fd2683390bd0 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:45.432188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-21e0b5fc-d3bc-49c0-8094-fd2683390bd0 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1223 microversion: 2.1 time: 0.829137 Jul 19 20:02:45.445229 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1766/3654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:44 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1223 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:45.451575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:45.453032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:45.461031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.461860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.462899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.463521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.742934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:45.756528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b97e0e59-69bd-4b39-a4cb-1fab446ab6bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 1.414327 Jul 19 20:02:45.766862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1889/3655] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:44 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:45.780286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:45.784835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:45.800040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.800943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.801902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.802709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.924685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d82d1a29-7c4d-41ed-a878-9fe656d8b8bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.156008 Jul 19 20:02:45.933176 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1890/3656] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:45 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:45.995408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca0dd12-194e-4a18-ac5a-e035bdb5749e"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:45.996628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.014165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.025529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.026623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.027259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.066761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:46.112585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8e2d3d6c-6a9e-4cde-a182-aa59b4410a08 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1315 microversion: 2.1 time: 0.638614 Jul 19 20:02:46.115951 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1767/3657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:45 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:46.191490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments HTTP/1.1 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 74 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: {"volumeAttachment": {"volumeId": "7ca0dd12-194e-4a18-ac5a-e035bdb5749e"}} Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '002e370a-a19e-4c29-b942-1ce1e6f30a43', 'body': {'volumeAttachment': {'volumeId': '7ca0dd12-194e-4a18-ac5a-e035bdb5749e'}}} Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:46.195415 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 Jul 19 20:02:46.200330 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:46.206992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 400 to user: Invalid volume: volume 7ca0dd12-194e-4a18-ac5a-e035bdb5749e is already attached to instances: 002e370a-a19e-4c29-b942-1ce1e6f30a43 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:46.209782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b141314-c9d8-49b4-9424-32bf8e6deacd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.224254 Jul 19 20:02:46.216454 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1891/3658] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:45 2022] POST /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 174 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:46.316222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:46.316491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.333101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.333991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.335321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.336097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.455870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:46.457045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.488345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.489999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.491162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.496805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.542985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lazy-loading 'services' on Instance uuid 002e370a-a19e-4c29-b942-1ce1e6f30a43 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:46.548226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:46.708363 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f29402c9-54ac-4f8b-b2e6-579678aa4efe tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments/7ca0dd12-194e-4a18-ac5a-e035bdb5749e" status: 202 len: 0 microversion: 2.1 time: 0.396752 Jul 19 20:02:46.708973 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1768/3659] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:02:46 2022] DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments/7ca0dd12-194e-4a18-ac5a-e035bdb5749e => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:46.727333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:46.728735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.743372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.744139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.745120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.745723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.806696 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0ac7e9c-586b-4600-8f9b-161fd49a003f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084787 Jul 19 20:02:46.807303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1769/3660] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:46 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:46.813848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:46.814804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.822660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.823538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.824575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.825179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.948764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:46.967704 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56d472e5-ddf9-4b23-b8eb-59669cfbf07d tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1283 microversion: 2.1 time: 0.519408 Jul 19 20:02:46.968369 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1892/3661] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:46 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1283 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:46.973857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:46.975004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:46.989792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.991581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.992678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.993893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.200161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a458f85-354f-4ea8-a503-b3aa4569f64f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.230142 Jul 19 20:02:47.204535 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1893/3662] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:46 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:47.223383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:47.224598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:47.257953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.276666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.280149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.283871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.723173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:47.733981 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bcc7e843-868a-4f16-b493-75f29fcd7a18 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 0.925312 Jul 19 20:02:47.735191 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1770/3663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:46 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:47.741588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-55d8d7ca-e76b-43a2-b324-46f6737e422e req-4eaf14e6-be0b-4b33-8684-17fb84675c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68504707-ef6d-499d-9866-1053528b89fb", "tag": "1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:47.752480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-55d8d7ca-e76b-43a2-b324-46f6737e422e req-4eaf14e6-be0b-4b33-8684-17fb84675c20 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.753097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-55d8d7ca-e76b-43a2-b324-46f6737e422e req-4eaf14e6-be0b-4b33-8684-17fb84675c20 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.765714 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-55d8d7ca-e76b-43a2-b324-46f6737e422e req-4eaf14e6-be0b-4b33-8684-17fb84675c20 service nova] Creating event network-changed:1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc for instance 68504707-ef6d-499d-9866-1053528b89fb on n-h1-843861-3 Jul 19 20:02:47.771090 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-55d8d7ca-e76b-43a2-b324-46f6737e422e req-4eaf14e6-be0b-4b33-8684-17fb84675c20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033704 Jul 19 20:02:47.772299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1771/3664] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:47.825363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:47.826601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:47.834558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.835448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.836360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.837013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.869929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32df6d45-f0e3-4f98-84bb-9784c0305847 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053316 Jul 19 20:02:47.870639 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1772/3665] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:47 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:47.986611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:47.987327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:47.994602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.995368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.996557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.997050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.026660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:48.045685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:48.055023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6ba02f55-f199-4207-af69-1563316526fe tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1315 microversion: 2.1 time: 0.849433 Jul 19 20:02:48.056093 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1894/3666] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:47 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1315 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:48.164646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:48.191593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d098a26-4077-4819-a410-9d6259ec4ebc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1281 microversion: 2.1 time: 0.209666 Jul 19 20:02:48.204342 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1773/3667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:47 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:48.239859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:48.243680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:48.253578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.259068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.260803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.262180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.338959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e37e327d-aab9-4d40-8ecf-10bc0ce787af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.127072 Jul 19 20:02:48.342947 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1895/3668] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:48 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:48.750874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:48.751583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:48.762658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.763125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.763990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.764884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.790830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-983a264d-6396-45cc-b9aa-077bdf02bf33 req-530b1b95-5d99-498d-98d3-f98ec9bc7889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3cc92e-1fe2-4f69-986d-91d5e8ab1831", "tag": "6f372432-0d4b-44bf-b282-4ca2b2378e01"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:48.811343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-983a264d-6396-45cc-b9aa-077bdf02bf33 req-530b1b95-5d99-498d-98d3-f98ec9bc7889 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.811823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-983a264d-6396-45cc-b9aa-077bdf02bf33 req-530b1b95-5d99-498d-98d3-f98ec9bc7889 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.848385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-983a264d-6396-45cc-b9aa-077bdf02bf33 req-530b1b95-5d99-498d-98d3-f98ec9bc7889 service nova] Creating event network-changed:6f372432-0d4b-44bf-b282-4ca2b2378e01 for instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 on n-h1-843861-3 Jul 19 20:02:48.853797 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-983a264d-6396-45cc-b9aa-077bdf02bf33 req-530b1b95-5d99-498d-98d3-f98ec9bc7889 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068334 Jul 19 20:02:48.855172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1896/3669] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:48.890944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:48.892527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:48.901405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.901914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.906675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.907104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.944556 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6ecc02ab-10ea-4a2c-8d28-4f8efa92adb4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063839 Jul 19 20:02:48.949282 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1897/3670] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:48 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:49.072982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:49.073768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:49.083852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.085228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.086647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.087502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.906729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:49.916205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bd886994-89f7-486f-a528-c12749c32364 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 1.169550 Jul 19 20:02:49.916802 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1774/3671] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:48 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:49.922609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:49.938853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:49.945399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.945864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.946842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.947847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.125023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:50.140116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53120e82-4687-4f62-a589-07ded5fd65c3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1315 microversion: 2.1 time: 1.070702 Jul 19 20:02:50.141272 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1898/3672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:49 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:50.149279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:50.150095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:50.151155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.159767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.160477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.161609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.162371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.162780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42fd7b7c-db1f-4f0d-a88d-385065e80801 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1281 microversion: 2.1 time: 0.243974 Jul 19 20:02:50.177395 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1775/3673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:49 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:50.237509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e5ebe44-40a1-43ab-b307-0aca96a0fd28 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 14 microversion: 2.1 time: 0.092296 Jul 19 20:02:50.238455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1899/3674] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:50 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:50.246351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.248724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.257602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.258777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.260047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.260840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.303896 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05558d9a-abd5-449c-97a5-450a4741e085 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063679 Jul 19 20:02:50.305904 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1900/3675] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:50.342789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-37dc963b-ee77-4340-8b98-3f8695e22580 tempest-ExtensionsTest-1460123402 tempest-ExtensionsTest-1460123402-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.344447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-37dc963b-ee77-4340-8b98-3f8695e22580 tempest-ExtensionsTest-1460123402 tempest-ExtensionsTest-1460123402-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.165691 Jul 19 20:02:50.345061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1776/3676] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:50.354794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0a16b88-4e5a-46e1-8cb1-9ab101229603 tempest-ExtensionsTest-1460123402 tempest-ExtensionsTest-1460123402-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.357148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0a16b88-4e5a-46e1-8cb1-9ab101229603 tempest-ExtensionsTest-1460123402 tempest-ExtensionsTest-1460123402-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006377 Jul 19 20:02:50.367405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1901/3677] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:02:50.931091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:50.937906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.939191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.958262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.961137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.962286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.964424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.159769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:51.160684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:51.173674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.177856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.178870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.183192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.582500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:51.595833 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-667f6568-ff7c-468c-a367-3f508ff7328a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 0.665099 Jul 19 20:02:51.597282 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1777/3678] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:51.603798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:51.605052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:51.614869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.615632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.616636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.619916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.034243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:52.052902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ae4986c-536c-454b-b697-a5d48253aa00 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1315 microversion: 2.1 time: 0.899193 Jul 19 20:02:52.063323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1902/3679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:51 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1315 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:52.068561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:52.069515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:52.086804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:52.099315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.099780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.101625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.102326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.205380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-267d26af-3594-40c1-b945-0e15e1c32a77 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action" status: 200 len: 8181 microversion: 2.1 time: 0.140587 Jul 19 20:02:52.211365 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1903/3680] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:52 2022] POST /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74/action => generated 8181 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:52.217950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:52.229472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:52.237558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.238266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.239259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.240000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.433075 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65f53bc4-548d-4c77-aaad-5837cd9779be tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217658 Jul 19 20:02:52.439768 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1904/3681] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:52 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:52.446614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2e229826-8d34-454a-b82f-1fa66f7c2bfe req-62b11878-4831-4c86-bfa4-3a7385a26850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68504707-ef6d-499d-9866-1053528b89fb", "name": "network-vif-plugged", "status": "completed", "tag": "1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:52.467249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2e229826-8d34-454a-b82f-1fa66f7c2bfe req-62b11878-4831-4c86-bfa4-3a7385a26850 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.468317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2e229826-8d34-454a-b82f-1fa66f7c2bfe req-62b11878-4831-4c86-bfa4-3a7385a26850 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.483206 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2e229826-8d34-454a-b82f-1fa66f7c2bfe req-62b11878-4831-4c86-bfa4-3a7385a26850 service nova] Creating event network-vif-plugged:1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc for instance 68504707-ef6d-499d-9866-1053528b89fb on n-h1-843861-3 Jul 19 20:02:52.489922 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2e229826-8d34-454a-b82f-1fa66f7c2bfe req-62b11878-4831-4c86-bfa4-3a7385a26850 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047347 Jul 19 20:02:52.495219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1905/3682] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:52.520657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:52.522441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:52.533902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.534862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.535972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.537249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.608509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:52.625080 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-64c2c1db-1f79-4cef-a044-eb1d2444f62b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 1.018862 Jul 19 20:02:52.626095 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1778/3683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:51 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:52.641709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-773f2f79-9743-4589-aa9c-049ea24bf1cb req-b4f78b53-c220-49d1-8536-92418da90bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca", "tag": "84e275ef-d1d8-4cc9-99a5-a37199e1c7cb"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:52.674360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-773f2f79-9743-4589-aa9c-049ea24bf1cb req-b4f78b53-c220-49d1-8536-92418da90bbf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.674912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-773f2f79-9743-4589-aa9c-049ea24bf1cb req-b4f78b53-c220-49d1-8536-92418da90bbf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.715726 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-773f2f79-9743-4589-aa9c-049ea24bf1cb req-b4f78b53-c220-49d1-8536-92418da90bbf service nova] Creating event network-changed:84e275ef-d1d8-4cc9-99a5-a37199e1c7cb for instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca on n-h1-843861-3 Jul 19 20:02:52.725656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-773f2f79-9743-4589-aa9c-049ea24bf1cb req-b4f78b53-c220-49d1-8536-92418da90bbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093541 Jul 19 20:02:52.733040 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1779/3684] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:52.743499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:52.744373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:52.760773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.761476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.764946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.765606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.988026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:53.378189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:53.801613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:53.815936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a54ca302-d0b6-4588-96b2-754c839b892c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 1.317770 Jul 19 20:02:53.818014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1906/3685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:52 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:53.867166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:53.869602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:53.878232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.879423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.880717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.881362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.906189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:53.921981 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3496ee32-6a17-4153-89c1-27143581133a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 1.187188 Jul 19 20:02:53.922602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1780/3686] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:52 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:53.940371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:53.943937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:53.967571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.968161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.970680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.971299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.033709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6811885-c2a9-4f81-a70b-932630c27763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106451 Jul 19 20:02:54.034614 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1781/3687] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:53 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:54.039871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:54.040486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.047531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.048105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.048910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.049346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.520999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:54.532594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0023d84-aa33-4f32-bcfb-e598083a33ab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1315 microversion: 2.1 time: 0.710446 Jul 19 20:02:54.533590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1907/3688] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:53 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:54.538389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:54.551304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.572328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.573849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.574904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.577310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.664885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:54.674106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15516c34-e743-4560-a43e-0fa95cc54a5b tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.638290 Jul 19 20:02:54.681937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1782/3689] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:54 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:54.708892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-460b9285-70f4-4094-9267-f97deda30bfc req-37939c78-90fc-48cf-a164-cc1890277e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b02d83-7482-4c78-85b6-2c7622bf435b", "tag": "0a26caf0-8602-4c67-9329-a95d4a5f305a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:54.726707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-460b9285-70f4-4094-9267-f97deda30bfc req-37939c78-90fc-48cf-a164-cc1890277e5f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.727981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-460b9285-70f4-4094-9267-f97deda30bfc req-37939c78-90fc-48cf-a164-cc1890277e5f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.755714 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-460b9285-70f4-4094-9267-f97deda30bfc req-37939c78-90fc-48cf-a164-cc1890277e5f service nova] Creating event network-changed:0a26caf0-8602-4c67-9329-a95d4a5f305a for instance f5b02d83-7482-4c78-85b6-2c7622bf435b on n-h2-843861-3 Jul 19 20:02:54.772770 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-460b9285-70f4-4094-9267-f97deda30bfc req-37939c78-90fc-48cf-a164-cc1890277e5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068407 Jul 19 20:02:54.774641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1783/3690] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:54.940153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:54.949538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.965220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.965672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.967120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.967766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.293590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:55.305050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-644991d6-2219-4131-b823-1ceff270459d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.770253 Jul 19 20:02:55.305657 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1908/3691] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:54 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:55.319184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:55.320238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:55.329337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.329790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.330560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.331667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.369398 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ae99995-39c2-4f8d-81d4-873c1122fa6a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057249 Jul 19 20:02:55.370723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1909/3692] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:55 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:55.392284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:55.394432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:55.408908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.409969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.419457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.420191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.427777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:55.522345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:55.540500 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-875a8c68-71aa-45cb-98e0-2fe8b0d20768 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 0.605353 Jul 19 20:02:55.546384 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1784/3693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:54 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:55.553058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:55.553883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:55.561272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.561843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.563492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.564236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.600997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:55.711766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26a50cd3-b662-44cb-863c-1cd53290795a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 204 len: 0 microversion: 2.1 time: 0.162878 Jul 19 20:02:55.712758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1785/3694] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:55 2022] DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:55.719582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3d71a460-8cae-4db3-9c30-6a522d0363eb req-1db95e02-45dc-4466-bcc0-d34ace31c3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3cc92e-1fe2-4f69-986d-91d5e8ab1831", "name": "network-vif-plugged", "status": "completed", "tag": "6f372432-0d4b-44bf-b282-4ca2b2378e01"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:55.728472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3d71a460-8cae-4db3-9c30-6a522d0363eb req-1db95e02-45dc-4466-bcc0-d34ace31c3fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.728951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3d71a460-8cae-4db3-9c30-6a522d0363eb req-1db95e02-45dc-4466-bcc0-d34ace31c3fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.743307 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3d71a460-8cae-4db3-9c30-6a522d0363eb req-1db95e02-45dc-4466-bcc0-d34ace31c3fc service nova] Creating event network-vif-plugged:6f372432-0d4b-44bf-b282-4ca2b2378e01 for instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 on n-h1-843861-3 Jul 19 20:02:55.749574 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3d71a460-8cae-4db3-9c30-6a522d0363eb req-1db95e02-45dc-4466-bcc0-d34ace31c3fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Jul 19 20:02:55.752121 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1786/3695] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:55.759782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:55.760567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:55.773290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.774290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.775611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.776269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.051186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.081398 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc051b1b-1d6c-4422-a948-73a33e68454e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.709123 Jul 19 20:02:56.084146 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1910/3696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:55 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.102995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:56.103462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.113108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.113563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.114418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.114854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.153092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.163795 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-daeac8f4-5d53-408e-8c6d-962b11ae0b99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1502 microversion: 2.1 time: 0.409957 Jul 19 20:02:56.164692 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1787/3697] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:55 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.175763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:56.177449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.184598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.185769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.186548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.186980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.431361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.443962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.447209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78aeaee7-5f86-47b8-a619-123a766f9e5c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.361969 Jul 19 20:02:56.448716 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1911/3698] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:56 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.452664 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a383975-4e90-42bd-ad92-c12ed9ba5ca0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1683 microversion: 2.1 time: 0.286674 Jul 19 20:02:56.458473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:56.459131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.460204 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1788/3699] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:56 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1683 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.465489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:56.466471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.469888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.470340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.472604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.473046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.474296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.474983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.476116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.476798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.572140 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-703e8c6b-dfa9-4616-ba16-b0ff8a822fab tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb/action" status: 202 len: 0 microversion: 2.1 time: 0.110169 Jul 19 20:02:56.576422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1789/3700] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:56 2022] POST /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:56.579476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:56.580237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.589847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.590420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.591514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.592159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.614412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:56.708142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.718315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:56.742822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b05924c2-2b60-422e-b270-65424be6cb37 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.291628 Jul 19 20:02:56.743753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1912/3701] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:56 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.754166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:56.754789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.772637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.773456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.774449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.774885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.854566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.870366 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b60a5cfb-8646-4e24-b601-80746985e712 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1313 microversion: 2.1 time: 0.295576 Jul 19 20:02:56.881544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1790/3702] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:56 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:56.888802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:56.889974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:56.898593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.900017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.901662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:56.902570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.980471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Locking {{(pid=126007) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 19 20:02:57.026170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:57.045535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3618a375-038d-43d2-8212-1e5ecf03a654 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1507 microversion: 2.1 time: 0.299775 Jul 19 20:02:57.047632 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1913/3703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:56 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.060341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8b052f77-cc3e-4912-8c6c-5437be275cc8 req-c455fb58-5876-4085-a1b3-822997920959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da64c1b-1851-4629-ac18-9c6447163256", "tag": "04b336f4-05b8-4803-8c01-a20e72b5bf49"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:57.084760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8b052f77-cc3e-4912-8c6c-5437be275cc8 req-c455fb58-5876-4085-a1b3-822997920959 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.086201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8b052f77-cc3e-4912-8c6c-5437be275cc8 req-c455fb58-5876-4085-a1b3-822997920959 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.087653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c95d3f72-3afd-4d82-a0f2-0ac21114dbca tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.204176 Jul 19 20:02:57.096626 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1791/3704] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:56 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:57.103925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:57.105770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:57.119757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8b052f77-cc3e-4912-8c6c-5437be275cc8 req-c455fb58-5876-4085-a1b3-822997920959 service nova] Creating event network-changed:04b336f4-05b8-4803-8c01-a20e72b5bf49 for instance 4da64c1b-1851-4629-ac18-9c6447163256 on n-h2-843861-3 Jul 19 20:02:57.132947 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8b052f77-cc3e-4912-8c6c-5437be275cc8 req-c455fb58-5876-4085-a1b3-822997920959 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082127 Jul 19 20:02:57.133993 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1914/3705] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:57.136875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.139286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.141943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.143688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.465549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:57.466300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:57.492708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.501083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.502090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.504613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.539295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:57.550057 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c3777f45-cc9a-416b-b616-948f2f92b07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.451439 Jul 19 20:02:57.551327 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1792/3706] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:57 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.556570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:57.557819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:57.565050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.565866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.566945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.567915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.881671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:57.893522 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8bf195b5-b6fd-488b-a8d4-5075e08abd74 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.432488 Jul 19 20:02:57.896695 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1915/3707] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:57 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.908682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:57.917223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:57.929343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-901d75c7-4de9-4390-b083-f2e6b44ec6a4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1683 microversion: 2.1 time: 0.376343 Jul 19 20:02:57.932288 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1793/3708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:57 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1683 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.943558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.945145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:57.945930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.950097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:57.974119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.974763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.980441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.980979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.991487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action HTTP/1.1 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: {"os-stop": {}} Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '04e4c3cf-b720-405f-88f9-75ff21285168', 'body': {'os-stop': {}}} Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked Jul 19 20:02:57.997344 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:02:58.004802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 409 to user: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 is locked {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:58.006300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fb19f698-85f8-4b38-80a8-bf17994ef179 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 409 len: 107 microversion: 2.1 time: 0.107608 Jul 19 20:02:58.007410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1916/3709] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:57 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 107 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:58.016802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:58.017351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:58.026962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.029696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.031553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.032101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.115327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Unlocking {{(pid=126008) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 20:02:58.194006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3711c5ce-24d9-40c1-b5d7-b9d726bfafbd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.181813 Jul 19 20:02:58.195367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1917/3710] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:58 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:02:58.201553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.202620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:58.211726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.217270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.217270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.217270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.248705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:58.260532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-288c318a-303e-403b-8a25-620aed37c571 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1463 microversion: 2.1 time: 0.326861 Jul 19 20:02:58.261134 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1794/3711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:57 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1463 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:58.266767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a21dceda-1603-44a4-ae4f-c06f3a885ea4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:58.288588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a21dceda-1603-44a4-ae4f-c06f3a885ea4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.296568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a21dceda-1603-44a4-ae4f-c06f3a885ea4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.349905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a21dceda-1603-44a4-ae4f-c06f3a885ea4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:02:58.431644 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a21dceda-1603-44a4-ae4f-c06f3a885ea4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.169021 Jul 19 20:02:58.436055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1795/3712] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:58 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:58.470494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:58.490324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-307ce83e-6081-4b3f-8cca-51b004321be9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1487 microversion: 2.1 time: 0.293510 Jul 19 20:02:58.493519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1918/3713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:58 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:58.511966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.513892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:58.539482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.539993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.540804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.541566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.759336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.764104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'deleted': False, 'project_id': 'c31c5cf7b0bb4342b6eebd57439ec7ee'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:02:58.771378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.772020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.773019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.773645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.806669 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5de47a6f-c6db-43f7-b749-ea965d793ecc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.371355 Jul 19 20:02:58.807989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1796/3714] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:02:58 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:02:58.832266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.833644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:58.845517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.846298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.847290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.847937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.921295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:58.953188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:58.964537 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea2cc20c-9aae-4b05-958c-45ce48e383b5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.469647 Jul 19 20:02:58.965812 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1919/3715] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:58 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:58.973088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.983337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'deleted': False} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:02:58.992934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.993856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.995014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.000348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.092787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62da94b3-087b-4ada-9f67-b03bb47de9d0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 204 len: 0 microversion: 2.1 time: 0.281419 Jul 19 20:02:59.095113 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1797/3716] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:58 2022] DELETE /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:02:59.103272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:59.105091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:59.114231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.115630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.117678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.118288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.165029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:02:59.262301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.262657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.711632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:59.729031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8a573ff-2fae-49ce-86ed-845a8a155c0a tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.632215 Jul 19 20:02:59.730056 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1798/3717] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:59 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:59.735750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:59.736765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:59.758346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.760418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.761036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:59.761333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.078656 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42b06311-c61e-4d66-8d55-d23cf82a6616 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19574 microversion: 2.1 time: 1.110676 Jul 19 20:03:00.079335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1920/3718] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Jul 19 20:02:58 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19574 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:03:00.084619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:00.085265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:00.093717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.094204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.094987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.096459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.159980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:00.169838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fc96d9f-5bd6-46b3-90f4-90420d6d3e3f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1683 microversion: 2.1 time: 0.437808 Jul 19 20:03:00.184246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1799/3719] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:59 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1683 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:00.190238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-21938f37-c98d-4699-b565-43d1281ba49f req-9444c9b9-f424-4152-9519-5e7cd2059897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca", "name": "network-vif-plugged", "status": "completed", "tag": "84e275ef-d1d8-4cc9-99a5-a37199e1c7cb"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:00.199349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-21938f37-c98d-4699-b565-43d1281ba49f req-9444c9b9-f424-4152-9519-5e7cd2059897 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.199793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-21938f37-c98d-4699-b565-43d1281ba49f req-9444c9b9-f424-4152-9519-5e7cd2059897 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.216778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-21938f37-c98d-4699-b565-43d1281ba49f req-9444c9b9-f424-4152-9519-5e7cd2059897 service nova] Creating event network-vif-plugged:84e275ef-d1d8-4cc9-99a5-a37199e1c7cb for instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca on n-h1-843861-3 Jul 19 20:03:00.225998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-21938f37-c98d-4699-b565-43d1281ba49f req-9444c9b9-f424-4152-9519-5e7cd2059897 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039265 Jul 19 20:03:00.227589 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1800/3720] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:00.233677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:00.241650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:00.268074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.274702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.275920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.282856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.255547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:01.268383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56737753-ad70-4a55-a6f3-89b8bb451a23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 1.039242 Jul 19 20:03:01.282572 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1801/3721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:00 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:01.293675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:01.301417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'deleted': False, 'project_id': 'c31c5cf7b0bb4342b6eebd57439ec7ee'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:01.307972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.308664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.311115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.311866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.387139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae07d701-31f8-4ef8-8bf6-377ccb6f21ae tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=7966f3d8fa06454ba3e7b879174509f6" status: 200 len: 15 microversion: 2.1 time: 0.102807 Jul 19 20:03:01.388640 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1802/3722] 10.222.0.33 () {58 vars in 1230 bytes} [Tue Jul 19 20:03:01 2022] GET /compute/v2.1/servers/detail?tenant_id=7966f3d8fa06454ba3e7b879174509f6 => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:01.405228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:01.406081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:01.425573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.429916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.432398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.436952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.592062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:01.605043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32b114b9-b90e-4ed6-8341-1eee9aac2676 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1493 microversion: 2.1 time: 1.521069 Jul 19 20:03:01.605822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1921/3723] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:00 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1493 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:01.611001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:01.625067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:01.632275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.633103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.634153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.635938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.006478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:02.015982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a1c6933-03c4-4145-8cd4-fe045a743859 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.615165 Jul 19 20:03:02.019855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1803/3724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:01 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:02.030207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:02.037316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'tenant_id': '7966f3d8fa06454ba3e7b879174509f6', 'deleted': False} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:02.043210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.045031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.046077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.047317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.064729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:02.088968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:02.143949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.144399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.534614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:02.548449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f38b263a-978e-40be-8388-55aeaa6cb3dc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1683 microversion: 2.1 time: 0.937570 Jul 19 20:03:02.548771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1922/3725] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:01 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1683 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:02.573172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:02.576766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:02.591106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.594907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.596445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.597684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.902920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b81f9404-fec6-4a40-b4a6-dcdc8715530a tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7966f3d8fa06454ba3e7b879174509f6" status: 200 len: 4826 microversion: 2.1 time: 0.878887 Jul 19 20:03:02.903799 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1804/3726] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 20:03:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7966f3d8fa06454ba3e7b879174509f6 => generated 4826 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:02.927768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6ae7ef46-7e60-48a0-8e9c-ac2cefd3451f req-57fc2bf5-cb25-448a-b78f-0e12fe85c051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002e370a-a19e-4c29-b942-1ce1e6f30a43", "name": "network-vif-unplugged", "status": "completed", "tag": "a25cb0d8-988c-4119-871d-1e350b72e36a"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:02.958146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6ae7ef46-7e60-48a0-8e9c-ac2cefd3451f req-57fc2bf5-cb25-448a-b78f-0e12fe85c051 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.959138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6ae7ef46-7e60-48a0-8e9c-ac2cefd3451f req-57fc2bf5-cb25-448a-b78f-0e12fe85c051 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.010977 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6ae7ef46-7e60-48a0-8e9c-ac2cefd3451f req-57fc2bf5-cb25-448a-b78f-0e12fe85c051 service nova] Creating event network-vif-unplugged:a25cb0d8-988c-4119-871d-1e350b72e36a for instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 on n-h2-843861-3 Jul 19 20:03:03.021518 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6ae7ef46-7e60-48a0-8e9c-ac2cefd3451f req-57fc2bf5-cb25-448a-b78f-0e12fe85c051 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114611 Jul 19 20:03:03.023418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1805/3727] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:03.032572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:03.033817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:03.048846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.049630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.050656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.051647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.203779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:03.214519 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5323a856-6eba-4577-89f0-0baaa4793957 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.650446 Jul 19 20:03:03.215140 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1923/3728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:02 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:03.227018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:03.232821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'tenant_id': 'c31c5cf7b0bb4342b6eebd57439ec7ee', 'deleted': False} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:03.255222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.255674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.256707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.257316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.341907 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e0979853-35a6-4f65-8645-50c8da6fa505 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c31c5cf7b0bb4342b6eebd57439ec7ee" status: 200 len: 15 microversion: 2.1 time: 0.125303 Jul 19 20:03:03.350817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:03.359746 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1924/3729] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 20:03:03 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c31c5cf7b0bb4342b6eebd57439ec7ee => generated 15 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:03.364780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:03.365401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:03.376357 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8134ed2b-7b30-4f5e-883e-0aca11907dd8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 200 len: 1451 microversion: 2.1 time: 0.349126 Jul 19 20:03:03.379066 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1806/3730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:03 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 1451 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:03.399833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.400588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.401792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.402452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.409414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-44e4e3fd-8327-4432-be28-c0576aa70cff req-e43ce135-65a0-4a90-a612-272adf2c0ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68504707-ef6d-499d-9866-1053528b89fb", "name": "network-vif-deleted", "tag": "1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:03.439214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-44e4e3fd-8327-4432-be28-c0576aa70cff req-e43ce135-65a0-4a90-a612-272adf2c0ad2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.440404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-44e4e3fd-8327-4432-be28-c0576aa70cff req-e43ce135-65a0-4a90-a612-272adf2c0ad2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.473700 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-44e4e3fd-8327-4432-be28-c0576aa70cff req-e43ce135-65a0-4a90-a612-272adf2c0ad2 service nova] Creating event network-vif-deleted:1c2197b3-e93d-4f3c-bbcd-2f7e6961bcbc for instance 68504707-ef6d-499d-9866-1053528b89fb on n-h1-843861-3 Jul 19 20:03:03.492441 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-44e4e3fd-8327-4432-be28-c0576aa70cff req-e43ce135-65a0-4a90-a612-272adf2c0ad2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105471 Jul 19 20:03:03.495188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1807/3731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:03.510523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfc5d1f2-67bc-487b-9e26-ce8644ae33dc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:03.524639 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfc5d1f2-67bc-487b-9e26-ce8644ae33dc tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.027714 Jul 19 20:03:03.527269 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1808/3732] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Jul 19 20:03:03 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:03.546606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:03.554399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:03.569678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:03.584943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.586654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.588633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.590059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.814753 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15583240-0820-4920-b682-7ffd24514085 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 0 microversion: 2.1 time: 0.273076 Jul 19 20:03:03.822950 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1809/3733] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:03 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:03.840885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:03.841126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:03.870126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.888805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.890359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:03.891042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.098270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:04.099123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:04.123667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf54a858-d9e0-44be-8224-7d3198e10501 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.760637 Jul 19 20:03:04.137098 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8bcc8f75-a932-4724-bdda-a81a9ee3086e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1615 microversion: 2.1 time: 0.298436 Jul 19 20:03:04.138684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1925/3734] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:03 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:04.152417 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1810/3735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:03 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1615 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:04.168001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:04.179950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:04.183089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7966f3d8fa06454ba3e7b879174509f6'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:04.190273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.191556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.193808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.194556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.230210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:04.274807 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8550b512-b3af-46da-929c-004ad42ffbb8 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.133127 Jul 19 20:03:04.276157 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1926/3736] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Jul 19 20:03:04 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:04.282426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:04.283817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:04.293448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.295164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.296447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.297141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.317956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-256e056c-0750-459c-8666-2314a42b1b90 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: .version_select at 0x7fb88ccba8b0>, body: {"keypair": {"name": "tempest-keypair-160017067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMviIe3mh0DkMq02B6Hf7WoDLJmSGsYd3E2UXKKlUzuynH3I3NPets65KHRsN3NFg9kzSSO6ybE5PlJM5UYGLoJqpzyUKuVeVCI6OHx7cY1OJdm0BnvBitOE34eVOwLrBg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:04.347572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-256e056c-0750-459c-8666-2314a42b1b90 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:04.355146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-256e056c-0750-459c-8666-2314a42b1b90 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for user 61fded06139c4a678720e043ef773dfa and project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:04.402815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-256e056c-0750-459c-8666-2314a42b1b90 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.248941 Jul 19 20:03:04.403775 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1811/3737] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 20:03:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:03:04.412476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:04.413628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:04.421805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.422284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.423127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.423573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.568352 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f831948-e0ff-4f01-918f-e2f1fefa34cd tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 0 microversion: 2.1 time: 0.163068 Jul 19 20:03:04.577430 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1812/3738] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:04 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:04.590971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:04.594852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:04.615953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.617138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.619543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.620105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.667705 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb HTTP/1.1 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '68504707-ef6d-499d-9866-1053528b89fb'} Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:04.674909 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:03:04.679707 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:04.683324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:04.688388 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-350eb42f-bf24-4f4c-be7d-87bff5b697c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 404 len: 111 microversion: 2.1 time: 0.108440 Jul 19 20:03:04.689240 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1813/3739] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:04 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:04.699193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:04.703019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:04.727161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.730737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.737979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.738883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:05.150588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:05.163350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:05.177287 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-367460f3-0e95-4d38-9995-320df0dc58e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.899453 Jul 19 20:03:05.179167 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1927/3740] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:05.184802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-137579521", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:05.274769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:05.277675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57a1ed39-7d57-42d4-b8f4-ee7145421168 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1614 microversion: 2.1 time: 0.587009 Jul 19 20:03:05.280689 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1814/3741] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:04 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1614 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:05.304732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:05.305671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:05.325462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:05.325857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:05.326664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:05.327106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:05.859462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:05.871188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0c9c475-fd62-4068-bd81-ddcd6bf4481f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.587755 Jul 19 20:03:05.871794 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1815/3742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:05 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:05.883117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:05.886291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:05.904561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:05.907353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:05.908448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:05.913244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.284852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:06.327469 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc93a8f8-fbbe-47a7-8b74-61de1c17a03a tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 200 len: 1615 microversion: 2.1 time: 0.436467 Jul 19 20:03:06.334747 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1816/3743] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:05 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 1615 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:06.352581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:06.354311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:06.376514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.377035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.381817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.382281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.437924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:06.439190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:06.439955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:06.440526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:06.441100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:06.482877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.486995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.490316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.490944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.560084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:06.578758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:06.636858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:06.649024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:06.807308 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66b22229-c959-4fae-94e4-9db44e6f029a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626350 Jul 19 20:03:06.808615 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1928/3744] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:03:06.817670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f06e4be-0dad-4bf3-8365-17929351bed7 req-baf16a0a-3422-456b-b32a-75a6156c47a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002e370a-a19e-4c29-b942-1ce1e6f30a43", "name": "network-vif-deleted", "tag": "a25cb0d8-988c-4119-871d-1e350b72e36a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:06.842832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f06e4be-0dad-4bf3-8365-17929351bed7 req-baf16a0a-3422-456b-b32a-75a6156c47a0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.843558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f06e4be-0dad-4bf3-8365-17929351bed7 req-baf16a0a-3422-456b-b32a-75a6156c47a0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.876132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f06e4be-0dad-4bf3-8365-17929351bed7 req-baf16a0a-3422-456b-b32a-75a6156c47a0 service nova] Creating event network-vif-deleted:a25cb0d8-988c-4119-871d-1e350b72e36a for instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 on n-h2-843861-3 Jul 19 20:03:06.882961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f06e4be-0dad-4bf3-8365-17929351bed7 req-baf16a0a-3422-456b-b32a-75a6156c47a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072363 Jul 19 20:03:06.884226 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1929/3745] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:06.899860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:06.901049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:06.911486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.912295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.913449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.914068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:07.372825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0fd2cb4-4674-4400-b64c-9791613155ed tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1614 microversion: 2.1 time: 1.032299 Jul 19 20:03:07.386542 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1817/3746] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:06 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1614 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:07.397333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:07.399675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1223244339", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0354c93-9b9a-4f78-8255-05762b29cd8d"}], "security_groups": [{"name": "tempest-securitygroup--80885436"}], "key_name": "tempest-keypair-160017067", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:07.408552 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1e6307b-2c1f-4124-86a7-14dca0f4a4d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.522698 Jul 19 20:03:07.410875 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1930/3747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:06 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:07.431945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6146a55-bdf1-4562-9ba4-2d88817eb63c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:07.434861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6146a55-bdf1-4562-9ba4-2d88817eb63c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:07.563034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6146a55-bdf1-4562-9ba4-2d88817eb63c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:07.582563 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6146a55-bdf1-4562-9ba4-2d88817eb63c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1214 microversion: 2.1 time: 0.169971 Jul 19 20:03:07.584114 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1931/3748] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:07 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:07.594038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:07.595347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:07.626276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:07.627126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:07.628647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:07.629364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:07.648803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] validate_networks() for [('a0354c93-9b9a-4f78-8255-05762b29cd8d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:08.109423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:08.124851 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e091b76-8817-4cc3-837e-88818200cb67 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 0.534385 Jul 19 20:03:08.125810 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1932/3749] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:07 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:08.138468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:08.139111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:08.172295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.172679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:08.173451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.173892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:08.269754 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 HTTP/1.1 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '002e370a-a19e-4c29-b942-1ce1e6f30a43'} Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:08.271880 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:08.278414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34801462-1b9e-4858-a03f-ad983d8bcd14 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 404 len: 111 microversion: 2.1 time: 0.145824 Jul 19 20:03:08.287964 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1933/3750] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:08 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:08.304328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:08.321193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'host': 'n-h1-843861-3', 'deleted': False} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:08.334782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.339271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:08.340560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.341149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:08.612351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:08.772488 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a779e15-b7ac-45b4-ac71-46fe846a32ba tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=n-h1-843861-3&all_tenants=1" status: 200 len: 1324 microversion: 2.1 time: 0.483153 Jul 19 20:03:08.773501 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1934/3751] 10.222.0.33 () {58 vars in 1189 bytes} [Tue Jul 19 20:03:08 2022] GET /compute/v2.1/servers?host=n-h1-843861-3&all_tenants=1 => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:08.781690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ab2e4dab-d01c-4d02-ad2b-cce2df8921d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '.version_select at 0x7fb88cf6dc10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:08.817689 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ab2e4dab-d01c-4d02-ad2b-cce2df8921d4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135082571" status: 202 len: 0 microversion: 2.1 time: 0.042941 Jul 19 20:03:08.819073 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1935/3752] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135082571 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:08.829795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:08.830753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:08.847265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.848234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:08.849411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:08.850099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.286719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:09.301007 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94614aee-44c8-469b-96a5-555979f27df6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.480468 Jul 19 20:03:09.302038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1936/3753] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:09.307837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-eecce287-9e4e-41c4-96e2-ffe7fd685b21 req-3cd50643-b83a-42f2-b670-7ff250f8d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b02d83-7482-4c78-85b6-2c7622bf435b", "name": "network-vif-plugged", "status": "completed", "tag": "0a26caf0-8602-4c67-9329-a95d4a5f305a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:09.337099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-eecce287-9e4e-41c4-96e2-ffe7fd685b21 req-3cd50643-b83a-42f2-b670-7ff250f8d069 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.337552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-eecce287-9e4e-41c4-96e2-ffe7fd685b21 req-3cd50643-b83a-42f2-b670-7ff250f8d069 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.370457 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-eecce287-9e4e-41c4-96e2-ffe7fd685b21 req-3cd50643-b83a-42f2-b670-7ff250f8d069 service nova] Creating event network-vif-plugged:0a26caf0-8602-4c67-9329-a95d4a5f305a for instance f5b02d83-7482-4c78-85b6-2c7622bf435b on n-h2-843861-3 Jul 19 20:03:09.381626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-eecce287-9e4e-41c4-96e2-ffe7fd685b21 req-3cd50643-b83a-42f2-b670-7ff250f8d069 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077837 Jul 19 20:03:09.382755 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1937/3754] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:09.389266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:09.397617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:09.413054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.413846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.414841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.415489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.500657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:09.501817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:09.502553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:09.503719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:09.504407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:09.529159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.530025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.531103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.531778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.581386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:09.588121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for user 61fded06139c4a678720e043ef773dfa and project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:09.622371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:09.637522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:09.670676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:09.683236 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3df4f501-023c-4d7b-ac64-8ab57dcc3138 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1272 microversion: 2.1 time: 0.297800 Jul 19 20:03:09.686182 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1938/3755] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:09 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:09.697402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:09.703436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:09.725537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.733573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.734540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.740879 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea55966b-aca7-4709-826a-2e7ddf6681f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.352445 Jul 19 20:03:09.741204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.746723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1818/3756] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:03:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:03:09.752266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:09.752896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:09.781698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.782148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.782960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:09.783408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.823550 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71164a98-2f8a-4b24-a416-e57916e4d0d7 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.132904 Jul 19 20:03:09.827369 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1939/3757] 10.222.0.33 () {58 vars in 1195 bytes} [Tue Jul 19 20:03:09 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:09.849671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:09.854419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.337258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:10.346734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:10.348331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:10.357301 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4fe99b5a-67f4-432b-8140-009ef9aded7b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1281 microversion: 2.20 time: 0.520982 Jul 19 20:03:10.359887 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1940/3758] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:09 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1281 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:10.375386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:10.378594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.386902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:10.390331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.391271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.393765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.394419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.580974 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a82bac69-f395-4fb1-a87a-f8f5d50e842b tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 0 microversion: 2.1 time: 0.212891 Jul 19 20:03:10.582220 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1941/3759] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:10 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:10.589398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:10.589857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.600449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.600948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.602004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.602448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.808883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:10.836479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ca8c68d-969e-4d1b-b0ad-8fe8b478f30c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 1.086858 Jul 19 20:03:10.837994 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1819/3760] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:09 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:10.860750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:10.876547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.926182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.927278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.930674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.932570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.116606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:11.120216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:11.120881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:11.124910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:11.125491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:11.186597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:11.209485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.224688 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c4191a6-27d4-4e9b-806b-8e5172f5c44e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.638148 Jul 19 20:03:11.227916 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1942/3761] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:10 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:11.252221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.255188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:11.259330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.267882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.268791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.269737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.270520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.298113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.298620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.299464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.299928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.314433 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe69d4fd-d63d-4097-8cad-45f31f09f43e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 1067 microversion: 2.1 time: 0.474376 Jul 19 20:03:11.316041 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1820/3762] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:10 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 1067 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 20:03:11.322619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4942fc30-8708-49dd-bef1-044a990dcfdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: .version_select at 0x7fb88cc46040>, body: {"keypair": {"name": "tempest-keypair-498481739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAG3vUbTQuyr+XfcxXKsEUcWsO8Ds1cdhrdgyU6X0JpQOhrb9Wn7ZLQSYIPONJJGU3uKOQ/RQZ2VG/rfEuYAfYEfeivxQXv/fJ4mFPrqtEYFcJ2Owl7LJF8QSqkSQbs5Rg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:11.346480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4942fc30-8708-49dd-bef1-044a990dcfdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:11.353993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-4942fc30-8708-49dd-bef1-044a990dcfdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:11.384273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4942fc30-8708-49dd-bef1-044a990dcfdb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066595 Jul 19 20:03:11.385210 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1821/3763] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:03:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:11.392058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:11.393513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.402200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.402907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.403728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.404339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.462907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.473044 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0684326e-db56-4e8b-a6ac-d5d86221a6c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1272 microversion: 2.1 time: 0.243045 Jul 19 20:03:11.474042 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1943/3764] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:11 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:11.479234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:11.480130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.492479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.493905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.514797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.515266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.751779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.767477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.769259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.774368 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af3af4a2-2c22-490b-bc76-644d7f6b84ab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1333 microversion: 2.20 time: 0.298830 Jul 19 20:03:11.775075 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1944/3765] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:11 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1333 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:11.858016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:11.859512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.891313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.894370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.897593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.898052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.207442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:12.235296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1c848aa-b45d-4e2c-bfde-186cb0e892c4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.843266 Jul 19 20:03:12.236416 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1822/3766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:11 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:12.242297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3ad5ef65-e3b2-4002-9f3f-c03c4573dff1 req-c98df50c-09d2-45e0-9c89-fa3fe4460f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da64c1b-1851-4629-ac18-9c6447163256", "name": "network-vif-plugged", "status": "completed", "tag": "04b336f4-05b8-4803-8c01-a20e72b5bf49"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:12.260544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3ad5ef65-e3b2-4002-9f3f-c03c4573dff1 req-c98df50c-09d2-45e0-9c89-fa3fe4460f58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.277025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3ad5ef65-e3b2-4002-9f3f-c03c4573dff1 req-c98df50c-09d2-45e0-9c89-fa3fe4460f58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.319440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3ad5ef65-e3b2-4002-9f3f-c03c4573dff1 req-c98df50c-09d2-45e0-9c89-fa3fe4460f58 service nova] Creating event network-vif-plugged:04b336f4-05b8-4803-8c01-a20e72b5bf49 for instance 4da64c1b-1851-4629-ac18-9c6447163256 on n-h2-843861-3 Jul 19 20:03:12.334763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3ad5ef65-e3b2-4002-9f3f-c03c4573dff1 req-c98df50c-09d2-45e0-9c89-fa3fe4460f58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096584 Jul 19 20:03:12.336025 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1823/3767] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:12.358438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:12.359545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:12.369836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.370704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.374255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.375049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.869595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:12.886438 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58d71f4e-3214-40aa-8b38-fc67459ae57f tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1323 microversion: 2.1 time: 1.035528 Jul 19 20:03:12.911008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1945/3768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:11 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1323 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:12.921097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:12.928739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:12.950593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.951320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.954630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.955169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.349217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.358541 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ad39ac6-5e40-4a99-878b-3e58c17a449d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1656 microversion: 2.1 time: 1.020992 Jul 19 20:03:13.364005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1824/3769] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:12 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1656 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:13.375660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:13.376352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:13.387945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:13.388405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.389201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:13.390037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.543259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.560477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.562532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.563917 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-53bd59da-6981-452a-872e-2fdfabf00eb8 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1339 microversion: 2.20 time: 0.198782 Jul 19 20:03:13.575222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1825/3770] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:13 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1339 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:13.581076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:13.581898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:13.589769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:13.590465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.592143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:13.592812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.617842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.631937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-daab9bcd-c6be-443e-94ec-3c01c438b4c4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.719099 Jul 19 20:03:13.633095 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1946/3771] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:12 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:13.642173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f9364a7-ca03-4bd5-ae07-2750cea43dce tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:13.661152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f9364a7-ca03-4bd5-ae07-2750cea43dce tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:13.661658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f9364a7-ca03-4bd5-ae07-2750cea43dce tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.709923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f9364a7-ca03-4bd5-ae07-2750cea43dce tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Going to try to start instance {{(pid=126008) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:03:13.768230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:13.778112 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f9364a7-ca03-4bd5-ae07-2750cea43dce tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.142697 Jul 19 20:03:13.780054 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1947/3772] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:13 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:14.001499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2035038858", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "e5173230-cf0e-480c-873a-5eca92d8e2eb"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:14.085463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:14.100715 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-92d138d2-09b1-467f-8dcd-ca7b2e9c10a6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.521500 Jul 19 20:03:14.115071 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1826/3773] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:13 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:14.130951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] validate_networks() for [('e5173230-cf0e-480c-873a-5eca92d8e2eb', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:14.135542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:14.136113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:14.149001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.149464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:14.150300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.150743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:14.805196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:14.822416 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09953679-dd93-4153-b364-6c89d40230fb tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1665 microversion: 2.1 time: 0.705904 Jul 19 20:03:14.824188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1827/3774] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:14 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1665 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:14.830791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:14.832828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:14.844195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.845789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:14.847224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.848330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.258518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:15.274547 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0812e747-1b27-4ebc-9183-d4390d365688 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1517 microversion: 2.1 time: 0.447622 Jul 19 20:03:15.276225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1828/3775] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:14 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1517 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:15.288934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:15.289589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:15.290695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:15.290695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:15.290695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:15.296939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:15.299218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:15.305946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.306461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.307177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.307620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.315991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.319389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.322423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.323173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.348146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Getting quotas for project c5cb476af397438b90dece4eb04e31ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:15.362594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Getting quotas for user fcce70e1a2bb41a9bca19e0a1d30e87d and project c5cb476af397438b90dece4eb04e31ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:15.446574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:15.449210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:15.521739 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0eb7c162-5d8f-4b19-a068-febfe5a4df1f tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740037 Jul 19 20:03:15.523119 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1948/3776] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:03:15.529115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:15.530181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:15.561834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.562975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.564631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.565650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.837878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:15.855633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:15.876329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:15.880253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48e9622f-15d6-40f2-a010-259566f6a6b5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1405 microversion: 2.20 time: 0.599637 Jul 19 20:03:15.882188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1829/3777] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:15 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1405 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:15.895207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:15.896799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:15.917666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.919278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.920993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:15.933670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:16.408278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:16.416836 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-949f2a44-9b76-4a2b-aa1c-fe0e7dbfa7ca tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.892285 Jul 19 20:03:16.417436 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1949/3778] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:15 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:16.437659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:16.438290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:16.469475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:16.470253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:16.471535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:16.472257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.243036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.271162 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ee3b109-df46-4c50-9467-12e31d4d3cb4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 1.385618 Jul 19 20:03:17.273984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1830/3779] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:15 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:17.297089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b463c5bd-f886-43bc-aa40-dd2dd1917be3 req-8405ca58-168b-4a3d-b4da-b38388cf953d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728a3bd3-b439-43df-8f1c-09e2a7d34b8a", "tag": "a91ade39-aa57-4deb-9731-81be7469fc34"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:17.317482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b463c5bd-f886-43bc-aa40-dd2dd1917be3 req-8405ca58-168b-4a3d-b4da-b38388cf953d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.324205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b463c5bd-f886-43bc-aa40-dd2dd1917be3 req-8405ca58-168b-4a3d-b4da-b38388cf953d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.351479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b463c5bd-f886-43bc-aa40-dd2dd1917be3 req-8405ca58-168b-4a3d-b4da-b38388cf953d service nova] Creating event network-changed:a91ade39-aa57-4deb-9731-81be7469fc34 for instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a on n-h2-843861-3 Jul 19 20:03:17.378221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b463c5bd-f886-43bc-aa40-dd2dd1917be3 req-8405ca58-168b-4a3d-b4da-b38388cf953d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089960 Jul 19 20:03:17.378991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1831/3780] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:17.389330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:17.391095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:17.400499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.400955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.401757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.402194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.415202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.427978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d48f476e-ff43-4d08-8278-aaeba0099fcc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 200 len: 1516 microversion: 2.1 time: 0.994740 Jul 19 20:03:17.442235 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1950/3781] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:16 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 1516 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:17.442235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:17.442235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:17.461441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.461441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.461441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.462038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.536277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.548984 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f084c73-b9f8-40bb-9227-74c523f4fb50 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1277 microversion: 2.1 time: 0.167049 Jul 19 20:03:17.559191 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1832/3782] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:17 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:17.574450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-92ff5e6f-e7c6-4e3d-b586-402fbd569c69 req-c7fdb99f-3804-423e-a12d-2b3539863d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:17.583971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-92ff5e6f-e7c6-4e3d-b586-402fbd569c69 req-c7fdb99f-3804-423e-a12d-2b3539863d70 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.584715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-92ff5e6f-e7c6-4e3d-b586-402fbd569c69 req-c7fdb99f-3804-423e-a12d-2b3539863d70 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.599671 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-92ff5e6f-e7c6-4e3d-b586-402fbd569c69 req-c7fdb99f-3804-423e-a12d-2b3539863d70 service nova] Creating event network-changed:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:03:17.609750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-92ff5e6f-e7c6-4e3d-b586-402fbd569c69 req-c7fdb99f-3804-423e-a12d-2b3539863d70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048329 Jul 19 20:03:17.610721 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1833/3783] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:17.616247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:17.616952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:17.638983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.639433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.642754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.643273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.865164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.892797 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54c99a64-d743-4849-9780-4f7406af2db3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.449064 Jul 19 20:03:17.898187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1951/3784] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:17 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:17.908949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:17.909582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:17.929598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.933523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.937853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.939193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.940889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.956895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.958454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.959616 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c523508-470d-4fe7-95a3-bb5f49c51f34 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1405 microversion: 2.20 time: 0.347776 Jul 19 20:03:17.960658 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1834/3785] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:17 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:17.966335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:17.967289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:17.977421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.982240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:17.996889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:17.997617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.161476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:18.176367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff7b2d7f-7938-4300-adc2-b438197c2a27 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.276364 Jul 19 20:03:18.176970 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1952/3786] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:17 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.191466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.192066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.204576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.205274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.206500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.207134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.293457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:18.301423 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45d77790-c5f3-4b4f-9db4-b219230b920c tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1516 microversion: 2.1 time: 0.339405 Jul 19 20:03:18.302790 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1835/3787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:17 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.308206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.309064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.315719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.316482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.317467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.318367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.427321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:18.443479 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8daa40e4-b912-46f3-acad-ccea3ee3c019 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.254904 Jul 19 20:03:18.443836 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1953/3788] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:18 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.449404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.451016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.459662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.460528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.461559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.462231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.491964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:18.495751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:18.500281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff7d5283-672a-4b0a-8fb9-a3f2af8304d6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.195968 Jul 19 20:03:18.500875 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1836/3789] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:18 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.506226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1895665723", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81"}], "security_groups": [{"name": "tempest-securitygroup--1588297040"}], "key_name": "tempest-keypair-498481739", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:18.635751 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95731281-fa65-44c9-8258-fc0923adacc7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 204 len: 0 microversion: 2.1 time: 0.189867 Jul 19 20:03:18.638191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1954/3790] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:18 2022] DELETE /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:18.645081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:18.645993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.652474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] validate_networks() for [('dd438ba3-f7fe-4cdb-8faa-4c644d8c8c81', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:18.656579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.657328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.658550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.659527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.728236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Unlocking {{(pid=126008) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 20:03:18.830393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd1e57b0-3b3b-431e-a38b-99290c725dbe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.190491 Jul 19 20:03:18.831315 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1955/3791] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:18 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:18.836800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.837554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.844663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.845359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.846144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.846581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.923571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:18.931388 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b8f1d02-4357-4d03-b711-37956bab5211 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1295 microversion: 2.1 time: 0.098752 Jul 19 20:03:18.932094 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1956/3792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:18 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.936817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.937427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.943821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.944289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.945060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.945493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.203273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:19.212133 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4fbb5e43-361b-423b-a260-09a07a04e6bc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1522 microversion: 2.1 time: 0.278869 Jul 19 20:03:19.213030 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1957/3793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:18 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:19.224152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:19.224786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:19.238189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.238759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.239790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.240348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.266047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:19.266467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:19.266934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:19.267436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:19.268094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:19.270501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:19.280690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.281146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.281958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.282768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.303326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:19.310867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Getting quotas for user 1144c1c606c74f598f317b909f472d8d and project ff66dd692865486cae57a1315821ddab. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:19.326857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:19.330352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:19.386701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b46bd8d-55bc-4e9a-a28a-66d061c04b90 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.884197 Jul 19 20:03:19.395115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1837/3794] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:03:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:03:19.400443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:19.401519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:19.409233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.409778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.410644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.411159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.465186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:19.474109 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6168cda2-0b14-42f9-9837-d973ddfd90d6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.259691 Jul 19 20:03:19.480037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1958/3795] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:19 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:19.481396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:19.482025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:19.495326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.496095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.497512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:19.504994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.848487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:19.877790 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5bbbeca6-197c-4176-bd94-c045a4c48ecf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.401301 Jul 19 20:03:19.887091 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1959/3796] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:19 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:19.892435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f8588040-aabd-4da6-a95c-f213ae7e3a23 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:19.893050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f8588040-aabd-4da6-a95c-f213ae7e3a23 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:19.997542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f8588040-aabd-4da6-a95c-f213ae7e3a23 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.006994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.008121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f8588040-aabd-4da6-a95c-f213ae7e3a23 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1241 microversion: 2.1 time: 0.125775 Jul 19 20:03:20.018830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1960/3797] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:19 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.024087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.026673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.028980 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-653ef8ac-fd17-4e82-8a59-010a58be89c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1405 microversion: 2.20 time: 0.631855 Jul 19 20:03:20.030516 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1838/3798] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:19 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1405 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:20.031961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.032727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.042961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.044443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.045279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.045832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.048246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.049677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.058355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.058931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.060527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.061484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.306040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.315485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dcf3d082-8300-428b-986d-0d802f433bf0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.291039 Jul 19 20:03:20.316410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1961/3799] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.321424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.322037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.328542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.329276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.330246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.330860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.336177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:20.343943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.359733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55ac286c-3047-406e-b703-74780cb083b3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.327298 Jul 19 20:03:20.361131 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1839/3800] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.368085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.369125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.379321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.380677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.382913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.384043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.393270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:20.421102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.430086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6dacab72-f797-47c0-babf-edcc37e555ed tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1295 microversion: 2.1 time: 0.112408 Jul 19 20:03:20.430713 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1962/3801] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.435497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.436132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.446235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.446681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.448618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.449689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.656232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.670183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d039486-284a-4c88-83ab-23077581d818 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1522 microversion: 2.1 time: 0.306963 Jul 19 20:03:20.670755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:20.671456 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1840/3802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.679975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-344e96ce-477a-4302-aef0-24c6a9e30f2f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.248153 Jul 19 20:03:20.680571 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1963/3803] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.699155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:20.699704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.706726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.707193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.708037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.708484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.799241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff8fbf5f-2bb0-4a34-9200-73625c922a1f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.103633 Jul 19 20:03:20.800290 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1841/3804] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:20 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:03:20.815449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.816499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.827824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.828935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.830761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.833623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.895742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.896487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.905297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.906283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.907230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.907912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.121256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.135732 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d7232922-c753-4a7d-bbba-fb6806b5520a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1674 microversion: 2.1 time: 0.324349 Jul 19 20:03:21.138433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1964/3805] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1674 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:21.147400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.149210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.160738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.162101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.164228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.172375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.231026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.256625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1222f804-a935-4c9a-9687-fed3e2fb7739 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.365123 Jul 19 20:03:21.262126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1842/3806] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:21.272821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.273991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.283219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.283711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.284751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.285458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.302185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.315038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a719f77-78a6-4fcd-8849-0b80e9f24160 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1301 microversion: 2.1 time: 0.174355 Jul 19 20:03:21.316036 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1965/3807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:21.380723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.381552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.391256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.391986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.393049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.394199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.609894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.632420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.645970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.648222 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f7b3e99-cc2e-421d-b009-f40b4371a932 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1405 microversion: 2.20 time: 0.385473 Jul 19 20:03:21.666756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1843/3808] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:21.681729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.683496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.695257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.696087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.697985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.698635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.764040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.803235 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-395a4aa3-20a9-44be-8f57-c8c3d4346ea1 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.428563 Jul 19 20:03:21.805521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1966/3809] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:21.814364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-979c778e-a303-4f94-99f7-5ea8664afb4b req-2f258ae4-b84d-4aa1-9601-58cd66e33c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "name": "network-vif-plugged", "status": "completed", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:21.836835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-979c778e-a303-4f94-99f7-5ea8664afb4b req-2f258ae4-b84d-4aa1-9601-58cd66e33c82 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.838130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-979c778e-a303-4f94-99f7-5ea8664afb4b req-2f258ae4-b84d-4aa1-9601-58cd66e33c82 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.845298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.860750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4df4332-3a54-46b5-8fd6-b87a424d26ca tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1283 microversion: 2.1 time: 0.191990 Jul 19 20:03:21.862207 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1844/3810] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:21.868410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-979c778e-a303-4f94-99f7-5ea8664afb4b req-2f258ae4-b84d-4aa1-9601-58cd66e33c82 service nova] Creating event network-vif-plugged:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:03:21.871429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.872659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.881987 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-979c778e-a303-4f94-99f7-5ea8664afb4b req-2f258ae4-b84d-4aa1-9601-58cd66e33c82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074087 Jul 19 20:03:21.884027 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1967/3811] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:21.885632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.886625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.888191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.888637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.157117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.158663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.166924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.168263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.169484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.170057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.297280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:22.322246 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb04d89f-190b-41db-8866-0abec7136596 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1522 microversion: 2.1 time: 0.457328 Jul 19 20:03:22.340174 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1845/3812] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:22.347840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.348569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.362472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.362953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.364492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.365177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.538681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:22.552063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fe58c1b-f79d-4e8a-b788-dc85eb02cc02 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1674 microversion: 2.1 time: 0.400502 Jul 19 20:03:22.554248 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1968/3813] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1674 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:22.563745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.564968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.574242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.574929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.576403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.577329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.725845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:22.745447 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d18a12d3-67bf-4cae-8e0a-a9590c256c3e tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1299 microversion: 2.1 time: 0.188993 Jul 19 20:03:22.747696 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1969/3814] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:22.753710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.754649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.763776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.765071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.766349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.766490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.814696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:22.826687 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1843607a-1864-45d9-b061-e7f722fdf9e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.485128 Jul 19 20:03:22.827756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1846/3815] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:22.833814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.834825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.841865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.842374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.843252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.843773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.313578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.324251 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-379fbdab-8d2c-4126-b943-e8a85baf98d0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.494955 Jul 19 20:03:23.328326 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1847/3816] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:23.337794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.346087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:23.347008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:23.352627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.356509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:23.357271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.357426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.358658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63648162-4728-4e88-906a-22b149980fb7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1405 microversion: 2.20 time: 0.609636 Jul 19 20:03:23.365285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1970/3817] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1405 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:23.369987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:23.370670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:23.371192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.371332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:23.385364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:23.385886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.386730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:23.387224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.932713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.953253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46b749a8-a5b7-4b20-91b2-e193b562263e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.612993 Jul 19 20:03:23.953854 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1848/3818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:23 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:23.968323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:23.973541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:23.977062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.992783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:23.993507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.994593 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31b5aa8c-bc40-423e-b001-5b4774588ab7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1522 microversion: 2.1 time: 0.627769 Jul 19 20:03:24.005757 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1971/3819] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:23 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:24.006861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.012004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.013492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:24.014872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:24.044795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.045572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.046825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.047614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.530501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:24.553007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74afa95e-b555-4c50-94c5-80492cfcdcc0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1654 microversion: 2.1 time: 0.596752 Jul 19 20:03:24.555394 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1849/3820] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:23 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1654 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:24.572713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:24.573415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:24.585478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.585943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.596034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.598981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.616815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:24.642505 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5cd78474-2754-4f37-adad-aa1736845043 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.635072 Jul 19 20:03:24.648774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1972/3821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:24 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:24.660478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dc3511d2-4562-4c2c-9a51-07da082b703a req-f7532053-1fd1-4935-9957-94c7a25cd660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3505c608-f387-4a2c-af0a-8c7587c83bb0", "tag": "6d3bbfad-0caa-4ab9-b7ec-528292afbcfe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:24.690674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc3511d2-4562-4c2c-9a51-07da082b703a req-f7532053-1fd1-4935-9957-94c7a25cd660 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.691249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dc3511d2-4562-4c2c-9a51-07da082b703a req-f7532053-1fd1-4935-9957-94c7a25cd660 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.719051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dc3511d2-4562-4c2c-9a51-07da082b703a req-f7532053-1fd1-4935-9957-94c7a25cd660 service nova] Creating event network-changed:6d3bbfad-0caa-4ab9-b7ec-528292afbcfe for instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 on n-h2-843861-3 Jul 19 20:03:24.727585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dc3511d2-4562-4c2c-9a51-07da082b703a req-f7532053-1fd1-4935-9957-94c7a25cd660 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076039 Jul 19 20:03:24.734182 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1973/3822] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:24.750067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:24.751366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:24.770486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.770949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.771754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.772290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.321120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=14 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:25.614674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.623743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.631401 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4edf60b-e95f-4cd7-89ee-e80f9e40c76d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 1.074373 Jul 19 20:03:25.635203 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1850/3823] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:24 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:25.639271 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad6733c4-0df5-415a-b749-7bc4b3016dfa tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.903006 Jul 19 20:03:25.641228 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1974/3824] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:24 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:25.654308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:25.655029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:25.656680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.657089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.669126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.669371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.669770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.670258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.671027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.671572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.671787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.672520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.785576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b27a16b-4db2-426d-93a3-1dde278e1b5f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.141720 Jul 19 20:03:25.786591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1975/3825] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:25 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:25.797541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:25.798286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.805745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.806204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.807043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.807485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.949193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.962865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.967341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.972484 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26d26b8a-4543-4e53-a2da-3cc5a79e3824 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1597 microversion: 2.20 time: 0.333440 Jul 19 20:03:25.975432 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1851/3826] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:03:25 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1597 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:03:25.983332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:25.986348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.998516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.999460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.001219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.002217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.048530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.056960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d12bfa4d-5f00-4171-9612-20a3d54997d4 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.268954 Jul 19 20:03:26.057561 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1976/3827] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:25 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:26.062739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-32eae7c2-3f2d-4e1e-9566-9fe640e413d3 req-358bba1f-410f-4ce8-b045-2c4cc037661c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b02d83-7482-4c78-85b6-2c7622bf435b", "name": "network-vif-deleted", "tag": "0a26caf0-8602-4c67-9329-a95d4a5f305a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:26.063427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.064044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.064760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lazy-loading 'fault' on Instance uuid f5b02d83-7482-4c78-85b6-2c7622bf435b {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:26.072697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32eae7c2-3f2d-4e1e-9566-9fe640e413d3 req-358bba1f-410f-4ce8-b045-2c4cc037661c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.073142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-32eae7c2-3f2d-4e1e-9566-9fe640e413d3 req-358bba1f-410f-4ce8-b045-2c4cc037661c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.092023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-32eae7c2-3f2d-4e1e-9566-9fe640e413d3 req-358bba1f-410f-4ce8-b045-2c4cc037661c service nova] Creating event network-vif-deleted:0a26caf0-8602-4c67-9329-a95d4a5f305a for instance f5b02d83-7482-4c78-85b6-2c7622bf435b on n-h2-843861-3 Jul 19 20:03:26.101882 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-32eae7c2-3f2d-4e1e-9566-9fe640e413d3 req-358bba1f-410f-4ce8-b045-2c4cc037661c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042146 Jul 19 20:03:26.102901 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1977/3828] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:26.113136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.114418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.124086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.124394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.125484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.125934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.126920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.135651 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d127483-09ee-476c-8691-6bdb65f6a9a2 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1313 microversion: 2.1 time: 0.158426 Jul 19 20:03:26.141623 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1852/3829] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:25 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:26.144760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.145643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.154759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.155552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.156389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.156831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.374864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.378374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.385842 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b6a24f4d-fdef-4c2c-b467-c2f530e25763 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.281051 Jul 19 20:03:26.386496 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1978/3830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:26.388824 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c645a2c-3d54-491b-9020-2f3c900e2ebf tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1661 microversion: 2.1 time: 0.248754 Jul 19 20:03:26.390314 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1853/3831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1661 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:26.393988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.394650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.398239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-34d7f8c7-210f-4dae-b74e-123d3c9b3f47 req-fd8184d5-4aa5-45d9-aa41-d430b9969041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728a3bd3-b439-43df-8f1c-09e2a7d34b8a", "name": "network-vif-plugged", "status": "completed", "tag": "a91ade39-aa57-4deb-9731-81be7469fc34"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:26.402615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.403817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.404739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.405181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.413169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-34d7f8c7-210f-4dae-b74e-123d3c9b3f47 req-fd8184d5-4aa5-45d9-aa41-d430b9969041 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.413954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-34d7f8c7-210f-4dae-b74e-123d3c9b3f47 req-fd8184d5-4aa5-45d9-aa41-d430b9969041 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.430286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-34d7f8c7-210f-4dae-b74e-123d3c9b3f47 req-fd8184d5-4aa5-45d9-aa41-d430b9969041 service nova] Creating event network-vif-plugged:a91ade39-aa57-4deb-9731-81be7469fc34 for instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a on n-h2-843861-3 Jul 19 20:03:26.435570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-34d7f8c7-210f-4dae-b74e-123d3c9b3f47 req-fd8184d5-4aa5-45d9-aa41-d430b9969041 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043729 Jul 19 20:03:26.436506 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1854/3832] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:26.523508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48a62c12-c5d3-4454-b3d8-909ed68df6af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134917 Jul 19 20:03:26.524169 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1979/3833] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:03:26.663424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.664745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.665479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.665687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.668966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:26.674837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.675400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.676543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.677175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.677351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.677967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.679206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.680261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.688196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:26.978121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.985886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.987561 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c8b0052-3ecf-456b-8a65-58afe1f6c2ab tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.327173 Jul 19 20:03:26.991427 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1980/3834] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:26.996007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b7c428b4-0586-4c43-b01a-88b747b228b0 req-abcb3860-1498-4cd4-8028-bdd22e5425ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4700e5f4-0c76-49de-a895-07b0a44bc11c", "tag": "77d9bdac-8f2c-4c64-9c35-8d35a3189ab9"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:26.998386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce804b6c-1172-47d2-8f89-614e28caaf85 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.341961 Jul 19 20:03:27.001114 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1855/3835] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:27.010261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b7c428b4-0586-4c43-b01a-88b747b228b0 req-abcb3860-1498-4cd4-8028-bdd22e5425ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.011570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b7c428b4-0586-4c43-b01a-88b747b228b0 req-abcb3860-1498-4cd4-8028-bdd22e5425ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.033795 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b7c428b4-0586-4c43-b01a-88b747b228b0 req-abcb3860-1498-4cd4-8028-bdd22e5425ce service nova] Creating event network-changed:77d9bdac-8f2c-4c64-9c35-8d35a3189ab9 for instance 4700e5f4-0c76-49de-a895-07b0a44bc11c on n-h1-843861-3 Jul 19 20:03:27.041936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b7c428b4-0586-4c43-b01a-88b747b228b0 req-abcb3860-1498-4cd4-8028-bdd22e5425ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050491 Jul 19 20:03:27.043072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1981/3836] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:27.079842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:27.080899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:27.101941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.102500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.103386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.103854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.108890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:27.174232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:27.185793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:27.202880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.203732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.205291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.206093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.283565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.284863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.285722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lazy-loading 'fault' on Instance uuid f5b02d83-7482-4c78-85b6-2c7622bf435b {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:27.372635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.385968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d22ec4b6-17a1-42ee-b0e6-0f9a61b87a57 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.314382 Jul 19 20:03:27.387505 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1856/3837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:27 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:27.394694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.407911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:27.408592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:27.411176 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f181ed06-f013-439a-a2a4-1218caf2a9f4 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1313 microversion: 2.1 time: 0.245633 Jul 19 20:03:27.413276 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1982/3838] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:27 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:27.422728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:27.423383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:27.425283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.426001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.426942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.427536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.434780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.435637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.437133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.438312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.822675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.827671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.839651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6914688-bc25-466d-bf65-3c94fde93b2a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1661 microversion: 2.1 time: 0.424694 Jul 19 20:03:27.841474 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1983/3839] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:27 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1661 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:27.842074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a90d297-f610-4c24-8c42-b29c809410fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.437759 Jul 19 20:03:27.842948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1857/3840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:27 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.014969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.016127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.024565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.024940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.025738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.026117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.030665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.036789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.052127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.053748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.056342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.057309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.335064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:28.347011 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0bec52e-6314-4f75-96bd-38de3404ee85 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1471 microversion: 2.1 time: 0.338210 Jul 19 20:03:28.349831 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1984/3841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.360518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:28.373150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-53abe44c-9b72-4500-8ab8-a9ada346c041 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.351564 Jul 19 20:03:28.373941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1858/3842] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:28.408186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.409326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.420720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.421587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.423023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.423839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.433157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.433888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.441749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.442678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.444220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.445091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.517490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.518320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.519542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lazy-loading 'fault' on Instance uuid f5b02d83-7482-4c78-85b6-2c7622bf435b {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:28.591404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:28.604447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7541113e-e7a8-405f-9e61-07fec15a73a7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 200 len: 1313 microversion: 2.1 time: 0.175292 Jul 19 20:03:28.607118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1859/3843] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.678426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:28.695513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11c2a971-7a66-4625-8932-5838784a7b2e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.291880 Jul 19 20:03:28.696785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1985/3844] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.866094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.869919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.878679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.882858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.908565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.912199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.917475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.917952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.919836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.920461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.920658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.921590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.296819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:29.321447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=22 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:29.569795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:29.584357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:29.585934 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d598884-9249-4f85-b075-26d3cb4ad766 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.722540 Jul 19 20:03:29.587556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1860/3845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:29.601815 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-666de2d7-3378-47ae-a124-461f580ba9c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1661 microversion: 2.1 time: 0.741890 Jul 19 20:03:29.611858 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1986/3846] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1661 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:29.611858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.611858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.612385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.612385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.620589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.621050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.621873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.622321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.625443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.625984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.629608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.630167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.860930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:29.872419 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a37467a-27ee-4d8c-a28e-e2d54c925637 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.267657 Jul 19 20:03:29.872948 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1987/3847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:29.876906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:29.877599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ee05e35a-a798-4dc4-9438-a9b922100209 req-0ca2a943-a00e-491c-922c-1191de65dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:29.890379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-283caad4-886d-4c00-a616-923cb646556b tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1477 microversion: 2.1 time: 0.300783 Jul 19 20:03:29.892198 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1861/3848] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:29.899836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.900887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.904620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ee05e35a-a798-4dc4-9438-a9b922100209 req-0ca2a943-a00e-491c-922c-1191de65dc42 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.905180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ee05e35a-a798-4dc4-9438-a9b922100209 req-0ca2a943-a00e-491c-922c-1191de65dc42 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.910854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.912050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.923791 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ee05e35a-a798-4dc4-9438-a9b922100209 req-0ca2a943-a00e-491c-922c-1191de65dc42 service nova] Creating event network-changed:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:03:29.924356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.926070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.929746 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ee05e35a-a798-4dc4-9438-a9b922100209 req-0ca2a943-a00e-491c-922c-1191de65dc42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055320 Jul 19 20:03:29.931076 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1988/3849] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:29.938138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.939015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.947187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.947626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.948436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.949153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.951675 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] HTTP exception thrown: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b HTTP/1.1 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f5b02d83-7482-4c78-85b6-2c7622bf435b'} Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:29.954627 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 404 to user: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc30ec06-b199-4ad8-9e9f-825f5d294e39 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 404 len: 111 microversion: 2.1 time: 0.063061 Jul 19 20:03:29.960028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1862/3850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:29.964910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ffe8f2d2-12b2-419b-8887-33c43d48795d req-766822ca-5d11-431a-8723-3bd7ae62bacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4700e5f4-0c76-49de-a895-07b0a44bc11c", "name": "network-vif-plugged", "status": "completed", "tag": "77d9bdac-8f2c-4c64-9c35-8d35a3189ab9"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:29.973866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ffe8f2d2-12b2-419b-8887-33c43d48795d req-766822ca-5d11-431a-8723-3bd7ae62bacd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.974325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ffe8f2d2-12b2-419b-8887-33c43d48795d req-766822ca-5d11-431a-8723-3bd7ae62bacd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.986941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ffe8f2d2-12b2-419b-8887-33c43d48795d req-766822ca-5d11-431a-8723-3bd7ae62bacd service nova] Creating event network-vif-plugged:77d9bdac-8f2c-4c64-9c35-8d35a3189ab9 for instance 4700e5f4-0c76-49de-a895-07b0a44bc11c on n-h1-843861-3 Jul 19 20:03:29.992390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ffe8f2d2-12b2-419b-8887-33c43d48795d req-766822ca-5d11-431a-8723-3bd7ae62bacd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Jul 19 20:03:29.992998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1863/3851] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:29.999736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.003303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.003953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=20 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:30.004221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.010382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.010895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.011721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.012277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.108253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6dc98d9-ea81-4a82-8c7a-18af07bfeba5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.113721 Jul 19 20:03:30.108846 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1864/3852] 10.222.0.33 () {58 vars in 1229 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:30.120069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e03ad8cd-19c2-4262-b043-5b2a13580d4e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e03ad8cd-19c2-4262-b043-5b2a13580d4e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:03:30.123257 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e03ad8cd-19c2-4262-b043-5b2a13580d4e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e03ad8cd-19c2-4262-b043-5b2a13580d4e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.008589 Jul 19 20:03:30.133709 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1865/3853] 10.222.0.33 () {58 vars in 1181 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:03:30.138217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.142200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.142884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.149278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.149733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.150543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.150987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.174609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.178095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:30.188516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e73d0d2-8fbe-4fd5-88b8-3bfd310fb496 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.256120 Jul 19 20:03:30.189241 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1989/3854] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:30.213914 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4775f990-e232-4b91-bddc-a919b74202be tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.079900 Jul 19 20:03:30.214952 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1866/3855] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers => generated 683 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:30.230196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.234430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.234890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.servers [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Removing options 'limit' from query {{(pid=126008) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 20:03:30.235670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.241986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.242439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.243247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.243686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.272778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:30.309953 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56cd5df9-6c69-4ef2-b7ed-e3190bc1c43e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.084776 Jul 19 20:03:30.310635 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1990/3856] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:30.322893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-859da583-b547-4d5f-a28e-a605f09852ab tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-859da583-b547-4d5f-a28e-a605f09852ab tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: action_args: {} Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '-1' Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:03:30.325658 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-859da583-b547-4d5f-a28e-a605f09852ab tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-859da583-b547-4d5f-a28e-a605f09852ab tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008379 Jul 19 20:03:30.331359 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1867/3857] 10.222.0.33 () {58 vars in 1141 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:03:30.339902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8ee1c99-d51d-470c-ad08-c53d07550112 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8ee1c99-d51d-470c-ad08-c53d07550112 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: action_args: {} Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'testing' Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:03:30.343487 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8ee1c99-d51d-470c-ad08-c53d07550112 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8ee1c99-d51d-470c-ad08-c53d07550112 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009596 Jul 19 20:03:30.349300 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1991/3858] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:03:30.355356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04688575-51ba-4603-a84a-786e482744a5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.359843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04688575-51ba-4603-a84a-786e482744a5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.360507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04688575-51ba-4603-a84a-786e482744a5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.368273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.servers [None req-04688575-51ba-4603-a84a-786e482744a5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Flavor 'non_existing_flavor' could not be found {{(pid=126007) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 19 20:03:30.369457 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04688575-51ba-4603-a84a-786e482744a5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018406 Jul 19 20:03:30.370147 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1868/3859] 10.222.0.33 () {58 vars in 1177 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:03:30.381853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.385560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.386222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.392915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.393377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.394257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.394688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.484869 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-486ecf33-5006-42d6-8e92-1c0586fe0c04 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.106515 Jul 19 20:03:30.485691 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1992/3860] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:03:30.498229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.502189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.502855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.508465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.508989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.509941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.510464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.605374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.606590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:30.607417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-442130f7-7dee-4e70-ac29-cffddcf796dc tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.114091 Jul 19 20:03:30.608102 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1869/3861] 10.222.0.33 () {58 vars in 1183 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:30.614912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.615365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.616320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.616948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.620842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.624300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.625077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:30.630976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.631319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.632617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.632617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.671526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:30.719653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.728590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.729147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.008384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.024483 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b77f515d-e1e1-455a-babf-8625b2f97036 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.423710 Jul 19 20:03:31.025837 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1993/3862] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.035206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.036305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.045640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.046501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.047642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.048384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.185267 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f39c98ba-e3d0-47b0-9dac-a5b257afbaa5 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.568566 Jul 19 20:03:31.205126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1870/3863] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.210893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.211647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.221485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.222290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.223370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.224124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.322892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.336065 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-349439b4-76fb-401b-ab5c-d6ffe8e6e40f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.308656 Jul 19 20:03:31.337431 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1994/3864] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.353192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.354901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.366858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.367644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.369021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.369781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.452870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.484331 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-748cc638-da71-45a7-a2eb-8e6230283d9c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1314 microversion: 2.1 time: 0.277472 Jul 19 20:03:31.486246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1871/3865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.494748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-71fce6e4-f28a-4518-b97c-e700f58e994e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.503050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-71fce6e4-f28a-4518-b97c-e700f58e994e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.505248 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-71fce6e4-f28a-4518-b97c-e700f58e994e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017124 Jul 19 20:03:31.506892 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1872/3866] 10.222.0.33 () {58 vars in 1177 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:31.517358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.519130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.532119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.532596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.534012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.534874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.595715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.610731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d490a30f-be47-4bf5-a2d9-be98b7aa0ed6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1477 microversion: 2.1 time: 0.268582 Jul 19 20:03:31.611613 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1995/3867] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.618210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.618942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.627331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.627983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.629563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.630108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.778519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.788857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c13883e-f577-4940-9041-2f6ac6f4e5f7 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.280208 Jul 19 20:03:31.789637 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1873/3868] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.796113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.800135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.800915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Searching by: {'deleted': False, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:03:31.808199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.809742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.810335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.811058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.844376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:03:31.845740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.854038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1120e620-96c4-4a83-a53d-a56e3888c208 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.241410 Jul 19 20:03:31.856351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1996/3869] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.879879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.881000 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72627334-885d-4a10-be9c-4ea5c8528062 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.089064 Jul 19 20:03:31.881758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1874/3870] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:31.881889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.890529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.891058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.891940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.892451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.893887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.894461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.902157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.902605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.903419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.903878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.923579 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] HTTP exception thrown: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b HTTP/1.1 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f5b02d83-7482-4c78-85b6-2c7622bf435b'} Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:31.925561 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 404 to user: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f4fe157-becf-4230-ae78-c96206f29eec tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 404 len: 111 microversion: 2.1 time: 0.037453 Jul 19 20:03:31.931002 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1875/3871] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:31 2022] DELETE /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:31.937248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.937888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.946041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.946041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.946771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.947208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.976689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:32.042052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:32.061329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.070263 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b71c8a3c-f05b-41f1-b630-7308ab502978 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.194183 Jul 19 20:03:32.071223 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1997/3872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.076771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.076771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.077435 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-63012fed-bb63-4d73-b0ba-ac1f01e0c2af tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 204 len: 0 microversion: 2.1 time: 0.144943 Jul 19 20:03:32.078030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1876/3873] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:31 2022] DELETE /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:03:32.088898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.089317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.090093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.091185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.093963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.094952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.102825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.103363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.104461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.105044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.320686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.330347 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-80982193-cfa9-4eee-9afc-26cf3f234177 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.257977 Jul 19 20:03:32.331327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1998/3874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.336236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.337773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.338539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.346723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.347278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.348156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.348829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.352386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-edd50ab9-7dd0-4120-bb29-17abfd9359ad tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.268806 Jul 19 20:03:32.353755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:32.360386 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1877/3875] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:32.370266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.371423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.376258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:32.381050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:32.383692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.384178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.384958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.385396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.478824 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a740b7f-aac8-4783-a1e8-6d39323f1158 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 204 len: 0 microversion: 2.1 time: 0.144747 Jul 19 20:03:32.479434 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 1999/3876] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:32 2022] DELETE /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:32.487861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.488553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: f5b02d83-7482-4c78-85b6-2c7622bf435b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.495268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.495705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.497722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.497722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.511018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] HTTP exception thrown: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b HTTP/1.1 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f5b02d83-7482-4c78-85b6-2c7622bf435b'} Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:32.513229 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 404 to user: Instance f5b02d83-7482-4c78-85b6-2c7622bf435b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad68992b-17f6-4b40-b8c9-157a0b728879 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b" status: 404 len: 111 microversion: 2.1 time: 0.030848 Jul 19 20:03:32.521016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2000/3877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/f5b02d83-7482-4c78-85b6-2c7622bf435b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:32.524268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.524881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.531691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.532209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.533196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.533630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.541496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.549535 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd2ee2af-637e-4cab-994e-7233a541f10a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.183881 Jul 19 20:03:32.550315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1878/3878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.554777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.555390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.561943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.562412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.563197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.563635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.800485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.804700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.809984 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d486c438-642d-4efb-8a45-a4307cdc0c99 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1501 microversion: 2.1 time: 0.289333 Jul 19 20:03:32.810686 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2001/3879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.813545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b962d8c6-644e-44bd-8749-ddbcc596bfe9 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 200 len: 1522 microversion: 2.1 time: 0.262326 Jul 19 20:03:32.814383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1879/3880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.816071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.816774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.826538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.827616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.827858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.828198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.828750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.829364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.836059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.836575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.837308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.838234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.057951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.062569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.068539 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e433b366-fb74-420d-b1d2-2d7744c42b94 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.256614 Jul 19 20:03:33.069274 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2002/3881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.073244 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e06cab99-646e-49a1-ae34-6002930909be tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1477 microversion: 2.1 time: 0.248879 Jul 19 20:03:33.082653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1880/3882] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.082938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:33.082938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.083266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:33.083266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.083605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.083994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.084779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.085287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.089604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.090054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.090980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.091420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.129647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lazy-loading 'flavor' on Instance uuid 728a3bd3-b439-43df-8f1c-09e2a7d34b8a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:33.255122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.269575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-457fdec8-46eb-4bba-9275-4cbf5b7b3448 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.198990 Jul 19 20:03:33.272703 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2003/3883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:33 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.351676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:33.352338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.362085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.362820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.364041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.364515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.442449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-469eee00-0f85-4bca-8787-ad2db4a19845 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a/action" status: 202 len: 0 microversion: 2.1 time: 0.366108 Jul 19 20:03:33.443162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1881/3884] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:33 2022] POST /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:33.452106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:33.452765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.459318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.459777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.460569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.461006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.548304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.561487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01c3b787-616b-4b00-92d6-55d7a19349df tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1367 microversion: 2.1 time: 0.214373 Jul 19 20:03:33.562591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2004/3885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:33 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.643078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.651684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-298cf28e-6f2a-47a3-a6b1-a46473117401 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.203774 Jul 19 20:03:33.652329 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1882/3886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:33 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:33.658499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3476e79b-9345-4fc2-8b13-c929eb1b6294 req-cce067cd-6fc3-4275-a497-7dbf95d241dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88d10dd-f023-4440-9c9f-a8075ad83fac", "name": "network-vif-plugged", "status": "completed", "tag": "35e99701-2d9d-41f4-9bca-aa5a3be5cc85"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:33.667992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3476e79b-9345-4fc2-8b13-c929eb1b6294 req-cce067cd-6fc3-4275-a497-7dbf95d241dd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.668513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3476e79b-9345-4fc2-8b13-c929eb1b6294 req-cce067cd-6fc3-4275-a497-7dbf95d241dd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.680056 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3476e79b-9345-4fc2-8b13-c929eb1b6294 req-cce067cd-6fc3-4275-a497-7dbf95d241dd service nova] Creating event network-vif-plugged:35e99701-2d9d-41f4-9bca-aa5a3be5cc85 for instance c88d10dd-f023-4440-9c9f-a8075ad83fac on n-h1-843861-3 Jul 19 20:03:33.686105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3476e79b-9345-4fc2-8b13-c929eb1b6294 req-cce067cd-6fc3-4275-a497-7dbf95d241dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031138 Jul 19 20:03:33.687152 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2005/3887] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:33.831956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:33.832366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.838835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.839344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.840272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.840763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.983293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.992694 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9d014145-e790-4393-a780-0b8375062703 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 200 len: 1522 microversion: 2.1 time: 0.164938 Jul 19 20:03:33.993412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1883/3888] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:33 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:34.092974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.094245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.102062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.102771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.103462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.103999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.288963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.289883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.306182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.316598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.317462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.318085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.520239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:34.530772 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1befac8e-651c-49ec-8445-5685693b736d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1477 microversion: 2.1 time: 0.443115 Jul 19 20:03:34.542037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2006/3889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:34.579442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.580597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.587038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.587482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.589382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.589382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.720600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:34.728255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-25425df2-df91-41af-a09e-c9fa73975422 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.443291 Jul 19 20:03:34.728862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1884/3890] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:34.733572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.734464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.741307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.741768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.742560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.743009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.888361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:34.899251 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecb4dc28-2ba2-4b12-9a2b-62ea35db62a8 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1557 microversion: 2.1 time: 0.323563 Jul 19 20:03:34.900519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2007/3891] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1557 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:34.917817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.918467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.927190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.928232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.929531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.930296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.352792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51352170-0325-486a-a27a-70d0a1d7f1e6 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440051 Jul 19 20:03:35.353422 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2008/3892] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-interface => generated 284 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:03:35.358698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:35.359314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:35.368412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.368874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.369692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.370175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.404107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:35.425189 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-520bf6ab-f108-4a1a-8359-b3b2c79bdc95 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.694273 Jul 19 20:03:35.449034 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1885/3893] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:35.550707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:35.552172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:35.560289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.561046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.562060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.562491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.861517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:35.869736 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aedfc82e-fc59-4ce5-9cc9-1361c66ab280 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 200 len: 1522 microversion: 2.1 time: 0.515262 Jul 19 20:03:35.870337 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2009/3894] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:35 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:35.875188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7c6c083e-73ab-46d1-93ca-ced6c0f5065d req-0e36b4fa-8e75-44c3-81fc-c5f163ddfc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3505c608-f387-4a2c-af0a-8c7587c83bb0", "name": "network-vif-plugged", "status": "completed", "tag": "6d3bbfad-0caa-4ab9-b7ec-528292afbcfe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:35.892818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c6c083e-73ab-46d1-93ca-ced6c0f5065d req-0e36b4fa-8e75-44c3-81fc-c5f163ddfc31 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.893519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7c6c083e-73ab-46d1-93ca-ced6c0f5065d req-0e36b4fa-8e75-44c3-81fc-c5f163ddfc31 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.906149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7c6c083e-73ab-46d1-93ca-ced6c0f5065d req-0e36b4fa-8e75-44c3-81fc-c5f163ddfc31 service nova] Creating event network-vif-plugged:6d3bbfad-0caa-4ab9-b7ec-528292afbcfe for instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 on n-h2-843861-3 Jul 19 20:03:35.912852 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7c6c083e-73ab-46d1-93ca-ced6c0f5065d req-0e36b4fa-8e75-44c3-81fc-c5f163ddfc31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040660 Jul 19 20:03:35.914907 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2010/3895] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:35.922221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:35.923234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:35.930484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.931294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.932302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.932909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.071476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:36.080871 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e7c814d-61f4-475d-95ed-cc8a95f2796f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1477 microversion: 2.1 time: 0.534674 Jul 19 20:03:36.081984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1886/3896] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:35 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1477 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:36.088067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-56f9dd80-3e0c-45b8-884a-3d92999f4f49 req-b81153f7-5fe7-4424-961b-278d5ca78f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca", "name": "network-vif-deleted", "tag": "84e275ef-d1d8-4cc9-99a5-a37199e1c7cb"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:36.101596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-56f9dd80-3e0c-45b8-884a-3d92999f4f49 req-b81153f7-5fe7-4424-961b-278d5ca78f9c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.102387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-56f9dd80-3e0c-45b8-884a-3d92999f4f49 req-b81153f7-5fe7-4424-961b-278d5ca78f9c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.165822 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-56f9dd80-3e0c-45b8-884a-3d92999f4f49 req-b81153f7-5fe7-4424-961b-278d5ca78f9c service nova] Creating event network-vif-deleted:84e275ef-d1d8-4cc9-99a5-a37199e1c7cb for instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca on n-h1-843861-3 Jul 19 20:03:36.176150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-56f9dd80-3e0c-45b8-884a-3d92999f4f49 req-b81153f7-5fe7-4424-961b-278d5ca78f9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091774 Jul 19 20:03:36.177737 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1887/3897] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:36.253894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:36.264014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4867219d-c277-4e3d-8827-40d433450e12 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.347541 Jul 19 20:03:36.276266 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2011/3898] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:35 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:36.407498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.409885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.422540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.423568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.424840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.426009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.455646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.456460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.473446 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-689e4dd7-506d-4815-9581-196123480485 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.293432 Jul 19 20:03:36.474368 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1888/3899] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/ips => generated 146 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:36.480023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.480023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.480023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.480023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.688918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:36.699206 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b122c61-ee2d-41b9-8ea1-cbb0173fa667 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.247385 Jul 19 20:03:36.699916 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2012/3900] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:36.892561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.894122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.906228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.906697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.908409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.909115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.970607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.971736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.972630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lazy-loading 'fault' on Instance uuid a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:37.033175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.047987 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f95a902-f275-4e21-a261-ab32e92e8ae7 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 200 len: 1313 microversion: 2.1 time: 0.163735 Jul 19 20:03:37.049442 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1889/3901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:37.104062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:37.105164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.114159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.114735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.115633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.116414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.287192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:37.289700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.303094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.304442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.306561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.307654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.326181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.337123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9d599332-8a87-41e4-ad81-36ad55b2acb3 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1463 microversion: 2.1 time: 0.239009 Jul 19 20:03:37.357189 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2013/3902] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:37 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1463 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:37.365390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:37.367719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.380159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.380893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.390421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.391515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.716790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.727039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b3bc390-6f8c-4f00-909e-aa5864fe1a5e tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1325 microversion: 2.1 time: 0.447849 Jul 19 20:03:37.737304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.748876 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-207d16ae-2a24-48e0-9362-db0eceb4264d tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1463 microversion: 2.1 time: 0.388267 Jul 19 20:03:37.750540 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1890/3903] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:37 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:37.757424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bd0435dc-c736-470b-891f-b6d2ce360a5c req-941033dc-166f-4010-ab3a-facdf22b9fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4700e5f4-0c76-49de-a895-07b0a44bc11c", "tag": "77d9bdac-8f2c-4c64-9c35-8d35a3189ab9"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:37.774402 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2014/3904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:37 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1463 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:37.783979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:37.784979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.792381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.793873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.795430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.796564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.798006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd0435dc-c736-470b-891f-b6d2ce360a5c req-941033dc-166f-4010-ab3a-facdf22b9fae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.798461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd0435dc-c736-470b-891f-b6d2ce360a5c req-941033dc-166f-4010-ab3a-facdf22b9fae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.812453 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bd0435dc-c736-470b-891f-b6d2ce360a5c req-941033dc-166f-4010-ab3a-facdf22b9fae service nova] Creating event network-changed:77d9bdac-8f2c-4c64-9c35-8d35a3189ab9 for instance 4700e5f4-0c76-49de-a895-07b0a44bc11c on n-h1-843861-3 Jul 19 20:03:37.818300 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bd0435dc-c736-470b-891f-b6d2ce360a5c req-941033dc-166f-4010-ab3a-facdf22b9fae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065696 Jul 19 20:03:37.819305 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1891/3905] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:37.825091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:37.826713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.833739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.834434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.836198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.836815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.936819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:37.964517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:37.965337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:37.965918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:37.966416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:37.966912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:37.967370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.976207 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-638e802b-1ab5-477c-a364-6cf954ea3252 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.202422 Jul 19 20:03:37.977375 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2015/3906] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:37 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:38.070686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.071799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.083539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.084761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.089125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.090857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.119953 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] HTTP exception thrown: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca HTTP/1.1 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca'} Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:38.123318 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. Jul 19 20:03:38.129892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.132488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 404 to user: Instance a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:38.134161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-815b8a99-6b75-4bed-b24b-4c34cabbb778 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca" status: 404 len: 111 microversion: 2.1 time: 0.070922 Jul 19 20:03:38.135692 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2016/3907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/a41cfbbc-1a3a-41b1-9751-3bca4c95b4ca => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:38.145219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.147647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.149026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.155101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.155577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.156421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.156870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.162226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.163511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.165005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.166758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.173399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:38.227588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.228510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.229216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lazy-loading 'fault' on Instance uuid 4da64c1b-1851-4629-ac18-9c6447163256 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:38.266373 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-341514eb-be06-4672-aa0c-bf233f1defd0 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 1067 microversion: 2.1 time: 0.445523 Jul 19 20:03:38.281970 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1892/3908] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:37 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 1067 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 20:03:38.296843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-066e9e65-355e-4ab3-b44e-3aa834e9ee2d req-04aef65c-76a2-4a2a-9fa0-a708a05ff5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da64c1b-1851-4629-ac18-9c6447163256", "name": "network-vif-deleted", "tag": "04b336f4-05b8-4803-8c01-a20e72b5bf49"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:38.319062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-066e9e65-355e-4ab3-b44e-3aa834e9ee2d req-04aef65c-76a2-4a2a-9fa0-a708a05ff5e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.320486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-066e9e65-355e-4ab3-b44e-3aa834e9ee2d req-04aef65c-76a2-4a2a-9fa0-a708a05ff5e4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.335945 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-066e9e65-355e-4ab3-b44e-3aa834e9ee2d req-04aef65c-76a2-4a2a-9fa0-a708a05ff5e4 service nova] Creating event network-vif-deleted:04b336f4-05b8-4803-8c01-a20e72b5bf49 for instance 4da64c1b-1851-4629-ac18-9c6447163256 on n-h2-843861-3 Jul 19 20:03:38.346123 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-066e9e65-355e-4ab3-b44e-3aa834e9ee2d req-04aef65c-76a2-4a2a-9fa0-a708a05ff5e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061394 Jul 19 20:03:38.347341 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1893/3909] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:38.355423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.356986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.366891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.367486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.368830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.371491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.441358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80091859a434c8aab4edefbb784f8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1651d3eff9ad4b0bae1fec9a6092be85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:38.455361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-562a231d-3508-454c-b14c-6092169001d3 tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 200 len: 1313 microversion: 2.1 time: 0.314900 Jul 19 20:03:38.458042 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2017/3910] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:38.688987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:38.705788 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e3f57d9-0f4c-42b0-841c-288213d21397 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.355969 Jul 19 20:03:38.708510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1894/3911] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:38.775068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.776548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.785003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.785854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.787099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.788025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.997128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.997743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.008914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.010877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.010877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.010877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.048476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.080831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50bab18f-8c5e-4b1d-8960-c925b8f7b0d0 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1522 microversion: 2.1 time: 0.310205 Jul 19 20:03:39.096926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2018/3912] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:39.109110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.110124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.118909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.119496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.120426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.120968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.149839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] HTTP exception thrown: Instance is not a member of specified network Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Request method failure captured: Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0/ips/invalid HTTP/1.1 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4BNhxgJqbpk2nNgeeJ2Xg3rq5G-b79hlnmW2lTiIFPxhOFk6_1JWM2eX9L8piUF3NdKzLTgx-7c6mxt7nbYDIrvxVUt65eXgPAr4MWpKN19jqj4y8Yzx6T4N2AffbwU7KlQgoeUjunVxHKdNySpxspLd8Pyy5_ai6-SBZtYEnPDiU Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fcce70e1a2bb41a9bca19e0a1d30e87d Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance is not a member of specified network Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '3505c608-f387-4a2c-af0a-8c7587c83bb0', 'id': 'invalid'} Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 19 20:03:39.155476 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.171324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:39.171324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-edbb6f7d-7e53-4cdf-a7ea-d9e78202ce30 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.056822 Jul 19 20:03:39.171324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2019/3913] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:03:39 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0/ips/invalid => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:03:39.171324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9763618a-4ed3-4c35-9967-878090860f09"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:39.171324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.172170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.172626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.173420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.173894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.319892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.330112 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f4b98a9-ed92-4204-b837-65c83fabaa38 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.337901 Jul 19 20:03:39.331530 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1895/3914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:39.337745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.338352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Failed to fetch instance by id 999 {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:03:39.338990 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] HTTP exception thrown: Instance 999 could not be found. Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Request method failure captured: Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4BNhxgJqbpk2nNgeeJ2Xg3rq5G-b79hlnmW2lTiIFPxhOFk6_1JWM2eX9L8piUF3NdKzLTgx-7c6mxt7nbYDIrvxVUt65eXgPAr4MWpKN19jqj4y8Yzx6T4N2AffbwU7KlQgoeUjunVxHKdNySpxspLd8Pyy5_ai6-SBZtYEnPDiU Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fcce70e1a2bb41a9bca19e0a1d30e87d Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 999 could not be found. Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '999'} Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 20:03:39.344258 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.349037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:39.349037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-45073e64-f1c5-425e-9635-1fc8ba664fb2 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012964 Jul 19 20:03:39.349037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1896/3915] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 20:03:39 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:03:39.357882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.358447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.368874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.369542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.370800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.371428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.411442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:39.514535 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-377b3cad-a6cb-4904-aea3-406a381e56ec tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 204 len: 0 microversion: 2.1 time: 0.160652 Jul 19 20:03:39.516858 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1897/3916] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:39 2022] DELETE /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:39.529457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.530942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] [instance: 4da64c1b-1851-4629-ac18-9c6447163256] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.540359 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1992b2b2-9ce7-40dc-9311-762bab7b65f2 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380656 Jul 19 20:03:39.541392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2020/3917] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:03:39 2022] POST /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:39.543188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.544118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.545051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.545710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.553158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.554144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.562446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.563182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.564085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.564249 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] HTTP exception thrown: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. Jul 19 20:03:39.564463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Request method failure captured: Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 HTTP/1.1 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3gjCEZI6JGUXsk1wGrFf9eS68-eVS5e9Jb42Ix8dqRuzFRD1-FX6OYnjCZTZNjmKyT6HKrHnin80rMYEzs8RJXWHLK3ZaRMZl8qgTTIykhEkTlcE1p550VmhAosZF1DZtdFjs4yW4_0_VMVPscGYTZMfpHJfNenEFp25jDVP59vZk Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1651d3eff9ad4b0bae1fec9a6092be85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1651d3eff9ad4b0bae1fec9a6092be85 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1985925908 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: e80091859a434c8aab4edefbb784f8c8 Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ListServersNegativeTestJSON-1985925908-project Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4da64c1b-1851-4629-ac18-9c6447163256'} Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:39.566082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] Returning 404 to user: Instance 4da64c1b-1851-4629-ac18-9c6447163256 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:39.571733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf28ce73-0d52-48c4-867c-8f72f918084e tempest-ListServersNegativeTestJSON-1985925908 tempest-ListServersNegativeTestJSON-1985925908-project] 10.222.0.33 "GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256" status: 404 len: 111 microversion: 2.1 time: 0.048453 Jul 19 20:03:39.573214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1898/3918] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:39 2022] GET /compute/v2.1/servers/4da64c1b-1851-4629-ac18-9c6447163256 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:39.722688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.731147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.732098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:39.735087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53d6cebf-fde2-45cd-a1da-c2a93fe71603 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1528 microversion: 2.1 time: 0.191595 Jul 19 20:03:39.736132 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2021/3919] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:39 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1528 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:39.738901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.739354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.740324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:39.740772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.899140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.907603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58651627-7ce9-4c26-91f6-f34beaa45551 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.180990 Jul 19 20:03:39.908667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1899/3920] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:39 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:40.350997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:40.351641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:40.359955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.360660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.361955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.362643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.422250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:40.523401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:40.531453 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5af0084f-3f75-4d55-a83c-088ab2b614e1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.184715 Jul 19 20:03:40.532106 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2022/3921] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:40 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:40.755457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:40.757258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:40.761466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:40.794370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.795131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.796442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.797124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.927694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:40.928669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:40.961679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.962133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.962952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.963387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.999674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:41.013266 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1902857-3998-48aa-bbe5-9e145acb5b25 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1528 microversion: 2.1 time: 0.262852 Jul 19 20:03:41.015846 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1900/3922] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:40 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1528 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:41.205352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:41.214409 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6bf52d55-91d6-40d8-b25b-f1fb2ad54242 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.292251 Jul 19 20:03:41.216444 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2023/3923] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:40 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:41.552321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:41.552959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:41.574172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:41.575534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:41.576958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:41.577792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:41.818487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:41.980593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:41.990897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-85a5a17f-7c9f-48da-a08f-de1f458e593b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.443329 Jul 19 20:03:41.992006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1901/3924] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:41 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:42.036650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:42.038709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:42.065503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.066127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.067134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.067705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.235197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:42.237199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:42.248430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.251226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.255690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.257006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.309706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcce70e1a2bb41a9bca19e0a1d30e87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb476af397438b90dece4eb04e31ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:42.320011 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f2015a0-2f7c-4611-aab8-bc7ded9263bb tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 200 len: 1486 microversion: 2.1 time: 0.287098 Jul 19 20:03:42.323157 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2024/3925] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:42 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 1486 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:42.335952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dd1014b9-0002-4b8a-ad6e-6b999af8b4bf req-5e2b8ed5-5c85-4663-a217-f6850abe1ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3505c608-f387-4a2c-af0a-8c7587c83bb0", "name": "network-vif-deleted", "tag": "6d3bbfad-0caa-4ab9-b7ec-528292afbcfe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:42.356999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd1014b9-0002-4b8a-ad6e-6b999af8b4bf req-5e2b8ed5-5c85-4663-a217-f6850abe1ab2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.360465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd1014b9-0002-4b8a-ad6e-6b999af8b4bf req-5e2b8ed5-5c85-4663-a217-f6850abe1ab2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.395542 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dd1014b9-0002-4b8a-ad6e-6b999af8b4bf req-5e2b8ed5-5c85-4663-a217-f6850abe1ab2 service nova] Creating event network-vif-deleted:6d3bbfad-0caa-4ab9-b7ec-528292afbcfe for instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 on n-h2-843861-3 Jul 19 20:03:42.402085 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dd1014b9-0002-4b8a-ad6e-6b999af8b4bf req-5e2b8ed5-5c85-4663-a217-f6850abe1ab2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077322 Jul 19 20:03:42.403986 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2025/3926] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:42.533986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:42.542743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2e091fb-de86-4c67-a98c-4d8f4c068b23 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.313556 Jul 19 20:03:42.551931 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1902/3927] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:42 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:43.009156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:43.010341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:43.024161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:43.029108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.029993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.032182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.032990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.341768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:43.342673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] [instance: 3505c608-f387-4a2c-af0a-8c7587c83bb0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:43.349983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:43.361630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.362470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.363448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.364031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.366716 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-701e185c-6331-47f9-bb6a-3e5b8f7dbebf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.361131 Jul 19 20:03:43.384195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2026/3928] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:43 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:43.396775 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] HTTP exception thrown: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Request method failure captured: Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 HTTP/1.1 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4BNhxgJqbpk2nNgeeJ2Xg3rq5G-b79hlnmW2lTiIFPxhOFk6_1JWM2eX9L8piUF3NdKzLTgx-7c6mxt7nbYDIrvxVUt65eXgPAr4MWpKN19jqj4y8Yzx6T4N2AffbwU7KlQgoeUjunVxHKdNySpxspLd8Pyy5_ai6-SBZtYEnPDiU Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5cb476af397438b90dece4eb04e31ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c5cb476af397438b90dece4eb04e31ab Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-618554092 Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fcce70e1a2bb41a9bca19e0a1d30e87d Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-618554092-project Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3505c608-f387-4a2c-af0a-8c7587c83bb0'} Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:43.399498 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] Returning 404 to user: Instance 3505c608-f387-4a2c-af0a-8c7587c83bb0 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8733b9e-c35d-4aaf-96f7-ccd0f73915b9 tempest-ServerAddressesNegativeTestJSON-618554092 tempest-ServerAddressesNegativeTestJSON-618554092-project] 10.222.0.33 "GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0" status: 404 len: 111 microversion: 2.1 time: 0.067659 Jul 19 20:03:43.405999 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1903/3929] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:43 2022] GET /compute/v2.1/servers/3505c608-f387-4a2c-af0a-8c7587c83bb0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:43.572718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:43.578663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:43.598604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.599978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.601580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.602695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.087923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:44.106766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ae130545-6af7-40c4-8f63-f76b8a48322e tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.539174 Jul 19 20:03:44.107396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2027/3930] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:43 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:44.397022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:44.398707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:44.414007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:44.414631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.415669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:44.416545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.922423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:44.932698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5678652-019b-4db4-8451-24287f626537 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.540767 Jul 19 20:03:44.934646 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1904/3931] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:44 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:45.129482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:45.131098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:45.143902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.145450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.146573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.147276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.553075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:45.565946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f1cdd164-b843-43ea-88ff-7e7a17e23995 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.443184 Jul 19 20:03:45.578009 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2028/3932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:45 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:45.963562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:45.964565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:45.976010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.977338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.978967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.979801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:46.267877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:46.283065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7852514c-fe77-4659-9240-7aa6dd9e70dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.325404 Jul 19 20:03:46.307618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1905/3933] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:45 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:46.589801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:46.591899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:46.635529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:46.636487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:46.642156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:46.642784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:47.131050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:47.142492 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87d662f2-bb88-432e-8afa-a4fc840eb452 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.559565 Jul 19 20:03:47.153798 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2029/3934] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:46 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:47.316338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:47.316977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:47.330629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:47.331094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:47.332130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:47.332582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:47.725480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:47.740929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8bd5e00-c2cc-488c-a5e6-365d15d4b27b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.429086 Jul 19 20:03:47.741549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1906/3935] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:47 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:48.170713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:48.172501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:48.187213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.192998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.194182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.196853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.759110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:48.760682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:48.783221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:48.796565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.797667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.798911 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b3eb1e7-3fec-42ae-b597-fbb483be7489 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.635166 Jul 19 20:03:48.799249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.799736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2030/3936] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:48 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:48.800496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:49.223473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:49.232647 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d85824e-e02b-4fd4-b53a-4ff72cd419e8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.477547 Jul 19 20:03:49.233872 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1907/3937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:48 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:49.825858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:49.828152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:49.843875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:49.845150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:49.848167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:49.848652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.257455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:50.259854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:50.260136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:50.276300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:50.276996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.278603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-814ed786-d353-49cb-8551-f1f47d20354a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.462415 Jul 19 20:03:50.279471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2031/3938] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:49 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:50.279634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:50.280732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.614021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:50.617904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:50.643694 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a1fa6d21-f0e3-42ed-8165-249d0221a57a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.393883 Jul 19 20:03:50.656723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1908/3939] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:50 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:51.298418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:51.299861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:51.308533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:51.309867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:51.311151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:51.311853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:51.591313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:51.606077 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fabbf507-4309-4e7b-985a-1a7704f3293c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.311687 Jul 19 20:03:51.620325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2032/3940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:51 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:51.676786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:51.678561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:51.692773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:51.693488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:51.694707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:51.701361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:51.940082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:51.955642 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-558348f7-c3e3-48e7-9127-185082218b8f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.285835 Jul 19 20:03:51.956843 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1909/3941] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:51 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:52.627854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:52.628643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:52.643941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:52.648814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:52.649700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:52.650152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:52.725183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:52.979167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:52.981261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:52.982557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:52.991414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c9b489b7-f0d0-44e6-b054-00eee2c6435c tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.367387 Jul 19 20:03:53.003741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2033/3942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:52 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:53.022080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.022881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.024355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.028032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.289204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:53.305169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8ce838b-70df-40a7-87f6-f95ec62a3551 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.331647 Jul 19 20:03:53.306237 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1910/3943] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:52 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:54.020369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:54.026639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:54.040008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.040990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.043307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.045828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.286613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:54.299011 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-151615c9-c2d5-4438-9283-c84bd05468c2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.288030 Jul 19 20:03:54.300308 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2034/3944] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:54 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:54.328062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:54.329396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:54.337248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.338518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.339548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.344216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.551238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:54.572691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a6169c6-94b3-469b-9880-d560daaaebaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.242247 Jul 19 20:03:54.573929 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1911/3945] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:54 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:55.261176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.261176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.266544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.267086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.269260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.270067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.314075 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c905530-648c-4dc9-ad09-0adabe9f35cc tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061950 Jul 19 20:03:55.322196 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1912/3946] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:55.327411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.328173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.336672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.337605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.338628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.339270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.376867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: .version_select at 0x7fb892fc9310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-788971704", "policies": ["affinity"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:55.417884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.424455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.517230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.524104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.542177 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f442cf3d-6a3d-46b5-b7f4-a713984d8a71 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.447837 Jul 19 20:03:55.549398 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2035/3947] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Jul 19 20:03:55 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:55.550430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.551136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.558035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.558502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.559296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.559733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.609009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc9abf2e-46c3-4e54-b636-ad888aef4f28 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09" status: 200 len: 194 microversion: 2.1 time: 0.064038 Jul 19 20:03:55.614997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2036/3948] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:55.620503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: .version_select at 0x7fb88d22b9d0>, body: {"server_group": {"name": "tempest-server-group-1481980956", "policies": ["affinity"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:55.626901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:55.640633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.646496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.654374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0a6b043-65ba-4b58-9e99-45da828b7100 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.328779 Jul 19 20:03:55.655473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1913/3949] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:55.675060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.676187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.701719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.703334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.704423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.704871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.741489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.753643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.796504 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea51aa0e-4878-4547-afd1-8f89ef2abea5 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.179936 Jul 19 20:03:55.797511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2037/3950] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 20:03:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:55.811048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: .version_select at 0x7fb88d1fe160>, body: {"server_group": {"name": "tempest-server-group-1481980956", "policies": ["affinity"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:55.839711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.850149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.938750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:55.952501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:55.986848 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61b59b52-db7d-409f-bc5c-680f10e22121 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.182721 Jul 19 20:03:55.987850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2038/3951] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 20:03:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.001070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f89ca951-2eaa-4903-ad21-291f679a2a32 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.003231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:56.037640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f89ca951-2eaa-4903-ad21-291f679a2a32 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ab10440c-63ed-46f3-b03c-326e690e4689" status: 204 len: 0 microversion: 2.1 time: 0.041645 Jul 19 20:03:56.039054 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2039/3952] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:03:55 2022] DELETE /compute/v2.1/os-server-groups/ab10440c-63ed-46f3-b03c-326e690e4689 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:56.050573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0811516-f73a-41dd-be7d-35f966ebaac6 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.079546 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0811516-f73a-41dd-be7d-35f966ebaac6 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.035274 Jul 19 20:03:56.113956 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2040/3953] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:03:56 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.122056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7dde3ec-2191-4200-91a5-35c4e9d846bc tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.194994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7dde3ec-2191-4200-91a5-35c4e9d846bc tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/f9e4ab07-03d6-4816-b600-c7086dc63427" status: 204 len: 0 microversion: 2.1 time: 0.077542 Jul 19 20:03:56.197878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2041/3954] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:03:56 2022] DELETE /compute/v2.1/os-server-groups/f9e4ab07-03d6-4816-b600-c7086dc63427 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:56.222863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2c53ed0-7aa0-4acb-98f1-32a27469272a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.256063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:56.256356 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2c53ed0-7aa0-4acb-98f1-32a27469272a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.050186 Jul 19 20:03:56.260495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2042/3955] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:03:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.284780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: .version_select at 0x7fb88d1fe0d0>, body: {"server_group": {"name": "tempest-server-group-1946453629", "policies": ["affinity"]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:56.285201 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4142fd4e-12ec-42db-b333-49f317740e03 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.628156 Jul 19 20:03:56.297171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1914/3956] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:56.321362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:56.334143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:56.401392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:56.410135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:56.426695 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f1b6f15-9ce3-49eb-8001-650abb00ad15 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.150633 Jul 19 20:03:56.427685 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2043/3957] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 20:03:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.444492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a49c588a-c65f-4c3a-bcc1-469240de889a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.493836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a49c588a-c65f-4c3a-bcc1-469240de889a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/1367db1f-8de8-42a3-9617-d5d866811b5e" status: 204 len: 0 microversion: 2.1 time: 0.058539 Jul 19 20:03:56.497494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1915/3958] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:03:56 2022] DELETE /compute/v2.1/os-server-groups/1367db1f-8de8-42a3-9617-d5d866811b5e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:56.514471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1f9506b-0808-4ae7-bcce-7fd637479bdd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.531001 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1f9506b-0808-4ae7-bcce-7fd637479bdd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020459 Jul 19 20:03:56.532479 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2044/3959] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:03:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.547515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: .version_select at 0x7fb88ce3d940>, body: {"server_group": {"name": "tempest-server-group-2118314740", "policies": ["anti-affinity"]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:56.599454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:56.613128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:56.631141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:56.674548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.675182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:56.694041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:56.696602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:56.698039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:56.704070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:56.733829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:56.748852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_groups'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:56.768430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa349623-14de-4720-bb36-a7f273bba597 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.228666 Jul 19 20:03:56.769730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1916/3960] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 20:03:56 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.790229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8490493-d8da-4f71-9a36-2a664c8b6524 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.850117 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8490493-d8da-4f71-9a36-2a664c8b6524 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/f2125b4d-5af4-4083-bb53-b06fd799075d" status: 204 len: 0 microversion: 2.1 time: 0.073032 Jul 19 20:03:56.851916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1917/3961] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:03:56 2022] DELETE /compute/v2.1/os-server-groups/f2125b4d-5af4-4083-bb53-b06fd799075d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:56.873928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-495d6585-a810-4447-9eed-5b82faa21088 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:56.908913 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-495d6585-a810-4447-9eed-5b82faa21088 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.051096 Jul 19 20:03:56.910143 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1918/3962] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:03:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:56.966611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2089081860", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "1aa0dddd-4725-4721-a3e2-b5bae80e69cd"}]}, "os:scheduler_hints": {"group": "f25b717e-6f6e-4cd2-91c0-085e77f1cb53"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:57.056113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] validate_networks() for [('1aa0dddd-4725-4721-a3e2-b5bae80e69cd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:57.618374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:57.627664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-20471edd-6c86-43ca-96f7-63b4afd14724 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.957657 Jul 19 20:03:57.638123 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2045/3963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:56 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:57.643788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:57.644802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:57.652446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:57.653166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:57.654178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:57.654961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.645040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:58.659391 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ae56b98-5b40-4293-b34e-2d89cad46eb3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 1.019382 Jul 19 20:03:58.660954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2046/3964] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:57 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:58.665992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1cb8baf-892c-4a62-84fa-5f55b79d38fe"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:58.667158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:58.678284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:58.679537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.681226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:58.682054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.992327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:58.993005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:58.993547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:58.994362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:58.997302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:59.026608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.028075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.029989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.031235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.069118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:59.080729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:59.104290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:59.107978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5ca33b8d-279c-4843-bc89-ed3527bc49b7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "POST /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446184 Jul 19 20:03:59.109257 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2047/3965] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:03:58 2022] POST /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:59.128647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:59.135525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:59.138919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:59.172873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.178792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.179900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.180553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.242871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:59.279776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:59.426370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:59.447651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Getting quotas for user 1a167fad43134816835a38c0783e93cd and project d202565e715240e4b0b591b8c73bdbea. Resources: {'server_group_members'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:59.547845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd944284-4bb6-4be0-887a-7b8404c0fad9 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.588398 Jul 19 20:03:59.551940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1919/3966] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:03:59.572035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4ce4993-d102-46fc-aeff-e7cf0433b538 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:59.572846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4ce4993-d102-46fc-aeff-e7cf0433b538 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:59.716746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4ce4993-d102-46fc-aeff-e7cf0433b538 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:59.728370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4ce4993-d102-46fc-aeff-e7cf0433b538 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1213 microversion: 2.1 time: 0.169946 Jul 19 20:03:59.739126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1920/3967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:59 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:59.744260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:59.744877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:59.771999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.772475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.773290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.773735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.832212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:59.849829 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f90c9de0-f1b3-47fd-8d37-f6624af30384 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.734435 Jul 19 20:03:59.852283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2048/3968] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:59 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:00.067567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:00.089109 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b7ff9c0-d644-41d4-b470-86cb52a05cb6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.348786 Jul 19 20:04:00.097849 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1921/3969] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:59 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:00.747952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:00.748582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:00.761430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:00.762776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.764150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:00.765251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.873845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:00.875079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:00.914193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:00.916980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.921777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:00.924280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.966223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:00.994263 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b265e0bd-8c3a-4970-99bb-3aaadd447d7d tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1209 microversion: 2.1 time: 0.241545 Jul 19 20:04:00.997708 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2049/3970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:00 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:01.115937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:01.116862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:01.130650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:01.131199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:01.135886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:01.136639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:01.317101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:01.360901 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e97a03e-8354-44cf-9900-06f7d329cd0a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.492580 Jul 19 20:04:01.364054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1922/3971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:00 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:01.540894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:01.554485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ee43133-e084-4050-a6fd-0a88a08815e5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.442525 Jul 19 20:04:01.557917 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2050/3972] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:01 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:02.017651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:02.018881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:02.039128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.040157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.041426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.044205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.281079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:02.296374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ddfbfb4-e0ca-4491-b70f-e96249cd95f8 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1271 microversion: 2.1 time: 0.282155 Jul 19 20:04:02.303543 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1923/3973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:02 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:02.384075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:02.388759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:02.399572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.400511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.401616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.403063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.581725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:02.591436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:02.607982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.612682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.615470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:02.616230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.912614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:02.932717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e07114f-055b-4d37-9b1c-bb375dd02cef tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.545415 Jul 19 20:04:02.936580 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2051/3974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:02 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:03.013186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:03.028188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f43237d-2e89-45d8-8c22-70d37187ea4c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.456903 Jul 19 20:04:03.033337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1924/3975] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:02 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:03.323077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:03.323708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:03.345589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.351000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.369466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.369940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.956503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:03.959631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:03.986355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.988100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.989584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.990617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.029784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:04.042442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e94d5d60-e094-46b5-98cb-ea0c59fa5be4 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.725158 Jul 19 20:04:04.045526 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2052/3976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:03 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:04.123403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1352633856", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:04.192645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] validate_networks() for [('fe44e18b-d8fe-4c62-ba4b-d50d31920122', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:04:04.358461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:04.371463 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-451ac2f8-babc-416a-b11d-cd547ad3b5ce tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.419931 Jul 19 20:04:04.372226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1925/3977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:03 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:04.385778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:04.387211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:04.395045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.395694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.397144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.397750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.875005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:04.886310 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c84d983-9ca2-4890-b7b4-065b0eff34fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1507 microversion: 2.1 time: 0.512538 Jul 19 20:04:04.888727 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1926/3978] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:04 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:04.903655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:04.904805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:04.922871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.924375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.926048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.926752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.965625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ccb044f-830d-42b4-962a-9c3daa7c4767 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/ips" status: 200 len: 152 microversion: 2.20 time: 0.075201 Jul 19 20:04:04.966277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1927/3979] 10.222.0.33 () {60 vars in 1288 bytes} [Tue Jul 19 20:04:04 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/ips => generated 152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:04:05.062943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:05.064854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:05.082932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.084405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.086478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.087574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.318185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:04:05.318886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:04:05.319269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:04:05.319672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:04:05.325122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:04:05.343205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.343978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.345058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.345695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.371892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Getting quotas for project 7e09cee661fa4d9eaee46c0f512fb139. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:04:05.381454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Getting quotas for user 4b369727298a4477862f2e3b475334cd and project 7e09cee661fa4d9eaee46c0f512fb139. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:04:05.400714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:04:05.404528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:04:05.492102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6861a503-862c-4d8a-b067-ff1940576a55 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436052 Jul 19 20:04:05.492102 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2053/3980] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:04:05.497101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4a43358c-562c-4269-b6c3-5ab0e76b9b30 req-12d70925-1117-4956-9311-1ba56cbce423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3223baa-92f5-4218-a723-0b283e65825f", "tag": "49bcbc1a-0023-4f4e-813d-ff517ee8c3a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:05.508505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4a43358c-562c-4269-b6c3-5ab0e76b9b30 req-12d70925-1117-4956-9311-1ba56cbce423 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.509288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4a43358c-562c-4269-b6c3-5ab0e76b9b30 req-12d70925-1117-4956-9311-1ba56cbce423 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.539791 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4a43358c-562c-4269-b6c3-5ab0e76b9b30 req-12d70925-1117-4956-9311-1ba56cbce423 service nova] Creating event network-changed:49bcbc1a-0023-4f4e-813d-ff517ee8c3a5 for instance f3223baa-92f5-4218-a723-0b283e65825f on n-h2-843861-3 Jul 19 20:04:05.545513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4a43358c-562c-4269-b6c3-5ab0e76b9b30 req-12d70925-1117-4956-9311-1ba56cbce423 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058197 Jul 19 20:04:05.546601 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2054/3981] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:05.552930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:05.554377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:05.562455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.563059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.564122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.564669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.102851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.115885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4100797-1d88-48bd-a8cd-dc317a4eac0f tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 1.060175 Jul 19 20:04:06.118631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1928/3982] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:05 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:06.135714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6290af7-3b8c-4e4b-9277-30c2e8cdc58f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:06.137955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6290af7-3b8c-4e4b-9277-30c2e8cdc58f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:06.287424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d6290af7-3b8c-4e4b-9277-30c2e8cdc58f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.298128 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6290af7-3b8c-4e4b-9277-30c2e8cdc58f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1224 microversion: 2.1 time: 0.175520 Jul 19 20:04:06.301233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.301421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1929/3983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:06 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:06.317486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00b655a3-b618-4d28-8ee0-0c526e47a855 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.769173 Jul 19 20:04:06.322266 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2055/3984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:05 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:06.323336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:06.325260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:06.340300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:06.343435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.346271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:06.347949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.853123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.865507 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-580fa054-d390-4f5d-a2f3-bc5e77f0826c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1528 microversion: 2.1 time: 0.552646 Jul 19 20:04:06.884055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1930/3985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:06 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1528 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:07.138270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:07.139171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:07.150335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.151733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.155303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.156081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.321849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:07.322650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:07.365772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.366335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.367157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.367816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.457696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:07.474187 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3265b919-8af0-4269-8617-8a2828d95f24 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1282 microversion: 2.1 time: 0.157920 Jul 19 20:04:07.476407 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1931/3986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:07.488779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:07.490406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:07.506323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:07.513892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.514482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:07.516460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.518162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.519296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.527783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-756f666c-7dbd-4d39-9ee1-7092c6b88f2a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.392563 Jul 19 20:04:07.528485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2056/3987] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:07.551051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:07.811244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:07.828197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19ef0875-cccc-4d28-89fa-af0032a2df3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.350444 Jul 19 20:04:07.829378 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1932/3988] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:07.885182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:07.887431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:07.907687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.908489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.909275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.909719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.194334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:08.207441 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09643a56-359a-4891-9502-21f078dc92cc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1528 microversion: 2.1 time: 0.327612 Jul 19 20:04:08.208087 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2057/3989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1528 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:08.349071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:08.349667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:08.358278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.358555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.359302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.359989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.398466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lazy-loading 'flavor' on Instance uuid 21e5b374-dea7-4797-9d14-c0350b8fb054 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:08.499369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:08.502011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:08.534631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.535788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.536341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.537499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.841452 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ad799b0-b4bf-4914-9a29-2b51285f5941 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/action" status: 202 len: 0 microversion: 2.20 time: 0.496387 Jul 19 20:04:08.842627 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1933/3990] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 20:04:08 2022] POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:08.852313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:08.853041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:08.862646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.863421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.864492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.865261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.050688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:09.117238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.121354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:09.130437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-faffc85f-27f1-4c56-a1f8-cc8cd8d41e29 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.638242 Jul 19 20:04:09.131455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2058/3991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:08 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:09.136938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:09.138964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:09.147092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.147693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.149133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.149644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.188016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.206161 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34a6ea7c-79fb-46dc-9e2a-8a599d3276f3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.360862 Jul 19 20:04:09.209989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1934/3992] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:08 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:09.211867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:09.227589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:09.236221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.236677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.237606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.238179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.559396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.570217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c7a5ce65-2a09-4299-9ba4-9b1f517b5900 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1472 microversion: 2.1 time: 0.437424 Jul 19 20:04:09.581591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2059/3993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:09 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:09.586806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:09.587132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:09.594162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.594616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.595385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.595909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.635025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.643604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.645213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.646430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1375f871-85c7-4ff9-8aae-da946ede2668 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.438660 Jul 19 20:04:09.647207 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1935/3994] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:09 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:09.801068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.809541 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57c52a1e-d867-46a5-b3ac-515333ed359f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1528 microversion: 2.1 time: 0.226872 Jul 19 20:04:09.810137 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2060/3995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:09 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1528 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:09.856523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-84439243-696e-4b2c-abf2-d8d049245916 req-29c25419-4d29-416f-aa04-c7a7118ff257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e034cf3-4c9e-4b42-b4fa-8543cd87ad68", "tag": "26d1523c-7e12-4e05-ba8a-2807e3e82f30"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:09.865904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-84439243-696e-4b2c-abf2-d8d049245916 req-29c25419-4d29-416f-aa04-c7a7118ff257 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.866423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-84439243-696e-4b2c-abf2-d8d049245916 req-29c25419-4d29-416f-aa04-c7a7118ff257 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.879074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-84439243-696e-4b2c-abf2-d8d049245916 req-29c25419-4d29-416f-aa04-c7a7118ff257 service nova] Creating event network-changed:26d1523c-7e12-4e05-ba8a-2807e3e82f30 for instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 on n-h1-843861-3 Jul 19 20:04:09.883995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-84439243-696e-4b2c-abf2-d8d049245916 req-29c25419-4d29-416f-aa04-c7a7118ff257 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 Jul 19 20:04:09.884598 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1936/3996] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:10.149279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.149279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.156499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.156947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.157715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.158149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.243696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.252425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.267191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.267646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.268478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.268917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.445779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:10.457364 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34839bd5-2d7c-42b5-9f0e-ab142332cc2c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.313080 Jul 19 20:04:10.461123 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2061/3997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:10 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:10.466631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2e6bde51-1c6a-435e-a839-a3e06ecb4656 req-9b20ea1e-6d43-4381-9055-8c34bd033979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728a3bd3-b439-43df-8f1c-09e2a7d34b8a", "name": "network-vif-plugged", "status": "completed", "tag": "a91ade39-aa57-4deb-9731-81be7469fc34"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:10.487164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2e6bde51-1c6a-435e-a839-a3e06ecb4656 req-9b20ea1e-6d43-4381-9055-8c34bd033979 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.504590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2e6bde51-1c6a-435e-a839-a3e06ecb4656 req-9b20ea1e-6d43-4381-9055-8c34bd033979 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.533070 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2e6bde51-1c6a-435e-a839-a3e06ecb4656 req-9b20ea1e-6d43-4381-9055-8c34bd033979 service nova] Creating event network-vif-plugged:a91ade39-aa57-4deb-9731-81be7469fc34 for instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a on n-h2-843861-3 Jul 19 20:04:10.549244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2e6bde51-1c6a-435e-a839-a3e06ecb4656 req-9b20ea1e-6d43-4381-9055-8c34bd033979 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086256 Jul 19 20:04:10.549686 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2062/3998] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:10.597510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.598403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.608114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:10.612014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.612713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.613780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.614414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.696981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:10.708745 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9af16598-0df5-4ab8-9129-4bc8e87cf066 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.487236 Jul 19 20:04:10.723061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1937/3999] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:10 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:10.728728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.729628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.737556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.738006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.738785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.739226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.138859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.151360 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-08512c47-def5-4878-8e22-44ed350b5a69 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1490 microversion: 2.1 time: 0.566914 Jul 19 20:04:11.162062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2063/4000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:10 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1490 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:11.162282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.162399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:11.162399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:11.169034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.169368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.170073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.171762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.172663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.173900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.176194 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c983cfcf-817a-4ff1-96b4-0b0a27d89832 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.451444 Jul 19 20:04:11.177218 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1938/4001] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:10 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:11.413279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.420858 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d18a1b78-b044-4b43-8d7b-dfd33fe77ba0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1528 microversion: 2.1 time: 0.267252 Jul 19 20:04:11.421440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2064/4002] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:11 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1528 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:11.477184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:11.477794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:11.485124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.485279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.486073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.486502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.625009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.633682 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c234895-2bfe-4e85-8648-2d1db00e7c3e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.159561 Jul 19 20:04:11.633682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1939/4003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:11 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:11.726246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:11.726861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:11.736046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.736592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.737380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.737818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.004241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:12.030814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc352684-755b-4c54-8aea-8fcc336df867 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.307899 Jul 19 20:04:12.040386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2065/4004] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:11 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:12.173236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:12.174374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:12.183576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.184188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.185144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.185617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.202391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:12.204811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:12.217750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.218847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.220506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.221623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.550314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:12.556481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:12.564118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cf88fb1-28f9-40f0-9b7e-38a73d5c9c81 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1478 microversion: 2.1 time: 0.396612 Jul 19 20:04:12.564783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1940/4005] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:12 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1478 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:12.570222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:12.571161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:12.584499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:12.586150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:12.587402 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27e801d5-0c33-4a21-a266-5e484cf89757 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.391811 Jul 19 20:04:12.593689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.594229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.594977 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2066/4006] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:12 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:12.595133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.595552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.655356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:12.656988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:12.670648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.671845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.673052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.673782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.322876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.336143 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca6ae6d4-f9d1-4577-b399-ab1b5065470b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1528 microversion: 2.1 time: 0.768656 Jul 19 20:04:13.336884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1941/4007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:12 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1528 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:13.342253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:13.342905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:13.349925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.350379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.352222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.352976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.356831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.365464 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4949d8d3-15d7-403d-9d58-1b78e9ddfef6 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.718339 Jul 19 20:04:13.376273 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2067/4008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:12 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:13.585749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:13.586929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:13.595438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.595912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.596850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.597310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.602999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.614258 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de7013a3-f4dd-4a92-a426-833d28e8cbfe tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.275669 Jul 19 20:04:13.615013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1942/4009] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:13 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:13.621872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:13.623269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:13.631891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.632602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.633647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.634093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.845032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.849693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.853822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79561837-f223-45c9-bf06-8173b681c8ba tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1463 microversion: 2.1 time: 0.272887 Jul 19 20:04:13.865671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.872125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.872364 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2068/4010] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:13 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:13.872625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c881dce-8e1e-4d39-9a4a-01b0549ee7a0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.253448 Jul 19 20:04:13.887083 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1943/4011] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:13 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:13.887512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:13.887512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:13.892904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.893506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.894575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.895252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.914004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-11ad95b1-5cee-45ca-8946-d83911799a07 req-a0664114-02d4-4402-9952-5061f4e9578e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88d10dd-f023-4440-9c9f-a8075ad83fac", "name": "network-vif-plugged", "status": "completed", "tag": "35e99701-2d9d-41f4-9bca-aa5a3be5cc85"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:13.923786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-11ad95b1-5cee-45ca-8946-d83911799a07 req-a0664114-02d4-4402-9952-5061f4e9578e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:13.924439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-11ad95b1-5cee-45ca-8946-d83911799a07 req-a0664114-02d4-4402-9952-5061f4e9578e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:13.940799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-11ad95b1-5cee-45ca-8946-d83911799a07 req-a0664114-02d4-4402-9952-5061f4e9578e service nova] Creating event network-vif-plugged:35e99701-2d9d-41f4-9bca-aa5a3be5cc85 for instance c88d10dd-f023-4440-9c9f-a8075ad83fac on n-h1-843861-3 Jul 19 20:04:13.956297 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-11ad95b1-5cee-45ca-8946-d83911799a07 req-a0664114-02d4-4402-9952-5061f4e9578e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045507 Jul 19 20:04:13.958267 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1944/4012] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:14.010954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fe34986-4bb2-4f97-a05a-63693d0a6c0e tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 0 microversion: 2.1 time: 0.132788 Jul 19 20:04:14.012469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2069/4013] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:13 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:14.021442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.022166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.030103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.031933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.031933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.031933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.071115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.071470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.072033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lazy-loading 'fault' on Instance uuid c88d10dd-f023-4440-9c9f-a8075ad83fac {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:14.194896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2f72cfe-75bc-4346-aefa-bda34bce20e4 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1597 microversion: 2.1 time: 0.177812 Jul 19 20:04:14.195490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1945/4014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1597 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:14.213435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:14.215143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.222765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.223310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.224205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.224705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.332126 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73a29abb-d44f-4d9a-9bd8-da64e0a9f408 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action" status: 202 len: 0 microversion: 2.1 time: 0.123869 Jul 19 20:04:14.333238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2070/4015] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:14 2022] POST /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:14.341131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.341761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.349231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.349690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.350493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.350993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.354242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.355242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.362872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.364377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.365422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.366272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.579243 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db88492b-ff27-48ae-af70-fd5367c87b31 tempest-ServersAdminTestJSON-315644783 tempest-ServersAdminTestJSON-315644783-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1614 microversion: 2.1 time: 0.241665 Jul 19 20:04:14.581937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1946/4016] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1614 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:14.589661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.590763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.600071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.601036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.603366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.604509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.615636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:14.629944 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-549d3720-77f2-4caf-9fb7-f1c3a497a35c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.280378 Jul 19 20:04:14.648389 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2071/4017] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:14.654104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.654904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.662875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.663820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.664843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.665560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.702702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:14.718403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:14.832065 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c05922f-a0d8-4c3d-ac7d-03a885dc36a2 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 204 len: 0 microversion: 2.1 time: 0.181131 Jul 19 20:04:14.833807 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2072/4018] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:14 2022] DELETE /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:14.841807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.842924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.859976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.860539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.861437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.862115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.884459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:14.897508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee39f70f-d69a-43ac-9835-38c0ee5a3dce tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.313526 Jul 19 20:04:14.898231 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1947/4019] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:14.904550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.905746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.913637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.914487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.915665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.916317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.919894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:15.143788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.155966 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2180250a-aa0a-4093-a69b-13cbef1917c7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1469 microversion: 2.1 time: 0.256282 Jul 19 20:04:15.156752 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1948/4020] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:15.162240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.168244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:15.168927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:15.174437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-88896f42-6118-4d78-a9ed-93777ea9494e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.338115 Jul 19 20:04:15.175614 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2073/4021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:15.186183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.186767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.187612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.188087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.346502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.361476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.363788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.366393 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a2044cd-90f2-490b-881e-8af6e1da835f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.208374 Jul 19 20:04:15.367884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1949/4022] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:15 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:15.373115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:15.380326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:15.380849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:15.391088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.391474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.392264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.392703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.393305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:15.424195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e091e66-3ece-46f9-8b41-bc69eef039fa tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/ips" status: 200 len: 150 microversion: 2.1 time: 0.058138 Jul 19 20:04:15.425036 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2074/4023] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:04:15 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:15.655851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:15.656306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:15.674455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.674896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.675904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.676572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.920514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:15.921278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:15.947239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.959967 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-555b3b8f-23bb-4990-b2c7-cbe0ac416ccf tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.308774 Jul 19 20:04:15.960651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1950/4024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:15 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:15.961364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.966544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.967892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:15.968519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.007393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bd592284-6a65-48d1-bba3-0dd8819bd22b req-8ff6081c-c8c1-4a6d-8733-c9b53279eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3223baa-92f5-4218-a723-0b283e65825f", "name": "network-vif-plugged", "status": "completed", "tag": "49bcbc1a-0023-4f4e-813d-ff517ee8c3a5"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:16.031754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd592284-6a65-48d1-bba3-0dd8819bd22b req-8ff6081c-c8c1-4a6d-8733-c9b53279eeb1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.033362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd592284-6a65-48d1-bba3-0dd8819bd22b req-8ff6081c-c8c1-4a6d-8733-c9b53279eeb1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.059221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bd592284-6a65-48d1-bba3-0dd8819bd22b req-8ff6081c-c8c1-4a6d-8733-c9b53279eeb1 service nova] Creating event network-vif-plugged:49bcbc1a-0023-4f4e-813d-ff517ee8c3a5 for instance f3223baa-92f5-4218-a723-0b283e65825f on n-h2-843861-3 Jul 19 20:04:16.086880 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bd592284-6a65-48d1-bba3-0dd8819bd22b req-8ff6081c-c8c1-4a6d-8733-c9b53279eeb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096463 Jul 19 20:04:16.089140 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1951/4025] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:16.183933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.185429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.239155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.239988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.241404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.242128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.293263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=26 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:16.671845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:16.682210 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-504b4388-5a73-493f-ae50-83fc58732770 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.770637 Jul 19 20:04:16.702076 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2075/4026] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:15 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:16.707444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.708352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.726285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.727052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.728105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.728712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.891371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:16.904819 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f2eb56b-cf64-47db-80b4-1ecf31b04f3a tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1469 microversion: 2.1 time: 0.731673 Jul 19 20:04:16.905487 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1952/4027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:16.920426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.923680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.930630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.931445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.932530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.933371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.197279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.218479 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de046ef7-6030-4491-8def-ec26a3d5caca tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.514848 Jul 19 20:04:17.219746 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2076/4028] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:17.225222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:17.226108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:17.233541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.234003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.236510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.236996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.397299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.415535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.417795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.419074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d79f7bc0-2da7-43f1-9f89-807b0143fb30 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.511250 Jul 19 20:04:17.419995 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1953/4029] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:17.424989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:17.425984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:17.445303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.445770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.446572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.447018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.513380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e38fcbcc-c8c2-44da-b708-2ba679cf61a7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.092254 Jul 19 20:04:17.515792 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1954/4030] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:17 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:17.610574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.641689 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4873b15f-c6c0-41e3-9d08-684d3749c2b6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.420480 Jul 19 20:04:17.644920 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2077/4031] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:17 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:17.660628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:17.661279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:17.673087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.673690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.675749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.676721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.700805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1a6ad1d2-d635-4de8-ae80-c2bbe9fee0dd req-9063ed8d-87df-4bb2-8a68-d69654727960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3cc92e-1fe2-4f69-986d-91d5e8ab1831", "name": "network-vif-deleted", "tag": "6f372432-0d4b-44bf-b282-4ca2b2378e01"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:17.714596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1a6ad1d2-d635-4de8-ae80-c2bbe9fee0dd req-9063ed8d-87df-4bb2-8a68-d69654727960 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.715358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1a6ad1d2-d635-4de8-ae80-c2bbe9fee0dd req-9063ed8d-87df-4bb2-8a68-d69654727960 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.729431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1a6ad1d2-d635-4de8-ae80-c2bbe9fee0dd req-9063ed8d-87df-4bb2-8a68-d69654727960 service nova] Creating event network-vif-deleted:6f372432-0d4b-44bf-b282-4ca2b2378e01 for instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 on n-h1-843861-3 Jul 19 20:04:17.736209 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1a6ad1d2-d635-4de8-ae80-c2bbe9fee0dd req-9063ed8d-87df-4bb2-8a68-d69654727960 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042253 Jul 19 20:04:17.736850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2078/4032] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:17.740440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3ba8f1c-a889-4785-80a8-b3ccf31ef1bb tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09" status: 200 len: 194 microversion: 2.1 time: 0.083576 Jul 19 20:04:17.746175 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1955/4033] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 19 20:04:17 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:17.749558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:17.750506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:17.753341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:17.753952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:17.758327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.758780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.759565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.760667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.761794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.762560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.763585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:17.764379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.912810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lazy-loading 'services' on Instance uuid 7f6f6742-1a02-45c1-a039-f44afeea52c7 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:18.128477 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ef62dac-a4ab-4b37-b8d4-345502d07a8a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09" status: 202 len: 0 microversion: 2.1 time: 0.378640 Jul 19 20:04:18.129369 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1956/4034] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:04:17 2022] DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/9763618a-4ed3-4c35-9967-878090860f09 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:18.134800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:18.136987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:18.144093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.146629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1e359ff-4db3-4b3e-bf80-1491b3349ba9 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.408294 Jul 19 20:04:18.160576 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2079/4035] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:17 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:18.175311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51940381-a892-4201-9e7c-be023d293d80"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:18.176963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.190310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.191082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.192479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.193243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.202604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.203071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.204863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.205307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.354618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.355924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.356762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lazy-loading 'fault' on Instance uuid 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:18.432604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:18.442123 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4fbc029d-5082-4e33-9d8b-38d8a929944f tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 200 len: 1303 microversion: 2.1 time: 0.310858 Jul 19 20:04:18.443257 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1957/4036] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:18 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:18.460726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:18.461493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.471540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.472237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.473542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.474383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.796016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f0fdb8f-b5ab-4fd6-8b0d-33f2ff74e6bd tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "POST /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626889 Jul 19 20:04:18.797250 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2080/4037] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:04:18 2022] POST /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:18.817341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:18.819783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.833920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.834808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.835871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.836477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.962118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:18.974294 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e827d4b-9212-4150-b230-331f3d29989a tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1313 microversion: 2.1 time: 0.529700 Jul 19 20:04:18.975357 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1958/4038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:18 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:18.981296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fa8aeee2-5de8-4e4e-ab0a-81f782ea36d1 req-8da05be8-8938-4679-b68c-ba5aafcb9d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e034cf3-4c9e-4b42-b4fa-8543cd87ad68", "name": "network-vif-plugged", "status": "completed", "tag": "26d1523c-7e12-4e05-ba8a-2807e3e82f30"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:18.997961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fa8aeee2-5de8-4e4e-ab0a-81f782ea36d1 req-8da05be8-8938-4679-b68c-ba5aafcb9d94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.999196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fa8aeee2-5de8-4e4e-ab0a-81f782ea36d1 req-8da05be8-8938-4679-b68c-ba5aafcb9d94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.017423 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fa8aeee2-5de8-4e4e-ab0a-81f782ea36d1 req-8da05be8-8938-4679-b68c-ba5aafcb9d94 service nova] Creating event network-vif-plugged:26d1523c-7e12-4e05-ba8a-2807e3e82f30 for instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 on n-h1-843861-3 Jul 19 20:04:19.023506 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fa8aeee2-5de8-4e4e-ab0a-81f782ea36d1 req-8da05be8-8938-4679-b68c-ba5aafcb9d94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046687 Jul 19 20:04:19.025107 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1959/4039] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:19.034252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:19.036580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:19.065864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.068272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.070759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.073147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.150418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:19.166998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:19.170298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:19.172654 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c3ff859-6dde-4d9b-95e6-93040864c41c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.374418 Jul 19 20:04:19.185133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2081/4040] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:18 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:19.191042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:19.192852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:19.202163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.203046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.204372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.206478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.532629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:19.546962 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68f4789a-906d-460e-8d1d-275cc2f9c890 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.519728 Jul 19 20:04:19.563848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1960/4041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:19 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:19.563848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:19.563848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:19.595591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.596078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.597017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.597386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.627085 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] HTTP exception thrown: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Request method failure captured: Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 HTTP/1.1 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w3DYiOW8C_ZlXClL8rYB1ewkA9sBudz6v0EjSIaYnvt6IlAT0RBeAJ24HMHep7HT65lbtSLFihKMcieVvCGyGu0X8pxyyMmgCsGX52pELFlYLq8J2Bolsb5eOSe8jBwRG16qclo5muiKqa2ynyreOwZizgunOfj41N4Of6WsjEzySs Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 24d88c1036be473096fdc2b64fbc9641 Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7d3cc92e-1fe2-4f69-986d-91d5e8ab1831'} Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:19.632101 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Returning 404 to user: Instance 7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-caf8d62b-f357-4cc8-9c37-a335204ed917 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831" status: 404 len: 111 microversion: 2.1 time: 0.084761 Jul 19 20:04:19.645656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1961/4042] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:19 2022] GET /compute/v2.1/servers/7d3cc92e-1fe2-4f69-986d-91d5e8ab1831 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:19.654989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:19.657394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:19.672601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:19.680232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.683121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.686337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.687896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.718108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d54a8fa2-be55-40c6-99f8-758edeff1633 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.530871 Jul 19 20:04:19.719493 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2082/4043] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:19 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:19.749419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:19.971707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b75a557-2977-4cf1-a7d9-84b35c651270 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "DELETE /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 204 len: 0 microversion: 2.1 time: 0.327606 Jul 19 20:04:19.977411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1962/4044] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:19 2022] DELETE /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:04:19.987052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:19.988097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.000307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.003205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.004148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.005159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.005725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.006612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.018130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.019315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.021765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.023291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.382829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.394248 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7cb7fbe1-0551-4f51-8e6e-f609f7763a80 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1470 microversion: 2.1 time: 0.414702 Jul 19 20:04:20.410615 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2083/4045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:19 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:20.416334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.421319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.435791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.446391 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa7ced62-98c9-4e78-90a8-8881a3f9942e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1498 microversion: 2.1 time: 0.452360 Jul 19 20:04:20.447170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.448121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.449215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.450462 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1963/4046] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:19 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1498 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:20.451428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.474348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52a46dfe-510c-4f10-947e-d955b713a5ec tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.493068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.server_groups [None req-52a46dfe-510c-4f10-947e-d955b713a5ec tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Querying cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) for 1 instances {{(pid=126007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:04:20.494256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a46dfe-510c-4f10-947e-d955b713a5ec tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.494899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52a46dfe-510c-4f10-947e-d955b713a5ec tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.526192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:20.529181 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52a46dfe-510c-4f10-947e-d955b713a5ec tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53" status: 200 len: 221 microversion: 2.1 time: 0.060422 Jul 19 20:04:20.530436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1964/4047] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53 => generated 221 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:20.545504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.546167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.560337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.560864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.561712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.562200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.648677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:20.702569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.721348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.723183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.724706 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23164690-5d80-49f6-b83f-23405ad89882 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.312597 Jul 19 20:04:20.739989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2084/4048] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:20.739989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.739989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.742047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.743189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.745189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.747219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.827545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-333e570e-ec23-45b4-9a5c-a38a21085cf7 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 204 len: 0 microversion: 2.1 time: 0.287317 Jul 19 20:04:20.832525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1965/4049] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:20 2022] DELETE /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:20.853589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.857858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.869215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.870106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.872487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.874458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.978988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.988780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-35d22203-ad4d-4796-8454-149fe0ae5aea tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.261324 Jul 19 20:04:20.990221 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2085/4050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:20.995493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.996546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:21.003671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.004557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.005759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.006498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.228701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:21.244052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d52e4ac7-8606-4079-8fe1-43db64adbe62 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1324 microversion: 2.1 time: 0.407975 Jul 19 20:04:21.244620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1966/4051] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:21.277932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:21.289901 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e445e2e1-b65d-4599-ae4e-98a23a969709 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1504 microversion: 2.1 time: 0.298006 Jul 19 20:04:21.290794 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2086/4052] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:21.417975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:21.418594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:21.427148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.427599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.428422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.428861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.654734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:21.671892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a012217-519e-49eb-9623-5c902f615e67 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1470 microversion: 2.1 time: 0.257560 Jul 19 20:04:21.672836 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1967/4053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:21 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:21.748339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:21.749313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:21.771248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.786876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.788426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.789281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.020800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:22.024186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:22.038099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.039768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.041769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.042958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.207157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:22.209659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:22.222570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:22.241591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:22.243179 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d571e88-bf73-4cc7-96c4-5577a2d358af tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.499670 Jul 19 20:04:22.244362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2087/4054] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:21 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:22.262158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:22.262869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:22.283632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.284056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.285099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.285716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.833625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:22.847070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c619052-448e-4161-a269-79706c50aa69 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.834229 Jul 19 20:04:22.858272 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1968/4055] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:22 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:22.870537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:22.875912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:22.893003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.894986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.895970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:22.900057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:22.958863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:23.002900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eceadbcc-85a0-4c20-b8aa-e80f27dcf9fa tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1520 microversion: 2.1 time: 0.725761 Jul 19 20:04:23.003566 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2088/4056] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:22 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1520 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:23.038812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:23.043203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:23.070586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.071277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.084369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.087980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.391449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:23.410378 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9530d52-bcb3-4982-86fe-b65853a42da7 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 200 len: 1299 microversion: 2.1 time: 0.404328 Jul 19 20:04:23.412465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2089/4057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:23 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 1299 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:23.424600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-42360525-d30f-4181-a670-40ee10739667 req-6ee9e584-4bad-466a-a0b6-3bab7ac719ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ac3037-7be4-472c-9f92-0b39d2d0a4bd", "name": "network-vif-deleted", "tag": "9176e1ae-6b92-489b-9dc3-f74613fbed21"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:23.450593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-42360525-d30f-4181-a670-40ee10739667 req-6ee9e584-4bad-466a-a0b6-3bab7ac719ab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.451352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-42360525-d30f-4181-a670-40ee10739667 req-6ee9e584-4bad-466a-a0b6-3bab7ac719ab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.465638 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-42360525-d30f-4181-a670-40ee10739667 req-6ee9e584-4bad-466a-a0b6-3bab7ac719ab service nova] Creating event network-vif-deleted:9176e1ae-6b92-489b-9dc3-f74613fbed21 for instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd on n-h1-843861-3 Jul 19 20:04:23.470995 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-42360525-d30f-4181-a670-40ee10739667 req-6ee9e584-4bad-466a-a0b6-3bab7ac719ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050148 Jul 19 20:04:23.472125 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2090/4058] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:23.477697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4aaa7a1d-1404-4de4-90a6-64809ec73854 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1265961161", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4aaa7a1d-1404-4de4-90a6-64809ec73854 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 243 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1265961161", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1265961161', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'fe44e18b-d8fe-4c62-ba4b-d50d31920122'}]}}} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:23.481604 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4aaa7a1d-1404-4de4-90a6-64809ec73854 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4aaa7a1d-1404-4de4-90a6-64809ec73854 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011361 Jul 19 20:04:23.490872 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2091/4059] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:04:23.502235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:23.503681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:23.517662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.518676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.520258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.521173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.533184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:23.549380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04ef12b0-f1d3-424a-9d92-7fd7c40f81fd tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1504 microversion: 2.1 time: 0.699818 Jul 19 20:04:23.550099 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1969/4060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:22 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:23.581985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:23.585256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 059c8c16-f5af-460f-98d4-76226515e525] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:23.598850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] HTTP exception thrown: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/059c8c16-f5af-460f-98d4-76226515e525/metadata HTTP/1.1 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '059c8c16-f5af-460f-98d4-76226515e525'} Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.604068 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.610223 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:23.610223 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:23.610223 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. Jul 19 20:04:23.610223 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.612271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 404 to user: Instance 059c8c16-f5af-460f-98d4-76226515e525 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:23.613585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f21e7e1-bb8c-4667-aaac-4bec8dcdc72d tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/059c8c16-f5af-460f-98d4-76226515e525/metadata" status: 404 len: 111 microversion: 2.1 time: 0.053588 Jul 19 20:04:23.614658 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1970/4061] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:04:23 2022] GET /compute/v2.1/servers/059c8c16-f5af-460f-98d4-76226515e525/metadata => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:23.692427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-373cce34-99e2-48ce-a402-7c39177e970e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-253341813", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-373cce34-99e2-48ce-a402-7c39177e970e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 498 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-253341813", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-253341813', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'fe44e18b-d8fe-4c62-ba4b-d50d31920122'}]}}} Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 20:04:23.696560 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.700925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-373cce34-99e2-48ce-a402-7c39177e970e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:23.703272 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-373cce34-99e2-48ce-a402-7c39177e970e tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013583 Jul 19 20:04:23.715512 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1971/4062] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:04:23.860197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c2264d9-62e0-4e72-b170-d1d47a4f3c8f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732032992", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c2264d9-62e0-4e72-b170-d1d47a4f3c8f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 499 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732032992", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-732032992', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'fe44e18b-d8fe-4c62-ba4b-d50d31920122'}]}}} Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 20:04:23.872935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:23.879108 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:23.886957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c2264d9-62e0-4e72-b170-d1d47a4f3c8f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:23.888150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c2264d9-62e0-4e72-b170-d1d47a4f3c8f tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.042749 Jul 19 20:04:23.889313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1972/4063] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:04:23.914360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:23.917754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:23.935594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.936684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.940594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:23.942177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.279685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:24.289917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:24.302050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:24.303663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d79c7c3a-5c02-4964-ae9e-d437aea490a7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.808313 Jul 19 20:04:24.304505 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2092/4064] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:23 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:24.309511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-982da6b4-59ef-4243-ba34-3851bf449b6c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096736243", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-982da6b4-59ef-4243-ba34-3851bf449b6c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 754 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096736243", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2096736243', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'fe44e18b-d8fe-4c62-ba4b-d50d31920122'}]}}} Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:24.313888 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:24.316956 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:24.319871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.319871 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.321987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-982da6b4-59ef-4243-ba34-3851bf449b6c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:24.323135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-982da6b4-59ef-4243-ba34-3851bf449b6c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017483 Jul 19 20:04:24.324553 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2093/4065] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 20:04:24.396979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:24.418963 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ec152f1e-c000-4a55-9e76-128a1174657a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.526532 Jul 19 20:04:24.449112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.452098 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1973/4066] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:23 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:24.453247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: 87ac3037-7be4-472c-9f92-0b39d2d0a4bd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.472570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.473262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.476620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.477075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.508521 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] HTTP exception thrown: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Request method failure captured: Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd HTTP/1.1 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w3DYiOW8C_ZlXClL8rYB1ewkA9sBudz6v0EjSIaYnvt6IlAT0RBeAJ24HMHep7HT65lbtSLFihKMcieVvCGyGu0X8pxyyMmgCsGX52pELFlYLq8J2Bolsb5eOSe8jBwRG16qclo5muiKqa2ynyreOwZizgunOfj41N4Of6WsjEzySs Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 24d88c1036be473096fdc2b64fbc9641 Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '87ac3037-7be4-472c-9f92-0b39d2d0a4bd'} Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.510082 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Returning 404 to user: Instance 87ac3037-7be4-472c-9f92-0b39d2d0a4bd could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-77f05c8d-6dda-4d4e-a6b0-fd2a37a621bd tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd" status: 404 len: 111 microversion: 2.1 time: 0.079644 Jul 19 20:04:24.516867 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2094/4067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:24 2022] GET /compute/v2.1/servers/87ac3037-7be4-472c-9f92-0b39d2d0a4bd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:24.526268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.527912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.539211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.539676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.541611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.542079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.570256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.571056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.585928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.586386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.587350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.589994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.609475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:24.726146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a167fad43134816835a38c0783e93cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd202565e715240e4b0b591b8c73bdbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:24.743686 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cf7ec24-c4a1-4ec2-92cc-863fa7cf2fd1 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 200 len: 1462 microversion: 2.1 time: 0.177590 Jul 19 20:04:24.748217 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2095/4068] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:24 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 1462 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:24.767405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0ab1473-eb8e-46e1-9787-26c49a3c34ca tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1043286833", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0ab1473-eb8e-46e1-9787-26c49a3c34ca tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 1266 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1043286833", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fe44e18b-d8fe-4c62-ba4b-d50d31920122"}]}} Jul 19 20:04:24.772912 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1043286833', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'fe44e18b-d8fe-4c62-ba4b-d50d31920122'}]}}} Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.775477 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:24.777338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:24.781620 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 20:04:24.781620 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.781620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0ab1473-eb8e-46e1-9787-26c49a3c34ca tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:24.781620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0ab1473-eb8e-46e1-9787-26c49a3c34ca tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.026337 Jul 19 20:04:24.781620 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2096/4069] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Jul 19 20:04:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 20:04:24.792640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:24.815411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.816478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: e5685024-ba53-4c61-bb32-16d51fd74e18] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.827940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] HTTP exception thrown: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e5685024-ba53-4c61-bb32-16d51fd74e18/metadata/test2 HTTP/1.1 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': 'e5685024-ba53-4c61-bb32-16d51fd74e18', 'id': 'test2'} Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:24.833036 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:24.842273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:24.842273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:24.842273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. Jul 19 20:04:24.842273 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:24.851284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 404 to user: Instance e5685024-ba53-4c61-bb32-16d51fd74e18 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:24.863045 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-adecd7a5-ff33-44ce-8f6b-ba474b6afb4b tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/e5685024-ba53-4c61-bb32-16d51fd74e18/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.062277 Jul 19 20:04:24.867255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86f52b49-458e-4c66-bb16-c1aaed2542e6 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 204 len: 0 microversion: 2.1 time: 0.338410 Jul 19 20:04:24.877329 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2097/4071] 10.222.0.33 () {58 vars in 1280 bytes} [Tue Jul 19 20:04:24 2022] GET /compute/v2.1/servers/e5685024-ba53-4c61-bb32-16d51fd74e18/metadata/test2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:04:24.882770 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1974/4071] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:24 2022] DELETE /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:24.916351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.919269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.922633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.925620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.944530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.945307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.947528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.949177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.991796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.992524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.993391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.993846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.001024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:25.143753 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-694bb24c-0a85-4d4e-80b0-f52700f51537 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 204 len: 0 microversion: 2.1 time: 0.256480 Jul 19 20:04:25.145351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2098/4072] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:24 2022] DELETE /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:25.162701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:25.172084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:25.180664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.181399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.183032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.185677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.443877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.457832 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9cd7d32-b582-44ae-bf3b-bd7fead7bbd0 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1526 microversion: 2.1 time: 0.305767 Jul 19 20:04:25.460259 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2099/4073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:25.468078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:25.469234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:25.476493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.478187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.478990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.480624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.481362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.486857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc51d05a-30bd-4a42-9d2c-fdefbbd44382 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1469 microversion: 2.1 time: 0.597830 Jul 19 20:04:25.490890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1975/4074] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:24 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:25.501061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:25.502206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:25.510162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.512173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.513819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.514587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.758642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.774480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.780564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.783713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:25.785267 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aad5ee71-ac16-457a-bba7-9afdd47e0c43 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1743 microversion: 2.20 time: 0.322160 Jul 19 20:04:25.787083 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2100/4075] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1743 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:25.793379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c75a9758-4c53-4e95-b1bf-e2b936a7f93e req-1c640e84-13cf-4aeb-b93c-e72f069be4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3223baa-92f5-4218-a723-0b283e65825f", "name": "network-vif-deleted", "tag": "49bcbc1a-0023-4f4e-813d-ff517ee8c3a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:25.801116 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6a16d4b-b164-41f1-8c40-1779f3fccb1f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.308798 Jul 19 20:04:25.810582 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1976/4076] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:25.812325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c75a9758-4c53-4e95-b1bf-e2b936a7f93e req-1c640e84-13cf-4aeb-b93c-e72f069be4ba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.812981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c75a9758-4c53-4e95-b1bf-e2b936a7f93e req-1c640e84-13cf-4aeb-b93c-e72f069be4ba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.815252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:25.815916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:25.833574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.834141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.835110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.835554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.838015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c75a9758-4c53-4e95-b1bf-e2b936a7f93e req-1c640e84-13cf-4aeb-b93c-e72f069be4ba service nova] Creating event network-vif-deleted:49bcbc1a-0023-4f4e-813d-ff517ee8c3a5 for instance f3223baa-92f5-4218-a723-0b283e65825f on n-h2-843861-3 Jul 19 20:04:25.849394 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c75a9758-4c53-4e95-b1bf-e2b936a7f93e req-1c640e84-13cf-4aeb-b93c-e72f069be4ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060634 Jul 19 20:04:25.850645 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2101/4077] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:25.883176 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f HTTP/1.1 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f3223baa-92f5-4218-a723-0b283e65825f'} Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:25.886676 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3719752a-5bdd-461d-a5c6-ba76e3562ac3 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 404 len: 111 microversion: 2.1 time: 0.083910 Jul 19 20:04:25.910070 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1977/4078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:25.911536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-406eb3be-dd42-447f-b911-2d66941c4f21 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:25.936875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.server_groups [None req-406eb3be-dd42-447f-b911-2d66941c4f21 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Querying cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) for 1 instances {{(pid=126008) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:04:25.946431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406eb3be-dd42-447f-b911-2d66941c4f21 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:25.946895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406eb3be-dd42-447f-b911-2d66941c4f21 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:25.987933 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-406eb3be-dd42-447f-b911-2d66941c4f21 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.091786 Jul 19 20:04:26.003771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-369a85ee-fac9-40fd-b1bd-e6dcc928f27e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.004775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2102/4079] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:26.026768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.server_groups [None req-369a85ee-fac9-40fd-b1bd-e6dcc928f27e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Querying cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) for 1 instances {{(pid=126007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:04:26.028059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369a85ee-fac9-40fd-b1bd-e6dcc928f27e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.028683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369a85ee-fac9-40fd-b1bd-e6dcc928f27e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.045409 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-369a85ee-fac9-40fd-b1bd-e6dcc928f27e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53" status: 200 len: 183 microversion: 2.1 time: 0.047626 Jul 19 20:04:26.060691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.061645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:26.065125 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1978/4080] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:04:25 2022] GET /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53 => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:26.069791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.070827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.072449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.074033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.102886 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f HTTP/1.1 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f3223baa-92f5-4218-a723-0b283e65825f'} Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:26.105501 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.112675 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.115596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.117228 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94371bf3-fe59-497a-a19e-1ac30368c139 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 404 len: 111 microversion: 2.1 time: 0.061086 Jul 19 20:04:26.122961 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2103/4081] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:26.129688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.130649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] [instance: f3223baa-92f5-4218-a723-0b283e65825f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:26.151481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.151986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.152808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.154642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.184506 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f HTTP/1.1 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f3223baa-92f5-4218-a723-0b283e65825f'} Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.186296 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance f3223baa-92f5-4218-a723-0b283e65825f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f45ab17-d99a-4bf9-ba81-facfd6d22024 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f" status: 404 len: 111 microversion: 2.1 time: 0.064490 Jul 19 20:04:26.194280 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1979/4082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:26 2022] GET /compute/v2.1/servers/f3223baa-92f5-4218-a723-0b283e65825f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:26.205639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-510d7883-b111-4b61-b585-ca20fd95e503 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.236371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-510d7883-b111-4b61-b585-ca20fd95e503 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-510d7883-b111-4b61-b585-ca20fd95e503 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-server-groups/f2125b4d-5af4-4083-bb53-b06fd799075d HTTP/1.1 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f2125b4d-5af4-4083-bb53-b06fd799075d'} Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.240564 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.252276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-510d7883-b111-4b61-b585-ca20fd95e503 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance group f2125b4d-5af4-4083-bb53-b06fd799075d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.255040 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-510d7883-b111-4b61-b585-ca20fd95e503 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/f2125b4d-5af4-4083-bb53-b06fd799075d" status: 404 len: 117 microversion: 2.1 time: 0.058164 Jul 19 20:04:26.256867 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2104/4083] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/os-server-groups/f2125b4d-5af4-4083-bb53-b06fd799075d => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:26.267333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78a00b67-e21c-4143-916f-6c5dc1b9417e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.275458 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-78a00b67-e21c-4143-916f-6c5dc1b9417e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78a00b67-e21c-4143-916f-6c5dc1b9417e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-server-groups/1367db1f-8de8-42a3-9617-d5d866811b5e HTTP/1.1 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1367db1f-8de8-42a3-9617-d5d866811b5e'} Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.277738 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. Jul 19 20:04:26.284077 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.286220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78a00b67-e21c-4143-916f-6c5dc1b9417e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance group 1367db1f-8de8-42a3-9617-d5d866811b5e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.287523 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78a00b67-e21c-4143-916f-6c5dc1b9417e tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/1367db1f-8de8-42a3-9617-d5d866811b5e" status: 404 len: 117 microversion: 2.1 time: 0.025961 Jul 19 20:04:26.288863 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1980/4084] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/os-server-groups/1367db1f-8de8-42a3-9617-d5d866811b5e => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:04:26.302244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1bf97364-d3f6-41b5-adc0-357d38f1148c tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.314143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-1bf97364-d3f6-41b5-adc0-357d38f1148c tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1bf97364-d3f6-41b5-adc0-357d38f1148c tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-server-groups/f9e4ab07-03d6-4816-b600-c7086dc63427 HTTP/1.1 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f9e4ab07-03d6-4816-b600-c7086dc63427'} Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.316313 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. Jul 19 20:04:26.321709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.324155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1bf97364-d3f6-41b5-adc0-357d38f1148c tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance group f9e4ab07-03d6-4816-b600-c7086dc63427 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.325393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1bf97364-d3f6-41b5-adc0-357d38f1148c tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/f9e4ab07-03d6-4816-b600-c7086dc63427" status: 404 len: 117 microversion: 2.1 time: 0.031946 Jul 19 20:04:26.326564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2105/4085] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/os-server-groups/f9e4ab07-03d6-4816-b600-c7086dc63427 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:04:26.340211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a050023e-09b7-47f0-834d-117fd3b007ef tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.355215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a050023e-09b7-47f0-834d-117fd3b007ef tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] HTTP exception thrown: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a050023e-09b7-47f0-834d-117fd3b007ef tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Request method failure captured: Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-server-groups/ab10440c-63ed-46f3-b03c-326e690e4689 HTTP/1.1 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4qi-PhTAJdNcguJRAiFT7ZP_v7YBpXQR2cSTqLjgEoJy55cNHdKYb5MsOTPensTRxMEgSk7GyvNQ0ZE1JgXHgkJsUO-MILrbSvNQzCmb-n2E76hjek0mFr6X4g7gL_KFw6QKT54AyvWzAIQuMyAhWj3YWHb4hEhKWufO92-gaKj9A Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d202565e715240e4b0b591b8c73bdbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d202565e715240e4b0b591b8c73bdbea Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerGroupTestJSON-2091606121 Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1a167fad43134816835a38c0783e93cd Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerGroupTestJSON-2091606121-project Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ab10440c-63ed-46f3-b03c-326e690e4689'} Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.358501 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a050023e-09b7-47f0-834d-117fd3b007ef tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Returning 404 to user: Instance group ab10440c-63ed-46f3-b03c-326e690e4689 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a050023e-09b7-47f0-834d-117fd3b007ef tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ab10440c-63ed-46f3-b03c-326e690e4689" status: 404 len: 117 microversion: 2.1 time: 0.030220 Jul 19 20:04:26.364534 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1981/4086] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/os-server-groups/ab10440c-63ed-46f3-b03c-326e690e4689 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:26.377327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca9f8b05-014e-4b3e-8c6f-98b1076b74e6 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.418958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:26.437268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca9f8b05-014e-4b3e-8c6f-98b1076b74e6 tempest-ServerGroupTestJSON-2091606121 tempest-ServerGroupTestJSON-2091606121-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53" status: 204 len: 0 microversion: 2.1 time: 0.068201 Jul 19 20:04:26.438792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2106/4087] 10.222.0.33 () {58 vars in 1265 bytes} [Tue Jul 19 20:04:26 2022] DELETE /compute/v2.1/os-server-groups/f25b717e-6f6e-4cd2-91c0-085e77f1cb53 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:26.482312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.484306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:26.507963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.509001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.516464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.517220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.532672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.543938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:26.582052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.583050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.586744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.590113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.904178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:26.925638 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-846b01cb-23a3-4b41-b77c-da3fa76e63dd tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1526 microversion: 2.1 time: 0.452078 Jul 19 20:04:26.926967 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1982/4088] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:26 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1526 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:26.935103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:26.936757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:26.947683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.949173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:26.950588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:26.951317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.286330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:27.297867 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02dd3b0a-fb31-46a7-a7eb-7ddca7c2c381 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1469 microversion: 2.1 time: 0.790682 Jul 19 20:04:27.306572 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2107/4089] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:26 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:27.317417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:27.330232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:27.346086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.346926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.351597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.352407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.577217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:27.590169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:27.595330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:27.597409 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41256161-c89b-4a7c-a1fc-862720b6f1b0 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1743 microversion: 2.20 time: 0.668345 Jul 19 20:04:27.600126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1983/4090] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:26 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1743 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:27.608946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:27.612108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:27.632408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.633350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.634454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.635167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.724171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:27.739565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c6e7344-3ab1-4b37-8fd5-a2186b3b8db0 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/c1cb8baf-892c-4a62-84fa-5f55b79d38fe" status: 200 len: 194 microversion: 2.1 time: 0.138122 Jul 19 20:04:27.742632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1984/4091] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 19 20:04:27 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/c1cb8baf-892c-4a62-84fa-5f55b79d38fe => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:27.768608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:27.769821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:27.797050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.803947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:27.805311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:27.808596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.067966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lazy-loading 'services' on Instance uuid 7f6f6742-1a02-45c1-a039-f44afeea52c7 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:28.286032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:28.305928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26b97063-79a3-43bb-ba54-33f9442e2974 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.997582 Jul 19 20:04:28.308604 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2108/4092] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:27 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:28.316744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:28.321296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:28.348351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.350456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.352130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.353922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.412972 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cdcc834e-89dc-4edf-ae26-fd4d5cadb3ee tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/c1cb8baf-892c-4a62-84fa-5f55b79d38fe" status: 202 len: 0 microversion: 2.1 time: 0.654981 Jul 19 20:04:28.417603 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1985/4093] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:04:27 2022] DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments/c1cb8baf-892c-4a62-84fa-5f55b79d38fe => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:04:28.459131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:28.482706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:28.536921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.538029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.539492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.547043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.457152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:29.475494 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea461f78-3276-4ea4-9865-109f58572028 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1469 microversion: 2.1 time: 1.047968 Jul 19 20:04:29.476298 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1986/4094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:28 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1469 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:29.494735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-88c66a82-3077-4d2f-aa9e-f304e57725c3 req-3b21ab00-7739-43af-8f5e-e89831bb43c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "name": "network-vif-plugged", "status": "completed", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:29.501844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b369727298a4477862f2e3b475334cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e09cee661fa4d9eaee46c0f512fb139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:29.519578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b397d8c0-2b7c-4c88-b3dc-e25e7647a551 tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 200 len: 1526 microversion: 2.1 time: 1.209515 Jul 19 20:04:29.523191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2109/4095] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:28 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 1526 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:29.541179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:29.544517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:29.549599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-88c66a82-3077-4d2f-aa9e-f304e57725c3 req-3b21ab00-7739-43af-8f5e-e89831bb43c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.553215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-88c66a82-3077-4d2f-aa9e-f304e57725c3 req-3b21ab00-7739-43af-8f5e-e89831bb43c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.567207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.572270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.581096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.585404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.609095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-88c66a82-3077-4d2f-aa9e-f304e57725c3 req-3b21ab00-7739-43af-8f5e-e89831bb43c2 service nova] Creating event network-vif-plugged:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:04:29.625041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-88c66a82-3077-4d2f-aa9e-f304e57725c3 req-3b21ab00-7739-43af-8f5e-e89831bb43c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133702 Jul 19 20:04:29.647541 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1987/4096] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:29.677895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:29.684348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:29.709914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.713225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.721298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.722214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.061966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.063634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.076754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3181bc2d-ee93-431d-8256-5530c8b3b917 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 1.426617 Jul 19 20:04:31.090046 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1988/4097] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:29 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:31.097370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8112ce28-a77e-4a6d-9791-b28c4adbeef4 req-016dc13e-5d11-4213-810b-9e8d9280df10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e034cf3-4c9e-4b42-b4fa-8543cd87ad68", "name": "network-vif-deleted", "tag": "26d1523c-7e12-4e05-ba8a-2807e3e82f30"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:31.108698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.110945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.115082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8112ce28-a77e-4a6d-9791-b28c4adbeef4 req-016dc13e-5d11-4213-810b-9e8d9280df10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.115949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8112ce28-a77e-4a6d-9791-b28c4adbeef4 req-016dc13e-5d11-4213-810b-9e8d9280df10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.124455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b464e96a-b23b-4149-8021-ae7b9ca8eff5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 1.598433 Jul 19 20:04:31.131465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2110/4098] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:29 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:31.131979 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8112ce28-a77e-4a6d-9791-b28c4adbeef4 req-016dc13e-5d11-4213-810b-9e8d9280df10 service nova] Creating event network-vif-deleted:26d1523c-7e12-4e05-ba8a-2807e3e82f30 for instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 on n-h1-843861-3 Jul 19 20:04:31.138959 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8112ce28-a77e-4a6d-9791-b28c4adbeef4 req-016dc13e-5d11-4213-810b-9e8d9280df10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046784 Jul 19 20:04:31.140522 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1989/4099] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:31.145635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:31.148446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:31.149427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] [instance: 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:31.154432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:31.157012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.157975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.159169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.159886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.183520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] HTTP exception thrown: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Request method failure captured: Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 HTTP/1.1 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w4zxqzlZHbcaT0EwxqH0a7x_AzhOAlxZt7_rIsxXS1ESscYdQXiFvu8OsyGuiYmtWVJmAs2wryPlyANueCMnqr0cQcQRey-bpIqbJMj4NdgvvsUGndre8h2G6YsT115mrcqDIpSGtS2NLlfOcu9hrfXvg-PJhJGAiFzxDs08Jcz0TA Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e09cee661fa4d9eaee46c0f512fb139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7e09cee661fa4d9eaee46c0f512fb139 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1458515228 Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4b369727298a4477862f2e3b475334cd Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1458515228-project Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4e034cf3-4c9e-4b42-b4fa-8543cd87ad68'} Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:31.185867 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. Jul 19 20:04:31.193808 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:31.195917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] Returning 404 to user: Instance 4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:31.196587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.197324 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d058c6a-2fd2-44ad-9d1d-103ed499f66c tempest-ServerMetadataNegativeTestJSON-1458515228 tempest-ServerMetadataNegativeTestJSON-1458515228-project] 10.222.0.33 "GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68" status: 404 len: 111 microversion: 2.1 time: 0.055480 Jul 19 20:04:31.197962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.198476 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1990/4100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:31 2022] GET /compute/v2.1/servers/4e034cf3-4c9e-4b42-b4fa-8543cd87ad68 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:31.203033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.206204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.215363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5c6b54b8-28cb-4244-84ff-84e4f600d1a3 req-1907bca2-ec10-44f4-871f-44cc141f283d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88d10dd-f023-4440-9c9f-a8075ad83fac", "name": "network-vif-deleted", "tag": "35e99701-2d9d-41f4-9bca-aa5a3be5cc85"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:31.257353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5c6b54b8-28cb-4244-84ff-84e4f600d1a3 req-1907bca2-ec10-44f4-871f-44cc141f283d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.258033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5c6b54b8-28cb-4244-84ff-84e4f600d1a3 req-1907bca2-ec10-44f4-871f-44cc141f283d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.313752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:31.314199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:31.317347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lazy-loading 'fault' on Instance uuid c88d10dd-f023-4440-9c9f-a8075ad83fac {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:31.333140 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5c6b54b8-28cb-4244-84ff-84e4f600d1a3 req-1907bca2-ec10-44f4-871f-44cc141f283d service nova] Creating event network-vif-deleted:35e99701-2d9d-41f4-9bca-aa5a3be5cc85 for instance c88d10dd-f023-4440-9c9f-a8075ad83fac on n-h1-843861-3 Jul 19 20:04:31.344012 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5c6b54b8-28cb-4244-84ff-84e4f600d1a3 req-1907bca2-ec10-44f4-871f-44cc141f283d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134594 Jul 19 20:04:31.345365 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1991/4101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:31.713932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d88c1036be473096fdc2b64fbc9641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7966f3d8fa06454ba3e7b879174509f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.749121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d1ee5f4-19c5-407d-87f9-440b035603f4 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 200 len: 1303 microversion: 2.1 time: 0.613620 Jul 19 20:04:31.750671 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2111/4102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:31 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 1303 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:32.099141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:32.100595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:32.122205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.122665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.123475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.123993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.164728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:32.166087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:32.190716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.191681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.192798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.193525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.746198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:32.752629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:32.784735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:32.787545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:32.791513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5874397f-b180-4f1f-9289-baf2055c402b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 0.634448 Jul 19 20:04:32.798196 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2112/4103] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:32 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:32.812055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:32.813160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] [instance: c88d10dd-f023-4440-9c9f-a8075ad83fac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:32.821739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:32.830744 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-126ba503-dcfa-4877-9a60-f669df0f6eba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.736349 Jul 19 20:04:32.839497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.856443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1992/4104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:32 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:32.872074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.873655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.874562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.903452 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] HTTP exception thrown: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Request method failure captured: Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac HTTP/1.1 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w3DYiOW8C_ZlXClL8rYB1ewkA9sBudz6v0EjSIaYnvt6IlAT0RBeAJ24HMHep7HT65lbtSLFihKMcieVvCGyGu0X8pxyyMmgCsGX52pELFlYLq8J2Bolsb5eOSe8jBwRG16qclo5muiKqa2ynyreOwZizgunOfj41N4Of6WsjEzySs Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7966f3d8fa06454ba3e7b879174509f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7966f3d8fa06454ba3e7b879174509f6 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminTestJSON-2048934982 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 24d88c1036be473096fdc2b64fbc9641 Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminTestJSON-2048934982-project Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c88d10dd-f023-4440-9c9f-a8075ad83fac'} Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:32.911690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. Jul 19 20:04:32.920488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:04:32.925914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] Returning 404 to user: Instance c88d10dd-f023-4440-9c9f-a8075ad83fac could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:32.943615 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-006387ed-adc2-4dc0-b507-b114a3f3d971 tempest-ServersAdminTestJSON-2048934982 tempest-ServersAdminTestJSON-2048934982-project] 10.222.0.33 "GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac" status: 404 len: 111 microversion: 2.1 time: 0.143754 Jul 19 20:04:32.944759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2113/4105] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:32 2022] GET /compute/v2.1/servers/c88d10dd-f023-4440-9c9f-a8075ad83fac => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:33.821376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:33.824470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:33.841871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.844783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:33.849796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.867284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:33.902058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:33.902810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:33.910220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.911185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:33.912457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.913214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:34.926751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:34.945732 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-994d8a86-602a-4bcc-8ecd-6d046e0d7a8e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 1.091030 Jul 19 20:04:34.946325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2114/4106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:33 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:35.790278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:35.806910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:35.812326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:35.821965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f813323-9a8b-45ba-81fa-a522b87c00b9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 2.004723 Jul 19 20:04:35.822960 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1993/4107] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:33 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:35.963327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:35.965726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:35.982357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.984498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:35.987830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.990812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:36.558514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:36.595307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cfefeb83-045e-49aa-9e27-b1ae0be86bc8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1523 microversion: 2.1 time: 0.635530 Jul 19 20:04:36.596992 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2115/4108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:35 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:36.842246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:36.843934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:36.867461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:36.867949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:36.874206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:36.876815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:37.615033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:37.618557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:37.633247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:37.652670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:37.654463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:37.655304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:37.657253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:37.658078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:37.659296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:37.665337 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0640126-c9a3-4ed3-9bd6-ed0e051ccfe4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 0.823524 Jul 19 20:04:37.666719 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1994/4109] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:36 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:37.825390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:37.827490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:37.850213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:37.853985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:37.856598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:37.859740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.046235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a152d63e-aba6-43ff-85c9-66462b1f918c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.225795 Jul 19 20:04:38.048426 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1995/4110] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:37 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:38.060311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:38.061454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:38.073089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.074895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.080138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.081248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.246469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.262377 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb45f102-08be-4033-8879-a739b77dd49b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1505 microversion: 2.1 time: 1.651336 Jul 19 20:04:39.264038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2116/4111] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:37 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1505 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:39.280981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:39.281969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:39.305412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:39.306088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.307384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:39.308642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.504733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.530174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57cc67f6-6dd0-4b42-8495-1c5ebb669072 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1671 microversion: 2.1 time: 1.477403 Jul 19 20:04:39.531631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1996/4112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:38 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1671 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:39.947150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.962186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.976577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.981664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee28f2c9-08b8-46ca-b072-a3de60f7ac54 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 0.715858 Jul 19 20:04:40.003324 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2117/4113] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:39 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:40.281733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:40.282405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:40.300922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.301413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.302239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.302669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.527144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:40.538932 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-21740457-ca7a-40ae-bac1-504052191d5a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1505 microversion: 2.1 time: 0.262314 Jul 19 20:04:40.549244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:40.549725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:40.551082 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1997/4114] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:40 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:40.560970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.561698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.562702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.564344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.917919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:40.921516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f5a5d649-d870-4330-9156-ffba61db87f7 req-f9cf5bdf-9797-4a3f-a9a2-02d2b3dca769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728a3bd3-b439-43df-8f1c-09e2a7d34b8a", "name": "network-vif-unplugged", "status": "completed", "tag": "a91ade39-aa57-4deb-9731-81be7469fc34"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:40.939569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41250049-563f-422f-9efa-691ea092c6aa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1671 microversion: 2.1 time: 0.394700 Jul 19 20:04:40.945245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2118/4115] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:40 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1671 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:40.946704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5a5d649-d870-4330-9156-ffba61db87f7 req-f9cf5bdf-9797-4a3f-a9a2-02d2b3dca769 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.947459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5a5d649-d870-4330-9156-ffba61db87f7 req-f9cf5bdf-9797-4a3f-a9a2-02d2b3dca769 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.976293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f5a5d649-d870-4330-9156-ffba61db87f7 req-f9cf5bdf-9797-4a3f-a9a2-02d2b3dca769 service nova] Creating event network-vif-unplugged:a91ade39-aa57-4deb-9731-81be7469fc34 for instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a on n-h2-843861-3 Jul 19 20:04:40.982917 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f5a5d649-d870-4330-9156-ffba61db87f7 req-f9cf5bdf-9797-4a3f-a9a2-02d2b3dca769 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069652 Jul 19 20:04:40.984632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1998/4116] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:41.012416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:41.013131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:41.061927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.062876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.064062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.064753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.475401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:41.486326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:41.493501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:41.495192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c9d80f7-580c-45ed-8263-e7b982d80836 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 0.488650 Jul 19 20:04:41.495867 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2119/4117] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:41 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:41.557682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:41.558539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:41.570679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.571136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.571965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.572408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.967038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:41.967864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:41.983241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.983779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.986955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.988920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:42.614231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:42.636428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08f8b567-301d-4a8d-a43e-059e10e8cdd6 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1505 microversion: 2.1 time: 1.081397 Jul 19 20:04:42.637096 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 1999/4118] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:41 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1505 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:42.643437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:42.648829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:42.672527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:42.679907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:42.687899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:42.689536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:42.971176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:42.993583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41510137-09e8-4c9d-be92-d9c6ef143304 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1671 microversion: 2.1 time: 1.034030 Jul 19 20:04:42.997135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2120/4119] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:41 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1671 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:43.285386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:43.286786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:43.306991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.309991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.312749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.314814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.398493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0474a646-201b-4470-8a61-dd5682e30cf6 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118244 Jul 19 20:04:43.400164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2121/4120] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:43 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:04:43.480897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:43.501493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:43.505606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:43.511441 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-406ce244-42b0-4d10-8370-aba51265e6bc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 0.869236 Jul 19 20:04:43.512568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2000/4121] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:42 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:43.630538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:43.631516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:43.645087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.645571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.646355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.646797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.657268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:43.657982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:43.669360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.673825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.675267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.676104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.725769 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-250cd63a-98d8-49e3-8ca4-3835a1efd606 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100095 Jul 19 20:04:43.726967 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2122/4122] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:43 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:04:43.974954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:43.976329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:43.990560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.991344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.992511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.994731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.011086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:44.027076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb0bcd9c-68f0-468f-ac52-61762deb30ba tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 200 len: 1448 microversion: 2.1 time: 0.372413 Jul 19 20:04:44.031590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2001/4123] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:43 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 1448 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:44.049511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:44.050410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:44.082050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.083766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.087187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.088617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.101684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:44.318231 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71eddd95-06b5-437b-b913-40c0e388b51f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 204 len: 0 microversion: 2.1 time: 0.346718 Jul 19 20:04:44.328344 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2123/4124] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:43 2022] DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:04:44.335329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:44.335962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:44.344934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.346344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.347396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.348074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.436257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:04:44.472531 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.api [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Working on deleting snapshot fb512c01-f1f8-4202-9f60-e7addd3d72eb from shelved instance... Jul 19 20:04:44.681060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:44.696988 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a2fe7c3d-67b5-4d4f-919d-fc53284146a2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.663999 Jul 19 20:04:44.711294 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2002/4125] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:44 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:44.717228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:44.724387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:44.738483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.739259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.740393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:44.741053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:44.744516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:45.510260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:45.529488 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26102fb8-4bce-4559-a156-d6d4d1a8c4ab tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1674 microversion: 2.1 time: 0.816564 Jul 19 20:04:45.530766 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2003/4126] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:44 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1674 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:45.547267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:45.549478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:45.574255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:45.578505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:45.579629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:45.582482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.545934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:46.553012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Doing local delete in cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126008) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 20:04:46.580875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:46.584240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.585701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.api [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 20:04:46.598863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:46.599229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] deallocate_for_instance() {{(pid=126008) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 20:04:46.602592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:46.609022 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c04cd78a-33a3-4e0d-a31f-475f0e70d2a4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 1.075470 Jul 19 20:04:46.613265 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2004/4127] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:45 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:46.656421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:46.659839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:46.687338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:46.691067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.694997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:46.696027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:47.908556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:47.918719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b96ffe2-2e15-48b9-b986-0453475fad72 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1674 microversion: 2.1 time: 1.276003 Jul 19 20:04:47.930789 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2005/4128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:46 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1674 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:47.938184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:47.939420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:47.953879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:47.955465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:47.956827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:47.957869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.575584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.605949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.610502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.622177 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eff655e2-6f80-4f34-9093-e31b9616613f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 2.689577 Jul 19 20:04:50.633606 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2006/4129] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:47 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:50.659106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.663870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.704141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.715035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.716382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.726027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.849241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Updating instance_info_cache with network_info: [] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 20:04:51.720258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:52.076131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-603568b9-bf07-4f72-a09f-c6e095a11bb7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 204 len: 0 microversion: 2.1 time: 7.742203 Jul 19 20:04:52.078098 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2124/4130] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:44 2022] DELETE /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 0 bytes in 7749 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:04:52.093005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-931948b3-7354-4b2a-8665-ce731c410650 req-e6820def-890d-4317-ac53-960c992284ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728a3bd3-b439-43df-8f1c-09e2a7d34b8a", "name": "network-vif-deleted", "tag": "a91ade39-aa57-4deb-9731-81be7469fc34"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:52.125689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-931948b3-7354-4b2a-8665-ce731c410650 req-e6820def-890d-4317-ac53-960c992284ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.128433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-931948b3-7354-4b2a-8665-ce731c410650 req-e6820def-890d-4317-ac53-960c992284ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.176832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.server_external_events [req-931948b3-7354-4b2a-8665-ce731c410650 req-e6820def-890d-4317-ac53-960c992284ed service nova] Unable to find a host for instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a. Dropping event network-vif-deleted {{(pid=126008) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:04:52.180162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-931948b3-7354-4b2a-8665-ce731c410650 req-e6820def-890d-4317-ac53-960c992284ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.099829 Jul 19 20:04:52.185135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2125/4131] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 20:04:52.203581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:52.205904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:52.223219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.225904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.227627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.230115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.617800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:52.637905 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e77662a-f65e-400b-b0ce-7f0974380db9 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1674 microversion: 2.1 time: 1.992758 Jul 19 20:04:52.639850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2007/4132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:50 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1674 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:52.678866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:52.682779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:52.721133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.726545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.731909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.733623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.851290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a HTTP/1.1 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '728a3bd3-b439-43df-8f1c-09e2a7d34b8a'} Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:52.862387 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:04:52.867423 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:52.899783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:52.902599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7e34e37-2d39-486c-a320-b8f0ec69af20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 404 len: 111 microversion: 2.1 time: 0.256930 Jul 19 20:04:52.918924 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2008/4133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:52 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:53.342992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-929698066", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:53.548531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:04:54.554455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:54.574974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:54.591897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:54.594268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9eafd5b-8c97-49f0-9aa3-0b48a46c57c5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 2.407031 Jul 19 20:04:54.595116 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2126/4134] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:52 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:54.619160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:54.621240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:54.634073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.635388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.637593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.638660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.949173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lazy-loading 'services' on Instance uuid 4700e5f4-0c76-49de-a895-07b0a44bc11c {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:55.158118 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f18e75f4-b7ef-4bed-bb3e-af844c6c145b tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments/51940381-a892-4201-9e7c-be023d293d80" status: 202 len: 0 microversion: 2.1 time: 0.560237 Jul 19 20:04:55.185459 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2127/4135] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:04:54 2022] DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments/51940381-a892-4201-9e7c-be023d293d80 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:55.222555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.238912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:55.294186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.307984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.317251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.318012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.665788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de95f85ce3714254acdb08a4004081bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d80827178dd426d92e131b50cf2cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:55.696485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f027c61-cb70-4c3c-9ee5-18ff332df2e1 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 200 len: 1322 microversion: 2.1 time: 0.508719 Jul 19 20:04:55.697294 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2128/4136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:55 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:56.287557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e050187-81cd-472d-a907-112ba7fc71ba tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Action: 'create', calling method: .version_select at 0x7fb88d133f70>, body: {"pool": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:57.421095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:04:57.421790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:04:57.421944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:04:57.422416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:04:57.422835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:04:57.425401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:57.472435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:57.473065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.474192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:57.474787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.539642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:04:57.581953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:04:57.599162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:04:57.602074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:04:57.686199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0361adcc-17f4-45a9-868d-2bae5e0cdb20 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.348057 Jul 19 20:04:57.687458 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2009/4137] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:04:57.693188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:57.694495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:57.702424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:57.703722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.705442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:57.706659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.772049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a0bf6fc-7ea7-4e6d-8879-9440ad105cdf tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081713 Jul 19 20:04:57.788459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2010/4138] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:57 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:57.819514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e5c00734-c0ee-48ca-ba41-c27c501f0c48 req-6ac20e6f-09ab-4083-9598-5e82f53a86d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6f6742-1a02-45c1-a039-f44afeea52c7", "name": "network-vif-deleted", "tag": "c516bb10-233a-49d8-9c92-7678f47e1a99"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:57.851540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e5c00734-c0ee-48ca-ba41-c27c501f0c48 req-6ac20e6f-09ab-4083-9598-5e82f53a86d2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:57.852404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e5c00734-c0ee-48ca-ba41-c27c501f0c48 req-6ac20e6f-09ab-4083-9598-5e82f53a86d2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.918328 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e5c00734-c0ee-48ca-ba41-c27c501f0c48 req-6ac20e6f-09ab-4083-9598-5e82f53a86d2 service nova] Creating event network-vif-deleted:c516bb10-233a-49d8-9c92-7678f47e1a99 for instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 on n-h2-843861-3 Jul 19 20:04:57.939960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e5c00734-c0ee-48ca-ba41-c27c501f0c48 req-6ac20e6f-09ab-4083-9598-5e82f53a86d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148878 Jul 19 20:04:57.946001 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2011/4139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:57.988979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:57.990471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:58.004980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.005683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.006910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.007504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.162022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:59.177121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:59.181169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:59.183486 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31346d7e-0bab-4fe1-960a-c67490d0b3f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1738 microversion: 2.20 time: 1.234134 Jul 19 20:04:59.192630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2012/4140] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:04:57 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1738 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:04:59.198997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:59.199915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:59.216718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.217409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.218367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.228729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.263149 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 HTTP/1.1 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7f6f6742-1a02-45c1-a039-f44afeea52c7'} Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:59.264074 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:59.272147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2bbdd792-21bc-4908-a07c-480efe4f4dd7 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 404 len: 111 microversion: 2.1 time: 0.071552 Jul 19 20:04:59.282467 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2013/4141] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:59 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:59.294753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:59.295789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:59.318148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.319367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.321290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.328261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.602018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:00.626815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf81ea42-e9d2-4c44-b688-8725120d10ed tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1210 microversion: 2.1 time: 1.342298 Jul 19 20:05:00.644595 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2014/4142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:59 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1210 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:00.662640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:00.663671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:00.679586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.680334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.685139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.685925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.776915 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e8c47b1-f666-4c14-b437-aaf76c305053 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124313 Jul 19 20:05:00.777934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2015/4143] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:00 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:00.788858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1602dddb-f216-4a18-ac95-fc42521f402f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '.version_select at 0x7fb88e267280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:00.854636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1602dddb-f216-4a18-ac95-fc42521f402f tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975337155" status: 202 len: 0 microversion: 2.1 time: 0.070772 Jul 19 20:05:00.860645 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2016/4144] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975337155 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:00.868289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:00.868927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:00.886313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.887045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.888585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.889402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.479882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:01.499767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:01.512408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:01.519199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4205148-f601-4e13-b399-cf8b020e8a95 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1720 microversion: 2.20 time: 0.660812 Jul 19 20:05:01.521710 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2017/4145] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:00 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1720 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:01.686539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:01.687945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:01.710070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.711055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.715345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.716075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.999655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:02.030973 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b851af5-4b82-4617-8aa2-100076939fa5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1272 microversion: 2.1 time: 0.375031 Jul 19 20:05:02.036961 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2018/4146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:01 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:02.061131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.065129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:02.092855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.094052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:02.098420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.100839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:02.228336 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3ea2038-03c6-4c4e-a311-712b8b833f56 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180984 Jul 19 20:05:02.238732 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2019/4147] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:02 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:02.548818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.549962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:02.572867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.577310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:02.579710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.580690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:04.762794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:04.826840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:04.838729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:04.844650 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af494e85-f9bc-44c2-acb7-a30786c65002 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1720 microversion: 2.20 time: 2.301796 Jul 19 20:05:04.859390 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2020/4148] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:02 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1720 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:05:04.879555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-638cefd7-78f0-4ad9-88e0-b3fef31b2c51 req-b48498cd-dea1-4930-83bb-ae138bb1247e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "name": "network-vif-unplugged", "status": "completed", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:04.931174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-638cefd7-78f0-4ad9-88e0-b3fef31b2c51 req-b48498cd-dea1-4930-83bb-ae138bb1247e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:04.934357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-638cefd7-78f0-4ad9-88e0-b3fef31b2c51 req-b48498cd-dea1-4930-83bb-ae138bb1247e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.016449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-638cefd7-78f0-4ad9-88e0-b3fef31b2c51 req-b48498cd-dea1-4930-83bb-ae138bb1247e service nova] Creating event network-vif-unplugged:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:05:05.042755 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-638cefd7-78f0-4ad9-88e0-b3fef31b2c51 req-b48498cd-dea1-4930-83bb-ae138bb1247e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178774 Jul 19 20:05:05.049525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2021/4149] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:05.067531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:05.069549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:05.091149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.096291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.098396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.108272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.262841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:05.676733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:07.495343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:07.593375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:07.726661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:07.762602 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2510290-deac-48d6-b9f4-9bc5334a61a5 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1314 microversion: 2.1 time: 2.710673 Jul 19 20:05:07.767936 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2022/4150] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:05 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1314 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:07.777491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:07.793880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:07.815840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.816666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.818080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.818886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.972005 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9b497b4-40c1-495a-895c-f7267880e7ae tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201494 Jul 19 20:05:07.992453 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2023/4151] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:07 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c/os-volume_attachments => generated 25 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:05:07.998360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:07.998998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:08.030596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.031090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.032004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.032445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.053430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:08.064901 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e050187-81cd-472d-a907-112ba7fc71ba tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 12.362145 Jul 19 20:05:08.073362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2129/4152] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 20:04:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 12374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:08.094629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2fd1bd38-054a-4bf7-ab89-07f0717d5189 req-63e260cc-6f94-498c-add5-a07933428822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c5639c-e907-4290-b67a-9bf56bb0ebdc", "tag": "df7f3a00-98f4-40c4-9280-fd0ca572f5de"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:08.131558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2fd1bd38-054a-4bf7-ab89-07f0717d5189 req-63e260cc-6f94-498c-add5-a07933428822 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.132618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2fd1bd38-054a-4bf7-ab89-07f0717d5189 req-63e260cc-6f94-498c-add5-a07933428822 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.199597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2fd1bd38-054a-4bf7-ab89-07f0717d5189 req-63e260cc-6f94-498c-add5-a07933428822 service nova] Creating event network-changed:df7f3a00-98f4-40c4-9280-fd0ca572f5de for instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc on n-h1-843861-3 Jul 19 20:05:08.219034 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2fd1bd38-054a-4bf7-ab89-07f0717d5189 req-63e260cc-6f94-498c-add5-a07933428822 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144202 Jul 19 20:05:08.222768 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2130/4153] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:08.239605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d9cbc3a-0297-4345-99a6-fb595e8e2dd8 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Action: 'create', calling method: .version_select at 0x7fb88cd634c0>, body: {"pool": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:08.701862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:08.750921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:08.759264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:08.773139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-007b839d-0dc1-44b5-8fb4-66ed0febde63 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1663 microversion: 2.20 time: 0.775495 Jul 19 20:05:08.784617 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2024/4154] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:07 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1663 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:08.813077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:08.825298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:08.848240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.852926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.861464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.864089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.911673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:05:09.162023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dbc9aba2-80bf-48ef-ada1-e2237efde9fc tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 204 len: 0 microversion: 2.1 time: 0.372939 Jul 19 20:05:09.163567 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2025/4155] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:08 2022] DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:09.171544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:09.172667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:09.181459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.182947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.184140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.184803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.672429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:09.689450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-74f5bdee-8b97-4d75-a5b4-6267b5305369 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1314 microversion: 2.1 time: 0.524149 Jul 19 20:05:09.712957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2026/4156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:09 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:09.724768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a93e4a4-a467-4ac9-85ff-22d63a330a2c"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:09.726304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:09.752305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.756046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.757820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.758530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:10.663850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5dd65f3-5100-4448-89a9-7d4c66f9f8d1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.934207 Jul 19 20:05:10.672114 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2027/4157] 10.222.0.33 () {62 vars in 1363 bytes} [Tue Jul 19 20:05:09 2022] POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 188 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:05:10.681069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:10.683126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:10.695787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.701353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:10.705811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.722820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:11.606773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:11.617546 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-06c1db99-922a-4735-be47-5ad65e2e3993 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1682 microversion: 2.1 time: 0.943852 Jul 19 20:05:11.618152 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2028/4158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:10 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1682 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:11.800889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-60587691", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:11.914788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] validate_networks() for [('8f8fbed9-92aa-483e-8565-36da7302591f', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:05:12.507916 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d9cbc3a-0297-4345-99a6-fb595e8e2dd8 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.282335 Jul 19 20:05:12.507916 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2131/4159] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 20:05:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:12.704402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-557245543", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:12.881609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] validate_networks() for [('6120914c-9305-48be-a9d6-29e40bcdaad7', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:05:13.523955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:05:13.524529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:05:13.524863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:05:13.526193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:05:13.526895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:05:13.554051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:13.554514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:13.555344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:13.555790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:13.596202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:13.620289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for user 3116ed1e64fa431684c2f78c794eec58 and project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:13.655942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:05:13.660806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:05:13.772892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f0d0a84-d12a-4c93-a482-e3fd27195140 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.147986 Jul 19 20:05:13.776862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2029/4160] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:05:13.792250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:13.793367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:13.823397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:13.825062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:13.826440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:13.827189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:15.419849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:15.435508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49c64653-0610-465d-8425-b3d5548c36a9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1314 microversion: 2.1 time: 1.657114 Jul 19 20:05:15.437494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2030/4161] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:13 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1314 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:15.448901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:15.450227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:15.484136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:15.484935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:15.485982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:15.486435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:15.764061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf8aa5ab-468c-44ea-b30d-35226865b37f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/action" status: 202 len: 0 microversion: 2.20 time: 0.324520 Jul 19 20:05:15.765653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2031/4162] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 20:05:15 2022] POST /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:15.773784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2966fd44-f85d-4b1a-8b2b-993d0412eadf tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Action: 'create', calling method: .version_select at 0x7fb88de948b0>, body: {"pool": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:16.063500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:05:16.065682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:05:16.066695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:05:16.067323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:05:16.068007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:05:16.087675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.089153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:16.090180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.090731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:16.115129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Getting quotas for project d1dc93dfca5b42c5a38baf6d0863574f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:16.123188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Getting quotas for user 745acea6be3d41818108c7d8fe49c8c3 and project d1dc93dfca5b42c5a38baf6d0863574f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:16.143701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:05:16.148236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:05:16.311785 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4bf87eb0-f981-4364-b9a7-c06336f291fe tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.802751 Jul 19 20:05:16.315279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2132/4163] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:05:16.321251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:16.322824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:16.345917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.346625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:16.377141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.378233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.188248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1144c1c606c74f598f317b909f472d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff66dd692865486cae57a1315821ddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:17.209105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ae838ba-333a-493b-8f5a-92bc31792728 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 200 len: 1614 microversion: 2.1 time: 0.892298 Jul 19 20:05:17.228916 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2133/4164] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:16 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 1614 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:17.242080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:17.242753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:17.261566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.262739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.264409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.265691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.695972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:17.704637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-672b5918-a04e-42da-aa85-bb17616a7633 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1278 microversion: 2.1 time: 0.474605 Jul 19 20:05:17.718376 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2134/4165] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:17 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1278 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:17.777775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:17.778472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:17.815133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.818298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.827216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.833445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.097316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:19.119126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:19.129286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:19.131033 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64a7aeb5-84d9-4f53-8f7c-ec721e400e47 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1749 microversion: 2.20 time: 1.396771 Jul 19 20:05:19.132238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2135/4166] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:17 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1749 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:19.144507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:19.162447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:19.179332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.189868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.191436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.192177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.465217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:19.491545 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6a084f9-2e0d-4e6b-b8b1-7f6037dffb4d tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1292 microversion: 2.1 time: 0.357640 Jul 19 20:05:19.493304 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2136/4167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:19 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1292 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:19.505804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:19.507444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:19.528702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.529881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.531825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.533174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:20.188501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:20.216553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a61a93c8-4101-40f8-b646-1bc6f31f07a3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1314 microversion: 2.1 time: 0.717985 Jul 19 20:05:20.218396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2137/4168] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:19 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:20.227050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fa474425-06f9-4aaa-b392-bff80efc4c6b req-bbb748fd-2c1b-4114-b703-55ef322551d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4700e5f4-0c76-49de-a895-07b0a44bc11c", "name": "network-vif-deleted", "tag": "77d9bdac-8f2c-4c64-9c35-8d35a3189ab9"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:20.252887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa474425-06f9-4aaa-b392-bff80efc4c6b req-bbb748fd-2c1b-4114-b703-55ef322551d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:20.253722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fa474425-06f9-4aaa-b392-bff80efc4c6b req-bbb748fd-2c1b-4114-b703-55ef322551d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:20.270335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fa474425-06f9-4aaa-b392-bff80efc4c6b req-bbb748fd-2c1b-4114-b703-55ef322551d1 service nova] Creating event network-vif-deleted:77d9bdac-8f2c-4c64-9c35-8d35a3189ab9 for instance 4700e5f4-0c76-49de-a895-07b0a44bc11c on n-h1-843861-3 Jul 19 20:05:20.281714 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fa474425-06f9-4aaa-b392-bff80efc4c6b req-bbb748fd-2c1b-4114-b703-55ef322551d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059795 Jul 19 20:05:20.282526 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2138/4169] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:20.294939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1111952751", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:20.438192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] validate_networks() for [('8f8fbed9-92aa-483e-8565-36da7302591f', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:05:23.106445 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2966fd44-f85d-4b1a-8b2b-993d0412eadf tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.339301 Jul 19 20:05:23.107635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2032/4170] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 20:05:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:23.112837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:23.116714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:23.149933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.150801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.151834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.152591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.168923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c HTTP/1.1 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4700e5f4-0c76-49de-a895-07b0a44bc11c'} Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:23.171642 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:23.177474 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:23.184354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:23.186365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70aad45a-8515-4238-b978-1d4057240a5d tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 404 len: 111 microversion: 2.1 time: 0.077258 Jul 19 20:05:23.188104 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2033/4171] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:23 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:23.194978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c3527c37-7346-483c-90e1-5abadfd8106a req-b05918fd-1f65-40c0-b8a1-491f4382f00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5639c-e907-4290-b67a-9bf56bb0ebdc", "name": "network-vif-plugged", "status": "completed", "tag": "df7f3a00-98f4-40c4-9280-fd0ca572f5de"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:23.210475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c3527c37-7346-483c-90e1-5abadfd8106a req-b05918fd-1f65-40c0-b8a1-491f4382f00e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.211662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c3527c37-7346-483c-90e1-5abadfd8106a req-b05918fd-1f65-40c0-b8a1-491f4382f00e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.239273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c3527c37-7346-483c-90e1-5abadfd8106a req-b05918fd-1f65-40c0-b8a1-491f4382f00e service nova] Creating event network-vif-plugged:df7f3a00-98f4-40c4-9280-fd0ca572f5de for instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc on n-h1-843861-3 Jul 19 20:05:23.243550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:05:23.245121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:05:23.245738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:05:23.247194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:05:23.247678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:05:23.253315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c3527c37-7346-483c-90e1-5abadfd8106a req-b05918fd-1f65-40c0-b8a1-491f4382f00e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062348 Jul 19 20:05:23.258226 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2034/4172] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:23.274133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:23.280249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.281378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.281783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:23.284972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.285881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.305235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.306108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.309375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.310202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.365873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:23.402441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for user 3116ed1e64fa431684c2f78c794eec58 and project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:23.458620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:05:23.461732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:05:23.579281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:23.634760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:23.673799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f08edd9-4c0d-4c2b-9451-06bc1f609a8a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.388744 Jul 19 20:05:23.679150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2139/4173] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:05:23.709489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:23.717942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:23.734143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.734807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.736469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:23.737023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:24.191885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:24.215153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:24.222919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:24.227241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5a96f8d-a0af-44a6-9b8e-6e83e056c5f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1751 microversion: 2.20 time: 0.966111 Jul 19 20:05:24.245163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2035/4174] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:23 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1751 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:24.273932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:24.274774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:24.289770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:24.290258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:24.291308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:24.292124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:24.509586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:24.537024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4d09ef8-6935-4443-8726-8af7f6e74799 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.851834 Jul 19 20:05:24.543547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2140/4175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:23 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:24.564729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f32a38d-124a-4e89-b036-4113de2baa6a tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Action: 'create', calling method: .version_select at 0x7fb88cd8adc0>, body: {"pool": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:25.018908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:25.035433 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6aeeeb54-1517-4567-a390-3c59f0fd6478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1314 microversion: 2.1 time: 0.788506 Jul 19 20:05:25.037200 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2036/4176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:24 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:25.046951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b70f5a47-5fa0-48d1-b2a9-384005f06d26 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '.version_select at 0x7fb88db753a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:25.090121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b70f5a47-5fa0-48d1-b2a9-384005f06d26 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498481739" status: 202 len: 0 microversion: 2.1 time: 0.050481 Jul 19 20:05:25.091491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2037/4177] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498481739 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:25.098277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:25.098959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:25.110541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.111123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.112297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.112755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.142384 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 HTTP/1.1 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7f6f6742-1a02-45c1-a039-f44afeea52c7'} Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:25.145714 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5baaa6bf-2153-4130-8ae9-0ca3ad39ab4c tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 404 len: 111 microversion: 2.1 time: 0.055381 Jul 19 20:05:25.149809 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2038/4178] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:25 2022] DELETE /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:25.159541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:25.160718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:25.172998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.174020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.175649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.176869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.411584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:25.427294 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4917d639-8cdd-4f6c-9010-5442bc3ba6a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1274 microversion: 2.1 time: 0.273161 Jul 19 20:05:25.430359 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2039/4179] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:25 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:25.444007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:25.445181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 7f6f6742-1a02-45c1-a039-f44afeea52c7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:25.457787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.458533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.459761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.480641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.502167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:25.549550 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 HTTP/1.1 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7f6f6742-1a02-45c1-a039-f44afeea52c7'} Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:25.554637 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. Jul 19 20:05:25.558555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:25.561940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 7f6f6742-1a02-45c1-a039-f44afeea52c7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:25.563759 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46195a8c-a258-4e02-a115-6dd0aac9974e tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7" status: 404 len: 111 microversion: 2.1 time: 0.131969 Jul 19 20:05:25.564872 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2040/4180] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:25 2022] GET /compute/v2.1/servers/7f6f6742-1a02-45c1-a039-f44afeea52c7 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:25.571664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-aac47470-b204-40ff-b9c9-11c7791b634e req-092e1440-1122-4ff9-b687-b4389ba6fbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1472b512-4550-4bcb-bb8e-21ed6101cedc", "tag": "84b864b5-4807-4300-b8c8-13ab2b4ae192"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:25.578142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:25.590395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-aac47470-b204-40ff-b9c9-11c7791b634e req-092e1440-1122-4ff9-b687-b4389ba6fbd9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.590750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-aac47470-b204-40ff-b9c9-11c7791b634e req-092e1440-1122-4ff9-b687-b4389ba6fbd9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.609930 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-aac47470-b204-40ff-b9c9-11c7791b634e req-092e1440-1122-4ff9-b687-b4389ba6fbd9 service nova] Creating event network-changed:84b864b5-4807-4300-b8c8-13ab2b4ae192 for instance 1472b512-4550-4bcb-bb8e-21ed6101cedc on n-h2-843861-3 Jul 19 20:05:25.616487 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-aac47470-b204-40ff-b9c9-11c7791b634e req-092e1440-1122-4ff9-b687-b4389ba6fbd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050043 Jul 19 20:05:25.617713 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2041/4181] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:25.633201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:25.636789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:25.660593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.661692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.677118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:25.677815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:26.970720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:26.984474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:26.986372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:26.987641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9d1d25b2-bf36-47e6-a304-b08911d8aa17 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1751 microversion: 2.20 time: 1.366902 Jul 19 20:05:26.988264 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2042/4182] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:25 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1751 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:26.999363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:27.000403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:27.008745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:27.010034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:27.011025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:27.011553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:27.539599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:27.550567 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-40c17025-bdc4-4947-923b-59b10a894491 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.557168 Jul 19 20:05:27.563883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2043/4183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:26 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:27.570744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:27.571514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:27.581491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:27.582151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:27.590075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:27.591146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.043179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:28.052621 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ed05346-90aa-438e-8fdc-9e99385917d4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1501 microversion: 2.1 time: 0.493576 Jul 19 20:05:28.063893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2044/4184] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:27 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:28.068736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:28.069484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:28.077188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.077614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.079160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.079863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.265792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:28.282095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2be12a6-155f-4386-b316-aea425a0996c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1280 microversion: 2.1 time: 0.217817 Jul 19 20:05:28.283268 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2045/4185] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:28 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:28.292963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-712924c8-5c14-4ff4-a4b0-a3a1ac06df29 req-adea4248-f99d-44b4-a09e-c130791da567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:28.309458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-712924c8-5c14-4ff4-a4b0-a3a1ac06df29 req-adea4248-f99d-44b4-a09e-c130791da567 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.310312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-712924c8-5c14-4ff4-a4b0-a3a1ac06df29 req-adea4248-f99d-44b4-a09e-c130791da567 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.328521 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-712924c8-5c14-4ff4-a4b0-a3a1ac06df29 req-adea4248-f99d-44b4-a09e-c130791da567 service nova] Creating event network-changed:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:05:28.335877 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-712924c8-5c14-4ff4-a4b0-a3a1ac06df29 req-adea4248-f99d-44b4-a09e-c130791da567 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050314 Jul 19 20:05:28.337458 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2046/4186] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:28.348633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:28.349558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:28.356926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.357684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.358662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.359277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.884121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:28.900451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:28.903463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:28.908518 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31a5d63d-84e9-4d70-b07d-58e808f35ceb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.565776 Jul 19 20:05:28.909531 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2047/4187] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:28 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:28.915954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfdae519-6a7a-4571-94dc-826c71a014b1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:28.928911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfdae519-6a7a-4571-94dc-826c71a014b1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:28.931071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfdae519-6a7a-4571-94dc-826c71a014b1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:28.962550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dfdae519-6a7a-4571-94dc-826c71a014b1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:05:29.046350 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfdae519-6a7a-4571-94dc-826c71a014b1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc/action" status: 202 len: 0 microversion: 2.1 time: 0.134398 Jul 19 20:05:29.047675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2048/4188] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:28 2022] POST /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:29.067250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:29.068989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:29.076949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.077840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.079390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.080149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.459268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:29.473381 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3296c3c2-f362-481d-a5fa-465235e4d7d8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.411569 Jul 19 20:05:29.474191 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2049/4189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:29 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:29.483576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:29.484345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:29.496226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.496681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.502027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.503128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.561105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f32a38d-124a-4e89-b036-4113de2baa6a tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.015765 Jul 19 20:05:29.561774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2141/4190] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 20:05:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:29.568507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:29.569353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:29.586057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.586557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.590129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:29.590618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.893703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:29.915289 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-334bbc67-0064-47e8-b4c6-02797b05bdfa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.439980 Jul 19 20:05:29.916789 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2050/4191] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:29 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:29.938254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-79c3fe59-9bdc-4811-aca1-6e8b4c1377de tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88e267280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:30.016173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:30.029275 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b50e18f-3319-416b-928c-d81d925a3d79 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.465567 Jul 19 20:05:30.030288 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2142/4192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:29 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:30.049088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:30.050434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:30.065173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.065716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:30.070173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.070652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:30.733136 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-79c3fe59-9bdc-4811-aca1-6e8b4c1377de tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/18343cd9-fcde-420e-94f7-b6e26ec5e29d" status: 200 len: 142 microversion: 2.1 time: 0.802996 Jul 19 20:05:30.736039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:30.742385 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2051/4193] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 20:05:29 2022] GET /compute/v2.1/os-floating-ips/18343cd9-fcde-420e-94f7-b6e26ec5e29d => generated 142 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:30.748079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:30.749151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:30.749587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:30.749710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:30.750918 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd2cbcde-4455-4347-86f8-c8418757c2b4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.717539 Jul 19 20:05:30.751346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2143/4194] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:30 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:30.772213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-672b4605-8cfa-4380-87d3-8d1ee42d0205 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88ccf4dc0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:30.772707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.773324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:30.775891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.776569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:31.676237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:31.690169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-737e574a-c213-4e4e-a0f4-a935ad152568 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.946545 Jul 19 20:05:31.690785 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2052/4195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:30 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:31.705749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:31.706384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:31.713249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:31.713708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:31.714500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:31.714944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:32.129127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:32.144820 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-369589a9-1f6d-4ca5-8118-b306bc482e45 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.452915 Jul 19 20:05:32.145459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2053/4196] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:31 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:32.162756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:32.162756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:32.178460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:32.178717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:32.179476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:32.180003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.230558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:33.260520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3cdc6687-8597-4bca-90d1-781c7c368870 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 1.108711 Jul 19 20:05:33.261974 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2054/4197] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:32 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:33.283869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:33.297401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:33.323911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:33.332853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:33.333624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.335096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:33.335838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.387334 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 HTTP/1.1 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2'} Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:33.394986 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:33.399788 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:33.403129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:33.404653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba610a59-8e32-4b50-ab0f-a3681abe892a tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 404 len: 111 microversion: 2.1 time: 0.141074 Jul 19 20:05:33.406234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2055/4198] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:33 2022] DELETE /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:33.412042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:33.413877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:33.423728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:33.424735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.425788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:33.426454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.449004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:33.945401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:33.964217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:33.967170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:33.967170 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e3b0e7fc-80b3-4c56-b0c5-0095bcd50f58 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.561113 Jul 19 20:05:33.984516 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2056/4199] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:33 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:34.001312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:34.002046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:34.016309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.016829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.017802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.018288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.473641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:34.482287 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-074203f7-6f0c-4291-9b78-cd2ac0724bb9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.496574 Jul 19 20:05:34.482882 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2057/4200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:33 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:34.503546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:34.504277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:34.531197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.531938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.532804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.533257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.834879 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-672b4605-8cfa-4380-87d3-8d1ee42d0205 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/18343cd9-fcde-420e-94f7-b6e26ec5e29d" status: 202 len: 0 microversion: 2.1 time: 4.082218 Jul 19 20:05:34.841584 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2144/4201] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:05:30 2022] DELETE /compute/v2.1/os-floating-ips/18343cd9-fcde-420e-94f7-b6e26ec5e29d => generated 0 bytes in 4090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:34.848847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:34.849649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:34.867309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.868164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.872984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.873782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.907112 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c HTTP/1.1 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4700e5f4-0c76-49de-a895-07b0a44bc11c'} Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:34.919520 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:34.923371 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:34.928159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:34.931506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d7833eff-4c4a-4dbf-b2c5-14d2615b5a61 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 404 len: 111 microversion: 2.1 time: 0.088303 Jul 19 20:05:34.932133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2145/4202] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:34 2022] DELETE /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:34.950306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:34.950989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] [instance: 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:34.968626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.969087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.969878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.970314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.003394 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] HTTP exception thrown: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Request method failure captured: Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 HTTP/1.1 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wzp3v1hVkbUiOWLgqgrT0xRsp4YiIn0zg8V4XfDl1MISuX2MEKqVmcpnrF-XH-EdkQqJix1L6pwyF31sBFn2ws4sikkE-z84YP6lsRDKOXmozpbl6vFoFDbY5zemhF3ad2ZblPd5uIVz3C6QlHl2hZiDsHs-9ldVutcsJ2_BBMHJ0M Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d80827178dd426d92e131b50cf2cb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7d80827178dd426d92e131b50cf2cb3c Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766054462 Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: de95f85ce3714254acdb08a4004081bf Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeTestJSON-766054462-project Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2'} Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:35.004910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] Returning 404 to user: Instance 9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:35.008587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cee1a94-07ce-49e1-9424-dc9b3ed77119 tempest-AttachVolumeTestJSON-766054462 tempest-AttachVolumeTestJSON-766054462-project] 10.222.0.33 "GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2" status: 404 len: 111 microversion: 2.1 time: 0.067590 Jul 19 20:05:35.022497 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2146/4203] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:34 2022] GET /compute/v2.1/servers/9c4f2bd4-2595-4e1b-a16d-9f824ba2abe2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:35.029629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:35.033057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:35.048122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.048561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.049354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.049794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.527421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:35.546306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf51f6b4-25c7-4beb-8038-d7e2cb4bc92d tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 1.043093 Jul 19 20:05:35.547032 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2058/4204] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:34 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:35.558322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d6ad323e-0531-4257-b5aa-97633dba8953 req-4d57993b-7765-4437-8571-8c3038db13bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3053c3e-b3af-4d1e-bd5f-05fe59b9583e", "tag": "aa9b9422-4c91-4b5e-9bc8-73542b2cd20f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:35.590373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d6ad323e-0531-4257-b5aa-97633dba8953 req-4d57993b-7765-4437-8571-8c3038db13bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.597226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d6ad323e-0531-4257-b5aa-97633dba8953 req-4d57993b-7765-4437-8571-8c3038db13bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.605784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:35.631180 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f5fb765-c87a-4228-af31-16c9fde08cb4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.606881 Jul 19 20:05:35.631856 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2147/4205] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:35 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:35.653660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d6ad323e-0531-4257-b5aa-97633dba8953 req-4d57993b-7765-4437-8571-8c3038db13bb service nova] Creating event network-changed:aa9b9422-4c91-4b5e-9bc8-73542b2cd20f for instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e on n-h2-843861-3 Jul 19 20:05:35.654641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d0692afd-aeb8-4b11-9653-65fe0dc1e9c0 req-9dc0aa93-a659-442e-b33b-d312542c9bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "name": "network-vif-plugged", "status": "completed", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:35.679505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:35.683194 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d6ad323e-0531-4257-b5aa-97633dba8953 req-4d57993b-7765-4437-8571-8c3038db13bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126189 Jul 19 20:05:35.683900 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2059/4206] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:35.692907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d0eda58-705f-4166-af0c-efbb524079b0 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88e0d0790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:35.693198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0692afd-aeb8-4b11-9653-65fe0dc1e9c0 req-9dc0aa93-a659-442e-b33b-d312542c9bad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.693954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0692afd-aeb8-4b11-9653-65fe0dc1e9c0 req-9dc0aa93-a659-442e-b33b-d312542c9bad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.750806 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d0692afd-aeb8-4b11-9653-65fe0dc1e9c0 req-9dc0aa93-a659-442e-b33b-d312542c9bad service nova] Creating event network-vif-plugged:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:05:35.766346 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d0692afd-aeb8-4b11-9653-65fe0dc1e9c0 req-9dc0aa93-a659-442e-b33b-d312542c9bad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127042 Jul 19 20:05:35.780707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2148/4207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:35.800856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:35.808943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4700e5f4-0c76-49de-a895-07b0a44bc11c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:35.836648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.837926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.839174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.839851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.859718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=69 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:35.898212 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c HTTP/1.1 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4700e5f4-0c76-49de-a895-07b0a44bc11c'} Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:35.906296 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. Jul 19 20:05:35.909654 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:35.911127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4700e5f4-0c76-49de-a895-07b0a44bc11c could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:35.912298 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e442f8c9-a895-44e9-a153-4ea7b82125b4 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c" status: 404 len: 111 microversion: 2.1 time: 0.130166 Jul 19 20:05:35.913447 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2149/4208] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:35 2022] GET /compute/v2.1/servers/4700e5f4-0c76-49de-a895-07b0a44bc11c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:35.931673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:35.932585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:35.939599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.940461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.941501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:35.942151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.076709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d0eda58-705f-4166-af0c-efbb524079b0 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.391533 Jul 19 20:05:37.077957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2060/4209] 10.222.0.33 () {58 vars in 1163 bytes} [Tue Jul 19 20:05:35 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:05:37.085314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:37.091514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:37.126188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.135177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.136459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.144402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.150800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:37.243409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.253581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.264912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.270265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d84a261-0714-4c80-83ce-aa3fb1635611 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 1.355424 Jul 19 20:05:37.271105 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2150/4210] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:35 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:37.292052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:37.292680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:37.311521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.325066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.326360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.332993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.504340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.516698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4c98372-fb5c-44a6-8bb2-e82435db26e5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 0.437201 Jul 19 20:05:37.540517 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2061/4211] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:37 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:37.566769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:37.567405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:37.583490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.584084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.584887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.585516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.627328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.638290 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a01a39c-35ee-4b94-a07d-d0d17ff8cd19 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.365939 Jul 19 20:05:37.639547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2151/4212] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:37 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:37.644291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-231bb3b5-d16c-4ed7-ae06-38afceb79f68 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88d133040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:38.038464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:38.060237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d1bb51d-b4e8-40e2-85c0-8f58ced6a2c9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.514784 Jul 19 20:05:38.061328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2062/4213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:37 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:38.081687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-cb82ee57-220e-48b4-abc7-75475cfa46ac req-e058f15a-f984-4abe-bd9b-fee770e2af69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1472b512-4550-4bcb-bb8e-21ed6101cedc", "name": "network-vif-plugged", "status": "completed", "tag": "84b864b5-4807-4300-b8c8-13ab2b4ae192"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:38.102921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cb82ee57-220e-48b4-abc7-75475cfa46ac req-e058f15a-f984-4abe-bd9b-fee770e2af69 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:38.104339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cb82ee57-220e-48b4-abc7-75475cfa46ac req-e058f15a-f984-4abe-bd9b-fee770e2af69 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:38.111391 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-231bb3b5-d16c-4ed7-ae06-38afceb79f68 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.470331 Jul 19 20:05:38.121409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2152/4214] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 20:05:37 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:38.130609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e728a43-8acb-4963-974a-18addf721e54 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88cd18820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:38.149772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-cb82ee57-220e-48b4-abc7-75475cfa46ac req-e058f15a-f984-4abe-bd9b-fee770e2af69 service nova] Creating event network-vif-plugged:84b864b5-4807-4300-b8c8-13ab2b4ae192 for instance 1472b512-4550-4bcb-bb8e-21ed6101cedc on n-h2-843861-3 Jul 19 20:05:38.159629 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-cb82ee57-220e-48b4-abc7-75475cfa46ac req-e058f15a-f984-4abe-bd9b-fee770e2af69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096189 Jul 19 20:05:38.161607 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2063/4215] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:38.297763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:38.299034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:38.316654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:38.317356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:38.318324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:38.318916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:39.030449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:39.059364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:39.062147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:39.066299 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34a129bc-eb5c-4e00-bd88-0fc9f57845dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.775595 Jul 19 20:05:39.069667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2064/4216] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:38 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:39.082555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:39.085312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:39.100871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:39.102182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:39.104105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:39.107228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:40.197303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:40.215996 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e47a208b-923b-4518-9d00-3fdd87d8fc79 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1322 microversion: 2.1 time: 1.144620 Jul 19 20:05:40.225622 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2065/4217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:39 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1322 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:40.236098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:40.241353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:40.270993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:40.276289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:40.277586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:40.278739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:40.926841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e728a43-8acb-4963-974a-18addf721e54 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/e4d6c945-39d9-4bee-879b-d3ce100060d6" status: 202 len: 0 microversion: 2.1 time: 2.803195 Jul 19 20:05:40.930913 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2153/4218] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:05:38 2022] DELETE /compute/v2.1/os-floating-ips/e4d6c945-39d9-4bee-879b-d3ce100060d6 => generated 0 bytes in 2808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:40.959471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:40.961458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:41.000734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:41.000859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:41.001583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:41.002061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:41.152833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:41.184091 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdc6a424-72ea-41b0-aa3f-dc8e2d667599 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.955131 Jul 19 20:05:41.194045 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2066/4219] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:40 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:41.216488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:41.228425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:41.289034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:41.291416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:41.294238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:41.303238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.133671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:42.169592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:42.177951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:42.186722 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8637ebdb-9dbb-444a-914c-7465c82816f2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.993393 Jul 19 20:05:42.191768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2067/4220] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:41 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:42.209302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af2bd5f5-38b9-414e-ad4d-afda1acb7213 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88db75160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:42.420488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:42.439685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa5c9ca5-eb7d-419a-bffb-d6e80043db60 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 1.504623 Jul 19 20:05:42.446876 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2154/4221] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:40 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:42.474468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:42.482792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:42.532762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.534275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.539737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.540987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:43.741959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:43.766735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-843eaab3-097a-4183-900c-f169010da42e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1516 microversion: 2.1 time: 1.318394 Jul 19 20:05:43.767339 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2155/4222] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:42 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1516 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:43.780186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:43.780186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:43.801109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:43.801870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:43.803261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:43.804101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.281443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:44.296431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffccb509-d5d0-42d7-800e-7d2211afc10a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.527555 Jul 19 20:05:44.298386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2156/4223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:43 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:44.307442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:44.308847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:44.322999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.324261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.326137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.327249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.360591 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 HTTP/1.1 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '002e370a-a19e-4c29-b942-1ce1e6f30a43'} Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:44.365382 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:44.373827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:44.378344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:44.380527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ad6e9b1-f674-4f58-a1c1-a440057b89f0 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 404 len: 111 microversion: 2.1 time: 0.079808 Jul 19 20:05:44.382843 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2157/4224] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:44 2022] DELETE /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:44.401284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:44.402827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:44.416161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.417768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.420058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.421217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.070488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.078685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.081028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.082805 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a741276c-c67a-4c89-a47f-8ae2dc875211 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.697190 Jul 19 20:05:45.083679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2158/4225] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:44 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:45.105410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.106172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.114123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.114869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.115867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.116444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.184633 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af2bd5f5-38b9-414e-ad4d-afda1acb7213 tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/ebe8a56a-f992-4e50-b105-574b4feddfb8" status: 202 len: 0 microversion: 2.1 time: 2.988416 Jul 19 20:05:45.187238 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2068/4226] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:05:42 2022] DELETE /compute/v2.1/os-floating-ips/ebe8a56a-f992-4e50-b105-574b4feddfb8 => generated 0 bytes in 2994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:45.198775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:45.200867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.236469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.238089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.241177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.241976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.285670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lazy-loading 'flavor' on Instance uuid 976abbd5-10b5-427b-a5c2-b4f793a9d60b {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:05:45.296094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.308670 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc100716-b3bc-4433-8971-6d6ac0295b95 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.222805 Jul 19 20:05:45.318501 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2159/4227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:45 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:45.318501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.319570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 002e370a-a19e-4c29-b942-1ce1e6f30a43] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.329164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.329924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.331188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.331925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.359022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 HTTP/1.1 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '002e370a-a19e-4c29-b942-1ce1e6f30a43'} Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:45.360827 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 002e370a-a19e-4c29-b942-1ce1e6f30a43 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05c41cac-1148-431f-becc-f967a267abd3 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43" status: 404 len: 111 microversion: 2.1 time: 0.050956 Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2160/4228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:45 2022] GET /compute/v2.1/servers/002e370a-a19e-4c29-b942-1ce1e6f30a43 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:45.373830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-37f0311d-9085-4bdd-b223-baba380834ee tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] Calling method '.version_select at 0x7fb88d0aa430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.436029 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4bb95917-8075-42d1-854a-6a4611faedf6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action" status: 200 len: 32 microversion: 2.1 time: 0.245663 Jul 19 20:05:45.437086 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2069/4229] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:45 2022] POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:05:45.447574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.448917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.463149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.464460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.465830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.466613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.856116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.871953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8b583fc-c564-41a0-be6e-fd7dd7dae1c0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.432657 Jul 19 20:05:45.882346 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2070/4230] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:45 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:45.899708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.905848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.923155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.927591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.935647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.936435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.963716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 HTTP/1.1 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4a5f133e-fe86-43c4-a521-0bf8018684f4'} Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:45.969105 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:45.975414 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:45.980732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:45.982965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48645ceb-8899-4abd-bee3-2dc34624abfb tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 404 len: 111 microversion: 2.1 time: 0.098344 Jul 19 20:05:45.984783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2071/4231] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:45 2022] DELETE /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:45.998378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.999453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:46.015133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.016305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.017798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.018698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.346093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:46.373960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-018f60be-6e82-4ee4-ae1e-daeadd0a4ea5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.386859 Jul 19 20:05:46.376261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2072/4232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:45 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:46.394269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2a127e80-7246-4974-86bf-986e7ddb1607 req-4f1a6b5b-cf81-446a-920f-05011c9b1fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3053c3e-b3af-4d1e-bd5f-05fe59b9583e", "name": "network-vif-plugged", "status": "completed", "tag": "aa9b9422-4c91-4b5e-9bc8-73542b2cd20f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:46.416853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2a127e80-7246-4974-86bf-986e7ddb1607 req-4f1a6b5b-cf81-446a-920f-05011c9b1fac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.417759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2a127e80-7246-4974-86bf-986e7ddb1607 req-4f1a6b5b-cf81-446a-920f-05011c9b1fac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.442911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2a127e80-7246-4974-86bf-986e7ddb1607 req-4f1a6b5b-cf81-446a-920f-05011c9b1fac service nova] Creating event network-vif-plugged:aa9b9422-4c91-4b5e-9bc8-73542b2cd20f for instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e on n-h2-843861-3 Jul 19 20:05:46.455152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2a127e80-7246-4974-86bf-986e7ddb1607 req-4f1a6b5b-cf81-446a-920f-05011c9b1fac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073095 Jul 19 20:05:46.463894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2073/4233] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:46.474524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:46.475245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 4a5f133e-fe86-43c4-a521-0bf8018684f4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:46.483835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.484298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.485091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.485534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.505750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 HTTP/1.1 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4a5f133e-fe86-43c4-a521-0bf8018684f4'} Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:46.508044 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 4a5f133e-fe86-43c4-a521-0bf8018684f4 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e99d08a7-558a-41b6-bce9-a59806df5a86 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4" status: 404 len: 111 microversion: 2.1 time: 0.040893 Jul 19 20:05:46.518236 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2074/4234] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:46 2022] GET /compute/v2.1/servers/4a5f133e-fe86-43c4-a521-0bf8018684f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:46.522546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:46.522546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:46.526584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.527043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.527857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.528310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.038724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.048496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.050558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.052053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-356403f8-ac70-4209-82f7-ad8b3975ebc6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.537342 Jul 19 20:05:47.052987 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2075/4235] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:46 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:47.058677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:47.059750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:47.067035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.067836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.069788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.070686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.201949 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-37f0311d-9085-4bdd-b223-baba380834ee tempest-FloatingIPDetailsTestJSON-785141397 tempest-FloatingIPDetailsTestJSON-785141397-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/5b76ed3b-de3c-4f30-bc65-e72a88a08b94" status: 202 len: 0 microversion: 2.1 time: 1.837626 Jul 19 20:05:47.203684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2161/4236] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:05:45 2022] DELETE /compute/v2.1/os-floating-ips/5b76ed3b-de3c-4f30-bc65-e72a88a08b94 => generated 0 bytes in 1840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:47.233889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:47.234777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:47.256598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.257057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.257964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.258614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.278135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.286856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3bbef9a1-06ba-4043-81ac-3aa72c37eceb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.232483 Jul 19 20:05:47.296355 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2076/4237] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:47 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:47.394534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:47.395388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:47.409258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.410830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.413306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.432538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.634275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.646960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fcfadad-77ff-471d-9c16-ae940ae7e14a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.441854 Jul 19 20:05:47.655579 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2162/4238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:47 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:47.905279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.920562 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4120eb05-ebd1-428b-b4a2-65cf6524b5e3 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.532080 Jul 19 20:05:47.922410 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2077/4239] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:47 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:48.092162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.093657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.104215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.105493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.107150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.108275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.310855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.311893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.338626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.345189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.347356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.348418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.414950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.433132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.437376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.440049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4755b80-064f-4f06-be06-a8462f679b50 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.356204 Jul 19 20:05:48.441412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2163/4240] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:48.452637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.453921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.479694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.485323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.486068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.486926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.781433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.816410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a89e172c-59bb-4335-bd32-e0b64f01f7f3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1322 microversion: 2.1 time: 0.512840 Jul 19 20:05:48.817383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2078/4241] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:48.857105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.858158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.888792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.892271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.894145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.897058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.944762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.969622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:48.983737 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9214a9c9-5f98-49c2-9bf8-5e5081597a87 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.539135 Jul 19 20:05:48.991843 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2164/4242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:48.996763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.998367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:49.019906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.021252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.024525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.026271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.336867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.357418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.376620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a285762-aaae-4c55-a101-29f82067ad6c tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.554810 Jul 19 20:05:49.381397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51901f13-1b6b-4ea7-ae83-34593ca38d57 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.394077 Jul 19 20:05:49.382544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2079/4243] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:49.391699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:49.392282 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2165/4244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:49.393718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:49.405353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.406683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.408326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.409287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.468383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:49.470596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:49.494610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.515221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.519607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.523000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.868102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.882857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.896691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ebe6252-6161-4dd3-9129-d3f82bcde708 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.512201 Jul 19 20:05:49.897775 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2080/4245] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:49 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:49.902626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.906821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:49.908466 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-620e054d-9765-4991-9d0f-c693e1d408dc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.447485 Jul 19 20:05:49.909885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2166/4246] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:49 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:05:49.913573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:49.914438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:49.925847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.929599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.932051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.932647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:49.934058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:49.934301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.951262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.952506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:49.954388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:49.955309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.270138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:50.286753 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f8e2621e-a630-496c-882d-17ff381a5b21 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1516 microversion: 2.1 time: 0.387757 Jul 19 20:05:50.288044 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2081/4247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:49 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1516 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:50.298445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:50.306851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:50.307985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:50.309318 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9c4d3066-0889-4e9a-a247-b2f576c8ad93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.388366 Jul 19 20:05:50.311571 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2167/4248] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:49 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:50.322786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.323582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.325025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.328976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.339023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:50.340023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:50.348767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.349372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.350297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.350737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.370020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'flavor' on Instance uuid d3053c3e-b3af-4d1e-bd5f-05fe59b9583e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:05:50.550376 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8395720-78c3-428d-8042-24f09fcb9967 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action" status: 200 len: 32 microversion: 2.1 time: 0.248932 Jul 19 20:05:50.551785 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2082/4249] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:50 2022] POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:05:50.562702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:50.564982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:50.585078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.588752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.590915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.594865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.609491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:50.624455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ed4d424-b42e-41ab-9d39-5ebcdacb03de tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.291105 Jul 19 20:05:50.625188 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2168/4250] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:50 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:50.644170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:50.655747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:50.682578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.684226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:50.686195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:50.689869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.291304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.304545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-30196b59-5086-4d8c-8c81-98a56998dd11 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.751180 Jul 19 20:05:51.305155 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2083/4251] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:50 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:51.309921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:51.310588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:51.331933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.332501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.333178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.333616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.413458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.426466 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a26f6ec3-28b7-478a-8f76-fedb5474d8a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.800217 Jul 19 20:05:51.427707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2169/4252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:50 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:51.443594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-789830916", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "2f332934-1a7c-403c-b4ff-1c5d43cb0949"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:51.539261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] validate_networks() for [('2f332934-1a7c-403c-b4ff-1c5d43cb0949', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:05:51.945155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.957263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af809e3c-1c72-426c-8f6e-ddb288425960 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.650937 Jul 19 20:05:51.958148 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2084/4253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:51 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:51.964223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:51.965102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:51.978252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.979395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.980738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.983249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.114925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.136766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.165086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.167275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1bc76b84-af9d-48c6-ad7a-b21f595dae98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 1.207437 Jul 19 20:05:53.170121 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2085/4254] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:51 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:53.202078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.203351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.230943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.231497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.240274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.240741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.277205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e HTTP/1.1 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '68a311e8-577a-4cc7-b1c5-9778770cf03e'} Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:53.278935 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7d34c28-dc33-4605-a0b2-0c21a3866c1f tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 404 len: 111 microversion: 2.1 time: 0.091667 Jul 19 20:05:53.282398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2086/4255] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:53 2022] DELETE /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:53.294830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:05:53.296113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:05:53.296590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:05:53.297003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:05:53.297458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.297938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:05:53.298053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.329070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.335131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.336123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.336770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.343724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.345966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.355097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.355655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.405863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:53.418134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:53.451883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:05:53.456283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:05:53.551741 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b2b3b9d-7eda-49b5-929e-bf78f64bf005 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121374 Jul 19 20:05:53.553723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2170/4256] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:05:53.567788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.568450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.578379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.579157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.581038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.581636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.630971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.636530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:53.643851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d2151267-2ddd-4145-9c9e-eb23b0dce566 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.350280 Jul 19 20:05:53.656345 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2087/4257] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:53.663668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.664841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.694207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.695013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.695846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.701985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.889688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.912254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4dae27e-6565-4ff8-9b4a-b3cc1b625382 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.352559 Jul 19 20:05:53.933287 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2171/4258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:53.956966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.958296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.958904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] [instance: 68a311e8-577a-4cc7-b1c5-9778770cf03e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.971009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.971457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.972535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.973154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.976574 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52dbf7e0-e5cd-43b9-af42-e08676f594d0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.309633 Jul 19 20:05:53.979018 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2088/4259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:53.988297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1699c587-86f9-40d8-9931-a29b39a3944a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.989260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1699c587-86f9-40d8-9931-a29b39a3944a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:54.024236 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] HTTP exception thrown: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Request method failure captured: Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e HTTP/1.1 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wyxcAJAEWSWhg8QjqAWvFteIfwSbfQC7gXZOqaFwGnq3ofYqWvCNEKCTpZOZcOFUcjv2H_a22g0SFiFPHJfe4B18qYCssc508fBf31HpzWx5tNsSvDKP1_d9nSdH-T1E4fJ2fZiUVCMUqka70YNEV75ddr9K64BjbYVA3LlPLR7_Z8 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff66dd692865486cae57a1315821ddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff66dd692865486cae57a1315821ddab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff66dd692865486cae57a1315821ddab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ff66dd692865486cae57a1315821ddab Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424133282 Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 1144c1c606c74f598f317b909f472d8d Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeNegativeTest-1424133282-project Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '68a311e8-577a-4cc7-b1c5-9778770cf03e'} Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:54.032242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. Jul 19 20:05:54.035488 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:05:54.036897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] Returning 404 to user: Instance 68a311e8-577a-4cc7-b1c5-9778770cf03e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:54.038717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8df49131-2d4f-4a83-9157-49843f794a19 tempest-AttachVolumeNegativeTest-1424133282 tempest-AttachVolumeNegativeTest-1424133282-project] 10.222.0.33 "GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e" status: 404 len: 111 microversion: 2.1 time: 0.103729 Jul 19 20:05:54.041781 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2172/4260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/68a311e8-577a-4cc7-b1c5-9778770cf03e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:54.049095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1699c587-86f9-40d8-9931-a29b39a3944a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.057920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1699c587-86f9-40d8-9931-a29b39a3944a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1214 microversion: 2.1 time: 0.076907 Jul 19 20:05:54.058521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2089/4261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:54.192929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:54.192929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:54.201966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.203257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.207301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.208115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.430122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-41e468cd-b34b-471f-80df-77ace12d66ac req-e77dfacb-3409-44b8-9d50-e79f6aa36895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "name": "network-vif-plugged", "status": "completed", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:54.448005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-41e468cd-b34b-471f-80df-77ace12d66ac req-e77dfacb-3409-44b8-9d50-e79f6aa36895 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.449132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-41e468cd-b34b-471f-80df-77ace12d66ac req-e77dfacb-3409-44b8-9d50-e79f6aa36895 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.465289 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-41e468cd-b34b-471f-80df-77ace12d66ac req-e77dfacb-3409-44b8-9d50-e79f6aa36895 service nova] Creating event network-vif-plugged:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:05:54.471785 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-41e468cd-b34b-471f-80df-77ace12d66ac req-e77dfacb-3409-44b8-9d50-e79f6aa36895 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Jul 19 20:05:54.472743 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2090/4262] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:54.516806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.530417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.533167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.534724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bc210c57-ad96-4ce0-bec8-26012d8e2e9c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.348141 Jul 19 20:05:54.536373 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2173/4263] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:54.679439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:54.681435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:54.709908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.711610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.713900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.714345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.944788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:54.946290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:54.983578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.987103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.991843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.995351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-88e24478-b317-4751-9be2-471dfe170024 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.329534 Jul 19 20:05:54.995988 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2091/4264] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:55.007897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.007897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.008085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.008085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.009518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.010246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.011594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.012439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.459324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.472817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b337317-8b68-47e6-acae-9085b286846a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.475751 Jul 19 20:05:55.475090 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2092/4265] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:55.484325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.495623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4007de01-0fe0-4811-97dd-4cc58771ef59 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.561931 Jul 19 20:05:55.497792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.499727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.501406 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2174/4266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:55.506234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:55.508309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.509548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.510526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.511736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.554827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.561289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.574971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.575329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.576162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.576589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.693326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.703774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5fa94d6-5009-4e13-bba0-4b73065076ff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1284 microversion: 2.1 time: 0.227289 Jul 19 20:05:55.705522 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2093/4267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:55 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:55.943904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.964920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.970334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.973479 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c64fc51-96b1-4a60-961e-d091b6b7260d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.423413 Jul 19 20:05:55.976033 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2175/4268] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:55 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:05:56.021952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:56.023829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:56.034343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.035165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.036995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.037688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.499078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:56.499732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:56.513905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.514372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.515209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.515666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.954175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:56.971921 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d0a8d47-ad47-46e6-aac1-7b5f9497bf04 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.959342 Jul 19 20:05:56.972903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2094/4269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:56 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:56.986127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:56.987105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:57.001657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.002646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.003956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.004705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.164984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:57.191335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd607a39-9011-4277-9a95-2d91f0104702 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.693771 Jul 19 20:05:57.193442 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2176/4270] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:56 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:57.363913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:57.375603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d76009ed-4871-4259-96db-38db23e5eb4a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.401367 Jul 19 20:05:57.391428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2095/4271] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:56 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:57.403225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:57.404126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:57.422999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.423455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.424281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.424723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.466998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:57.943726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c7bd62a-8c25-4289-b418-16359230c4f9 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88cd18dc0>, body: {"keypair": {"name": "tempest-keypair-288485358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuttV8ojhoxOCwUxy8y50l+9n9a28nNrOqab2Fle1OVtALg9XXSDzgYFwNXX+twI8QtX93T1dOiF9P4FNX4krH4lLWnD61TC+U3myAtbII1GPdwoUWyqk9NusU0aXTG8Q=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:58.019590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6c7bd62a-8c25-4289-b418-16359230c4f9 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:58.061273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-6c7bd62a-8c25-4289-b418-16359230c4f9 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:58.134505 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c7bd62a-8c25-4289-b418-16359230c4f9 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.938049 Jul 19 20:05:58.135147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2177/4272] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:05:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:58.143840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.149021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.160227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.160671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.161457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.161884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.301065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.328998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-627b3216-4fa2-4434-80fd-608474515698 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.935666 Jul 19 20:05:58.334473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2096/4273] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:57 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:58.343202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.344191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.364230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.369052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.370207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.370865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.702608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.716514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.719846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.721913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78ae99cb-ded7-4984-b8ad-958a3104c674 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1807 microversion: 2.20 time: 0.585621 Jul 19 20:05:58.722500 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2178/4274] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1807 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:05:58.729452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4513032-f637-4754-8f82-dd97849b3950 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88cd18550>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.741131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4513032-f637-4754-8f82-dd97849b3950 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-288485358" status: 200 len: 497 microversion: 2.1 time: 0.016708 Jul 19 20:05:58.750147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2179/4275] 10.222.0.33 () {58 vars in 1214 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-288485358 => generated 497 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:58.757365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.763885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.764825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.771035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-709311bc-56af-4154-97e0-7493ec57646b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.435091 Jul 19 20:05:58.771858 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2097/4276] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:58.772711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.773319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.774462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.775061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.795326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.796138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.811851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.812556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.814839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.816135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.372685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:59.394484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:59.397351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a6d722c-9c72-43c8-a24c-a313ea0371c4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.622917 Jul 19 20:05:59.402128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2098/4277] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:59.411476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d84a26b2-a193-4208-a33f-6fc52a59ffe7 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88dad5040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:59.433699 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c11e02b6-42b8-495b-8eec-976717396b2f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.679538 Jul 19 20:05:59.437602 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2180/4278] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:59.464747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:59.466140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:59.472110 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d84a26b2-a193-4208-a33f-6fc52a59ffe7 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288485358" status: 202 len: 0 microversion: 2.1 time: 0.067752 Jul 19 20:05:59.475033 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2099/4279] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288485358 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:59.484702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.485535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.487584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.488440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.499241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ddf828e8-61d3-4de5-bf49-10ed8e11dd41 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88dc0b700>, body: {"keypair": {"name": "tempest-keypair-1438303427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUUShHpBxTz8DCYQFbUtGU3xYicZQ3QdzofeOpe4AzNHqtIG+RebD8U6dzmtqY2/AulXAhCW2/JEWlfGFCTMRNOhgvDVArg7NCQxiChtzTR9I7XOqEwk8H5E4PHutFruA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:59.531468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ddf828e8-61d3-4de5-bf49-10ed8e11dd41 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:59.554140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ddf828e8-61d3-4de5-bf49-10ed8e11dd41 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:59.615413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ddf828e8-61d3-4de5-bf49-10ed8e11dd41 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127975 Jul 19 20:05:59.623877 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2100/4280] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:05:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:59.631263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5307b473-8b65-4dc4-955a-528743b9f54c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88dc0b8b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:59.661112 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5307b473-8b65-4dc4-955a-528743b9f54c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438303427" status: 202 len: 0 microversion: 2.1 time: 0.035407 Jul 19 20:05:59.662130 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2101/4281] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438303427 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:59.678146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fae1f5b7-c3ad-4bcf-ba62-bb0f716b6c93 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88dc2b160>, body: {"keypair": {"name": "tempest-keypair-1318472395", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:59.712919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fae1f5b7-c3ad-4bcf-ba62-bb0f716b6c93 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:59.720714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fae1f5b7-c3ad-4bcf-ba62-bb0f716b6c93 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:59.754694 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fae1f5b7-c3ad-4bcf-ba62-bb0f716b6c93 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.085208 Jul 19 20:05:59.756163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2102/4282] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:05:59 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:59.777272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:59.778160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:59.796650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.798003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.798939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.799849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.127057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.153936 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56fb70db-e4ed-44b8-aa0e-f4acaacbcb6c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.714512 Jul 19 20:06:00.154546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2181/4283] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:59 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:00.170452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-123af4d4-e446-4d0e-982e-3055b45fdd23 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88cd18c10>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.197718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-123af4d4-e446-4d0e-982e-3055b45fdd23 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318472395" status: 202 len: 0 microversion: 2.1 time: 0.031672 Jul 19 20:06:00.198670 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2182/4284] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318472395 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:00.209876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.210543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:00.244395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.245080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.246737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.247448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.451753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.466468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.468731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.470565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8186a831-bcca-42d1-a597-07c316e5b375 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1794 microversion: 2.20 time: 0.712965 Jul 19 20:06:00.471644 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2103/4285] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:05:59 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1794 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:06:00.509644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-476de747-9241-4f69-ad60-af0fe043019b tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88dad20d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1463323195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQad3DxmuROuh/0JwKmi4pxDSp7osbytIyjHyf6luauIV+7TySOfshq8ylYGhVdr1BbFMFwu2o+q4xxokI+4fPoWIpRPPqBqEDN3cTN6UKZgZBFpN8sh7x7C4I0vXa1OQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:00.543504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-476de747-9241-4f69-ad60-af0fe043019b tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:00.553759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-476de747-9241-4f69-ad60-af0fe043019b tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:00.608013 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-476de747-9241-4f69-ad60-af0fe043019b tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.134328 Jul 19 20:06:00.614852 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2104/4286] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:00.627911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.628558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:00.636244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.636591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.637616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.638205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.810081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.829601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2c8e3eb-bc4c-4be5-8b26-42e7f32a112f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1511 microversion: 2.1 time: 0.626166 Jul 19 20:06:00.830555 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2183/4287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:00 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1511 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:00.840413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.841037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:00.865533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.866582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.869878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.870496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.194732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:01.206498 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9531adfe-434a-43d1-88a3-17bea98944a9 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.588172 Jul 19 20:06:01.208076 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2105/4288] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:00 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:01.396333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:01.406556 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25414c25-d74f-4e62-9a0d-09efc78a625f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.574878 Jul 19 20:06:01.417426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2184/4289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:00 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:01.425246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f66bbe0-197d-411a-a5fb-80d8a730bb7f tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88cc74a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1864120972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUhr5yAyZ4Yv+sz8K3gQ2lE9GtIMFiROZfhw/Q/xs0HQPDpjBJ5v3v6dfE207BT8NaV5FIVRTzRoeunNQiaqmvzyqrcB0WR+qu490ekZO3PW1nerOxgsljrA0/kh7GfHA=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:01.441295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f66bbe0-197d-411a-a5fb-80d8a730bb7f tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:01.448905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4f66bbe0-197d-411a-a5fb-80d8a730bb7f tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:01.452728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:01.480655 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f66bbe0-197d-411a-a5fb-80d8a730bb7f tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061669 Jul 19 20:06:01.488377 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2185/4290] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:01.495651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.498048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:01.511430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.511911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.512798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.513231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.642028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-60d5fd6c-fe07-4c54-8dde-97cb0212bf0f req-573d12da-252b-44a6-9285-7cebd7f421d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344a0508-2c98-4a7e-92c1-cc0367c68795", "tag": "2dad781d-8623-4b97-8c5d-7c80d313db2b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:01.653853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-60d5fd6c-fe07-4c54-8dde-97cb0212bf0f req-573d12da-252b-44a6-9285-7cebd7f421d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.655020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-60d5fd6c-fe07-4c54-8dde-97cb0212bf0f req-573d12da-252b-44a6-9285-7cebd7f421d4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.668532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-60d5fd6c-fe07-4c54-8dde-97cb0212bf0f req-573d12da-252b-44a6-9285-7cebd7f421d4 service nova] Creating event network-changed:2dad781d-8623-4b97-8c5d-7c80d313db2b for instance 344a0508-2c98-4a7e-92c1-cc0367c68795 on n-h1-843861-3 Jul 19 20:06:01.676847 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-60d5fd6c-fe07-4c54-8dde-97cb0212bf0f req-573d12da-252b-44a6-9285-7cebd7f421d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465429 Jul 19 20:06:01.679490 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2106/4291] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:01.687878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7caf53a-09c2-4168-aa44-a623845e349c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Action: 'create', calling method: .version_select at 0x7fb88dddb1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-778242718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwJcyKkop2KDJUysn9wuteZW+6Sv6hk6WeZT6XzbizqXpyoWif4TvBVcmvPlLh7OlJIf2wLn58UxgSEsyzvCyHRf/5I+HqzqODjgfG2i+cRz6+0Syx8eF1mqEaH2kk/vA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:01.705536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e7caf53a-09c2-4168-aa44-a623845e349c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:01.712458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e7caf53a-09c2-4168-aa44-a623845e349c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Getting quotas for user 5639a97f5d7649668b7c5e2936b7698d and project c98cf4518f2a42dfbf8c9eeb61c4a221. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:01.742774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7caf53a-09c2-4168-aa44-a623845e349c tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.060480 Jul 19 20:06:01.749189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2107/4292] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:01 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:01.756509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5a80661-265f-4e5c-803c-55a24c73a8af tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88dbfa1f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.760894 n-d-843861-3 devstack@n-api.service[126007]: WARNING oslo_db.sqlalchemy.utils [None req-d5a80661-265f-4e5c-803c-55a24c73a8af tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 20:06:01.768378 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5a80661-265f-4e5c-803c-55a24c73a8af tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.017642 Jul 19 20:06:01.769620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2108/4293] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:06:01 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:01.779355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-334931fb-1c64-4517-8e12-a8c785fc9b18 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88dae0d30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.807415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-334931fb-1c64-4517-8e12-a8c785fc9b18 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-778242718" status: 202 len: 0 microversion: 2.1 time: 0.031687 Jul 19 20:06:01.808632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2109/4294] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-778242718 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:01.817536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03c8259e-0404-4111-8cff-1aace78c5543 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88d5a3940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.838805 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03c8259e-0404-4111-8cff-1aace78c5543 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1864120972" status: 202 len: 0 microversion: 2.1 time: 0.025953 Jul 19 20:06:01.839774 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2110/4295] 10.222.0.33 () {58 vars in 1277 bytes} [Tue Jul 19 20:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1864120972 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:06:01.847564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.848527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:01.856102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.856639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.857541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.858184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.908052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:01.926900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f68bc0c7-0ee3-48dc-8e33-e1526bcb1d8b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.440009 Jul 19 20:06:01.928637 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2186/4296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:01 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:01.937526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9d5a3363-5fdb-4b31-846a-d70ac253c2d7 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] Calling method '.version_select at 0x7fb88ccfd310>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.969448 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9d5a3363-5fdb-4b31-846a-d70ac253c2d7 tempest-KeyPairsV2TestJSON-876591790 tempest-KeyPairsV2TestJSON-876591790-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1463323195" status: 202 len: 0 microversion: 2.1 time: 0.039058 Jul 19 20:06:01.970097 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2187/4297] 10.222.0.33 () {58 vars in 1277 bytes} [Tue Jul 19 20:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1463323195 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:02.114063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:02.125450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc6df1f8-e823-491e-8233-10a96da8d478 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1488 microversion: 2.1 time: 0.282493 Jul 19 20:06:02.127165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2111/4298] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:01 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1488 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:02.156155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:02.157005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:02.171829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.172621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.173606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.174279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.208660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:02.259285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:02.260474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:02.276532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.277079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.277783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.278364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.389238 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7097b2dd-add0-4c20-b13d-df39d392e1a2 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 204 len: 0 microversion: 2.1 time: 0.238358 Jul 19 20:06:02.390635 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2188/4299] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:02 2022] DELETE /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:02.403124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:02.404661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:02.412302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.412916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.413812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.414350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.526162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:02.539061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2737912-aa7d-4ea5-b1fe-0237199f5e02 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.311385 Jul 19 20:06:02.549033 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2112/4300] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:02 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:02.549033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:02.549033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:02.561658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.562318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.563518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.565017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.629203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:02.643235 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0bc39788-ce99-43e7-938f-163f090b9042 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1494 microversion: 2.1 time: 0.246515 Jul 19 20:06:02.644190 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2189/4301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:02 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:02.737165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:02.746074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-28f7ba48-016b-4765-b68d-7485d7c63851 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.203647 Jul 19 20:06:02.746899 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2113/4302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:02 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:02.948318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:02.948318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:02.954919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.955697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:02.956479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:02.956913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.184011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:03.197094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-adfc4166-cdc4-4d9e-82ba-11058c39d940 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.256243 Jul 19 20:06:03.200423 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2190/4303] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:02 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:03.557566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:03.558302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:03.567040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.567653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.568540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.569120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.677005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:03.677005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:03.679424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:03.686728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.687177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.687975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.688573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.754943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:03.781745 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4bcbb249-6f3f-4fac-9af4-ff179e9715a5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.228495 Jul 19 20:06:03.782729 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2114/4304] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:03 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:03.808181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:03.808819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:03.816391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.817479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.818637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.819272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.890042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:03.902779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4927f21-550b-4522-89e9-0d44657d12b8 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1494 microversion: 2.1 time: 0.236288 Jul 19 20:06:03.911868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2191/4305] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:03 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1494 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:03.990750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:04.002024 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8cfd1685-1fa4-4bb5-abf5-ee6d069f8f1d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.205968 Jul 19 20:06:04.002635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2115/4306] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:03 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:04.219358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:04.219358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:04.227207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.228207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.229126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.230792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.302640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:04.659281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:04.669022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8ff5281-419d-478f-8fb6-4b3c58a4af74 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.458488 Jul 19 20:06:04.672231 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2192/4307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:04 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:04.802954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:04.803556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:04.812812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.813273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.814167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.814611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.938866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:04.939842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:04.969484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.969484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.972748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:04.974071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.113264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:05.138652 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d36746fb-656a-4b5b-ba83-0aecfef961dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 200 len: 1452 microversion: 2.1 time: 0.220066 Jul 19 20:06:05.143213 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2193/4308] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:04 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:05.157579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b377a3a7-a567-4071-b402-bfbb7bee3412 req-27ba35c7-2931-4927-b225-2034efd50130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5639c-e907-4290-b67a-9bf56bb0ebdc", "name": "network-vif-deleted", "tag": "df7f3a00-98f4-40c4-9280-fd0ca572f5de"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:05.163430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:05.166900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b377a3a7-a567-4071-b402-bfbb7bee3412 req-27ba35c7-2931-4927-b225-2034efd50130 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.167668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b377a3a7-a567-4071-b402-bfbb7bee3412 req-27ba35c7-2931-4927-b225-2034efd50130 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.181709 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b377a3a7-a567-4071-b402-bfbb7bee3412 req-27ba35c7-2931-4927-b225-2034efd50130 service nova] Creating event network-vif-deleted:df7f3a00-98f4-40c4-9280-fd0ca572f5de for instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc on n-h1-843861-3 Jul 19 20:06:05.184649 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c0de903-74cf-47f1-80e5-fa0e48fc3cc6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.384587 Jul 19 20:06:05.185390 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2116/4309] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:04 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:05.197465 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b377a3a7-a567-4071-b402-bfbb7bee3412 req-27ba35c7-2931-4927-b225-2034efd50130 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043308 Jul 19 20:06:05.201772 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2194/4310] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:05.202009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:05.202615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:05.238199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.239938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.240925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.241553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.406855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:05.416129 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77748b73-ba4c-448a-805d-002ab66e8800 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.229633 Jul 19 20:06:05.425760 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2117/4311] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:05 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:05.689661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:05.690560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:05.701663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.702174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.703318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.703772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.704626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98d981c9-bef5-401d-82c6-8867063ba2ef tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88d0aa040>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiNkXjmjj/vx2FNL6h/t03BmIHO5pfD2Wi++jjztMXri+uRvF/8p0zcWDOPt5AYxc2d9GMQG3RUQKdM86T3w/9x3gIpLQLH865Utq9dGtLMmITvUxCPMskwUaElIFCBcQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:05.713003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-98d981c9-bef5-401d-82c6-8867063ba2ef tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98d981c9-bef5-401d-82c6-8867063ba2ef tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 257 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiNkXjmjj/vx2FNL6h/t03BmIHO5pfD2Wi++jjztMXri+uRvF/8p0zcWDOPt5AYxc2d9GMQG3RUQKdM86T3w/9x3gIpLQLH865Utq9dGtLMmITvUxCPMskwUaElIFCBcQ=="}} Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiNkXjmjj/vx2FNL6h/t03BmIHO5pfD2Wi++jjztMXri+uRvF/8p0zcWDOPt5AYxc2d9GMQG3RUQKdM86T3w/9x3gIpLQLH865Utq9dGtLMmITvUxCPMskwUaElIFCBcQ=='}}} Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:05.723776 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 20:06:05.728631 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.731999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98d981c9-bef5-401d-82c6-8867063ba2ef tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:05.734626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98d981c9-bef5-401d-82c6-8867063ba2ef tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.463183 Jul 19 20:06:05.735922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2195/4312] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:05 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:06:05.749450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88cd5fa60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-395271533", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:05.783125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:05.799312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for user 146847e806ba417489baec79a734e754 and project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:05.821914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 2166 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-395271533", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:06:05.831213 n-d-843861-3 devstack@n-api.service[126008]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-395271533', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:05.833606 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:05.836253 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:05.838769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:05.839862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dab251fe-2bd7-4879-bf63-98bf5c23de06 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.098291 Jul 19 20:06:05.840906 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2196/4313] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Jul 19 20:06:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:06:05.853140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9188468c-2e6f-4906-942c-9aa832cb50d8 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88ccc9280>, body: {"keypair": {"name": "tempest-keypair-1899384649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUA02biozftUllCbhs+fYqf6+dLhCd6ZG7/4iBWH5507XAvb0PhYMkXiQIx6iHtApEnhrxeXaFHaD0ptQz3i7UcqUdidF2RNeyxyIww0tIDSe74IpzoPLFzEOosyoEoUw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:05.870560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9188468c-2e6f-4906-942c-9aa832cb50d8 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:05.877599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9188468c-2e6f-4906-942c-9aa832cb50d8 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for user 146847e806ba417489baec79a734e754 and project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:05.890382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:05.898989 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4c11bc2-fe8c-4158-9864-0fe8bb0c9dac tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.214291 Jul 19 20:06:05.900923 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2118/4314] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:05 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:05.916798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9188468c-2e6f-4906-942c-9aa832cb50d8 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068555 Jul 19 20:06:05.917814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2197/4315] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:05.933449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88dc0b5e0>, body: {"keypair": {"name": "tempest-keypair-1899384649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeObVyVPhWUvjxzy3gO/Xy755NXt/ebzRtaCT9V8OhKPINSibxb6cqaV2T0Sn7YB8NMxIfFYnLv+17cOXha/dvbwJjVJHv7kx//8ApIXC0wWPqo3GP3o4QED+/R1ayj4Q=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:05.938301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:05.953091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:05.960540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for user 146847e806ba417489baec79a734e754 and project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:05.991147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Key pair 'tempest-keypair-1899384649' already exists. Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 273 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: {"keypair": {"name": "tempest-keypair-1899384649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeObVyVPhWUvjxzy3gO/Xy755NXt/ebzRtaCT9V8OhKPINSibxb6cqaV2T0Sn7YB8NMxIfFYnLv+17cOXha/dvbwJjVJHv7kx//8ApIXC0wWPqo3GP3o4QED+/R1ayj4Q=="}} Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: exception: Key pair 'tempest-keypair-1899384649' already exists. Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1899384649', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeObVyVPhWUvjxzy3gO/Xy755NXt/ebzRtaCT9V8OhKPINSibxb6cqaV2T0Sn7YB8NMxIfFYnLv+17cOXha/dvbwJjVJHv7kx//8ApIXC0wWPqo3GP3o4QED+/R1ayj4Q=='}}} Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result.read() Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '146847e806ba417489baec79a734e754-tempest-keypair-1899384649' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 20:06:06.003799 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result.read() Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 20:06:06.007672 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '146847e806ba417489baec79a734e754-tempest-keypair-1899384649' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 20, 6, 5, 981212), 'updated_at': None, 'name': 'tempest-keypair-1899384649', 'user_id': '146847e806ba417489baec79a734e754', 'fingerprint': 'd4:86:e7:4a:5d:de:0c:e4:7e:63:22:1a:63:10:e7:a2', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeObVyVPhWUvjxzy3gO/Xy755NXt/ebzRtaCT9V8OhKPINSibxb6cqaV2T0Sn7YB8NMxIfFYnLv+17cOXha/dvbwJjVJHv7kx//8ApIXC0wWPqo3GP3o4QED+/R1ayj4Q==', 'type': 'ssh'}] Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi keypair.create() Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._create() Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1899384649' already exists. Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 19 20:06:06.012034 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1899384649' already exists. Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1899384649' already exists. Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 409 to user: Key pair 'tempest-keypair-1899384649' already exists. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0852dce-f8d5-431a-8261-d45b3dd0a609 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.088748 Jul 19 20:06:06.019118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2119/4316] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:05 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:06:06.030417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a18dd43e-618b-442f-a12e-ba695be58e94 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Calling method '.version_select at 0x7fb88cd8ad30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.050799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a18dd43e-618b-442f-a12e-ba695be58e94 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899384649" status: 202 len: 0 microversion: 2.1 time: 0.025418 Jul 19 20:06:06.052300 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2198/4317] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899384649 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:06.066897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32a58be8-e0c8-4dab-a90a-ea041eef45b5 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88db86a60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3fvkQKGNGCHQKg8uAMundtZSfvOq1/09V23jJGlfLp6LXtbZ3jP7/HkGJFXwJuY7d2oaeltptT43x6BRZ/x2tOOqxbyI+uWX4EHp7WEm5AAzMlinlVYxp/Hw3Ym0yC7A=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32a58be8-e0c8-4dab-a90a-ea041eef45b5 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 247 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3fvkQKGNGCHQKg8uAMundtZSfvOq1/09V23jJGlfLp6LXtbZ3jP7/HkGJFXwJuY7d2oaeltptT43x6BRZ/x2tOOqxbyI+uWX4EHp7WEm5AAzMlinlVYxp/Hw3Ym0yC7A=="}} Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3fvkQKGNGCHQKg8uAMundtZSfvOq1/09V23jJGlfLp6LXtbZ3jP7/HkGJFXwJuY7d2oaeltptT43x6BRZ/x2tOOqxbyI+uWX4EHp7WEm5AAzMlinlVYxp/Hw3Ym0yC7A=='}}} Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:06:06.069409 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32a58be8-e0c8-4dab-a90a-ea041eef45b5 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.072944 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32a58be8-e0c8-4dab-a90a-ea041eef45b5 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010355 Jul 19 20:06:06.076213 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2120/4318] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:06:06.081576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88cc8b550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1925069004", "public_key": " "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.098021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:06.105517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for user 146847e806ba417489baec79a734e754 and project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:06.124348 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 95 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1925069004", "public_key": " "}} Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1925069004', 'public_key': ' '}}} Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.126525 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.130455 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.134290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.135379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a6f7417-b83e-4503-bee4-0863e5bafa01 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058022 Jul 19 20:06:06.136585 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2199/4319] 10.222.0.33 () {60 vars in 1157 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:06:06.153594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2257a879-b3d6-49d3-9f97-ad7e0813b240 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88dacbee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVOlZypf4mllygx6FDP6JzBQyxJuTR0W0xwV/s4NY2sptfHWkEQPDvg9m7LexlfU75RPOAe5NxZ8lM2tf9Ir6MwgiYUYy6k4GmaDhuWgggPHT66EeziRPmzQbcg36qTTw=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2257a879-b3d6-49d3-9f97-ad7e0813b240 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 507 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVOlZypf4mllygx6FDP6JzBQyxJuTR0W0xwV/s4NY2sptfHWkEQPDvg9m7LexlfU75RPOAe5NxZ8lM2tf9Ir6MwgiYUYy6k4GmaDhuWgggPHT66EeziRPmzQbcg36qTTw=="}} Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVOlZypf4mllygx6FDP6JzBQyxJuTR0W0xwV/s4NY2sptfHWkEQPDvg9m7LexlfU75RPOAe5NxZ8lM2tf9Ir6MwgiYUYy6k4GmaDhuWgggPHT66EeziRPmzQbcg36qTTw=='}}} Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 19 20:06:06.158451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 20:06:06.164464 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.170209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.170482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2257a879-b3d6-49d3-9f97-ad7e0813b240 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.170622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:06.172057 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2257a879-b3d6-49d3-9f97-ad7e0813b240 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026569 Jul 19 20:06:06.173525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2121/4320] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:06:06.180592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.181361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.183170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.183988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.191210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Action: 'create', calling method: .version_select at 0x7fb88d4704c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-43152951", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.203430 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc HTTP/1.1 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '37c5639c-e907-4290-b67a-9bf56bb0ebdc'} Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.205402 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65eb27ff-2dec-42e2-b5a2-3238e586c29f tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 404 len: 111 microversion: 2.1 time: 0.050468 Jul 19 20:06:06.214895 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2200/4321] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:06 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:06.240161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.241260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:06.252872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.253325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.254124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.255118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.260735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:06.296472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Getting quotas for user 146847e806ba417489baec79a734e754 and project e766fc78f1b74a82bd8606bf3a369b51. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:06.340225 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 116 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-43152951", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-43152951', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 20:06:06.345585 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 20:06:06.352163 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.360695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.361214 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c970e3c-61f0-4e77-8672-daacf9b72b58 tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.179007 Jul 19 20:06:06.362786 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2122/4322] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:06:06.376035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0577f28d-f689-4e9a-bc6f-4ed06ba6156a tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Calling method '.version_select at 0x7fb88dc59160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.391411 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0577f28d-f689-4e9a-bc6f-4ed06ba6156a tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0577f28d-f689-4e9a-bc6f-4ed06ba6156a tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Request method failure captured: Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1245424632 HTTP/1.1 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w6t_gSCYJm-d_i_fGYeddBlHs27X8GFfbXXShWnJpLOnWMj_aM315FChDHmz7hMRU9_iA0mVDtlJ0i5kpuXFA-DLv9mfHv3T0iyT4VVmQmmYT4ewrcsKryUODWEZz2Pc8aQDQHMYZWhEC9gvm1QhWDcnXoHgWxhMaD4hW9VpHSZhqw Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e766fc78f1b74a82bd8606bf3a369b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: e766fc78f1b74a82bd8606bf3a369b51 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183923409 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 146847e806ba417489baec79a734e754 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183923409-project Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: exception: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'tempest-keypair-non-existent-1245424632'} Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.394303 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 Jul 19 20:06:06.397882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:06.402678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0577f28d-f689-4e9a-bc6f-4ed06ba6156a tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1245424632 not found for user 146847e806ba417489baec79a734e754 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:06.403947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0577f28d-f689-4e9a-bc6f-4ed06ba6156a tempest-KeyPairsNegativeTestJSON-1183923409 tempest-KeyPairsNegativeTestJSON-1183923409-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1245424632" status: 404 len: 145 microversion: 2.1 time: 0.034316 Jul 19 20:06:06.405548 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2123/4323] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 20:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1245424632 => generated 145 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:06.435215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.436196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:06.445355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.446727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.447731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.448526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.735961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:06.749592 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68b40012-6fba-4649-8d8c-fa26b5b261a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.319802 Jul 19 20:06:06.750731 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2124/4324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:06 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:06.755548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-706835935", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5d90fd12-6c41-49de-a6f8-066e6e5ee2cd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.855118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] validate_networks() for [('5d90fd12-6c41-49de-a6f8-066e6e5ee2cd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:06:07.501000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:07.515087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0cc94b11-846c-4c50-96db-36ab8f63217e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 1.303010 Jul 19 20:06:07.515700 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2201/4325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:06 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:07.525568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:07.529025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:07.542577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.543296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:07.544798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.545597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:07.962430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:07.973247 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54dd1c5d-4580-416c-997f-e19dd1ec91d4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.455873 Jul 19 20:06:07.974143 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2202/4326] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:07 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:07.980444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:07.981391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:07.989691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.990468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:07.991651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.992412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.372198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:06:08.374287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:06:08.375183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:06:08.376137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:06:08.377305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:06:08.392163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.392869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.394141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.394915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.425087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:08.433858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Getting quotas for user 7d706b8f50d44b12b3e727c9ecdc46c9 and project c724ef0d0c8941459eb9c9f0c67fcdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:08.455545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:06:08.459224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:06:08.460194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:08.470138 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de2451ac-5947-489c-b518-ecbb5b93e86b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.492676 Jul 19 20:06:08.471448 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2203/4327] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:07 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:08.530491 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-987a2963-fbd1-4c90-bda4-365102b5f1e3 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778664 Jul 19 20:06:08.531343 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2125/4328] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:06:08.538018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:08.538018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:08.544933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-916e6d11-c4e4-4114-92b7-5efcd1b3bdeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:08.545969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-916e6d11-c4e4-4114-92b7-5efcd1b3bdeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:08.547357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.548004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.548798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.549414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.648062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-916e6d11-c4e4-4114-92b7-5efcd1b3bdeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:08.664641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-916e6d11-c4e4-4114-92b7-5efcd1b3bdeb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1214 microversion: 2.1 time: 0.124491 Jul 19 20:06:08.673509 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2126/4329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:08 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:08.880311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:08.906270 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b933934-f677-4d54-a967-329771ad08e6 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.376911 Jul 19 20:06:08.908950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2204/4330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:08 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:08.967246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5be41ecf-c22e-4eed-8983-8f1ab8cc5cbe req-1dbac41b-d60e-4c74-8859-a17bb1bfbde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344a0508-2c98-4a7e-92c1-cc0367c68795", "name": "network-vif-plugged", "status": "completed", "tag": "2dad781d-8623-4b97-8c5d-7c80d313db2b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:08.983361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5be41ecf-c22e-4eed-8983-8f1ab8cc5cbe req-1dbac41b-d60e-4c74-8859-a17bb1bfbde4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.984090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5be41ecf-c22e-4eed-8983-8f1ab8cc5cbe req-1dbac41b-d60e-4c74-8859-a17bb1bfbde4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.994792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:08.995682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:09.002312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5be41ecf-c22e-4eed-8983-8f1ab8cc5cbe req-1dbac41b-d60e-4c74-8859-a17bb1bfbde4 service nova] Creating event network-vif-plugged:2dad781d-8623-4b97-8c5d-7c80d313db2b for instance 344a0508-2c98-4a7e-92c1-cc0367c68795 on n-h1-843861-3 Jul 19 20:06:09.009713 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5be41ecf-c22e-4eed-8983-8f1ab8cc5cbe req-1dbac41b-d60e-4c74-8859-a17bb1bfbde4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321766 Jul 19 20:06:09.011061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2127/4331] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:09.011185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.011557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.014166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.014600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.249601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:09.261359 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76918177-ae7f-4ad4-9e21-a8622a25f8fc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.273235 Jul 19 20:06:09.262797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2205/4332] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:08 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:09.491966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:09.493165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:09.517008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.518277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.519475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.523054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.697572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:09.698899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:09.712313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.713763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.715069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.715655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.799273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:09.810968 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52236657-c006-4f3e-9ee1-6eb1df2e563a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.324608 Jul 19 20:06:09.812447 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2128/4333] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:09 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:09.840248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:09.855728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53926489-0b5f-4408-bf0c-33654854a405 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1210 microversion: 2.1 time: 0.164423 Jul 19 20:06:09.856374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2206/4334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:09 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1210 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:09.926600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:09.927346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:09.937353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.938231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.939710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:09.940503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.166037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:10.174473 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24037cf6-810a-4e76-a1ff-564e4f3b55ef tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.253548 Jul 19 20:06:10.186161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2129/4335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:09 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:10.282593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:10.283854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:10.296740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.298416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.300046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.302464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.485031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:10.497698 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f17617e6-89c1-406b-88a9-28f074cc125c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1314 microversion: 2.1 time: 0.221855 Jul 19 20:06:10.499456 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2207/4336] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:10 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:10.829612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:10.830226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:10.847337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.850634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.855340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.855856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.875519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:10.876200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:10.886072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:10.896578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.897147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.897918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.898456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.246999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:11.260601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87ba7e0f-8d5e-4c4d-8477-efcb397e7521 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1284 microversion: 2.1 time: 0.390232 Jul 19 20:06:11.272662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2208/4337] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:10 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1284 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:11.287623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:11.288616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:11.305651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.309855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.311065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.313252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.514657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:11.547594 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cccaf19-1758-4f55-9d2d-ee2db62072db tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.719662 Jul 19 20:06:11.549309 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2130/4338] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:10 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:11.574593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:11.575255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:11.590132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.590868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.602937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.604470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.662473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:11.674431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8041be2b-defd-4745-959f-2aa38901a18c tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.399857 Jul 19 20:06:11.675559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2209/4339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:11 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:11.896922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:11.914093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41c1f597-c207-481f-b865-5ea82635cdf2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1500 microversion: 2.1 time: 0.359632 Jul 19 20:06:11.915969 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2131/4340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:11 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1500 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:11.932678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:11.933484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:11.941058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.942202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:11.943497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:11.944244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:12.279428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Removing security group 2b7e42a9-6cb1-405f-9661-9ced10149d17 from port 2dad781d-8623-4b97-8c5d-7c80d313db2b Jul 19 20:06:12.304389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:12.305114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:12.324471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:12.336006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:12.337754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:12.338352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.143436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:13.161932 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2727d5b9-f8d3-4a09-b89d-957adf438d60 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.861733 Jul 19 20:06:13.163596 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2132/4341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:12 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:13.179864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:13.181068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:13.243761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.244304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.245951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.250977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.718350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:13.737408 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-deebf59e-7aa7-40c4-8999-302741cd6b39 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.572006 Jul 19 20:06:13.741109 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2133/4342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:13 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:13.751346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:13.756358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:13.777243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.780100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.787340 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c63de3ec-a65b-4594-837d-3335a1c92ca5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795/action" status: 202 len: 0 microversion: 2.1 time: 1.858759 Jul 19 20:06:13.788182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.788872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.789112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2210/4343] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:11 2022] POST /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795/action => generated 0 bytes in 1861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:13.804300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:13.805896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:13.814766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.815641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:13.817298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:13.818750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.287253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:14.304150 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2011029-42a0-4a99-a06a-5f3bff7dfc0b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1458 microversion: 2.1 time: 0.505931 Jul 19 20:06:14.309216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2211/4344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:13 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1458 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:14.332135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-221999f6-7776-475b-aeb6-f760f015e1ee req-1b71edd2-bc78-42d8-a603-265456d98ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344a0508-2c98-4a7e-92c1-cc0367c68795", "tag": "2dad781d-8623-4b97-8c5d-7c80d313db2b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:14.376395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-221999f6-7776-475b-aeb6-f760f015e1ee req-1b71edd2-bc78-42d8-a603-265456d98ab6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.377716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-221999f6-7776-475b-aeb6-f760f015e1ee req-1b71edd2-bc78-42d8-a603-265456d98ab6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.397302 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-221999f6-7776-475b-aeb6-f760f015e1ee req-1b71edd2-bc78-42d8-a603-265456d98ab6 service nova] Creating event network-changed:2dad781d-8623-4b97-8c5d-7c80d313db2b for instance 344a0508-2c98-4a7e-92c1-cc0367c68795 on n-h1-843861-3 Jul 19 20:06:14.407760 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-221999f6-7776-475b-aeb6-f760f015e1ee req-1b71edd2-bc78-42d8-a603-265456d98ab6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095711 Jul 19 20:06:14.410325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2212/4345] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:14.426749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:14.430045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:14.452091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.453933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.456412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.457294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.679778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:14.702452 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15abb7ef-63e8-48d6-a771-7338f258c73e tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.959923 Jul 19 20:06:14.719855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2134/4346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:13 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:14.731752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:14.733866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:14.769072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.769611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.773043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.773722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.024024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:15.032783 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cd5d5c6-1f10-47d5-8fad-6810af377236 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.619649 Jul 19 20:06:15.033389 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2213/4347] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:14 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:15.043973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:15.049194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:15.070395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.071131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.072125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.072748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.208980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:15.221670 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-322553f3-a28d-4baf-9eae-444d2c50361d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.511249 Jul 19 20:06:15.239099 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2135/4348] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:14 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:15.248749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:15.249608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:15.268387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.269100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.270206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.270638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.554246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:15.574070 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eea8dcc4-5bba-43c3-b66e-52eea25438e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.534252 Jul 19 20:06:15.575261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2214/4349] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:15 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:15.650044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:15.661407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-018846de-88db-41eb-ac6c-ffe90509cc27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.416199 Jul 19 20:06:15.678007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2136/4350] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:15 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:15.686762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:15.688577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:15.713327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.714174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.715466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.716110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.737315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:15.740304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:15.771885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.776259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.778328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.781348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.113706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=26 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:16.240860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.265382 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4e81bad-d694-4096-bb34-c3fa9d14e09a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.529565 Jul 19 20:06:16.266973 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2137/4351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:15 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:16.282125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:16.287449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.300025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:16.301408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d5158f4-37d5-4d79-bb58-24fdb240a2dc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.621988 Jul 19 20:06:16.311939 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2215/4352] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:15 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:16.326385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.326920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.327975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.328668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.329672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:16.330640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:16.339583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:16.342187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.343174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.345358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.346034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.373399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:16.635763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.652694 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5988817b-7aeb-453e-ba6e-e0bef4a26354 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.384125 Jul 19 20:06:16.663223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2138/4353] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:16 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:16.672153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:16.673819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:16.686821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.687655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.689038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:16.689783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:16.703929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.716354 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-192f47ae-3e37-4e52-9212-d41192809e00 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.395251 Jul 19 20:06:16.717373 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2216/4354] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:16 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:16.873368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-578548365", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "2f332934-1a7c-403c-b4ff-1c5d43cb0949"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:16.937903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.947836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f62c5db3-b6ee-4a9d-bc29-788aa1de8b84 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.283283 Jul 19 20:06:16.954320 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2139/4355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:16 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:16.966394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] validate_networks() for [('2f332934-1a7c-403c-b4ff-1c5d43cb0949', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:06:17.095196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-39b22306-ba52-4a0a-a161-4296a094f79f req-73b2c331-9747-4f4b-aa7e-7380f3d65fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93c38cb-a31d-4f2e-ae46-af353a767d21", "tag": "d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:17.115904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-39b22306-ba52-4a0a-a161-4296a094f79f req-73b2c331-9747-4f4b-aa7e-7380f3d65fdd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.116721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-39b22306-ba52-4a0a-a161-4296a094f79f req-73b2c331-9747-4f4b-aa7e-7380f3d65fdd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.138519 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-39b22306-ba52-4a0a-a161-4296a094f79f req-73b2c331-9747-4f4b-aa7e-7380f3d65fdd service nova] Creating event network-changed:d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417 for instance a93c38cb-a31d-4f2e-ae46-af353a767d21 on n-h1-843861-3 Jul 19 20:06:17.144878 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-39b22306-ba52-4a0a-a161-4296a094f79f req-73b2c331-9747-4f4b-aa7e-7380f3d65fdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053946 Jul 19 20:06:17.146214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2140/4356] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:06:17.290150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:17.291013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:17.312940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.318269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.320162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.321782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.831518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:17.843273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c950a48-545c-47a7-b707-dfc31bf0b9e8 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.557482 Jul 19 20:06:17.857003 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2141/4357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:17 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:17.862293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:17.862885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:17.874239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.874929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.877561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.878203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.410558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:18.663732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:18.736049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:18.745295 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2e5ea1e-29c4-4a7b-891e-0dd9fadd6af9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.886811 Jul 19 20:06:18.747978 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2142/4358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:17 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:18.753622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:18.764698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:18.782814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:18.785257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.787039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:18.788467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.871140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:06:18.871625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:06:18.872236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:06:18.872827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:06:18.874117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:06:18.890929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:18.891857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.895156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:18.895789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.954789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:18.968418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Getting quotas for user f78ad139e751423989cc0e807a201c54 and project 780e8dd93d534fdc82b987128a16e450. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:19.004964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:06:19.007984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:06:19.084630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:19.097077 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9817394b-2755-4c58-b363-bfe61ca473c5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.347061 Jul 19 20:06:19.098478 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2143/4359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:18 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:19.111187 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-432b5c33-2870-4936-bb27-94130b82e157 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243001 Jul 19 20:06:19.116201 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2217/4360] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:06:19.122787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9bb53a18-86ac-4d7a-b382-d8f60c498538 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:19.123697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9bb53a18-86ac-4d7a-b382-d8f60c498538 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:19.131003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:19.133161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:19.147903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:19.148706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:19.150494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:19.151508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:19.298165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9bb53a18-86ac-4d7a-b382-d8f60c498538 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:19.309028 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9bb53a18-86ac-4d7a-b382-d8f60c498538 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1214 microversion: 2.1 time: 0.191123 Jul 19 20:06:19.313469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2218/4361] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:19 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:19.514583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:19.524815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da823374-7900-496d-ba57-07d9796910f5 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1522 microversion: 2.1 time: 0.424958 Jul 19 20:06:19.528297 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2144/4362] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:19 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:19.769988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:19.772265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:19.783490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:19.784472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:19.785606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:19.786200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.065143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.079135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6688c500-d961-42da-a404-ba6be60badaa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.316235 Jul 19 20:06:20.091733 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2219/4363] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:19 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:20.117286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:20.119655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:20.139276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.144081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.145388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.148289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.330466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb8e7768-0776-4e89-a374-ad8ada00de23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:20.331468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb8e7768-0776-4e89-a374-ad8ada00de23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:20.505145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb8e7768-0776-4e89-a374-ad8ada00de23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.523231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.529084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb8e7768-0776-4e89-a374-ad8ada00de23 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1214 microversion: 2.1 time: 0.204122 Jul 19 20:06:20.529755 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2220/4364] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:20 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:20.553004 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9387e234-951e-4039-92f0-d342837e33c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.438060 Jul 19 20:06:20.555889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:20.556394 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2145/4365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:20 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:20.556828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:20.569821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.570724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.571887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.572639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.776250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.793676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf90a3ec-7c9f-43c2-bf5d-62e9010d8888 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1502 microversion: 2.1 time: 0.250847 Jul 19 20:06:20.795216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2221/4366] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:20 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:20.825816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2131b19-302c-4bca-9d30-167e0a02fdda tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'create', calling method: .version_select at 0x7fb88dc67af0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1758488603", "description": "tempest-description-1373222795"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:21.102921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:21.105505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.146574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.147312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.148562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.160594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.595380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2131b19-302c-4bca-9d30-167e0a02fdda tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.787419 Jul 19 20:06:21.600828 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2146/4367] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:20 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:21.606624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:21.607350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.628085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.628697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.634425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.638714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.806219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:21.826544 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d13d98bb-a109-44f4-9201-25625e7d5508 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.723405 Jul 19 20:06:21.831623 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2222/4368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:21 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:21.840512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:21.850327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.867274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:21.877753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.878497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.879492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.880147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.890271 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05b31653-0a94-4236-a82f-0160c2b30336 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1266 microversion: 2.1 time: 0.287833 Jul 19 20:06:21.902781 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2147/4369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:21 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:21.923126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1758488603"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:21.924422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.944760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.945513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.947392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.948184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.988470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:22.135999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:22.151120 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5697217f-f318-4ce9-94a0-bbdec021647c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1522 microversion: 2.1 time: 0.317150 Jul 19 20:06:22.178111 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2223/4370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:21 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:22.392543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.security_group_api [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Adding security group 7cc8dbbc-a4f6-4558-9d51-9598fe71d224 to port 1ae51c48-0556-469c-a1a2-2bfd94acd314 Jul 19 20:06:22.657473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d909484-bf3d-4fc9-afd3-975a6aaeea0d tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d1b9280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1892149123", "description": "tempest-description-1790240684"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:23.220047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d909484-bf3d-4fc9-afd3-975a6aaeea0d tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.040333 Jul 19 20:06:23.230070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2224/4371] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:23.235896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:23.236745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:23.244240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.244931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.245882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.246527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.421874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18a07183-b3a6-49ae-b9f4-0da93bd1ee2f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action" status: 202 len: 0 microversion: 2.1 time: 1.516942 Jul 19 20:06:23.422829 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2148/4372] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:21 2022] POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action => generated 0 bytes in 1519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:23.431335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:23.433940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:23.450325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.454638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.456081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.456681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.646858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:23.692639 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54350076-bd0c-4304-b2ff-39036c5050f6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1272 microversion: 2.1 time: 0.267016 Jul 19 20:06:23.694267 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2149/4373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:23 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:23.701652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:23.702740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:23.711203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.712779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.714236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.714844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.780076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:23.795339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-008cf0eb-475f-4dc1-93ac-8782986287df tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.563992 Jul 19 20:06:23.804722 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2225/4374] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:23 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:23.809693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f4c75b6-1803-461f-8b46-4d90c1e68668 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d5cbca0>, body: {"security_group_rule": {"parent_group_id": "d81ad0c2-f70d-43a5-85cd-0a26d0aa69f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:24.192281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:24.202988 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-981edc42-bf55-41d6-aff2-0b7788314cd1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1502 microversion: 2.1 time: 0.505904 Jul 19 20:06:24.206277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2150/4375] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:23 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1502 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:24.235821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1758488603"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:24.236668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:24.253486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.257555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.260592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.261257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.360013 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f4c75b6-1803-461f-8b46-4d90c1e68668 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.559685 Jul 19 20:06:24.360881 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2226/4376] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:24.394324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9afa6150-062e-4ff0-8073-da6b299b0ff6 req-66e05b16-5299-492c-97fd-a4e2287641f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:24.421194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9afa6150-062e-4ff0-8073-da6b299b0ff6 req-66e05b16-5299-492c-97fd-a4e2287641f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.421484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9afa6150-062e-4ff0-8073-da6b299b0ff6 req-66e05b16-5299-492c-97fd-a4e2287641f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.451698 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9afa6150-062e-4ff0-8073-da6b299b0ff6 req-66e05b16-5299-492c-97fd-a4e2287641f4 service nova] Creating event network-changed:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:06:24.474914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9afa6150-062e-4ff0-8073-da6b299b0ff6 req-66e05b16-5299-492c-97fd-a4e2287641f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102285 Jul 19 20:06:24.475991 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2227/4377] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:24.495670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:24.496419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:24.511427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.511928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.512730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.520359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.706258 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.security_group_api [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Removing security group 7cc8dbbc-a4f6-4558-9d51-9598fe71d224 from port 1ae51c48-0556-469c-a1a2-2bfd94acd314 Jul 19 20:06:25.432364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:25.452924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f30d3a76-1e62-4210-9e60-abb80280eb54 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1513 microversion: 2.1 time: 0.963069 Jul 19 20:06:25.454090 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2228/4378] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:24 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1513 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:25.481746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c7d5029-2b0e-4b1a-85e8-73fe0db4e540 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88ccc93a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-400743544", "description": "tempest-description-1505383659"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:26.186370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c7d5029-2b0e-4b1a-85e8-73fe0db4e540 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.722223 Jul 19 20:06:26.187775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2229/4379] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:26.193432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:26.196900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:26.213485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:26.219599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:26.225191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:26.228583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:26.619017 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a0b7a17-cf91-42f9-bf0c-496a82889bc7 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action" status: 202 len: 0 microversion: 2.1 time: 2.410475 Jul 19 20:06:26.619702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2151/4380] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:24 2022] POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action => generated 0 bytes in 2413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:26.817077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:26.833988 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0db3130-3a5b-4bc0-9974-29c779e95a7b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.644837 Jul 19 20:06:26.834853 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2230/4381] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:26 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:26.844877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:26.875889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 054f29e4-105f-45b3-b320-4771a3405770] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:26.888385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/054f29e4-105f-45b3-b320-4771a3405770/action HTTP/1.1 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 14 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: {"rescue": {}} Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '054f29e4-105f-45b3-b320-4771a3405770', 'body': {'rescue': {}}} Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:26.908005 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 404 to user: Instance 054f29e4-105f-45b3-b320-4771a3405770 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b0ee9df9-f743-43aa-87db-2d1ebc57b349 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/054f29e4-105f-45b3-b320-4771a3405770/action" status: 404 len: 111 microversion: 2.1 time: 0.073640 Jul 19 20:06:26.915603 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2231/4382] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:26 2022] POST /compute/v2.1/servers/054f29e4-105f-45b3-b320-4771a3405770/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:26.919614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9def2712-bd78-46a7-afba-6a3a6a4158ff tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d0aac10>, body: {"security_group_rule": {"parent_group_id": "7649be75-af12-4760-8c02-9d8014bd7b92", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:27.221433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:27.222065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:27.236932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.237394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.248300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.249927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.742022 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9def2712-bd78-46a7-afba-6a3a6a4158ff tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.830746 Jul 19 20:06:27.743035 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2232/4383] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:26 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:27.755497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8db4c7de-f0c6-44c3-991b-31165382ba65 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'create', calling method: .version_select at 0x7fb88d18b550>, body: {"pool": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:27.812349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:27.827889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68333088-50ae-443a-a5a9-79f8cc20aaf0 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 1.202764 Jul 19 20:06:27.852621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2152/4384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:26 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:27.862258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-15117bd0-7229-48c8-8f45-bf9d67368019 req-9a892bb5-7fad-4226-b3ea-3a721b3a8327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:27.901877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15117bd0-7229-48c8-8f45-bf9d67368019 req-9a892bb5-7fad-4226-b3ea-3a721b3a8327 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.902818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15117bd0-7229-48c8-8f45-bf9d67368019 req-9a892bb5-7fad-4226-b3ea-3a721b3a8327 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.945108 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-15117bd0-7229-48c8-8f45-bf9d67368019 req-9a892bb5-7fad-4226-b3ea-3a721b3a8327 service nova] Creating event network-changed:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:06:27.952892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-15117bd0-7229-48c8-8f45-bf9d67368019 req-9a892bb5-7fad-4226-b3ea-3a721b3a8327 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097918 Jul 19 20:06:27.954874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2153/4385] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:27.961069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:27.961940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:27.983667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.986728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.988180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.989338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:28.099413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6792b4a-7ffd-41c9-bcd3-b18b423e9ab8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action" status: 202 len: 0 microversion: 2.1 time: 0.142562 Jul 19 20:06:28.101441 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2154/4386] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:27 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:28.107528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d294c7f3-4350-4780-ae9a-bfccc9f205d0 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb89307baf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2061050948", "description": "tempest-description-430588314"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:28.919025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:29.370849 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d294c7f3-4350-4780-ae9a-bfccc9f205d0 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.266279 Jul 19 20:06:29.383907 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2155/4387] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:29.383907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:29.383907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:29.400780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:29.404888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.405626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.406432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.406894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.661023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:29.673411 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-857d7be5-8470-4434-89a4-ef468324b759 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.300188 Jul 19 20:06:29.674638 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2156/4388] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:29 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:29.698962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:29.699752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:29.709958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.713127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.714412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.714961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.013378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:30.027503 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b8ce562-69b4-4a71-a0d0-af3e807c4d14 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1498 microversion: 2.1 time: 0.349650 Jul 19 20:06:30.028628 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2157/4389] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:29 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:30.035201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ad8521ef-3b16-423c-b271-fcf5d42ab57a req-a6cabc68-3111-4078-9183-5f37b6ae9f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93c38cb-a31d-4f2e-ae46-af353a767d21", "name": "network-vif-plugged", "status": "completed", "tag": "d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.047577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ad8521ef-3b16-423c-b271-fcf5d42ab57a req-a6cabc68-3111-4078-9183-5f37b6ae9f96 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.048352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ad8521ef-3b16-423c-b271-fcf5d42ab57a req-a6cabc68-3111-4078-9183-5f37b6ae9f96 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.063041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ad8521ef-3b16-423c-b271-fcf5d42ab57a req-a6cabc68-3111-4078-9183-5f37b6ae9f96 service nova] Creating event network-vif-plugged:d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417 for instance a93c38cb-a31d-4f2e-ae46-af353a767d21 on n-h1-843861-3 Jul 19 20:06:30.071998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ad8521ef-3b16-423c-b271-fcf5d42ab57a req-a6cabc68-3111-4078-9183-5f37b6ae9f96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040651 Jul 19 20:06:30.076205 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2158/4390] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:30.085174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:30.085910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:30.093959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.094599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.096150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.096771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.372211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:30.385588 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-27e03123-baac-40a9-bfe7-f88fbc4f28a1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1314 microversion: 2.1 time: 0.307122 Jul 19 20:06:30.398824 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2159/4391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:30 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:30.405713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fcffc9cb-b1b4-4c28-bd1f-909a6f7c356a tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d470d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1062484141", "description": "tempest-description-901276815"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.510725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:30.832471 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fcffc9cb-b1b4-4c28-bd1f-909a6f7c356a tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.430890 Jul 19 20:06:30.833408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2160/4392] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:30.842521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.843828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:30.863321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.863788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.864754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.865191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.892549 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8db4c7de-f0c6-44c3-991b-31165382ba65 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.148069 Jul 19 20:06:30.894058 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2233/4393] 10.222.0.33 () {60 vars in 1169 bytes} [Tue Jul 19 20:06:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:30.900865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0b9e9150-6551-45a3-86b8-7576db3743af req-de2f0435-ab85-440b-bdae-a061ccbaaa13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9971550f-e17d-4674-83ce-8e5b98dd1979", "tag": "6aaabb26-da3f-4581-9e5e-89103e5c3795"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.903646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'flavor' on Instance uuid 1472b512-4550-4bcb-bb8e-21ed6101cedc {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:30.915239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b9e9150-6551-45a3-86b8-7576db3743af req-de2f0435-ab85-440b-bdae-a061ccbaaa13 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.916008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0b9e9150-6551-45a3-86b8-7576db3743af req-de2f0435-ab85-440b-bdae-a061ccbaaa13 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.922113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Cannot 'rescue' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state paused Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action HTTP/1.1 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 14 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: {"rescue": {}} Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'rescue' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state paused Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1472b512-4550-4bcb-bb8e-21ed6101cedc', 'body': {'rescue': {}}} Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc in vm_state paused. Cannot rescue while the instance is in this state. Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state paused Jul 19 20:06:30.924385 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state paused Jul 19 20:06:30.928345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:30.930948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 409 to user: Cannot 'rescue' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state paused {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:30.931380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0b9e9150-6551-45a3-86b8-7576db3743af req-de2f0435-ab85-440b-bdae-a061ccbaaa13 service nova] Creating event network-changed:6aaabb26-da3f-4581-9e5e-89103e5c3795 for instance 9971550f-e17d-4674-83ce-8e5b98dd1979 on n-h2-843861-3 Jul 19 20:06:30.932660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb6a26e8-b169-4a15-9879-aed1c3744fcb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action" status: 409 len: 144 microversion: 2.1 time: 0.096177 Jul 19 20:06:30.937451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0b9e9150-6551-45a3-86b8-7576db3743af req-de2f0435-ab85-440b-bdae-a061ccbaaa13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041525 Jul 19 20:06:30.937618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2161/4394] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action => generated 144 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:06:30.938408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2234/4395] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:30.944208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-046c0d08-1f6d-410a-ab4b-3815cb2a6089 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88cd93e50>, body: {"security_group_rule": {"parent_group_id": "5b02f747-468a-4aca-9d7a-31e3faa88012", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "23c2bba7-499c-48d4-9bb0-a9b5ceb33d94"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.944705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:30.945518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:30.953841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.954614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.955412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.956112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.196724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:31.206610 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f596cc3-9826-4280-a209-f86b8c3eaf53 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.266960 Jul 19 20:06:31.207924 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2162/4396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:30 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:31.213422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.167"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:31.214803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:31.222026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.222858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.224222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.224956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.261494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Acquired lock "refresh_cache-976abbd5-10b5-427b-a5c2-b4f793a9d60b" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:06:31.477977 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-046c0d08-1f6d-410a-ab4b-3815cb2a6089 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.537565 Jul 19 20:06:31.489172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2235/4397] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:31.495351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:31.496410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:31.504312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.504766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.505757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.506419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.629524 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c670c77c-f0dc-4e98-a2be-70442df38f73 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action" status: 202 len: 0 microversion: 2.1 time: 0.139138 Jul 19 20:06:31.630292 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2236/4398] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:31 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:31.639339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:31.640074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:31.656466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.659570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.660484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:31.661829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.935762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:31.946089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-098599f7-d536-45df-a96d-a8041f166536 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1501 microversion: 2.1 time: 0.314610 Jul 19 20:06:31.947081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2237/4399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:31 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1501 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:31.970069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f464ed20-daa5-4174-b616-ee034f6acc42 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88cd931f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1327042773", "description": "tempest-description-263618771"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:32.490603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f464ed20-daa5-4174-b616-ee034f6acc42 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.533611 Jul 19 20:06:32.496009 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2238/4400] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:32.502691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:32.503168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:32.517199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.518515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.519627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.520328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.921258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:32.941449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd8f6a14-e474-493f-8c48-f5ceed89a9e3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1513 microversion: 2.1 time: 0.444019 Jul 19 20:06:32.943727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2239/4401] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:32 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1513 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:32.954526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:32.955010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:32.969246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.969909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.976603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.977607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:33.030334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lazy-loading 'flavor' on Instance uuid a93c38cb-a31d-4f2e-ae46-af353a767d21 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:33.152663 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad83b267-295c-4347-9047-a7f5e620fae1 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "POST /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21/action" status: 202 len: 0 microversion: 2.1 time: 0.205881 Jul 19 20:06:33.154852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2240/4402] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:32 2022] POST /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:33.170057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:33.172428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:33.192878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:33.193889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:33.194922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:33.196864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:33.893875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:33.905102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf67c385-a126-4da0-8057-592279a7e1ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.748233 Jul 19 20:06:33.905684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2241/4403] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:33 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:33.910794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ba188bf-711f-4dff-b5d3-7f9f3fe82aba tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d18b940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1265008127", "description": "tempest-description-1738464265"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:34.093936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Building network info cache for instance {{(pid=126007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 20:06:34.333210 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ba188bf-711f-4dff-b5d3-7f9f3fe82aba tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.426146 Jul 19 20:06:34.333736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2242/4404] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:34.339161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:34.339907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:34.358180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.359055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.361253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.362145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.375959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:34.695223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:34.706729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3c42ab6-7818-48ec-a0f4-1e29b906df56 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1492 microversion: 2.1 time: 0.371803 Jul 19 20:06:34.721313 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2243/4405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:34 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1492 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:34.729490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-be12657f-890c-455e-9999-e6d3db667721 req-b434088b-0943-4c89-9912-ed3fe0ddef64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:34.744014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be12657f-890c-455e-9999-e6d3db667721 req-b434088b-0943-4c89-9912-ed3fe0ddef64 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.744595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-be12657f-890c-455e-9999-e6d3db667721 req-b434088b-0943-4c89-9912-ed3fe0ddef64 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.761059 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-be12657f-890c-455e-9999-e6d3db667721 req-b434088b-0943-4c89-9912-ed3fe0ddef64 service nova] Creating event network-changed:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:06:34.767551 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-be12657f-890c-455e-9999-e6d3db667721 req-b434088b-0943-4c89-9912-ed3fe0ddef64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043464 Jul 19 20:06:34.768681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2244/4406] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:34.777022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:34.778013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:34.785987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.786822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.787887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.788499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.846176 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d51f6e9b-b158-41c9-8b8d-a9d10a2c34b2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments/9a93e4a4-a467-4ac9-85ff-22d63a330a2c" status: 200 len: 194 microversion: 2.20 time: 0.076127 Jul 19 20:06:34.847252 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2245/4407] 10.222.0.33 () {60 vars in 1453 bytes} [Tue Jul 19 20:06:34 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments/9a93e4a4-a467-4ac9-85ff-22d63a330a2c => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:34.853094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b9f738b-2712-4707-ab5d-957eb98d53e6 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88cd114c0>, body: {"security_group_rule": {"parent_group_id": "8d4da602-8eff-4455-bd50-a2b93946a509", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2f353ce1-b81f-484f-b3cf-51050d35ce75"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:35.475625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Updating instance_info_cache with network_info: [{"id": "1ae51c48-0556-469c-a1a2-2bfd94acd314", "address": "fa:16:3e:4e:d5:22", "network": {"id": "6120914c-9305-48be-a9d6-29e40bcdaad7", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-282254597-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d1dc93dfca5b42c5a38baf6d0863574f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1ae51c48-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 20:06:35.499856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Releasing lock "refresh_cache-976abbd5-10b5-427b-a5c2-b4f793a9d60b" {{(pid=126007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:06:35.502247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2eb232a1-cca6-4ac8-a7b6-deec00c2a28a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action" status: 202 len: 0 microversion: 2.1 time: 4.291584 Jul 19 20:06:35.503300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2163/4408] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:31 2022] POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action => generated 0 bytes in 4295 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 20:06:35.519607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:35.521135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:35.539331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.541348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.543307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.544743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.603698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:35.727335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b9f738b-2712-4707-ab5d-957eb98d53e6 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.878650 Jul 19 20:06:35.728795 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2246/4409] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:34 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:35.733628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:35.734254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:35.749034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.749484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.762451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.763136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.783220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c98fa6b3-59df-4bfc-a52c-5b1c0de05ca4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 204 len: 0 microversion: 2.1 time: 0.267356 Jul 19 20:06:35.787367 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2164/4410] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:35 2022] DELETE /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:35.806913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:35.806913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:35.822929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.825765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.826920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.832331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.870850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:35.993733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lazy-loading 'services' on Instance uuid 21e5b374-dea7-4797-9d14-c0350b8fb054 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:36.063178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:36.082093 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b5641122-4216-4f48-8375-d1a8725fc0c5 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.351595 Jul 19 20:06:36.084037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2247/4411] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:35 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:36.107011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.167"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:36.135019 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0da59d9-f90b-4413-aa0c-bf76dec49ecc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments/9a93e4a4-a467-4ac9-85ff-22d63a330a2c" status: 202 len: 0 microversion: 2.20 time: 0.345840 Jul 19 20:06:36.136390 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2165/4412] 10.222.0.33 () {60 vars in 1456 bytes} [Tue Jul 19 20:06:35 2022] DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments/9a93e4a4-a467-4ac9-85ff-22d63a330a2c => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:36.142867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:36.144530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:36.153955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:36.154850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:36.155947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:36.156706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:36.190358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'flavor' on Instance uuid 1472b512-4550-4bcb-bb8e-21ed6101cedc {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:36.308478 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75f8dee1-c6b6-44d3-9451-eb774a453190 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action" status: 200 len: 32 microversion: 2.1 time: 0.169441 Jul 19 20:06:36.310664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2166/4413] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:36 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:06:36.318098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dcb3cab8-4349-4258-b098-79fe5fb839c1 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d44af70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:36.461029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:36.468511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:36.469249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:36.470680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:36.471673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.057402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Acquired lock "refresh_cache-976abbd5-10b5-427b-a5c2-b4f793a9d60b" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:06:37.156281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dcb3cab8-4349-4258-b098-79fe5fb839c1 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2f353ce1-b81f-484f-b3cf-51050d35ce75" status: 202 len: 0 microversion: 2.1 time: 0.843981 Jul 19 20:06:37.157806 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2167/4414] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:36 2022] DELETE /compute/v2.1/os-security-groups/2f353ce1-b81f-484f-b3cf-51050d35ce75 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:37.164038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:37.165344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:37.186698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.187318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.190002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.191458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.577576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:37.587272 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6c1f611-7a13-4b59-baec-6c7a2b55c6fa tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1498 microversion: 2.1 time: 0.427519 Jul 19 20:06:37.588014 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2168/4415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:37 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1498 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:37.594080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:37.595454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:37.604065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.605103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.606355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.607272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.653320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8364c5f5-b9d8-4f2c-bc26-278c39a6ff9e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063810 Jul 19 20:06:37.658371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2169/4416] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:37 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:37.665119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:37.665945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:37.673472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.674172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.675740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.676592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.014206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:38.027211 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4eaaecc2-0586-452c-9cb7-4125455de40e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.366919 Jul 19 20:06:38.031630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2170/4417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:37 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:38.040848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:38.041711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:38.049193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.050469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.051446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.052100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.549057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:38.566512 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e43bc239-9eec-4bbc-89b4-303ed8bdf505 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.532495 Jul 19 20:06:38.579339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2171/4418] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:38 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:38.593803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3bfeccf3-cd0c-4b89-8daf-dfeab25c8b30 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d44a700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:38.801999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3bfeccf3-cd0c-4b89-8daf-dfeab25c8b30 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/8d4da602-8eff-4455-bd50-a2b93946a509" status: 200 len: 247 microversion: 2.1 time: 0.219871 Jul 19 20:06:38.803098 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2172/4419] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:06:38 2022] GET /compute/v2.1/os-security-groups/8d4da602-8eff-4455-bd50-a2b93946a509 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:38.820931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-619a0db3-a4f6-4bc4-b1fe-68637a013d8e req-79e5d8f8-0ddd-40d0-87cd-772e05233f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9971550f-e17d-4674-83ce-8e5b98dd1979", "name": "network-vif-plugged", "status": "completed", "tag": "6aaabb26-da3f-4581-9e5e-89103e5c3795"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:38.831848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-619a0db3-a4f6-4bc4-b1fe-68637a013d8e req-79e5d8f8-0ddd-40d0-87cd-772e05233f71 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.832570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-619a0db3-a4f6-4bc4-b1fe-68637a013d8e req-79e5d8f8-0ddd-40d0-87cd-772e05233f71 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.866786 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-619a0db3-a4f6-4bc4-b1fe-68637a013d8e req-79e5d8f8-0ddd-40d0-87cd-772e05233f71 service nova] Creating event network-vif-plugged:6aaabb26-da3f-4581-9e5e-89103e5c3795 for instance 9971550f-e17d-4674-83ce-8e5b98dd1979 on n-h2-843861-3 Jul 19 20:06:38.886046 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-619a0db3-a4f6-4bc4-b1fe-68637a013d8e req-79e5d8f8-0ddd-40d0-87cd-772e05233f71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076707 Jul 19 20:06:38.891565 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2173/4420] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:38.898542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:38.899536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:38.908219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.909493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.910579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.911623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.967087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:38.967838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.968636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lazy-loading 'fault' on Instance uuid a93c38cb-a31d-4f2e-ae46-af353a767d21 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:38.972579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Building network info cache for instance {{(pid=126008) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 20:06:39.357797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d706b8f50d44b12b3e727c9ecdc46c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c724ef0d0c8941459eb9c9f0c67fcdc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:39.393031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09cd29f6-e4b6-434a-9a77-6b192f2ca4ec tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 200 len: 1304 microversion: 2.1 time: 0.499393 Jul 19 20:06:39.394093 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2174/4421] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:38 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 1304 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:39.421845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-42905a3f-17fb-4139-a04a-806a291e59d9 req-80a8a560-01b4-4f4c-bd1e-ca1ca62fdd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93c38cb-a31d-4f2e-ae46-af353a767d21", "name": "network-vif-deleted", "tag": "d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:39.467686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-42905a3f-17fb-4139-a04a-806a291e59d9 req-80a8a560-01b4-4f4c-bd1e-ca1ca62fdd93 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.468628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-42905a3f-17fb-4139-a04a-806a291e59d9 req-80a8a560-01b4-4f4c-bd1e-ca1ca62fdd93 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.522872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-42905a3f-17fb-4139-a04a-806a291e59d9 req-80a8a560-01b4-4f4c-bd1e-ca1ca62fdd93 service nova] Creating event network-vif-deleted:d807e3e3-3b1b-4ae2-98fb-1bdd7ebe7417 for instance a93c38cb-a31d-4f2e-ae46-af353a767d21 on n-h1-843861-3 Jul 19 20:06:39.555113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-42905a3f-17fb-4139-a04a-806a291e59d9 req-80a8a560-01b4-4f4c-bd1e-ca1ca62fdd93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158529 Jul 19 20:06:39.561514 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2175/4422] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:39.590148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:39.595356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:39.623120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.623930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.625756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.629954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.701592 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3ff0ded-b5a4-4252-9862-9dc8773810fc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138303 Jul 19 20:06:39.702682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2176/4423] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:39 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:39.712482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-452f2a8b-f340-4717-ac04-b985fd1a1932 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d485ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1960310595", "description": "tempest-description-1528410085"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:40.900098 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-452f2a8b-f340-4717-ac04-b985fd1a1932 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.195683 Jul 19 20:06:40.901783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2177/4424] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Jul 19 20:06:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:40.906879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c8948edc-31ae-47c8-85a0-6117b68490a6 req-9803e6ec-1b62-42c6-9a9d-08f08e038ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:40.924896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c8948edc-31ae-47c8-85a0-6117b68490a6 req-9803e6ec-1b62-42c6-9a9d-08f08e038ce4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:40.925389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c8948edc-31ae-47c8-85a0-6117b68490a6 req-9803e6ec-1b62-42c6-9a9d-08f08e038ce4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:40.950832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c8948edc-31ae-47c8-85a0-6117b68490a6 req-9803e6ec-1b62-42c6-9a9d-08f08e038ce4 service nova] Creating event network-changed:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:06:40.962807 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c8948edc-31ae-47c8-85a0-6117b68490a6 req-9803e6ec-1b62-42c6-9a9d-08f08e038ce4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059726 Jul 19 20:06:40.963936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Updating instance_info_cache with network_info: [{"id": "1ae51c48-0556-469c-a1a2-2bfd94acd314", "address": "fa:16:3e:4e:d5:22", "network": {"id": "6120914c-9305-48be-a9d6-29e40bcdaad7", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-282254597-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d1dc93dfca5b42c5a38baf6d0863574f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1ae51c48-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126008) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 20:06:40.966475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2178/4425] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:40.972025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:40.972992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:40.980698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:40.981334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:40.982290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:40.982890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:40.983619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Releasing lock "refresh_cache-976abbd5-10b5-427b-a5c2-b4f793a9d60b" {{(pid=126008) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:06:40.985295 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d5a9c79-1811-4ac4-8f52-36a451ffa476 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action" status: 202 len: 0 microversion: 2.1 time: 4.889092 Jul 19 20:06:40.986010 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2248/4426] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:36 2022] POST /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b/action => generated 0 bytes in 4901 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 20:06:40.998008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:40.999904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:41.013201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.018513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.020005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.020796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.514749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:41.522902 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3480676-b6fc-46b4-8ed9-62fe9652671d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.555150 Jul 19 20:06:41.527745 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2179/4427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:40 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:41.532911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:41.538190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:41.553538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.554171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.555525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.556060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.578575 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 HTTP/1.1 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a93c38cb-a31d-4f2e-ae46-af353a767d21'} Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:41.581855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:41.586549 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:41.588721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:41.589848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f55ba2c1-c500-499c-8c32-46fbcba8b25e tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 404 len: 111 microversion: 2.1 time: 0.061141 Jul 19 20:06:41.590978 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2180/4428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:41 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:41.596300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:41.598610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:41.606770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.607455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.609104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.609696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.623519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:41.635476 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90240591-f966-42da-8cfa-60c38f449dff tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1314 microversion: 2.1 time: 0.648086 Jul 19 20:06:41.638807 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2249/4429] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:40 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:41.650518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66f70794-2ed1-41b2-aa70-94ad59e9c5f8 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d1b9dc0>, body: {"security_group_rule": {"parent_group_id": "93ea5849-2182-4fc3-9900-2d9450b95f83", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:41.683788 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d57ef12f-79bb-4f8b-9f55-c7d0acb023ba tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091140 Jul 19 20:06:41.684959 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2181/4430] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:41 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:41.697271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed202cca-9888-46b3-99ed-502883a5ed9f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '.version_select at 0x7fb88d4854c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:42.184919 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66f70794-2ed1-41b2-aa70-94ad59e9c5f8 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.544549 Jul 19 20:06:42.185918 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2250/4431] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:42.192183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:42.192694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:42.212370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.212902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.214355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.216452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.242992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 HTTP/1.1 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a93c38cb-a31d-4f2e-ae46-af353a767d21'} Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:42.244709 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5be46a12-e547-404f-b85d-614e656d5fa7 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 404 len: 111 microversion: 2.1 time: 0.059229 Jul 19 20:06:42.250032 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2251/4432] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:42 2022] DELETE /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:42.263011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54fb204d-65ed-4f80-ae20-a2c6b7fa3137 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Action: 'create', calling method: .version_select at 0x7fb88d1b9ca0>, body: {"security_group_rule": {"parent_group_id": "93ea5849-2182-4fc3-9900-2d9450b95f83", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:42.772883 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54fb204d-65ed-4f80-ae20-a2c6b7fa3137 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.519168 Jul 19 20:06:42.773676 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2252/4433] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Jul 19 20:06:42 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:42.789032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:42.791468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: a93c38cb-a31d-4f2e-ae46-af353a767d21] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:42.806935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.807885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.809071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.809637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.828108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 HTTP/1.1 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a93c38cb-a31d-4f2e-ae46-af353a767d21'} Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:42.830002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. Jul 19 20:06:42.833614 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:42.837475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance a93c38cb-a31d-4f2e-ae46-af353a767d21 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:42.838589 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de16ca0e-7707-4b34-b81a-2b1cde69cb40 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21" status: 404 len: 111 microversion: 2.1 time: 0.058007 Jul 19 20:06:42.839377 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2253/4434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:42 2022] GET /compute/v2.1/servers/a93c38cb-a31d-4f2e-ae46-af353a767d21 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:42.845439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:42.846409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:42.858053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.859209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.860713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:42.861384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.107844 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed202cca-9888-46b3-99ed-502883a5ed9f tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/fcc2d5cb-17d9-40e4-9697-4605c27d085c" status: 202 len: 0 microversion: 2.1 time: 1.421304 Jul 19 20:06:43.109479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2182/4435] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 19 20:06:41 2022] DELETE /compute/v2.1/os-floating-ips/fcc2d5cb-17d9-40e4-9697-4605c27d085c => generated 0 bytes in 1424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:43.115535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.116591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.126358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.127167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.141805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.149331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.190700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:43.201259 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4feed21-9ce7-44d0-a2c5-4f5baf778be2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.358788 Jul 19 20:06:43.202294 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2254/4436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:42 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:43.222694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.228028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.279584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.279762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.280907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.281537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.373163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cac9ba3-5574-418a-b959-5c1c12b6e096 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169080 Jul 19 20:06:43.374078 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2255/4437] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:43.381884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb4cf950-8826-4fcb-b9a4-8ee549404170 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d0bf9d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.404071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:43.415486 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a15b433-59bf-4800-b8bb-d98e7e54c7b1 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1500 microversion: 2.1 time: 0.301905 Jul 19 20:06:43.416719 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2183/4438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1500 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:43.428067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.430317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.438417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.439163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.440467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.441217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.457544 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc HTTP/1.1 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '37c5639c-e907-4290-b67a-9bf56bb0ebdc'} Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:43.459468 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.463617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.466732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:43.466732 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c9171a67-fbf5-423b-9ae3-35027b0805c9 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 404 len: 111 microversion: 2.1 time: 0.048548 Jul 19 20:06:43.472206 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2184/4439] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:43 2022] DELETE /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:43.477764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb4cf950-8826-4fcb-b9a4-8ee549404170 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/93ea5849-2182-4fc3-9900-2d9450b95f83" status: 200 len: 665 microversion: 2.1 time: 0.102011 Jul 19 20:06:43.478378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-edaf41df-aa31-472d-af08-c6e2fc591ea1 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '.version_select at 0x7fb88dc59160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.479184 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2256/4440] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/os-security-groups/93ea5849-2182-4fc3-9900-2d9450b95f83 => generated 665 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:43.491172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:43.492097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.506127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.506580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.507354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.507782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.639555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d5e77d0-5f88-465a-8c60-08632cc5e6fe tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979/action" status: 202 len: 0 microversion: 2.1 time: 0.156629 Jul 19 20:06:43.644764 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2257/4441] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:43 2022] POST /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:43.660791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.664363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 37c5639c-e907-4290-b67a-9bf56bb0ebdc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.683512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.684325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.688413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.691898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.730313 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc HTTP/1.1 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '37c5639c-e907-4290-b67a-9bf56bb0ebdc'} Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:43.734979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 37c5639c-e907-4290-b67a-9bf56bb0ebdc could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:43.739009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26fb5583-8955-4e31-bbaa-ef77d20d0d83 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc" status: 404 len: 111 microversion: 2.1 time: 0.090703 Jul 19 20:06:43.741002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2258/4442] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/37c5639c-e907-4290-b67a-9bf56bb0ebdc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:43.748240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e11b7a6a-17bf-4811-aea3-c3922c3826f3 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d297e50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.756227 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-edaf41df-aa31-472d-af08-c6e2fc591ea1 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7cc8dbbc-a4f6-4558-9d51-9598fe71d224" status: 202 len: 0 microversion: 2.1 time: 0.282329 Jul 19 20:06:43.757545 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2185/4443] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:43 2022] DELETE /compute/v2.1/os-security-groups/7cc8dbbc-a4f6-4558-9d51-9598fe71d224 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:44.019914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e11b7a6a-17bf-4811-aea3-c3922c3826f3 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/75f89bfc-5a39-45e1-baca-02c2fcd49382" status: 202 len: 0 microversion: 2.1 time: 0.277653 Jul 19 20:06:44.020863 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2259/4444] 10.222.0.33 () {58 vars in 1286 bytes} [Tue Jul 19 20:06:43 2022] DELETE /compute/v2.1/os-security-group-rules/75f89bfc-5a39-45e1-baca-02c2fcd49382 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:44.027202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.037280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.046751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.047354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.049531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.049531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.067960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a HTTP/1.1 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '728a3bd3-b439-43df-8f1c-09e2a7d34b8a'} Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:44.069632 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:44.073380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69d3a6ba-ade0-47d3-b6a0-322feda343dc tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 404 len: 111 microversion: 2.1 time: 0.049009 Jul 19 20:06:44.075254 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2260/4445] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:44 2022] DELETE /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:44.081226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.081737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.089600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.090414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.091378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.091979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.127385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:44.246621 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93940ca0-a48d-46cb-b8e0-67bacfe0144a tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "DELETE /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 204 len: 0 microversion: 2.1 time: 0.169894 Jul 19 20:06:44.248835 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2261/4446] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:44 2022] DELETE /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:44.259185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3bff1b0-eb7c-4425-9a26-b35152b76183 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d21caf0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.263046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.263674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.294177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.294665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.296412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.298185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.544733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:44.557280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32ec10dc-8b9f-403c-bfe9-9665ad0c0e88 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1485 microversion: 2.1 time: 0.795930 Jul 19 20:06:44.557910 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2186/4447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1485 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:44.567542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.568281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 728a3bd3-b439-43df-8f1c-09e2a7d34b8a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.580902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.581542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.582543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.585073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.603496 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a HTTP/1.1 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '728a3bd3-b439-43df-8f1c-09e2a7d34b8a'} Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:44.605094 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 728a3bd3-b439-43df-8f1c-09e2a7d34b8a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:44.609134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d54c7815-714e-4227-baad-8a4d52889176 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a" status: 404 len: 111 microversion: 2.1 time: 0.045609 Jul 19 20:06:44.610464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2187/4448] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:44 2022] GET /compute/v2.1/servers/728a3bd3-b439-43df-8f1c-09e2a7d34b8a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:44.616428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.617791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.625486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.625957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.628401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.628864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.642814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3bff1b0-eb7c-4425-9a26-b35152b76183 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/93ea5849-2182-4fc3-9900-2d9450b95f83" status: 202 len: 0 microversion: 2.1 time: 0.390586 Jul 19 20:06:44.643792 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2262/4449] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:44 2022] DELETE /compute/v2.1/os-security-groups/93ea5849-2182-4fc3-9900-2d9450b95f83 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:44.649065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.649798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.657353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:44.663310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.663932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.665360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.665893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.907337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:44.908500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:44.916885 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d8d190d-5ce2-4d0e-9b13-df0cc609a323 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1508 microversion: 2.1 time: 0.271989 Jul 19 20:06:44.917114 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-229f0148-e56d-4fac-9740-84fd6dc410d6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.305427 Jul 19 20:06:44.917488 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2263/4450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:44 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:44.918161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2188/4451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:44 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:44.923054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:44.924205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.933273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.933607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:44.934245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.934534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:44.935431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.936118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.941779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.942542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.943401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.943870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.968084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lazy-loading 'flavor' on Instance uuid 9971550f-e17d-4674-83ce-8e5b98dd1979 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:45.003488 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3758d27-1771-4749-b46b-4cf32f8ed5d9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074590 Jul 19 20:06:45.004115 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2264/4452] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:44 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:06:45.009951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.010742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.019834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.020403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.021336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.021621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.044256 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb HTTP/1.1 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '68504707-ef6d-499d-9866-1053528b89fb'} Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:45.045985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ce0a3a7d-0df6-449d-a199-3554a6ee408a tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 404 len: 111 microversion: 2.1 time: 0.042176 Jul 19 20:06:45.049493 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2265/4453] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:45.068264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d1b91f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.105538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG neutronclient.v2_0.client [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist", "detail": ""}} {{(pid=126008) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 20:06:45.106200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Neutron security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 not found {{(pid=126008) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 20:06:45.106730 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] HTTP exception thrown: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.106730 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Request method failure captured: Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/os-security-groups/2f353ce1-b81f-484f-b3cf-51050d35ce75 HTTP/1.1 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w69Y-vr9Gsg1pSENNcSPq22B2mtU7ZTv_8GDeMKepXGz6KNWcWSnhy9wk1AIKhmjKb7Fz3_0oUkS70JmXNbjecLEcMW2RugaAfwI9tehpInyypTtP4UA46ZJyLTL7t1CYyyHs9EyGxOBZXMIy8Ld54KV4aHnkxbW5APl-ksHJ7imcI Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: e5a83e7ac40f41e4ad803fe0ff9b2a0b Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2056660518 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5a83e7ac40f41e4ad803fe0ff9b2a0b"}]}, {"type": "tempest-type-11228255", "name": "tempest-service-1299763240", "endpoints": []}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e5a83e7ac40f41e4ad803fe0ff9b2a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5a83e7ac40f41e4ad803fe0ff9b2a0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e5a83e7ac40f41e4ad803fe0ff9b2a0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2056660518 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: e5a83e7ac40f41e4ad803fe0ff9b2a0b Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2056660518 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-SecurityGroupRulesTestJSON-2056660518-project Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: dca8797e0b0741ec8006b5fa829ca500 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2056660518-project Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: method: Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: exception: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2f353ce1-b81f-484f-b3cf-51050d35ce75'} Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 20:06:45.108762 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Returning 404 to user: Security group 2f353ce1-b81f-484f-b3cf-51050d35ce75 does not exist Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: Neutron server returns request_ids: ['req-f40e7e11-fd8a-4233-b8c8-579f486fa8e9'] {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e32ff2d0-fd70-4c7e-a654-54eb616ce800 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2f353ce1-b81f-484f-b3cf-51050d35ce75" status: 404 len: 194 microversion: 2.1 time: 0.055786 Jul 19 20:06:45.116641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2266/4454] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/os-security-groups/2f353ce1-b81f-484f-b3cf-51050d35ce75 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:45.122386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.122386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 68504707-ef6d-499d-9866-1053528b89fb] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.145062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.145884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.148058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.149372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.161617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:45.189239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb HTTP/1.1 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '68504707-ef6d-499d-9866-1053528b89fb'} Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.190979 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. Jul 19 20:06:45.194587 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.197117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 68504707-ef6d-499d-9866-1053528b89fb could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:45.197679 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b74a2bb-4f39-4872-9df6-d27c613e0feb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb" status: 404 len: 111 microversion: 2.1 time: 0.084919 Jul 19 20:06:45.198971 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2267/4455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/68504707-ef6d-499d-9866-1053528b89fb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:45.209875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fefb1b7-b31b-4603-b8d1-3dcf23f6b283 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d1b99d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.376419 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-180fad23-ca76-4356-806c-6a29b6d4adb9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979/action" status: 202 len: 0 microversion: 2.1 time: 0.456385 Jul 19 20:06:45.378813 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2189/4456] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:44 2022] POST /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:45.389543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.390997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.399034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 HTTP/1.1 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '48b5a834-eb08-4118-84a0-a3886b5ddf72'} Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.401690 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.405220 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.407408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:45.408714 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49af6064-10f2-4e78-824c-45d9c0659bbb tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72" status: 404 len: 111 microversion: 2.1 time: 0.027684 Jul 19 20:06:45.413211 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2190/4457] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:45.422675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.423765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.433144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.433970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.435105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.435510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.570762 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fefb1b7-b31b-4603-b8d1-3dcf23f6b283 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/8d4da602-8eff-4455-bd50-a2b93946a509" status: 202 len: 0 microversion: 2.1 time: 0.370101 Jul 19 20:06:45.571696 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2268/4458] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/os-security-groups/8d4da602-8eff-4455-bd50-a2b93946a509 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:45.577359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.578133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 48b5a834-eb08-4118-84a0-a3886b5ddf72] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.587188 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 HTTP/1.1 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '48b5a834-eb08-4118-84a0-a3886b5ddf72'} Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:45.589802 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:45.595096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 48b5a834-eb08-4118-84a0-a3886b5ddf72 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:45.595847 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a5d1fc5-a03d-4ac3-b745-1d5aa6829cf4 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72" status: 404 len: 111 microversion: 2.1 time: 0.020813 Jul 19 20:06:45.596662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2269/4459] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/48b5a834-eb08-4118-84a0-a3886b5ddf72 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:45.602545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f80e3ee-4642-4b00-8dfc-1b4c705db734 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d170160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.637724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:45.651372 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83e77558-29d6-49a4-b65f-4d6b58bfecc9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1491 microversion: 2.1 time: 0.234720 Jul 19 20:06:45.663510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2191/4460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1491 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:45.874791 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f80e3ee-4642-4b00-8dfc-1b4c705db734 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/23c2bba7-499c-48d4-9bb0-a9b5ceb33d94" status: 202 len: 0 microversion: 2.1 time: 0.276829 Jul 19 20:06:45.875749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2270/4461] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/os-security-groups/23c2bba7-499c-48d4-9bb0-a9b5ceb33d94 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:45.893013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf2c91d6-72d2-4ae9-ab22-87f037fb522a tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88dc0b700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.934026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.934643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.944944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:45.952881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.953407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.955266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.956544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.222235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:46.235680 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8c6fa2c-2b95-4a2c-8c11-faa172cbada2 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1508 microversion: 2.1 time: 0.306161 Jul 19 20:06:46.247205 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2271/4462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:46.266002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:46.268708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:46.287200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.293118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.297283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.298217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.357537 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf2c91d6-72d2-4ae9-ab22-87f037fb522a tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5b02f747-468a-4aca-9d7a-31e3faa88012" status: 202 len: 0 microversion: 2.1 time: 0.475115 Jul 19 20:06:46.362422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2192/4463] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:45 2022] DELETE /compute/v2.1/os-security-groups/5b02f747-468a-4aca-9d7a-31e3faa88012 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:06:46.370673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:46.372992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:46.388913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.389555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.394424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.394886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.485925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e48d4cb9-72bc-4a63-9cda-b57c7be7200a tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.121435 Jul 19 20:06:46.486579 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2193/4464] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:06:46 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:46.505932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f07cd3ec-90c7-48dd-b0bf-60ad22573b1c tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88dc0b4c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:46.652476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:46.663376 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a56dfdf-820e-47cb-a7f8-25c7a7578b9a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.411835 Jul 19 20:06:46.683076 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2272/4465] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:46 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:46.693961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:46.697527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:46.711902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.716947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.718189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.722381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.794364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:46.940337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e43e11e1-eb13-410c-b919-d0712d80e370 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 204 len: 0 microversion: 2.20 time: 0.255346 Jul 19 20:06:46.942892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2273/4466] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:06:46 2022] DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:06:46.957953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:46.958993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:46.973490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.976823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.977855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:46.979188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.024495 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f07cd3ec-90c7-48dd-b0bf-60ad22573b1c tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7649be75-af12-4760-8c02-9d8014bd7b92" status: 202 len: 0 microversion: 2.1 time: 0.536597 Jul 19 20:06:47.025089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2194/4467] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:46 2022] DELETE /compute/v2.1/os-security-groups/7649be75-af12-4760-8c02-9d8014bd7b92 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:47.030974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.033467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:47.059968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.062812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.065718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.066437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.331654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.341697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba05c0cc-e7bd-4372-aecc-d8b3b554ff6f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1491 microversion: 2.1 time: 0.394990 Jul 19 20:06:47.353456 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2274/4468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:46 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1491 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:47.363954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3495be9f-7d99-4d9c-87a2-668c31b66eb7 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] Calling method '.version_select at 0x7fb88d21c820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.422285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.432657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.439383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.444396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f937215-9a53-4c7c-831e-bf8e7b4c276d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.418079 Jul 19 20:06:47.445941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2195/4469] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:06:47 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:06:47.452754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.456285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:47.466125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.466777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.467838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.468449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.587113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745acea6be3d41818108c7d8fe49c8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dc93dfca5b42c5a38baf6d0863574f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.595473 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-851ae693-bc1f-43a4-83fc-da991e9c1fd4 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 200 len: 1466 microversion: 2.1 time: 0.146316 Jul 19 20:06:47.596105 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2196/4470] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:47 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 1466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:47.611333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-dd7d5b66-10a6-4352-a1f1-647abda8be28 req-ae9805b2-8b21-4a16-913e-da1835e42d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976abbd5-10b5-427b-a5c2-b4f793a9d60b", "name": "network-vif-deleted", "tag": "1ae51c48-0556-469c-a1a2-2bfd94acd314"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:47.621492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dd7d5b66-10a6-4352-a1f1-647abda8be28 req-ae9805b2-8b21-4a16-913e-da1835e42d47 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.622119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dd7d5b66-10a6-4352-a1f1-647abda8be28 req-ae9805b2-8b21-4a16-913e-da1835e42d47 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.638755 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-dd7d5b66-10a6-4352-a1f1-647abda8be28 req-ae9805b2-8b21-4a16-913e-da1835e42d47 service nova] Creating event network-vif-deleted:1ae51c48-0556-469c-a1a2-2bfd94acd314 for instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b on n-h1-843861-3 Jul 19 20:06:47.644594 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-dd7d5b66-10a6-4352-a1f1-647abda8be28 req-ae9805b2-8b21-4a16-913e-da1835e42d47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037187 Jul 19 20:06:47.647738 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2197/4471] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:47.685423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.686399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:47.693785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.694486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.695770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.696648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.806548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3495be9f-7d99-4d9c-87a2-668c31b66eb7 tempest-SecurityGroupRulesTestJSON-2056660518 tempest-SecurityGroupRulesTestJSON-2056660518-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d81ad0c2-f70d-43a5-85cd-0a26d0aa69f4" status: 202 len: 0 microversion: 2.1 time: 0.448067 Jul 19 20:06:47.807959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2275/4472] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 19 20:06:47 2022] DELETE /compute/v2.1/os-security-groups/d81ad0c2-f70d-43a5-85cd-0a26d0aa69f4 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:47.882260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:47.891368 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-813b98b1-89e6-4b83-98ea-2fc07ae0ced1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.210088 Jul 19 20:06:47.892546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2198/4473] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:47 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:48.375229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:48.376621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:48.387567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.388381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.389653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.390680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.468150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:48.471037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:48.490076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.490541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.495680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.496176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.750305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.762394 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05d9b601-a237-4ad1-97d7-80335b21912b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1512 microversion: 2.1 time: 0.395386 Jul 19 20:06:48.775089 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2276/4474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:48 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:48.782103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:48.783118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] [instance: 976abbd5-10b5-427b-a5c2-b4f793a9d60b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:48.792037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.792952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.794236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.794882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.797594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.814620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] HTTP exception thrown: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Request method failure captured: Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b HTTP/1.1 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w51NF3jjPBl6xLIkRvr5nK4ZwyBb8BUvyBVOq9Pf-1appH8YgRDfX1D3vDbtqCTiuQWWahVAEyyTMgdnN37iOZ6hQyYBDY3VRSNHrLVBLbwXugUNsz4IrrJpnngAPvv6wAt3CDfCSl6_0uYTy9sxmUDXYoShvGZ8iYWgjXbj781Aec Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d1dc93dfca5b42c5a38baf6d0863574f Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1137159502 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1dc93dfca5b42c5a38baf6d0863574f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1dc93dfca5b42c5a38baf6d0863574f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1dc93dfca5b42c5a38baf6d0863574f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1dc93dfca5b42c5a38baf6d0863574f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1137159502 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d1dc93dfca5b42c5a38baf6d0863574f Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1137159502 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueTestJSONUnderV235-1137159502-project Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 745acea6be3d41818108c7d8fe49c8c3 Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1137159502-project Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '976abbd5-10b5-427b-a5c2-b4f793a9d60b'} Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:48.817242 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. Jul 19 20:06:48.821990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:48.835798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] Returning 404 to user: Instance 976abbd5-10b5-427b-a5c2-b4f793a9d60b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:48.840388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.841250 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02bdef40-9868-4408-98bd-294cdedbeb41 tempest-ServerRescueTestJSONUnderV235-1137159502 tempest-ServerRescueTestJSONUnderV235-1137159502-project] 10.222.0.33 "GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b" status: 404 len: 111 microversion: 2.1 time: 0.063275 Jul 19 20:06:48.847157 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2277/4475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:48 2022] GET /compute/v2.1/servers/976abbd5-10b5-427b-a5c2-b4f793a9d60b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:48.848940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.852836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bf600c5-7f2e-40f3-b896-3f34119eedbe tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1722 microversion: 2.20 time: 0.390644 Jul 19 20:06:48.853443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2199/4476] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:06:48 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:06:48.915304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:48.916991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:48.932024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.934664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.938201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:48.940457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.397956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:49.421779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5da4ff92-b37d-4dca-970e-e9afd60d501f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.511890 Jul 19 20:06:49.421779 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2278/4477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:48 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:49.783366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:49.787857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:49.809466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.810000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.814010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.816448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.877484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:49.878700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:49.919733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.935255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.941961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.945166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.333574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:50.376977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:50.388222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:50.396456 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83c8e3b5-6788-415b-b30e-4dd1b8086b03 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1656 microversion: 2.20 time: 0.522264 Jul 19 20:06:50.410081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2279/4478] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:06:49 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1656 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:06:50.426752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:50.450280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.452411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.475995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5f5483c9-1465-489b-8bd4-af038ae7314e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1512 microversion: 2.1 time: 0.694931 Jul 19 20:06:50.479385 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2200/4479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:49 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1512 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:50.489960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.496478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.500871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.501898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.512180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.513715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.553281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.554241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.556319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.557202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.559027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 HTTP/1.1 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '033f5746-9dcb-4f5a-b714-89bf3fbc8aa1'} Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:50.563326 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.567366 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.571042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:50.574268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-99ee201b-7e50-4198-94d7-ffeea3e5e12b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 404 len: 111 microversion: 2.1 time: 0.171146 Jul 19 20:06:50.576277 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2280/4480] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:50 2022] DELETE /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:50.593318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.594815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.616827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.619835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.620916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.623417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.711998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 HTTP/1.1 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '033f5746-9dcb-4f5a-b714-89bf3fbc8aa1'} Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.717700 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. Jul 19 20:06:50.722742 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.734059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:50.742146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7163ad74-39f7-4968-9605-c6d2d42b222b tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1" status: 404 len: 111 microversion: 2.1 time: 0.160523 Jul 19 20:06:50.744595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2281/4481] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:50 2022] GET /compute/v2.1/servers/033f5746-9dcb-4f5a-b714-89bf3fbc8aa1 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:50.753737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.763342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.790434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.797506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.804633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.805446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.847940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 HTTP/1.1 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '049f8f4e-947f-4567-b754-6d1a023a8333'} Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:50.849400 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.853236 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.863775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:50.868276 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c2c47ff-830f-414a-9f5d-ed6aa21ca402 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 404 len: 111 microversion: 2.1 time: 0.119228 Jul 19 20:06:50.875593 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2282/4482] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:50 2022] DELETE /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:50.886540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.893837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] [instance: 049f8f4e-947f-4567-b754-6d1a023a8333] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.917449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.922805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.923953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.924614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.973727 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] HTTP exception thrown: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Request method failure captured: Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 HTTP/1.1 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w2TPoxvyEXXmxicg46l1BXZCJNsdY18UMYt7P0sfMSsGIs8aaTDziqXBaRqmUr375Cpi9rhcObDZFuMij3TBE1oUeTwraxjCTk3c8ADS-hu3OTwS1akIdyXKVQRsyMjr-X75mbO1mrs1td8TRDFDLPg1SM6LgUuopEtbWkhGFe-Ys4 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c724ef0d0c8941459eb9c9f0c67fcdc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c724ef0d0c8941459eb9c9f0c67fcdc0 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-1282600936 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 7d706b8f50d44b12b3e727c9ecdc46c9 Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-1282600936-project Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '049f8f4e-947f-4567-b754-6d1a023a8333'} Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:50.983917 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. Jul 19 20:06:50.987466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:06:50.989651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] Returning 404 to user: Instance 049f8f4e-947f-4567-b754-6d1a023a8333 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:50.990776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57bc0643-6900-4d7d-88e3-05e367fbdd34 tempest-DeleteServersTestJSON-1282600936 tempest-DeleteServersTestJSON-1282600936-project] 10.222.0.33 "GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333" status: 404 len: 111 microversion: 2.1 time: 0.113467 Jul 19 20:06:50.991577 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2283/4483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:50 2022] GET /compute/v2.1/servers/049f8f4e-947f-4567-b754-6d1a023a8333 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:51.387328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:51.401280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-628e5538-c854-4387-a077-d6a633d31d0f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.917389 Jul 19 20:06:51.403500 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2201/4484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:50 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:51.437321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:51.441803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:51.476556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.478399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:51.482464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.486202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:51.498845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:51.499650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:51.510994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.513522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:51.518552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.519359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:52.855115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:52.863789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:52.865358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:52.866570 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f707608-6023-4d7c-886c-dd905d33bb27 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 200 len: 1656 microversion: 2.20 time: 1.438740 Jul 19 20:06:52.867169 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2284/4485] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:06:51 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 1656 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:06:52.884337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-128b5861-f5c4-4189-b722-9185989eb857 req-577dca0d-8b06-4a5e-acdf-259645d9f379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e5b374-dea7-4797-9d14-c0350b8fb054", "name": "network-vif-deleted", "tag": "5129ac24-e5bb-4aac-b0cf-7083bf9982d0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:52.908710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-128b5861-f5c4-4189-b722-9185989eb857 req-577dca0d-8b06-4a5e-acdf-259645d9f379 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:52.909475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-128b5861-f5c4-4189-b722-9185989eb857 req-577dca0d-8b06-4a5e-acdf-259645d9f379 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:52.933497 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-128b5861-f5c4-4189-b722-9185989eb857 req-577dca0d-8b06-4a5e-acdf-259645d9f379 service nova] Creating event network-vif-deleted:5129ac24-e5bb-4aac-b0cf-7083bf9982d0 for instance 21e5b374-dea7-4797-9d14-c0350b8fb054 on n-h1-843861-3 Jul 19 20:06:52.952506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-128b5861-f5c4-4189-b722-9185989eb857 req-577dca0d-8b06-4a5e-acdf-259645d9f379 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071764 Jul 19 20:06:52.953758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2285/4486] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:52.959848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-43536009-cff9-41a7-bf2a-39edcdc08a6e req-fa2e60c4-2974-4621-b609-13c025d17a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9971550f-e17d-4674-83ce-8e5b98dd1979", "name": "network-vif-plugged", "status": "completed", "tag": "6aaabb26-da3f-4581-9e5e-89103e5c3795"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:52.982360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-43536009-cff9-41a7-bf2a-39edcdc08a6e req-fa2e60c4-2974-4621-b609-13c025d17a7f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:52.992012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-43536009-cff9-41a7-bf2a-39edcdc08a6e req-fa2e60c4-2974-4621-b609-13c025d17a7f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.005267 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-43536009-cff9-41a7-bf2a-39edcdc08a6e req-fa2e60c4-2974-4621-b609-13c025d17a7f service nova] Creating event network-vif-plugged:6aaabb26-da3f-4581-9e5e-89103e5c3795 for instance 9971550f-e17d-4674-83ce-8e5b98dd1979 on n-h2-843861-3 Jul 19 20:06:53.023230 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-43536009-cff9-41a7-bf2a-39edcdc08a6e req-fa2e60c4-2974-4621-b609-13c025d17a7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067851 Jul 19 20:06:53.025172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2286/4487] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:53.039960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:53.040806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:53.050793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.053516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.055990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.060012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.129768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:53.156838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41b575ec-67cf-40c7-90cc-1533ec927cba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1512 microversion: 2.1 time: 1.664566 Jul 19 20:06:53.157937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2202/4488] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:51 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1512 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:53.706034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:53.719006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf0cdf9d-7921-4cca-9b5f-fe3c305a13e4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.692252 Jul 19 20:06:53.722564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2287/4489] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:53 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:53.885273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:53.886003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:53.906996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.911327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.914703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.915190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.956525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 HTTP/1.1 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '21e5b374-dea7-4797-9d14-c0350b8fb054'} Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:53.962439 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:06:53.968668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:53.972076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:53.973163 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb4aecd8-2bfd-40fc-878b-3e3ae16fa5ed tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 404 len: 111 microversion: 2.20 time: 0.092288 Jul 19 20:06:53.974274 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2203/4490] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:06:53 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:06:53.983370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-234a6cb3-1ccf-4687-b2a1-4e7af561e7d6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '.version_select at 0x7fb88e1c9040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:54.039874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-234a6cb3-1ccf-4687-b2a1-4e7af561e7d6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160017067" status: 204 len: 0 microversion: 2.20 time: 0.060230 Jul 19 20:06:54.043740 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2288/4491] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Jul 19 20:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160017067 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:06:54.179067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:54.179840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:54.189686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.191198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:54.195015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.195629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:54.753554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:54.754963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:54.777018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.777460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:54.795764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.799941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.328007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:55.347727 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2dfca07f-03d3-4999-bf91-beb42cc6f185 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1512 microversion: 2.1 time: 1.172801 Jul 19 20:06:55.350079 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2204/4492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:54 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1512 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:55.485609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:55.494487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e85e3b2f-b7b2-46c4-82bc-137c5ea5c695 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1499 microversion: 2.1 time: 0.756776 Jul 19 20:06:55.495081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2289/4493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:54 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1499 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:55.512068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc59cb02-48f1-43b1-96b7-9aca2438582f"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:55.513548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:55.525819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.526431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.528363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.528812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.594577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Cannot 'attach_volume' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state rescued Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/os-volume_attachments HTTP/1.1 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 74 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: {"volumeAttachment": {"volumeId": "fc59cb02-48f1-43b1-96b7-9aca2438582f"}} Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'attach_volume' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state rescued Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '1472b512-4550-4bcb-bb8e-21ed6101cedc', 'body': {'volumeAttachment': {'volumeId': 'fc59cb02-48f1-43b1-96b7-9aca2438582f'}}} Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 20:06:55.597608 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state rescued Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state rescued Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 409 to user: Cannot 'attach_volume' instance 1472b512-4550-4bcb-bb8e-21ed6101cedc while it is in vm_state rescued {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-64686d65-e55c-4e14-bdca-e5e354212aa3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.092045 Jul 19 20:06:55.605634 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2205/4494] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:06:55 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/os-volume_attachments => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:06:55.611486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:55.612068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:55.623732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.626467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.627290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.627738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.774624 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-887bd177-efb6-4215-a0fd-fdea2d9d285f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action" status: 202 len: 0 microversion: 2.1 time: 0.168844 Jul 19 20:06:55.776147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2290/4495] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:55 2022] POST /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:55.786880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:55.787801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:55.796357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.797200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.798357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.799054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.367213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:56.368264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:56.385949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.386858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.387927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.389298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.442788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:56.477996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:56.518421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9cd64234-2c50-4bb0-b22c-4908d594cf80 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1507 microversion: 2.1 time: 0.730230 Jul 19 20:06:56.523303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2206/4496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:55 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1507 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:56.587496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75a10b6d-df54-4c62-9c64-5831f83b7685 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: .version_select at 0x7fb88cecb1f0>, body: {"keypair": {"name": "tempest-keypair-365589661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnwi9Sl0jZ9RiPcTqJynyP45MuuT4hHdzoVNmPefm8kUWrhuW6vfnwZcl7rQxagCII1Ql2NKFdSKqBHTBxWtPeyP+LSo9rqDYvTKGe2ohCLBrsY1ZMsR5gOxybDosK05w=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:56.649857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-75a10b6d-df54-4c62-9c64-5831f83b7685 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:56.668438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-75a10b6d-df54-4c62-9c64-5831f83b7685 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for user 61fded06139c4a678720e043ef773dfa and project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:56.671290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:56.730068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75a10b6d-df54-4c62-9c64-5831f83b7685 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.145213 Jul 19 20:06:56.731306 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2207/4497] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 20:06:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:06:57.320721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:57.334382 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16385eee-8c7c-47cc-b0f4-251e600538fa tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.971531 Jul 19 20:06:57.338008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2291/4498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:56 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:57.541121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:57.542475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:57.553793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.556505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.558591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.561094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.612450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:58.355513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:58.356170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:58.369408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:58.369601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:58.370408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:58.370848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:58.994974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:59.016122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b561476-1394-4d71-b297-3850f613f1a3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1507 microversion: 2.1 time: 1.477029 Jul 19 20:06:59.017943 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2208/4499] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:57 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1507 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:59.162853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:59.181830 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-85df43b5-bff6-4573-9495-b6c2358e3e0a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.827400 Jul 19 20:06:59.183290 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2292/4500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:58 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:00.035972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:00.036733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:00.053542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:00.056301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:00.060070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:00.062073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:00.205497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:00.207645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:00.248119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:00.253101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:00.257407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:00.260067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:00.876455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:00.884653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:00.897170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1cade311-444b-40a5-af07-4efd7456c4df tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.698797 Jul 19 20:07:00.902512 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2293/4501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:00 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:00.905604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cad2f5da-f742-43fa-a59e-215ee091d621 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1507 microversion: 2.1 time: 0.870986 Jul 19 20:07:00.906418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2209/4502] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:00 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1507 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:01.933204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:01.937817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:01.938935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:01.942576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:01.965057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.966344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:01.972119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.972900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.974435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:01.974990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:01.981316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.983021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:02.688658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:02.719562 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2aa71653-47d1-4661-8e80-b9c06f1d42a6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1507 microversion: 2.1 time: 0.799177 Jul 19 20:07:02.723797 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2210/4503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:01 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1507 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:02.956836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:02.977165 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1f838e20-b93c-457e-8762-8537122d291a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 1.052230 Jul 19 20:07:02.978270 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2294/4504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:01 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:03.142947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-889623966", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0354c93-9b9a-4f78-8255-05762b29cd8d"}], "security_groups": [{"name": "tempest-securitygroup--1239980647"}], "key_name": "tempest-keypair-365589661", "user_data": "}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:03.396955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] validate_networks() for [('a0354c93-9b9a-4f78-8255-05762b29cd8d', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:03.743835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:03.744475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:03.758299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.761404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:03.764044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.765038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:04.480317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:04.480884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:04.481312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:04.481941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:04.482588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:04.531645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:04.534278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:04.538127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:04.548600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:04.590352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:04.596371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Getting quotas for user 61fded06139c4a678720e043ef773dfa and project a2bcff3b941e4198a38cd8b20b306ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:04.627714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:04.630451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:04.677024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:04.740334 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ff695fe-7c62-451d-9f45-05e78291a7a1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1513 microversion: 2.1 time: 0.994446 Jul 19 20:07:04.762621 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2295/4505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:03 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1513 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:04.763231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5a756cc-7eee-44ee-ba27-9703373f1b21 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.619794 Jul 19 20:07:04.772522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:04.772655 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2211/4506] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:07:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:07:04.772750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:04.796323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:04.799224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:04.801339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:04.802633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:04.803069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:04.806870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:06.276930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:06.312804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:06.323235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:06.326416 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc5304d2-4c0d-4486-895c-b2ec943bf0cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1280 microversion: 2.20 time: 1.540399 Jul 19 20:07:06.330115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2212/4507] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:04 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1280 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:06.453849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:06.463132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f316ded8-0514-4e10-b866-81cfe50b23e6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 1.712534 Jul 19 20:07:06.468191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2296/4508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:04 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:07.080513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31acfdec-b351-4380-b873-7fffe31087d7 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] Calling method '.version_select at 0x7fb88cec1700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:07.348620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:07.349217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:07.388422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:07.393020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:07.397748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:07.402600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:07.678947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31acfdec-b351-4380-b873-7fffe31087d7 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e/defaults" status: 200 len: 371 microversion: 2.1 time: 1.081192 Jul 19 20:07:07.695087 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2213/4509] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:07:06 2022] GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e/defaults => generated 371 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:07.716799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:07.717561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:07.744634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:07.752560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:07.753502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:07.753956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:08.192037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:08.206336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:08.208818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:08.210697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c41e189-f5ee-4c51-9020-1fb7f409c527 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1332 microversion: 2.20 time: 0.866254 Jul 19 20:07:08.212630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2297/4510] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:07 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1332 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:08.222136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d687879a-117d-4ff1-a2bd-718695169c4f tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] Calling method '.version_select at 0x7fb88cd93d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:08.404735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:08.424786 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-043c89e0-e20c-4c65-b43c-b7241c6061c2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.733409 Jul 19 20:07:08.426364 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2214/4511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:07 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:09.105227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d687879a-117d-4ff1-a2bd-718695169c4f tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e" status: 200 len: 371 microversion: 2.1 time: 0.891213 Jul 19 20:07:09.116690 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2298/4512] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 20:07:08 2022] GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e => generated 371 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:09.120563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20191229-f68f-47df-abcf-7465766f1d75 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] Calling method '.version_select at 0x7fb88cec1040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:09.212819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d11e1053-3645-4375-9aa3-25d62e645c69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: .version_select at 0x7fb88d21c820>, body: {"keypair": {"name": "tempest-keypair-2126717116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/4pJTyVTytJB17a7G1fK89l957+vjVf3Tr2MCBdoMNFM0VTRyf72Pl3oiKkW9Nsu49wEEWBqvLSWaJh97X9TEMxqmbiQ2ecGWOXMK6LGmH2eSPmCLR11x0h54tZuiI0w=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:09.259219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d11e1053-3645-4375-9aa3-25d62e645c69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for project ca870fb0242f4961bf3f433a7da6436f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:09.281605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-d11e1053-3645-4375-9aa3-25d62e645c69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for user 3116ed1e64fa431684c2f78c794eec58 and project ca870fb0242f4961bf3f433a7da6436f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:09.370321 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d11e1053-3645-4375-9aa3-25d62e645c69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162178 Jul 19 20:07:09.372307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2299/4513] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:07:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:07:09.385574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:09.393013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:09.415132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:09.415936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:09.417459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:09.418235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:09.633525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:09.659770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:09.673142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:09.678416 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aaf915eb-11a6-4f95-9203-b5a64598f179 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1338 microversion: 2.20 time: 0.302708 Jul 19 20:07:09.684481 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2300/4514] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:09 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:09.721427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:09.725821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:09.754433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:09.758869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:09.760724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:09.765231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:10.277219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20191229-f68f-47df-abcf-7465766f1d75 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e/defaults" status: 200 len: 371 microversion: 2.1 time: 1.162533 Jul 19 20:07:10.302223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2215/4515] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:07:09 2022] GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e/defaults => generated 371 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:07:10.317695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-33afdbc6-d90f-4dca-8702-db56588ef395 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] Calling method '.version_select at 0x7fb892f643a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:10.772139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:10.812533 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed4efcc9-3b43-449f-9268-21338f9d21a6 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 1.125026 Jul 19 20:07:10.827856 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2301/4516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:09 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:10.852552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:10.857521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:10.886029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.889385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:10.890969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.894048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:11.284128 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-33afdbc6-d90f-4dca-8702-db56588ef395 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e" status: 200 len: 371 microversion: 2.1 time: 0.974817 Jul 19 20:07:11.293940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2216/4517] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 20:07:10 2022] GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e => generated 371 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:11.302317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b68e49d4-d064-48f3-a2e4-e3dce89d6b66 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] Calling method '.version_select at 0x7fb892f64820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:11.345678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:11.384320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:11.386869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:11.389130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e0d2dd2-3fdb-4bbf-bf75-23cc9c90475e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1338 microversion: 2.20 time: 0.568890 Jul 19 20:07:11.406442 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2302/4518] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:10 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1338 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:11.851645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:11.853181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:11.876400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:11.881709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:11.883985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:11.885253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:12.619726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:12.646140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad186b27-2015-41a6-bd41-eee6ca58ae1a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.799141 Jul 19 20:07:12.649231 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2303/4519] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:11 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:12.665792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:12.666764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:12.681837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.682534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:12.687375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.689144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:13.104260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:13.120758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:13.128221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:13.129406 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac42c78d-6d04-4894-83b6-b196335d0a8f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1338 microversion: 2.20 time: 0.478927 Jul 19 20:07:13.135533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2304/4520] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:12 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1338 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:13.678740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:13.691439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:13.730734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:13.734410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:13.739513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:13.748154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:13.892311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b68e49d4-d064-48f3-a2e4-e3dce89d6b66 tempest-QuotasTestJSON-992418169 tempest-QuotasTestJSON-992418169-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e?user_id=54080544404a464f8702c7844bcf015a" status: 200 len: 371 microversion: 2.1 time: 2.596047 Jul 19 20:07:13.907677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2217/4521] 10.222.0.33 () {58 vars in 1322 bytes} [Tue Jul 19 20:07:11 2022] GET /compute/v2.1/os-quota-sets/f8b00190608544c4b94b5e39f3c6599e?user_id=54080544404a464f8702c7844bcf015a => generated 371 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:14.172769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:14.174778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:14.230578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.238835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.247772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.251785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.570907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:15.072372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:15.083358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-696fd24e-04ca-4f49-baec-3559c614f5ae tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 1.412354 Jul 19 20:07:15.092699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2305/4522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:13 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:15.219572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:15.264948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:15.276220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:15.282533 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9806ed58-64c1-4ab5-af74-fa13718cc227 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 1.119525 Jul 19 20:07:15.307002 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2218/4523] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:14 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:16.122770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:16.124728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:16.142549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:16.178291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:16.188078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:16.207975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:16.209190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:16.318545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:16.319392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:16.339720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:16.343197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:16.346122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:16.346634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:16.925230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:16.961449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5248f07f-3f4a-4047-bf07-9611c9838fd9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.845009 Jul 19 20:07:16.967413 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2306/4524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:16 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:16.981167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-546259951", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f8fbed9-92aa-483e-8565-36da7302591f"}], "security_groups": [{"name": "tempest-securitygroup--399236258"}], "key_name": "tempest-keypair-2126717116", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:17.311892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:17.330896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:17.336015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:17.337881 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0859d97-65c9-4e85-86b8-f8e398b9749b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 1.026625 Jul 19 20:07:17.352191 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2219/4525] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:16 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:17.542996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] validate_networks() for [('8f8fbed9-92aa-483e-8565-36da7302591f', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:18.005057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:18.008885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:18.050394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:18.056122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:18.058096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:18.061010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:18.823179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:18.837958 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-754f4e5b-8da4-4ed5-8528-bf553207421a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.849237 Jul 19 20:07:18.847879 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2220/4526] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:17 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:18.875716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:18.878697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:18.912865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:18.915745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:18.918091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:18.921032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:19.020636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:19.023506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:19.025209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:19.026433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:19.027438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:19.063877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:19.071597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:19.073523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:19.079897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:19.177190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:19.203941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Getting quotas for user 3116ed1e64fa431684c2f78c794eec58 and project ca870fb0242f4961bf3f433a7da6436f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:19.275895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:19.285386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:19.471576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e529501-9054-444f-8450-52dec092a4e1 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.502237 Jul 19 20:07:19.472736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2307/4527] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:07:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:07:19.495228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.497238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ae934480-5f5d-47b6-90dd-fbfeee7f4b05 req-caad765f-7457-4e11-bde8-f2b6cff8deec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:19.536144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.538640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.559476 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8539768f-1ba2-4d1a-84a1-395904774433 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 0.711706 Jul 19 20:07:19.561599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2221/4528] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:18 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:19.576359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6122ce0-b409-4fe1-a07a-bbccded809f4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:19.577006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6122ce0-b409-4fe1-a07a-bbccded809f4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:19.606016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ae934480-5f5d-47b6-90dd-fbfeee7f4b05 req-caad765f-7457-4e11-bde8-f2b6cff8deec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:19.612490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ae934480-5f5d-47b6-90dd-fbfeee7f4b05 req-caad765f-7457-4e11-bde8-f2b6cff8deec service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:19.654946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ae934480-5f5d-47b6-90dd-fbfeee7f4b05 req-caad765f-7457-4e11-bde8-f2b6cff8deec service nova] Creating event network-changed:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h1-843861-3 Jul 19 20:07:19.672866 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ae934480-5f5d-47b6-90dd-fbfeee7f4b05 req-caad765f-7457-4e11-bde8-f2b6cff8deec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193699 Jul 19 20:07:19.675258 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2308/4529] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:19.779749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6122ce0-b409-4fe1-a07a-bbccded809f4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.802737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=19 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:19.812342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6122ce0-b409-4fe1-a07a-bbccded809f4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1245 microversion: 2.1 time: 0.247438 Jul 19 20:07:19.814367 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2222/4530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:19 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1245 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:19.877071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:19.881977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:19.939455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:19.943998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:19.952020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:19.953012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.579980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:20.580715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:20.581265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:20.603839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e2429af0-8574-43f9-9673-1ac7911d269d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.742409 Jul 19 20:07:20.607174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.607630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.619704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.621109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.634487 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2309/4531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:19 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:20.837358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:20.841825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:20.895293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.895903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.903095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.916095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:21.131938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:21.196274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:21.207723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:21.216118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ece72a23-718a-49e0-a9a5-1fe0854bf6ae tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 0.640304 Jul 19 20:07:21.220906 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2223/4532] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:20 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:21.291686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:21.332408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5da90c7a-eaaf-4322-aac5-a1d999535b51 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1249 microversion: 2.1 time: 0.502534 Jul 19 20:07:21.340732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2310/4533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:20 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1249 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:21.628228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:21.633153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:21.699292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:21.702454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:21.704478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:21.706461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.237019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:22.237823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:22.259514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:22.261999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.263187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:22.269870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.355438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:22.647514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:22.665729 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d960d01d-d0dc-4271-a208-d816f6f28207 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 1.045943 Jul 19 20:07:22.668655 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2224/4534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:21 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:22.688873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:22.700261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:22.745984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:22.754966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.764757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:22.766758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.832912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:22.868783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:22.870750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:22.874475 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c777885e-7e19-468c-a537-29fd7849c879 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 0.641600 Jul 19 20:07:22.897503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2311/4535] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:22 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:23.044163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:23.080808 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f3786fe-73bf-4aa7-b98a-226f5a01bb4c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1303 microversion: 2.1 time: 0.404171 Jul 19 20:07:23.085902 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2225/4536] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:22 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1303 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:23.703418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:23.708555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:23.723542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.727437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:23.731212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.733498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:23.910464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:23.911433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:23.926514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.926973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:23.927753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.930603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:24.327785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:24.333138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:24.352710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4662ed6e-7343-41ac-839a-3f73111ab510 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1507 microversion: 2.1 time: 0.658923 Jul 19 20:07:24.355469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2312/4537] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:23 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:24.359245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:24.360939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:24.362565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04fcc412-bfa8-46e0-8159-c92f9e1f1f52 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 0.457493 Jul 19 20:07:24.365685 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2226/4538] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:23 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:24.367331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:24.368100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:24.388054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:24.388054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:24.388735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:24.389269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:24.542227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:24.553421 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba4e58c9-0e01-425d-955e-2d4b9d4c8487 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1303 microversion: 2.1 time: 0.195585 Jul 19 20:07:24.555418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2313/4539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:24 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:25.380251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:25.381848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:25.390536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:25.393192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:25.442777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:25.443767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:25.446975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:25.448096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:25.461384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:25.462280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:25.463913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:25.464517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:26.828783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:26.845310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:26.847055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:26.858380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1958491-0579-4f8b-b6aa-ee30ca04f0c7 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 1.466058 Jul 19 20:07:26.859369 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2314/4540] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:25 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:26.867446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:26.868572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:26.889866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:26.891677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:26.893198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:26.900136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:26.972163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:26.986892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-707dc7fd-fa63-4c76-8101-b1026c5e9929 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1504 microversion: 2.1 time: 1.616775 Jul 19 20:07:26.999157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2227/4541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:25 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1504 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:27.653095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:27.717744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-13623354-a2b8-4e1e-ab8d-d806e5bcc54e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 0.855536 Jul 19 20:07:27.722974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2315/4542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:26 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:27.734676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b98a70cc-119d-40f5-bd2c-0f3e1a96672c tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88d1b99d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:27.773871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2072628511", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5b99d575-5525-42b0-bce9-76c4b839720c"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:27.796695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:27.863442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] validate_networks() for [('5b99d575-5525-42b0-bce9-76c4b839720c', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:27.884010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b98a70cc-119d-40f5-bd2c-0f3e1a96672c tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/768ef159-d787-4d89-8514-9ee898bc93f7" status: 200 len: 350 microversion: 2.1 time: 0.158271 Jul 19 20:07:27.890588 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2316/4543] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:07:27 2022] GET /compute/v2.1/os-volumes/768ef159-d787-4d89-8514-9ee898bc93f7 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:27.897629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:27.898865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:27.914457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:27.916045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:27.918256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:27.919800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:28.877598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:28.940322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:28.947526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:28.955744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e0009f1-97e0-427f-97d7-666cec80a5d5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 1.069501 Jul 19 20:07:28.962988 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2317/4544] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:27 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:28.971444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:28.975510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:29.007689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:29.008179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:29.028096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:29.028963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:29.146528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:29.245193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:30.517654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:30.528937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6ffd615-f49b-4da5-8d0a-6e3f4704d5c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1504 microversion: 2.1 time: 1.564334 Jul 19 20:07:30.529539 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2318/4545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:28 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1504 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:30.545119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d2738a45-9911-428d-b1fb-a5a37d08e039 req-c796349d-686b-4ef3-a738-a800cd95ba41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9971550f-e17d-4674-83ce-8e5b98dd1979", "name": "network-vif-unplugged", "status": "completed", "tag": "6aaabb26-da3f-4581-9e5e-89103e5c3795"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:30.589830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:30.601411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d2738a45-9911-428d-b1fb-a5a37d08e039 req-c796349d-686b-4ef3-a738-a800cd95ba41 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.602206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d2738a45-9911-428d-b1fb-a5a37d08e039 req-c796349d-686b-4ef3-a738-a800cd95ba41 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:30.630183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d2738a45-9911-428d-b1fb-a5a37d08e039 req-c796349d-686b-4ef3-a738-a800cd95ba41 service nova] Creating event network-vif-unplugged:6aaabb26-da3f-4581-9e5e-89103e5c3795 for instance 9971550f-e17d-4674-83ce-8e5b98dd1979 on n-h2-843861-3 Jul 19 20:07:30.636684 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d2738a45-9911-428d-b1fb-a5a37d08e039 req-c796349d-686b-4ef3-a738-a800cd95ba41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105940 Jul 19 20:07:30.637857 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2319/4546] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:30.648622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:30.649720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:30.666165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.672748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:30.678267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.679009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.039142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:31.039942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:31.040472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:31.040930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:31.041376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:31.073758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:31.074212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.082242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:31.086208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.128639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=77 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:31.147457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:31.161288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for user fc1c7582f89d40549e8ddeb39285c030 and project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:31.189898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:31.192901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:31.271599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-248a1382-a3f9-41d6-9c76-9d86c2bcddb8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.269915 Jul 19 20:07:31.273591 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2228/4547] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:07:31.283153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:31.285981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:31.305436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:31.306307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.313357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:31.318810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.645823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:31.660253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5266276a-4c0c-479b-bfdc-f1f3e8909279 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 1.018869 Jul 19 20:07:31.662856 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2320/4548] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:30 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:31.674991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7fadc3ff-0d7e-4b39-a6f6-40d7fff0cb21 req-1b2f4687-99ff-488c-8385-92796b26be50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:31.720966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fadc3ff-0d7e-4b39-a6f6-40d7fff0cb21 req-1b2f4687-99ff-488c-8385-92796b26be50 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:31.721451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fadc3ff-0d7e-4b39-a6f6-40d7fff0cb21 req-1b2f4687-99ff-488c-8385-92796b26be50 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:31.745294 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7fadc3ff-0d7e-4b39-a6f6-40d7fff0cb21 req-1b2f4687-99ff-488c-8385-92796b26be50 service nova] Creating event network-changed:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:07:31.764327 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7fadc3ff-0d7e-4b39-a6f6-40d7fff0cb21 req-1b2f4687-99ff-488c-8385-92796b26be50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097444 Jul 19 20:07:31.766098 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2321/4549] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:31.786532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aaebebe-f87c-43fd-9152-16dc6954be5c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:31.793120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aaebebe-f87c-43fd-9152-16dc6954be5c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:31.901465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:31.932523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:31.954059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:31.955298 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a56895e-afb8-4562-8198-0a6149c2e942 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 0.680171 Jul 19 20:07:31.955890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2229/4550] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:31 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:31.981825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:31.983224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:32.006431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.010617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.011709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.012335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.322857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6aaebebe-f87c-43fd-9152-16dc6954be5c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:32.342725 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aaebebe-f87c-43fd-9152-16dc6954be5c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1218 microversion: 2.1 time: 0.572442 Jul 19 20:07:32.344043 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2322/4551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:31 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1218 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:32.375538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-10cfa9db-0c9d-4c9c-bfd3-3e550d989a52 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88dfd28b0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:32.551966 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-10cfa9db-0c9d-4c9c-bfd3-3e550d989a52 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0dc6c1a7-568e-42f4-a077-add8a6508783" status: 200 len: 351 microversion: 2.1 time: 0.206599 Jul 19 20:07:32.553456 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2323/4552] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:07:32 2022] GET /compute/v2.1/os-volumes/0dc6c1a7-568e-42f4-a077-add8a6508783 => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:32.635796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:32.644074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-391a8e51-a98d-4a2b-8694-24562ccf193d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1504 microversion: 2.1 time: 0.676099 Jul 19 20:07:32.664396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2230/4553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:31 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1504 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:32.678998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:32.679668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:32.697608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.698078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.698907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.699606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.878034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-169497aa-82f9-47e2-8f3e-d727cdc43718 req-bffe478a-086c-41c6-8647-e37c86537dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "name": "network-vif-plugged", "status": "completed", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:32.895881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-169497aa-82f9-47e2-8f3e-d727cdc43718 req-bffe478a-086c-41c6-8647-e37c86537dba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.898229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-169497aa-82f9-47e2-8f3e-d727cdc43718 req-bffe478a-086c-41c6-8647-e37c86537dba service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.929925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-169497aa-82f9-47e2-8f3e-d727cdc43718 req-bffe478a-086c-41c6-8647-e37c86537dba service nova] Creating event network-vif-plugged:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h1-843861-3 Jul 19 20:07:32.944571 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-169497aa-82f9-47e2-8f3e-d727cdc43718 req-bffe478a-086c-41c6-8647-e37c86537dba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070385 Jul 19 20:07:32.948399 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2231/4554] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:32.978782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:32.979532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:32.992290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:32.998514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.011834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.012397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.122893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:33.144755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b15093c6-582e-4462-a1b1-0d413a241161 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 0.467424 Jul 19 20:07:33.147918 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2324/4555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:32 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:33.365589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:33.366416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:33.392630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.396261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.401536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.404932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.738698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:33.762665 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea50513a-e2c8-4db0-b98c-aa160a093581 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1270 microversion: 2.1 time: 0.403842 Jul 19 20:07:33.763276 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2325/4556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:33 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1270 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:33.773906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:33.781217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:33.795546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.796402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.797907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.798935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:34.091772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:34.106446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:34.122966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:34.125253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-018ad7b1-8d2d-4c52-869d-cf1cf240e991 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1406 microversion: 2.20 time: 1.154814 Jul 19 20:07:34.143975 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2232/4557] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:32 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1406 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:34.169003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:34.170501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:34.193324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:34.193778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:34.195140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:34.204619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:35.341062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:35.350627 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-060f14fe-611c-47ee-bbd2-61b31cfe726d tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 200 len: 1447 microversion: 2.1 time: 1.586058 Jul 19 20:07:35.365527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2326/4558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:33 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 1447 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:35.388403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:35.388403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:35.427796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:35.432527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:35.433646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:35.434868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:35.543026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:35.586366 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a1b64bc-d8f9-42a1-ae86-60daae561ef8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 1.413298 Jul 19 20:07:35.587115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2233/4559] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:34 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:36.089242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:36.100254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bdb7756e-5d34-4fee-b603-e633be3417c0 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1276 microversion: 2.1 time: 0.733322 Jul 19 20:07:36.100999 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2327/4560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:35 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1276 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:36.117369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Calling method '.version_select at 0x7fb892f9a700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:36.118907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:36.119536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:36.119920 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:07:36.119920 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:07:36.121745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.122289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.128930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.129376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.130164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.130680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.166080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.166815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.179595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.180273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.188628 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66428bf2-82aa-4984-9b4b-74ba6477b0dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814 tempest-PortsAdminExtendedAttrsIpV6TestJSON-141298814-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.590240 Jul 19 20:07:36.198428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2234/4561] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:07:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:36.203777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:36.204648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:36.215755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.223989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.225016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:36.225621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.905568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:37.919608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:37.928830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:37.930469 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-251ff4c5-b00d-48a0-a78f-957b9cffe145 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1599 microversion: 2.20 time: 1.816896 Jul 19 20:07:37.934511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2328/4562] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:07:36 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1599 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:07:37.946394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:37.949298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:37.964753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:37.967278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.968162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.969670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.970375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.979756 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2983197f-a805-4ab6-841a-9d61a334d8d7 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 1.779818 Jul 19 20:07:37.981166 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2235/4563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:36 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:38.008780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a441001-a92f-4f06-bc6c-1fbeec096b03 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb892f94430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:38.153061 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a441001-a92f-4f06-bc6c-1fbeec096b03 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ba93c8c9-ecfc-4363-8332-305b41d88287" status: 200 len: 351 microversion: 2.1 time: 0.170328 Jul 19 20:07:38.155020 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2236/4564] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:07:37 2022] GET /compute/v2.1/os-volumes/ba93c8c9-ecfc-4363-8332-305b41d88287 => generated 351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:38.169141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:38.170929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:38.202676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:38.207138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:38.211210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:38.213786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:38.680556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:38.695282 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da923185-2c96-44db-9177-875555305043 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 0.758121 Jul 19 20:07:38.708411 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2329/4565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:37 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:38.715787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:38.716881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:38.726156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:38.727112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:38.728849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:38.729662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.019969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:39.037464 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38170c4e-2527-43cc-bdd3-5a2b980a7b62 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.880893 Jul 19 20:07:39.038768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2237/4566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:38 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:39.050829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:39.057273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:39.061602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffe8ec45-3d62-4fa0-bad2-e24bde65a36d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.351429 Jul 19 20:07:39.062281 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2330/4567] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 20:07:38 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:07:39.075754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:39.076402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.077493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:39.077757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-39163e51-4bd9-4909-8191-ad2ebff4aee8 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88d1fe670>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:39.078215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.283946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-39163e51-4bd9-4909-8191-ad2ebff4aee8 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.212116 Jul 19 20:07:39.284588 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2331/4568] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 19 20:07:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:39.305406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c009a1e-4659-4998-b008-0330f97a6a0b tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88cd18af0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:39.637328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c009a1e-4659-4998-b008-0330f97a6a0b tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.339652 Jul 19 20:07:39.638234 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2332/4569] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 19 20:07:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:39.656661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b0f79ed-5ac0-42a3-9997-99f7392d88f2 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88e19e4c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:39.874666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b0f79ed-5ac0-42a3-9997-99f7392d88f2 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226578 Jul 19 20:07:39.877676 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2333/4570] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 19 20:07:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:39.896514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-87f64c80-bb71-488f-85ec-5da4a42027ee req-2cdb3ca0-b463-41ec-a31b-ad1ad6a4959c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "name": "network-vif-plugged", "status": "completed", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:39.929265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-87f64c80-bb71-488f-85ec-5da4a42027ee req-2cdb3ca0-b463-41ec-a31b-ad1ad6a4959c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:39.929946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-87f64c80-bb71-488f-85ec-5da4a42027ee req-2cdb3ca0-b463-41ec-a31b-ad1ad6a4959c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.962978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-87f64c80-bb71-488f-85ec-5da4a42027ee req-2cdb3ca0-b463-41ec-a31b-ad1ad6a4959c service nova] Creating event network-vif-plugged:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:07:39.973619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-87f64c80-bb71-488f-85ec-5da4a42027ee req-2cdb3ca0-b463-41ec-a31b-ad1ad6a4959c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093843 Jul 19 20:07:39.974401 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2334/4571] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:39.992604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:39.993854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:40.007977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.013476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.016814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.017803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.215704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:40.224825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-202838cd-c02e-405c-888e-4d0e16f67cdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 1.184748 Jul 19 20:07:40.229370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2238/4572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:39 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:40.239312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10fc7cbe-7eb8-4c71-a002-96437727939d tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88ce273a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:40.435559 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10fc7cbe-7eb8-4c71-a002-96437727939d tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.204253 Jul 19 20:07:40.446544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2239/4573] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 19 20:07:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:40.452952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:40.454670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:40.464900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.465945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.468131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.469057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.922089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:40.934180 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3cac2ce0-5532-4144-9774-94bb729b9f45 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1370 microversion: 2.1 time: 0.958509 Jul 19 20:07:40.949265 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2335/4574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:39 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1370 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:40.954706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:40.955990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:40.964618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.965275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.966446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.967473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:41.008949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:41.129978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:41.181609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:41.299212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:41.309257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-613eb821-6288-4667-8fae-b96e33e501ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.860505 Jul 19 20:07:41.316626 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2240/4575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:40 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:41.322440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-59f4ba01-2bad-4b81-8fb2-020ccd8a55dd tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88ce25430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:41.470102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-59f4ba01-2bad-4b81-8fb2-020ccd8a55dd tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.151977 Jul 19 20:07:41.471369 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2241/4576] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:41.484071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31a54c1e-eece-4703-a6f9-fd50b94c7f17 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb892f9a3a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:41.627776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31a54c1e-eece-4703-a6f9-fd50b94c7f17 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.146758 Jul 19 20:07:41.629973 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2242/4577] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:41.646192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f4db852-f94b-4309-a70d-8218488a8428 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb892f9ae50>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:41.711521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:41.726583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82535924-3a86-4065-b513-91a3d19cb07e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.769302 Jul 19 20:07:41.727508 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2336/4578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:40 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:41.748797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:41.749749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:41.766298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:41.768382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:41.769437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:41.771401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:41.834788 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f4db852-f94b-4309-a70d-8218488a8428 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.194776 Jul 19 20:07:41.835945 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2243/4579] 10.222.0.33 () {58 vars in 1187 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:07:41.847376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-717371bd-2a8a-400a-aadb-13efcffe22f5 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] Calling method '.version_select at 0x7fb88cecb790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:41.985308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-717371bd-2a8a-400a-aadb-13efcffe22f5 tempest-VolumesTestJSON-629642012 tempest-VolumesTestJSON-629642012-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.140689 Jul 19 20:07:41.994563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2244/4580] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:42.000584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:42.001496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:42.022822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:42.023294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:42.024158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:42.028337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:42.339727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:44.417676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:44.432115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:44.435379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8c2c74a-e43d-48ee-a6af-a3ffd9f90c15 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 2.693214 Jul 19 20:07:44.436621 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2337/4581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:44.453101 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc8b670e-41c8-4f90-b018-fc1f0eebbc7b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1563 microversion: 2.1 time: 2.457106 Jul 19 20:07:44.463839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2245/4582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:41 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1563 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:44.464497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:44.464497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:44.464671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4fb59d8e-23c7-4df8-a6d6-d05599b9f1a4 req-c259542e-2962-4b9b-8baa-a973b8e5f16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:44.489320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.492717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.493959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.494408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.514534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4fb59d8e-23c7-4df8-a6d6-d05599b9f1a4 req-c259542e-2962-4b9b-8baa-a973b8e5f16c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.515540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4fb59d8e-23c7-4df8-a6d6-d05599b9f1a4 req-c259542e-2962-4b9b-8baa-a973b8e5f16c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.542998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4fb59d8e-23c7-4df8-a6d6-d05599b9f1a4 req-c259542e-2962-4b9b-8baa-a973b8e5f16c service nova] Creating event network-changed:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:07:44.551965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4fb59d8e-23c7-4df8-a6d6-d05599b9f1a4 req-c259542e-2962-4b9b-8baa-a973b8e5f16c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096297 Jul 19 20:07:44.553245 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2246/4583] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:44.563128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35b9eae8-fa1b-4aa9-a269-0bfc525970e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:44.572114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b9eae8-fa1b-4aa9-a269-0bfc525970e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.572846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b9eae8-fa1b-4aa9-a269-0bfc525970e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.608876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35b9eae8-fa1b-4aa9-a269-0bfc525970e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:07:44.681202 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35b9eae8-fa1b-4aa9-a269-0bfc525970e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.125281 Jul 19 20:07:44.683422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2247/4584] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:44 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:07:44.690417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:44.691480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:44.702376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.703272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.704690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:44.705397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:45.023400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e1871b99-744b-4693-958b-8df904221416 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337664 Jul 19 20:07:45.024174 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2248/4585] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:07:44 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:45.037038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:45.037949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:45.049290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:45.054797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:45.056059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:45.056760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:45.175090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:45.189875 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90485ad7-2945-4591-91ce-1c66d7723b4d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.751924 Jul 19 20:07:45.202753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2338/4586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:44 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:46.009080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:46.022637 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24393be4-569b-4d2c-b1ca-54ef4c5237bd tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.993302 Jul 19 20:07:46.024139 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2249/4587] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:45 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:46.208243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:46.209038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:46.242681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:46.243168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:46.244120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:46.255606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:46.627032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-59fe613f-a4a7-4437-9791-2113dcdfcd90 req-c5d5ed09-42cb-4b6a-9514-77f13d92bfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:46.645835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-59fe613f-a4a7-4437-9791-2113dcdfcd90 req-c5d5ed09-42cb-4b6a-9514-77f13d92bfdf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:46.646279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-59fe613f-a4a7-4437-9791-2113dcdfcd90 req-c5d5ed09-42cb-4b6a-9514-77f13d92bfdf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:46.670438 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-59fe613f-a4a7-4437-9791-2113dcdfcd90 req-c5d5ed09-42cb-4b6a-9514-77f13d92bfdf service nova] Creating event network-changed:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h1-843861-3 Jul 19 20:07:46.687232 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-59fe613f-a4a7-4437-9791-2113dcdfcd90 req-c5d5ed09-42cb-4b6a-9514-77f13d92bfdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065134 Jul 19 20:07:46.697620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2250/4588] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:46.928271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:46.946188 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b7239ef-6816-460d-a77d-8b550024207a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.740916 Jul 19 20:07:46.959777 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2339/4589] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:46 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:47.042888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:47.044674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:47.059783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.065517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:47.066700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.067298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:47.708022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:47.722158 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-039997ed-5522-4e60-a44f-98ba38776fef tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.684338 Jul 19 20:07:47.732906 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2251/4590] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:47 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:47.977751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:47.978305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:47.989870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:47.991538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.992032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:47.992829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.993270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:48.742347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:48.744140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:48.760183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:48.766830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:48.768947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:48.773970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:48.933994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:48.947976 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e618b45c-8b7a-4bf3-9d4b-999114b55fc7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.974751 Jul 19 20:07:48.951305 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2340/4591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:47 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:49.310285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:49.319035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:49.321513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-adc1bb5e-9be1-40f1-8551-f81bd53a1826 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.584916 Jul 19 20:07:49.328667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2252/4592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:48 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:49.859614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fd6d4431-442c-4464-800b-af08aee1c405 req-93672cf8-a59e-4602-9bd5-f7a519ba5680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:49.889814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fd6d4431-442c-4464-800b-af08aee1c405 req-93672cf8-a59e-4602-9bd5-f7a519ba5680 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:49.890281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fd6d4431-442c-4464-800b-af08aee1c405 req-93672cf8-a59e-4602-9bd5-f7a519ba5680 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:49.922574 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fd6d4431-442c-4464-800b-af08aee1c405 req-93672cf8-a59e-4602-9bd5-f7a519ba5680 service nova] Creating event network-changed:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:07:49.929700 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fd6d4431-442c-4464-800b-af08aee1c405 req-93672cf8-a59e-4602-9bd5-f7a519ba5680 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502087 Jul 19 20:07:49.934847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2341/4593] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:49.970402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:49.971906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:50.003636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.011476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.016502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.017798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.340661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:50.341715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:50.360406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.361247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.362822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.363844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.952310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:50.964370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6af141b-da16-41b1-8e05-9c7d60b64660 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.998911 Jul 19 20:07:50.965030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2253/4594] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:49 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:51.149310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:51.162003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c907bedc-7585-49e4-940a-55ba650c0568 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 0.825736 Jul 19 20:07:51.162625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2342/4595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:50 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:51.986449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:51.988579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:52.015225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:52.015820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:52.030900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:52.031835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:52.183543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:52.185126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:52.215962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:52.218067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:52.219548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:52.221518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:53.046604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:53.058918 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3962f42e-c496-46d1-a42b-d5dc6ff66471 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 1.080018 Jul 19 20:07:53.064204 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2254/4596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:51 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:54.034036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:54.056984 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-738da4fd-03b2-4b8c-a5ce-ae1afbe89721 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 1.879227 Jul 19 20:07:54.077805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:54.079024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:54.081041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2343/4597] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:52 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:54.096486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.097207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.098238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.100764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.485316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:54.509972 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f497189e-4952-47d7-acc4-997168cea10e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.434073 Jul 19 20:07:54.511415 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2255/4598] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:54 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:54.901822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e89230a2-8a7f-4d82-8fb3-300ff26d5d05 req-6d28b16a-7837-4096-9d16-df6011ce7b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "name": "network-vif-plugged", "status": "completed", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:54.922524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e89230a2-8a7f-4d82-8fb3-300ff26d5d05 req-6d28b16a-7837-4096-9d16-df6011ce7b38 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.922986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e89230a2-8a7f-4d82-8fb3-300ff26d5d05 req-6d28b16a-7837-4096-9d16-df6011ce7b38 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.955028 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e89230a2-8a7f-4d82-8fb3-300ff26d5d05 req-6d28b16a-7837-4096-9d16-df6011ce7b38 service nova] Creating event network-vif-plugged:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:07:54.966466 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e89230a2-8a7f-4d82-8fb3-300ff26d5d05 req-6d28b16a-7837-4096-9d16-df6011ce7b38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069723 Jul 19 20:07:54.967107 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2344/4599] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:55.086422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:55.087057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:55.115957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.116454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.134696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.137249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.528328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:55.529048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:55.543495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.543990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.544800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.556272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:56.200086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:56.213014 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb09724d-35df-4bdb-8f02-b64842749b20 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1679 microversion: 2.1 time: 1.131030 Jul 19 20:07:56.220681 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2256/4600] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:55 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1679 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:56.265621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:56.280344 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fe1d22d-c8e8-4d1d-b380-21b2f45d9e6e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.757190 Jul 19 20:07:56.293294 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2345/4601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:55 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:57.242084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:57.244738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:57.268858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.269354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.274343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.277817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.300304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:57.300944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:57.313979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.314458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.315244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.315679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:58.204401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:58.212789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-554f21fd-9157-4649-959d-07a0eae8ecda tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1318 microversion: 2.1 time: 0.916720 Jul 19 20:07:58.225275 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2346/4602] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:57 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1318 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:58.230787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:58.242268 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab5e53c3-c32a-4330-8a47-a3d6abb3292f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1656 microversion: 2.1 time: 1.007624 Jul 19 20:07:58.263119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78a5968d-c855-4fec-beae-388c8f8dfb5c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:58.266125 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2257/4603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:57 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1656 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:58.276883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78a5968d-c855-4fec-beae-388c8f8dfb5c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:58.277647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78a5968d-c855-4fec-beae-388c8f8dfb5c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:58.334015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78a5968d-c855-4fec-beae-388c8f8dfb5c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Going to try to start instance {{(pid=126008) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:07:58.418612 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78a5968d-c855-4fec-beae-388c8f8dfb5c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.159150 Jul 19 20:07:58.428552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:58.429442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:58.432002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:58.434999 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2347/4604] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:58 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:07:58.444092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:58.444560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:58.445361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:58.445793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:58.984787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:58.993141 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b6c0e73-2dd8-4dfc-bfe3-0e484d5b0835 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1665 microversion: 2.1 time: 0.569360 Jul 19 20:07:59.001629 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2258/4605] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:58 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1665 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:59.234962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:59.235666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:59.252767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.253226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:59.254290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.254734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:59.695791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:59.714930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb96d373-dfb0-45f6-b698-24ab90695e67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1506 microversion: 2.1 time: 0.485344 Jul 19 20:07:59.715538 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2348/4606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:59 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:59.737769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:59.739555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:59.761815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.765974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:59.769868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.774096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.022798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:00.024452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:00.039431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.039915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.040713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.041155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.065151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:00.077135 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d433bc8e-2425-4765-96e9-a899108533e4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1506 microversion: 2.1 time: 0.346023 Jul 19 20:08:00.077756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2259/4607] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:59 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:00.095678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:00.097477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:00.104635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.105087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.105969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.106408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.272387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:00.284370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b081976a-b701-45a2-bc20-3d9376b03e16 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1665 microversion: 2.1 time: 0.267725 Jul 19 20:08:00.296437 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2349/4608] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:00 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1665 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:00.605550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:08:00.605970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:08:00.606443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:08:00.606846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:08:00.607305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:08:00.702964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:00.728045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.728823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.732410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.733564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.776932 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ad36d45-a116-4d2f-85b2-bc8f326436ac tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "POST /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d/action" status: 202 len: 1108 microversion: 2.1 time: 0.685078 Jul 19 20:08:00.778221 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2260/4609] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:00 2022] POST /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d/action => generated 1108 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 20:08:00.794084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:00.794807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:00.807128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.811272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:00.813919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:00.814629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.029883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:01.039905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8d55a5c0-d334-4bdc-a135-3f36537af4b1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.251493 Jul 19 20:08:01.042619 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2350/4610] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:00 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:01.306719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:01.307406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:01.314533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.315125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.315922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.316658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.529713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:01.540998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc07ed1c-cb52-4eb4-ae26-ab5a3cd62948 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.240918 Jul 19 20:08:01.542113 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2261/4611] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:01 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:01.559761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:01.560673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:01.572627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.573757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.575250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.576074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.807267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:01.822380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4174debc-3cb1-45ad-bde3-9c375e7231cc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.267505 Jul 19 20:08:01.833217 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2351/4612] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:01 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:01.840864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:01.841481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:01.850575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.851040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.851861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.852505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.062288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:02.063295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:02.074514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.075555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.076991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.077618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.107861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:02.118059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c7057362-87c8-4612-88e1-9b890c143e9a tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.280920 Jul 19 20:08:02.118637 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2262/4613] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:01 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:02.138914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:02.139522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:02.162501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.163750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.173403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.174095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.518302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:02.530260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c431acf5-30af-4c60-9cf9-3328717518cc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.473190 Jul 19 20:08:02.531385 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2352/4614] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:02 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:02.594457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:02.608435 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-343553da-f37c-47f4-b6db-1a6e3a2fcfdc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.477800 Jul 19 20:08:02.609556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2263/4615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:02 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:02.630402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:02.631015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:02.642013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.642765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.643774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.645092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.672081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:02.918396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:02.931631 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f290b4c5-de37-42cc-a07c-2a628dd66977 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.306000 Jul 19 20:08:02.932437 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2353/4616] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:02 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:02.956059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:02.957224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:02.968122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.969887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.971399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.972472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:03.032869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lazy-loading 'flavor' on Instance uuid 04e4c3cf-b720-405f-88f9-75ff21285168 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:03.219636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1be52549-8b18-4f55-9e02-47241db77d55 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.239531 Jul 19 20:08:03.231020 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2264/4617] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:02 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:03.233529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:03.233988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:03.244518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:03.246536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:03.248451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:03.249752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:03.452912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:03.470977 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c791bea-405f-4470-88ad-99c992f89b11 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1677 microversion: 2.1 time: 0.241652 Jul 19 20:08:03.471593 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2354/4618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:03 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:03.550836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:03.551647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:03.562120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:03.562581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:03.563375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:03.563841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:03.760316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:03.763077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:03.775537 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d31ea948-7bc7-4ad0-a3ae-07044b847187 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.230863 Jul 19 20:08:03.793893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2265/4619] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:03 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:04.488894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:04.489505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:04.501970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.506323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.508112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.511897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.752520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:04.764163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fd6718a-82a3-4fce-8bcb-15d3d9e389c3 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1660 microversion: 2.1 time: 0.278863 Jul 19 20:08:04.765734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2355/4620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:04 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1660 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:04.784879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:04.786684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:04.811329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:04.813479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:04.815911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.818132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.823736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.824734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.837854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.842035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.847034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.847749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.007687 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa784eca-f00e-44eb-8453-917f83100aed tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action" status: 202 len: 0 microversion: 2.1 time: 0.226921 Jul 19 20:08:05.014639 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2266/4621] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:04 2022] POST /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:08:05.024302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:05.025173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:05.039827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:05.040359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.041468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:05.041920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.453541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:05.464426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a86f2ba-0d15-47c3-8c25-5609255f4d8f tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1666 microversion: 2.1 time: 0.447078 Jul 19 20:08:05.481907 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2267/4622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:05 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1666 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:05.490038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:05.499796 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e840d49-76fd-426d-ae6a-07feb3532092 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.702612 Jul 19 20:08:05.502963 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2356/4623] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:04 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:06.490809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:06.492012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:06.501385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.502252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:06.504159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.504671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:06.525731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:06.527225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:06.537264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.538616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:06.539935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.541020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:06.763936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:06.773344 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-351cb807-46be-41cc-be08-688646b20092 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1666 microversion: 2.1 time: 0.286684 Jul 19 20:08:06.777341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:06.786972 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2268/4624] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:06 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1666 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:06.790718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff92613b-5468-4223-bc20-806419efba72 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.269576 Jul 19 20:08:06.791546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2357/4625] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:06 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:07.815011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:07.816290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:07.818661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:07.819467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:07.842548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.843124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.843976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.845041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.845647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.847280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.848289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.851572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.150426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:08.153081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:08.160930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e3feb62-fdea-4b06-a9fa-a206fc33caf2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.352616 Jul 19 20:08:08.171986 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2358/4626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:07 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:08.173801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4517e40-1c65-4db0-8e12-8c7e2edbe0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.373924 Jul 19 20:08:08.174385 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2269/4627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:07 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:08.193208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:08.193832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:08.201254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.202085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.203326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.204050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.473610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:08.484708 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d5ca009-7e32-43d6-be4c-d256a98125f0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1669 microversion: 2.1 time: 0.295532 Jul 19 20:08:08.486154 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2359/4628] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:08 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1669 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:08.507046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:08.507642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:08.514646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.515103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.515909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.516345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.548465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:08.557365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Working on deleting snapshot 14cfdf4b-dd82-4595-871e-b4e66c97fb93 from shelved instance... Jul 19 20:08:09.187536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:09.187536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:09.195555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:09.196179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:09.196970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:09.197410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:09.404596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:09.414664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31fe3660-eb68-46c8-a7a7-50a146c5ebd1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.239736 Jul 19 20:08:09.415964 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2360/4629] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:09 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:09.585111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Doing local delete in cell 9f376e7e-4b8b-4ae3-95bf-5479c477f44b(cell1) {{(pid=126007) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 20:08:09.586575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:09.587237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:09.587859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 20:08:09.592326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] deallocate_for_instance() {{(pid=126007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 20:08:10.392184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Updating instance_info_cache with network_info: [] {{(pid=126007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 20:08:10.421860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8d75f290-8b49-4a01-8d1c-dd948544704b req-19d49750-655e-493b-a95a-d95c137db382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9971550f-e17d-4674-83ce-8e5b98dd1979", "name": "network-vif-deleted", "tag": "6aaabb26-da3f-4581-9e5e-89103e5c3795"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:10.458216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d75f290-8b49-4a01-8d1c-dd948544704b req-19d49750-655e-493b-a95a-d95c137db382 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:10.459164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d75f290-8b49-4a01-8d1c-dd948544704b req-19d49750-655e-493b-a95a-d95c137db382 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:10.510580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.server_external_events [req-8d75f290-8b49-4a01-8d1c-dd948544704b req-19d49750-655e-493b-a95a-d95c137db382 service nova] Unable to find a host for instance 9971550f-e17d-4674-83ce-8e5b98dd1979. Dropping event network-vif-deleted {{(pid=126008) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:08:10.512865 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8d75f290-8b49-4a01-8d1c-dd948544704b req-19d49750-655e-493b-a95a-d95c137db382 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.096843 Jul 19 20:08:10.530218 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2361/4630] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 20:08:10.538616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:10.539736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:10.547020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:10.547709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:10.549656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:10.550930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:10.998603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:11.015169 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b2de6eb-639d-4a34-9bfe-6cdf7afcdd20 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.479144 Jul 19 20:08:11.016312 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2362/4631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:10 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:11.056321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e40bee25-fe9b-44d7-afd1-5da2813795f9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 204 len: 0 microversion: 2.1 time: 2.553255 Jul 19 20:08:11.059641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2270/4632] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:08 2022] DELETE /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 0 bytes in 2558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:11.069647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:11.072279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 9971550f-e17d-4674-83ce-8e5b98dd1979] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:11.087968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.088377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.090999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.091555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.135183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 HTTP/1.1 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '9971550f-e17d-4674-83ce-8e5b98dd1979'} Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:11.140521 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. Jul 19 20:08:11.145730 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:11.152022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 404 to user: Instance 9971550f-e17d-4674-83ce-8e5b98dd1979 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:11.155274 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42bc2d02-f0b7-46c0-b23b-633455f7a6d0 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979" status: 404 len: 111 microversion: 2.1 time: 0.089742 Jul 19 20:08:11.156595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2363/4633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:11 2022] GET /compute/v2.1/servers/9971550f-e17d-4674-83ce-8e5b98dd1979 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:08:11.166149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:11.166888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:11.179778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.180533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.181614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.183189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.240398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:11.359532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77275e37-a964-48cc-ac5a-37c0dc785f27 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 204 len: 0 microversion: 2.1 time: 0.198434 Jul 19 20:08:11.361897 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2271/4634] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:11 2022] DELETE /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:11.372034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:11.372932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:11.385492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.389195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.393829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.395256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.619420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:11.628587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c50715bc-c342-4cf5-93aa-38f6557ce552 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1464 microversion: 2.1 time: 0.261688 Jul 19 20:08:11.633937 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2364/4635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:11 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:12.032942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:12.033905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:12.044228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.064745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.067215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.070586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.506595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:12.507845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:12.526723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.527189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.529689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.530579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.635471 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e493f3e7-c8dc-4058-bfe5-94ba00edcdcc tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/ips" status: 200 len: 153 microversion: 2.20 time: 0.806433 Jul 19 20:08:12.647894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2272/4636] 10.222.0.33 () {60 vars in 1288 bytes} [Tue Jul 19 20:08:11 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/ips => generated 153 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:08:12.661120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:12.661789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:12.683384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.691838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.693213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:12.693695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:12.730315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:12.744529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e011af0e-a638-4be6-bb39-c3ba2262654b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.715494 Jul 19 20:08:12.747202 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2365/4637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:12 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:12.961163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:12.963926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:12.977068 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ac840351-9399-4a74-9f68-6e50cdd6aa24 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1464 microversion: 2.1 time: 0.325327 Jul 19 20:08:12.978110 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2273/4638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:12 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:13.765147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:13.765927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:13.786664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:13.790189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:13.792536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:13.793178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:13.997569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:13.998259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:14.022048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:14.022429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:14.023211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:14.023638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:14.236350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:14.245006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-277e1b45-e4f7-4a0d-839a-e6a60a7edbc2 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1464 microversion: 2.1 time: 0.254232 Jul 19 20:08:14.253911 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2274/4639] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:13 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:14.357044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:14.373241 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a6e619a-a406-4237-8576-fbc3f9dfac2a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.613616 Jul 19 20:08:14.381939 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2366/4640] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:13 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:14.807632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-65ae0a1f-2974-49a4-86dd-d0cdc47dc236 req-c13b6d10-4b43-4da3-a7f0-82978d65d9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344a0508-2c98-4a7e-92c1-cc0367c68795", "name": "network-vif-deleted", "tag": "2dad781d-8623-4b97-8c5d-7c80d313db2b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:14.834902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-65ae0a1f-2974-49a4-86dd-d0cdc47dc236 req-c13b6d10-4b43-4da3-a7f0-82978d65d9d0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:14.839659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-65ae0a1f-2974-49a4-86dd-d0cdc47dc236 req-c13b6d10-4b43-4da3-a7f0-82978d65d9d0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:14.889111 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-65ae0a1f-2974-49a4-86dd-d0cdc47dc236 req-c13b6d10-4b43-4da3-a7f0-82978d65d9d0 service nova] Creating event network-vif-deleted:2dad781d-8623-4b97-8c5d-7c80d313db2b for instance 344a0508-2c98-4a7e-92c1-cc0367c68795 on n-h1-843861-3 Jul 19 20:08:14.898269 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-65ae0a1f-2974-49a4-86dd-d0cdc47dc236 req-c13b6d10-4b43-4da3-a7f0-82978d65d9d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094961 Jul 19 20:08:14.907356 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2275/4641] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:08:15.270389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:15.271705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:15.282819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.283274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.284161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.284506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.383866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.386586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.387221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lazy-loading 'fault' on Instance uuid 344a0508-2c98-4a7e-92c1-cc0367c68795 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:15.397698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:15.399008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:15.431488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.437299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.444372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.454984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.650686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:15.665666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b33a290-6154-457f-8f93-fac3cba52bcc tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 200 len: 1304 microversion: 2.1 time: 0.398350 Jul 19 20:08:15.670892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2367/4642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:15 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 1304 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:16.095942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:16.105035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14751d13-b708-46e7-8848-c4d98899df1a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.711513 Jul 19 20:08:16.110520 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2276/4643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:15 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:16.684367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:16.685616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 344a0508-2c98-4a7e-92c1-cc0367c68795] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:16.698435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.698891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.699678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.700148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.737384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 HTTP/1.1 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '344a0508-2c98-4a7e-92c1-cc0367c68795'} Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:16.738863 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 404 to user: Instance 344a0508-2c98-4a7e-92c1-cc0367c68795 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-865e8105-a896-4c07-9da0-881f76395900 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795" status: 404 len: 111 microversion: 2.1 time: 0.061046 Jul 19 20:08:16.743368 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2368/4644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:16 2022] GET /compute/v2.1/servers/344a0508-2c98-4a7e-92c1-cc0367c68795 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:08:16.756319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:16.756920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:16.766808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.767266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.768344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.768776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.809646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:16.962663 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af82ab2a-b527-4d36-93d4-b4eac6831aa4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 204 len: 0 microversion: 2.1 time: 0.211800 Jul 19 20:08:16.964546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2277/4645] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:16 2022] DELETE /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:16.985339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:16.986420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:17.003204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.004327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.005380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.006956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.131895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:17.132895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:17.153268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.156405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.159822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.166725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.450466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:17.485162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50889cc0-a579-4fe1-8dd3-e7a6b937a2af tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1507 microversion: 2.1 time: 0.509801 Jul 19 20:08:17.487241 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2369/4646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:16 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:17.507008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:17.510062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:17.529135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.529512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.530312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:17.530751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.574042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lazy-loading 'flavor' on Instance uuid 00bf3a02-8ecc-4df0-b623-df28efee120b {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:17.713438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:17.800712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:17.832146 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7414faa-8e30-4c6c-8ae5-e5a19b8aa597 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.703873 Jul 19 20:08:17.833153 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2278/4647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:17 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:18.240603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91528ee7-064f-44f1-8199-bbe389ed2b71 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/action" status: 202 len: 0 microversion: 2.20 time: 0.743502 Jul 19 20:08:18.242603 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2370/4648] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 20:08:17 2022] POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:18.257027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:18.261003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:18.288257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.290339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:18.291600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.294553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:18.504289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:18.505393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:18.525542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=64 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:18.529014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.529783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:18.530896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.531496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.063456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:20.078668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90f1d463-2079-4bbe-944b-eeb466297a0c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 200 len: 1507 microversion: 2.1 time: 1.579488 Jul 19 20:08:20.082810 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2371/4649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:18 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 1507 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:20.100446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:20.116717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:20.117577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:20.121561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:20.122621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:20.126326 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-077f1350-ac6f-4961-b834-6f3a03128bfa tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 1.878708 Jul 19 20:08:20.129051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2279/4650] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:18 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:20.137177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-08a804fb-2b39-4bed-871a-a90e19f8da04 req-8337ff16-d235-4c70-98b5-84b3b56bc451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da99f6b-0da4-4c76-8b12-755e4d441d74", "name": "network-vif-deleted", "tag": "6ddb17b1-06f6-4b10-b81c-2443d8753283"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:20.139395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:20.140080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.141550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:20.144671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.164336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-08a804fb-2b39-4bed-871a-a90e19f8da04 req-8337ff16-d235-4c70-98b5-84b3b56bc451 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:20.175757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-08a804fb-2b39-4bed-871a-a90e19f8da04 req-8337ff16-d235-4c70-98b5-84b3b56bc451 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.217550 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-08a804fb-2b39-4bed-871a-a90e19f8da04 req-8337ff16-d235-4c70-98b5-84b3b56bc451 service nova] Creating event network-vif-deleted:6ddb17b1-06f6-4b10-b81c-2443d8753283 for instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 on n-h2-843861-3 Jul 19 20:08:20.236052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-08a804fb-2b39-4bed-871a-a90e19f8da04 req-8337ff16-d235-4c70-98b5-84b3b56bc451 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105112 Jul 19 20:08:20.237362 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2280/4651] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:20.266892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "308f2996-34a4-4cad-9656-6275c5a4e4e3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:20.269296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:20.285680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:20.286373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.287399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:20.288164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:20.874998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4074c304-9412-4f21-ab02-47c83c54d4fa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635960 Jul 19 20:08:20.875636 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2281/4652] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:08:20 2022] POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:21.106573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:21.107280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 7da99f6b-0da4-4c76-8b12-755e4d441d74] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:21.130196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:21.130687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:21.131518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:21.131993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:21.180171 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 HTTP/1.1 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '7da99f6b-0da4-4c76-8b12-755e4d441d74'} Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:21.200871 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 404 to user: Instance 7da99f6b-0da4-4c76-8b12-755e4d441d74 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af897f54-b7ec-4c97-a051-9bf07ddbb3e4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74" status: 404 len: 111 microversion: 2.1 time: 0.100840 Jul 19 20:08:21.206775 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2282/4653] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:21 2022] GET /compute/v2.1/servers/7da99f6b-0da4-4c76-8b12-755e4d441d74 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:08:21.215494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:21.216445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:21.249143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:21.249603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:21.261191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:21.261957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.390925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:22.401878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89ecfb83-fe0e-4673-8181-6bb82420e407 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 2.310825 Jul 19 20:08:22.414987 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2372/4654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:20 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:22.437519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:22.446868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:22.465303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.467158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.471517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.476270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.484972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:22.505758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:22.510825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:22.513364 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58dc0e4e-de5e-498d-947e-550790c557df tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 1.306159 Jul 19 20:08:22.514976 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2283/4655] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:21 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:22.570289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:22.822202 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-40b5def1-a089-4747-9cf4-d2fdda7b383b tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 204 len: 0 microversion: 2.1 time: 0.397416 Jul 19 20:08:22.823032 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2373/4656] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:22 2022] DELETE /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:22.833420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:22.834116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:22.851347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.856020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.856942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.857597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:23.433928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:23.434898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:23.452746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:23.457225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:23.459297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:23.461502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.282945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:24.302065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17bbee5c-bc75-4ca5-92d2-4f945074a474 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1492 microversion: 2.1 time: 1.473022 Jul 19 20:08:24.302905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2284/4657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:22 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1492 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:24.322554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:24.328839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:24.357372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.358013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.366339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.366949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.679827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:24.712474 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27bcbca2-4150-4ccc-aaf8-27a7f7a1acd8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 1.278528 Jul 19 20:08:24.713420 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2374/4658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:23 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:25.227475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.241605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.243522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.250137 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-442affc7-5d8d-4a98-b50a-3ccabb04bcde tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.944832 Jul 19 20:08:25.250956 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2285/4659] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:24 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:25.323798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:25.324940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:25.335014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:25.335481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:25.336961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:25.337584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:25.730640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:25.731980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:25.744076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:25.747062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:25.751173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:25.754365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:25.917705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.968146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-86ad60e3-0f4e-4949-b222-8315edc3b76c tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 200 len: 1450 microversion: 2.1 time: 0.648521 Jul 19 20:08:25.969399 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2375/4660] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:25 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 1450 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:25.977120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4b9e4980-99a3-46cd-a7bd-be800663fcd3 req-c3aad97f-0423-49f4-886c-717960901ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de641a32-75be-4975-8d99-9a0267e7598e", "name": "network-vif-deleted", "tag": "ce3c8533-fa80-4296-bc3d-6ece3c8661fc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:26.066258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4b9e4980-99a3-46cd-a7bd-be800663fcd3 req-c3aad97f-0423-49f4-886c-717960901ee0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.077235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4b9e4980-99a3-46cd-a7bd-be800663fcd3 req-c3aad97f-0423-49f4-886c-717960901ee0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.122347 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4b9e4980-99a3-46cd-a7bd-be800663fcd3 req-c3aad97f-0423-49f4-886c-717960901ee0 service nova] Creating event network-vif-deleted:ce3c8533-fa80-4296-bc3d-6ece3c8661fc for instance de641a32-75be-4975-8d99-9a0267e7598e on n-h2-843861-3 Jul 19 20:08:26.138826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4b9e4980-99a3-46cd-a7bd-be800663fcd3 req-c3aad97f-0423-49f4-886c-717960901ee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166903 Jul 19 20:08:26.142608 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2376/4661] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:26.188644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:26.205614 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2ed3a5f-4569-4556-a8e1-ab3e7dd36829 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.479037 Jul 19 20:08:26.212940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2286/4662] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:25 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:26.273926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:26.285490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:26.316010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.316010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.316010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.316010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.531510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:26.543332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:26.545076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:26.546467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad519d96-3ce2-4058-8f5e-4ef5487bfa37 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.280554 Jul 19 20:08:26.558326 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2377/4663] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:26 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:26.986138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:26.986755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: de641a32-75be-4975-8d99-9a0267e7598e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:26.999301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.999760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.003156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.006892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.049859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e HTTP/1.1 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'de641a32-75be-4975-8d99-9a0267e7598e'} Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:27.054582 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:08:27.058819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 404 to user: Instance de641a32-75be-4975-8d99-9a0267e7598e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:27.059296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d907b96-6365-466b-8d9a-6cbd302044ba tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e" status: 404 len: 111 microversion: 2.1 time: 0.077109 Jul 19 20:08:27.060243 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2287/4664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:26 2022] GET /compute/v2.1/servers/de641a32-75be-4975-8d99-9a0267e7598e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:08:27.069154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:27.070294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:27.082000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.082831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.083997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.085181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.125986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:27.233269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:27.233895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:27.244300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.247518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.248680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.249137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.357302 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82ee18ac-1052-46b0-b2d4-9b921436c682 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 204 len: 0 microversion: 2.1 time: 0.292558 Jul 19 20:08:27.362001 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2378/4665] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:27 2022] DELETE /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:27.376110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:27.379252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:27.408690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.409143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.409922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.410351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.776113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:27.789614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a5f53e9-857e-49f4-a8ee-129e17f50027 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1675 microversion: 2.1 time: 0.423743 Jul 19 20:08:27.792070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2379/4666] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:27 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1675 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:27.800769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:27.808795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:27.821667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:27.827890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.828359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.831706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:27.837185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:27.838526 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dae0e62a-f0c0-4a63-82bf-39822ea626c1 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1513 microversion: 2.1 time: 0.611745 Jul 19 20:08:27.839121 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2288/4667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:27 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:28.118162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:28.129717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:28.136766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:28.139626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6be4ee47-4a04-4a5a-badd-74fc36e56cab tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.346160 Jul 19 20:08:28.143100 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2380/4668] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:27 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:28.809436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:28.811511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:28.828605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:28.852337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:28.852337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:28.852337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:28.852337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:28.864892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:28.869715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:28.890933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:28.891387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:28.897543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:28.903610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:29.947568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:29.969397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-62f4c6cc-7d5a-4258-b19a-53b0b0e3c03c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1531 microversion: 2.1 time: 1.116993 Jul 19 20:08:29.971745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2381/4669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:28 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1531 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:29.988244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:29.992177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:30.011468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.012298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:30.013855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.015772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:30.398709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:30.415582 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42371281-0949-43c8-afca-8046c95d06b8 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1675 microversion: 2.1 time: 1.612511 Jul 19 20:08:30.416530 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2289/4670] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:28 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1675 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:30.515344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:30.530135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:30.545480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:30.547054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0563cf93-ebec-4ce7-8810-7a2cdca4c5c4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.574113 Jul 19 20:08:30.548174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2382/4671] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:29 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:30.995935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:30.995935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:31.024247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.024718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.028115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.028570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.044539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:31.441724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:31.442432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:31.455096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.455957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.458207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.458859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.469271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.485585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a114ebf-b264-4994-8b04-a3257355ec49 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.496365 Jul 19 20:08:31.486561 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2290/4672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:30 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:31.568186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:31.569105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:31.579449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.580709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.585727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.586404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.781723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.790235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:31.797034 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7097efb8-168b-453a-a092-f7c9132481c9 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1675 microversion: 2.1 time: 0.366609 Jul 19 20:08:31.798167 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2383/4673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:31 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1675 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:31.902612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.918606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.918606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.918606 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4d9723ad-99b4-4358-8957-67019ecd482d tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.355497 Jul 19 20:08:31.918998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2291/4674] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:31 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:08:32.508827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:32.509474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:32.544103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.545283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.551184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.552217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.817717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:32.820983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:32.833558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.834132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.836182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.837051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.990259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.024575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79b958cb-0b15-431e-8c54-14bafd2ae938 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.514660 Jul 19 20:08:33.032600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2384/4675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:32 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:33.050184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:33.052086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:33.082142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.082979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.084215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.084804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.313347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.329765 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ae75307-dca3-4f3e-880a-5ed52e487c93 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1675 microversion: 2.1 time: 0.518059 Jul 19 20:08:33.331058 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2292/4676] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:32 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1675 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:33.338337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5f264293-3b52-4755-a6eb-cf28ad78d079 req-c1f4caaf-546d-44d9-aadf-221112afc5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "name": "network-vif-unplugged", "status": "completed", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:33.350901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5f264293-3b52-4755-a6eb-cf28ad78d079 req-c1f4caaf-546d-44d9-aadf-221112afc5ca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.353703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5f264293-3b52-4755-a6eb-cf28ad78d079 req-c1f4caaf-546d-44d9-aadf-221112afc5ca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.390282 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5f264293-3b52-4755-a6eb-cf28ad78d079 req-c1f4caaf-546d-44d9-aadf-221112afc5ca service nova] Creating event network-vif-unplugged:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:08:33.398260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5f264293-3b52-4755-a6eb-cf28ad78d079 req-c1f4caaf-546d-44d9-aadf-221112afc5ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065372 Jul 19 20:08:33.400887 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2293/4677] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:33.443527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.464622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.467630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.469826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d7a7820-f609-4765-a088-f830c96cc010 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.432349 Jul 19 20:08:33.470943 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2385/4678] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:33 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:34.054898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:34.056490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:34.089909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.102821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.104238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.106941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.350626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:34.351398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:34.373437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.375202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.377200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.378551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.625833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:34.634885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6cd5c02a-431e-47a1-bf38-1bd11902c62c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.587178 Jul 19 20:08:34.645260 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2294/4679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:34 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:34.655223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:34.655721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:34.655721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:34.665384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a8877432-9fe5-4190-9ce2-c4b790e53294 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1607 microversion: 2.1 time: 0.319408 Jul 19 20:08:34.677729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.677729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.678907 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2386/4680] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:34 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1607 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:34.679003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.679003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.166396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6c9bf7ed-1a3f-44da-bfe6-22c4b0e30f25 req-7cf6338c-475b-4aba-80e1-5b2e3d82e900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4c3cf-b720-405f-88f9-75ff21285168", "name": "network-vif-deleted", "tag": "b7d05acf-081d-4bda-a4af-7e3d6d2ca71a"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:35.188502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6c9bf7ed-1a3f-44da-bfe6-22c4b0e30f25 req-7cf6338c-475b-4aba-80e1-5b2e3d82e900 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.188954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6c9bf7ed-1a3f-44da-bfe6-22c4b0e30f25 req-7cf6338c-475b-4aba-80e1-5b2e3d82e900 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.207254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6c9bf7ed-1a3f-44da-bfe6-22c4b0e30f25 req-7cf6338c-475b-4aba-80e1-5b2e3d82e900 service nova] Creating event network-vif-deleted:b7d05acf-081d-4bda-a4af-7e3d6d2ca71a for instance 04e4c3cf-b720-405f-88f9-75ff21285168 on n-h2-843861-3 Jul 19 20:08:35.245253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6c9bf7ed-1a3f-44da-bfe6-22c4b0e30f25 req-7cf6338c-475b-4aba-80e1-5b2e3d82e900 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082787 Jul 19 20:08:35.248332 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2387/4681] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:35.490350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:35.513394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:35.520751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:35.526203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c5f6e85-7ba7-4545-aeac-1ceccc4bc888 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1745 microversion: 2.20 time: 0.888293 Jul 19 20:08:35.542013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2295/4682] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:34 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1745 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:35.659785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:35.664734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:35.678866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.683721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.686396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.687412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.690166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:35.690834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:35.710215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.710683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.711484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.711963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.774731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.775498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.776271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lazy-loading 'fault' on Instance uuid 04e4c3cf-b720-405f-88f9-75ff21285168 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:35.930091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78ad139e751423989cc0e807a201c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780e8dd93d534fdc82b987128a16e450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:35.951434 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a7cfbf5-db6d-4584-9d0e-90851768a0c4 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 200 len: 1328 microversion: 2.1 time: 0.268923 Jul 19 20:08:35.956222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2296/4683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:35 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:36.515471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:36.524755 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b85515d5-530b-431d-b6b8-4c058a98a9be tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.873811 Jul 19 20:08:36.526053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2388/4684] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:35 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:36.548754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:36.550113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:36.572599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:36.574105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:36.578606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:36.599741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:36.982785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:36.984872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] [instance: 04e4c3cf-b720-405f-88f9-75ff21285168] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:37.034168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.035635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.041802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.043844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.118071 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] HTTP exception thrown: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Request method failure captured: Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 HTTP/1.1 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1wx5Ec0Y_-X7oLU2PLl2Gr_g_4FL-5OAGhh-AKME8bb9hRyFJGzRIFUWrukJIF6FyYa_lJEKekIvjt-g4iPObqki0tymDnFSMICsw4Tt9smIZ7FRkPLlwJ44Q9anJqF7LkH0XO_TrBQvldzCHAd31nqiakiGjiFkTzJGXJpBax-vxVo Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/780e8dd93d534fdc82b987128a16e450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_780e8dd93d534fdc82b987128a16e450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 780e8dd93d534fdc82b987128a16e450 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-1892461406 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f78ad139e751423989cc0e807a201c54 Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-1892461406-project Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '04e4c3cf-b720-405f-88f9-75ff21285168'} Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:37.121953 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. Jul 19 20:08:37.127394 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:08:37.128439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Returning 404 to user: Instance 04e4c3cf-b720-405f-88f9-75ff21285168 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:37.129605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-06b31fb1-09aa-4cfc-8590-d01c95e08793 tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168" status: 404 len: 111 microversion: 2.1 time: 0.158641 Jul 19 20:08:37.140014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2389/4685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:36 2022] GET /compute/v2.1/servers/04e4c3cf-b720-405f-88f9-75ff21285168 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:08:37.159595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f8a49f6-3bd8-42c5-a554-22f6d327447e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] Calling method '.version_select at 0x7fb88dfd5790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:37.245736 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f8a49f6-3bd8-42c5-a554-22f6d327447e tempest-ServerActionsTestJSON-1892461406 tempest-ServerActionsTestJSON-1892461406-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634667153" status: 202 len: 0 microversion: 2.1 time: 0.104209 Jul 19 20:08:37.246688 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2390/4686] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634667153 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:37.542305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:37.543273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:37.551013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.551750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.571400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.572206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.654054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:37.670739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:37.672646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:37.674874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98c2151b-1a60-4f71-a545-17d71302fd5f tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 1.132128 Jul 19 20:08:37.676089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2297/4687] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:36 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:38.442309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:38.444635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:38.463426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:38.465822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:38.469724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:38.475447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:38.575087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'flavor' on Instance uuid 7fac2431-a538-4423-b3f7-ebb74df16f1a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:38.813446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:38.828449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-17b452f7-cf7c-4467-a91c-bbf258626ff7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 1.289570 Jul 19 20:08:38.829068 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2391/4688] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:37 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:38.841437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:38.846400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:38.859162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:38.859946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:38.861106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:38.861696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:39.000604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-225d182c-5e78-486d-919d-90f08079fe9f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/action" status: 200 len: 32 microversion: 2.1 time: 0.562660 Jul 19 20:08:39.003759 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2298/4689] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:38 2022] POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/action => generated 32 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:08:39.048455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:39.050567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:39.058901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:39.060817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:39.066534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:39.067257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.460816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:40.470502 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8ec9b18-a577-44e4-bf83-970c7a430b6f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 1.459973 Jul 19 20:08:40.477954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2299/4690] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:39 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:40.492785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:40.493290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:40.500648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.501376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.502428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.505289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.974237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:40.996577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.015363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.019467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fe5f3d9-6515-4678-a302-ab5a6931a279 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 2.188248 Jul 19 20:08:41.025601 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2392/4691] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:38 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:41.432452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.444853 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d1fd4233-dc14-4dcd-bfd2-fd1c2bb1bceb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.965264 Jul 19 20:08:41.448223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2300/4692] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:40 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:41.494106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:41.494733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:41.523981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:41.527540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:41.533922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:41.534584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:41.841824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3c18a6fa-e5f6-4271-80b2-0b96a045af44 req-d219b63e-ec46-4305-a35f-4ca5e55245b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "name": "network-vif-plugged", "status": "completed", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:41.861121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3c18a6fa-e5f6-4271-80b2-0b96a045af44 req-d219b63e-ec46-4305-a35f-4ca5e55245b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:41.861844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3c18a6fa-e5f6-4271-80b2-0b96a045af44 req-d219b63e-ec46-4305-a35f-4ca5e55245b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:41.888733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3c18a6fa-e5f6-4271-80b2-0b96a045af44 req-d219b63e-ec46-4305-a35f-4ca5e55245b3 service nova] Creating event network-vif-plugged:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:08:41.904538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3c18a6fa-e5f6-4271-80b2-0b96a045af44 req-d219b63e-ec46-4305-a35f-4ca5e55245b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065909 Jul 19 20:08:41.906382 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2301/4693] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:41.935896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.958191 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a464150a-64fd-4b56-b1c8-ffa459402464 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.464924 Jul 19 20:08:41.960431 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2393/4694] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:41 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:42.047902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:42.057026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:42.096996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.103070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.113522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.116773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.469729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:42.470779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:42.498752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.508282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.510108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.511420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.047647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.125343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.142763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.147911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38b758f8-99fe-4a27-a70e-fe5a59b2acd9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 1.109582 Jul 19 20:08:43.151339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2302/4695] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:42 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:43.171033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:43.178044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:43.208116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.209764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.213407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.214586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.266064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.372439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22cdda03-bda5-48e5-8a19-9342f08f7911 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.910585 Jul 19 20:08:43.377736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2394/4696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:42 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:43.916918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.932665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-249bb4a7-add9-460b-9718-89d8fc6c05c9 req-58009de9-5ecd-4ce6-b5c4-20bbb1e814d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "name": "network-vif-plugged", "status": "completed", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:43.996308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-249bb4a7-add9-460b-9718-89d8fc6c05c9 req-58009de9-5ecd-4ce6-b5c4-20bbb1e814d2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.998558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-249bb4a7-add9-460b-9718-89d8fc6c05c9 req-58009de9-5ecd-4ce6-b5c4-20bbb1e814d2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.001151 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b026b499-d01f-4d25-8606-7dd4fd4ceea3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.845158 Jul 19 20:08:44.018898 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2303/4697] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:43 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:44.054184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-249bb4a7-add9-460b-9718-89d8fc6c05c9 req-58009de9-5ecd-4ce6-b5c4-20bbb1e814d2 service nova] Creating event network-vif-plugged:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h1-843861-3 Jul 19 20:08:44.066573 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-249bb4a7-add9-460b-9718-89d8fc6c05c9 req-58009de9-5ecd-4ce6-b5c4-20bbb1e814d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138029 Jul 19 20:08:44.074815 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2395/4698] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:08:44.174042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:44.174620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:44.191773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.193174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.196802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.197680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.397369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:44.399525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:44.417020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.417933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.420913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.424997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.742576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:44.802705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:44.813964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:44.824322 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a51b023b-5387-4a73-a062-5f1622302e92 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.652751 Jul 19 20:08:44.828409 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2304/4699] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:44 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:45.039084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:45.039905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:45.060886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.068240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.088148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.089128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.118888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:45.132385 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c916dc2d-f56a-4395-bdac-9ac4e6756666 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1519 microversion: 2.1 time: 0.741290 Jul 19 20:08:45.142317 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2396/4700] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:44 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1519 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:45.846470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:45.847352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:45.867136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.867974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.872006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.872655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.961082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:45.965918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:46.005355 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3c593c5-7fc2-4613-a3fa-291284244da7 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.969653 Jul 19 20:08:46.011502 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2305/4701] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:45 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:46.165977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:46.171766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:46.253530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:46.254967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:46.281382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:46.283664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:46.498488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:46.520533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:46.532884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:46.541593 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-77b8c500-4ea1-4f67-98dd-0063cd3d06bd tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.697253 Jul 19 20:08:46.546910 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2397/4702] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:45 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:08:46.842995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:46.851886 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ddcc242-47c1-46af-b0fb-a84256333f99 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1504 microversion: 2.1 time: 0.696999 Jul 19 20:08:46.868612 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2306/4703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:46 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:46.882544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:46.883378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:46.909594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:46.910210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:46.915397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:46.916088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.033523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:47.034184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:47.054392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.054857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.055662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.056168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.865025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:47.877114 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58fc622b-7494-437a-9bdb-82a414e51a27 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.848142 Jul 19 20:08:47.893668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2307/4704] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:47 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:47.910075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:47.910751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:47.930376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.930839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.931632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.944629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.988185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:47.998320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8bebd877-c04b-4dec-b60c-8384787a0fc3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 200 len: 1504 microversion: 2.1 time: 1.129569 Jul 19 20:08:48.000990 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2398/4705] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:46 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 1504 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:48.039417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:48.040243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:48.066036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.066569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:48.067303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.067748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:48.126699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:48.292696 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1606319f-8aa3-47b3-85e8-7f5178142b48 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 204 len: 0 microversion: 2.1 time: 0.274246 Jul 19 20:08:48.294054 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2399/4706] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:48 2022] DELETE /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:48.542187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-490007425", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5b99d575-5525-42b0-bce9-76c4b839720c"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:48.668351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] validate_networks() for [('5b99d575-5525-42b0-bce9-76c4b839720c', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:08:48.854491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:48.871856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:48.878675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:48.881876 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9354eb2d-03a1-44a4-afd2-7f4b01596606 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.987420 Jul 19 20:08:48.885171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2308/4707] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:47 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:48.902051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:48.903760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:48.913598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.914541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:48.915701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.916837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:49.941884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:49.957094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f484e56e-c015-40b6-86c5-7c580d882032 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 1.060193 Jul 19 20:08:49.958371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2309/4708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:48 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:49.963541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-457f0ea8-b560-4125-bd28-9a50614d7a64 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Action: 'create', calling method: .version_select at 0x7fb88cddf670>, body: {"keypair": {"name": "tempest-keypair-620098174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ858Nd0h1DiSGAyy/f82sjELR6RVRMm4OCER98QnqmPETLvn4icqYTsFPWjzeUnJpC3sVviRQwnj/+el4YVBsIWkbjv0BGOvETsJupQImfec6wX79651b3gpZ7DmsAjg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:50.041264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-457f0ea8-b560-4125-bd28-9a50614d7a64 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Getting quotas for project 0f91a15924e04c8c8c173dd0975e7f01. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:08:50.077652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-457f0ea8-b560-4125-bd28-9a50614d7a64 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Getting quotas for user b862a0aa0096490c9c8bc84fc44d0412 and project 0f91a15924e04c8c8c173dd0975e7f01. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:08:50.130749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-457f0ea8-b560-4125-bd28-9a50614d7a64 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.169465 Jul 19 20:08:50.133439 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2310/4709] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 20:08:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:08:50.153477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:50.154845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:50.174002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.176292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.181194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.183143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.895323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:50.906161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:50.911750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:50.915933 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e22ed439-a2cc-4e79-8e86-dc1d5e6df8a3 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.781085 Jul 19 20:08:50.916644 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2311/4710] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:50 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:50.976988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:50.977689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:50.989792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.992143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.994471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.995444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.543383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:52.577863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-686ab063-1c30-435a-9a46-e915724ab2f8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 1.598808 Jul 19 20:08:52.579323 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2312/4711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:50 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:52.589473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:52.601900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:52.644380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.645306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.648149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.658303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.830398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:08:52.831970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:08:52.833455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:08:52.834065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:08:52.834981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:08:52.840113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:52.869443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.871036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.874549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.876727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.926520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:08:52.936823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for user fc1c7582f89d40549e8ddeb39285c030 and project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:08:52.983754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:08:52.988986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:08:53.129112 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4dbf63e3-b542-47cb-9eb4-08f1b345b4ff tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.590818 Jul 19 20:08:53.131617 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2400/4712] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:08:53.152392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-765669a9-1fec-4b77-a712-8086570f3361 req-aa895669-f454-41e3-bfda-3f33fd847e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "name": "network-vif-unplugged", "status": "completed", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:53.186175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-765669a9-1fec-4b77-a712-8086570f3361 req-aa895669-f454-41e3-bfda-3f33fd847e81 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:53.186920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-765669a9-1fec-4b77-a712-8086570f3361 req-aa895669-f454-41e3-bfda-3f33fd847e81 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:53.223555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-765669a9-1fec-4b77-a712-8086570f3361 req-aa895669-f454-41e3-bfda-3f33fd847e81 service nova] Creating event network-vif-unplugged:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:08:53.236964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-765669a9-1fec-4b77-a712-8086570f3361 req-aa895669-f454-41e3-bfda-3f33fd847e81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098466 Jul 19 20:08:53.238029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2401/4713] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:53.249574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-465c1462-a0bb-4ff0-8b77-5ed869137743 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:53.251525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-465c1462-a0bb-4ff0-8b77-5ed869137743 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:53.615855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-465c1462-a0bb-4ff0-8b77-5ed869137743 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:53.624106 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-465c1462-a0bb-4ff0-8b77-5ed869137743 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1217 microversion: 2.1 time: 0.384630 Jul 19 20:08:53.628747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2402/4714] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:53 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:53.639778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:53.641438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:53.661842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:53.666128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:53.667458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:53.670934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:53.804092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:53.821275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:53.829098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:53.830332 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5035a120-6de3-4824-a07e-5109a4e30d98 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 1.248001 Jul 19 20:08:53.835736 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2313/4715] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:52 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:54.646775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:54.647402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:54.675779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.680923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.682065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.682685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.882017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:54.897365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a90ab573-16c3-4d50-b095-9e6c713541af tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1213 microversion: 2.1 time: 0.251215 Jul 19 20:08:54.900313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2314/4716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:54 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:54.924537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:54.926138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:54.960651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.964726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.969498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.978004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:54.983210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.030728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47ae89c3-625d-4ea9-bc74-2c9e970ffd17 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 1.400208 Jul 19 20:08:55.039104 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2403/4717] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:53 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:55.070193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-689f9c3b-b44e-4d4c-89fb-538416dcd4a0 req-50539e5c-18d7-4fe0-9122-9a8c5e34da4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b63046-3394-47fd-b567-9a0977c2d05d", "name": "network-vif-deleted", "tag": "95711da3-28d9-46f5-8a5b-e08affdc6d48"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:55.112002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-689f9c3b-b44e-4d4c-89fb-538416dcd4a0 req-50539e5c-18d7-4fe0-9122-9a8c5e34da4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.112518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-689f9c3b-b44e-4d4c-89fb-538416dcd4a0 req-50539e5c-18d7-4fe0-9122-9a8c5e34da4d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.135581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:55.238146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-689f9c3b-b44e-4d4c-89fb-538416dcd4a0 req-50539e5c-18d7-4fe0-9122-9a8c5e34da4d service nova] Creating event network-vif-deleted:95711da3-28d9-46f5-8a5b-e08affdc6d48 for instance c8b63046-3394-47fd-b567-9a0977c2d05d on n-h2-843861-3 Jul 19 20:08:55.251476 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-689f9c3b-b44e-4d4c-89fb-538416dcd4a0 req-50539e5c-18d7-4fe0-9122-9a8c5e34da4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208613 Jul 19 20:08:55.253409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2404/4718] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:55.446527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:55.481304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:55.492576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:55.498313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f9930c0-8fab-4def-9970-edc54f513234 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.596431 Jul 19 20:08:55.500962 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2315/4719] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:54 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:55.930045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:55.937702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:55.965155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.965960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.966916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.968776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.062965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:56.085429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:56.142899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.144154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.161020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.161821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.422901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:56.434949 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1dcf69f2-27fc-4267-ba1a-55d2484380f3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1287 microversion: 2.1 time: 0.519386 Jul 19 20:08:56.437705 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2405/4720] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:55 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1287 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:56.519579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:56.520479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:56.540298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.541110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.542284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.543001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.730925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:56.742029 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5705e7c7-6df9-4372-baa9-3f270c8f133c tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.690630 Jul 19 20:08:56.747830 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2316/4721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:56 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:56.938220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:56.971481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:56.994511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:57.007089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43012f8e-90b5-4cc5-8d4c-2843982cf509 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.490480 Jul 19 20:08:57.036617 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2406/4722] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:56 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:57.455175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:57.456550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:57.475382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:57.475879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:57.480293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:57.480293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:57.766051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:57.767257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:57.785980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:57.786353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:57.796655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:57.797124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:57.858091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:57.877497 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eb75ee93-f932-4d03-a5cc-88f98eaaaf9d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1275 microversion: 2.1 time: 0.427226 Jul 19 20:08:57.892065 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2317/4723] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:57 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1275 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:58.057075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:58.057777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:58.074563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.075103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.075962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.076408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.569010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:58.598759 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6766ebc-9b71-4213-a824-1cec8264497e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.836441 Jul 19 20:08:58.600624 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2407/4724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:57 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:58.881933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:58.900398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:58.902552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:58.916154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:58.921999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.924785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:58.928259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.929154 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-94db0ad7-9444-49b4-b35a-1eb1fb729b01 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.878021 Jul 19 20:08:58.941049 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2318/4725] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:58 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:08:58.944634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.945676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.513763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:59.528583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-800a38c7-032f-4351-bfb5-264cb6f780b3 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1317 microversion: 2.1 time: 0.633477 Jul 19 20:08:59.529862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2408/4726] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:58 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:59.626412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:59.629573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:59.695223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:59.764187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.765838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.804984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.806500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.967003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:59.973217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:59.988994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.992070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.993497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.994268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.105634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:00.461418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:00.476535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:00.482635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:00.489370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d4b3836-d556-43a3-bc5e-35e101274a22 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.537514 Jul 19 20:09:00.491137 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2409/4727] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:08:59 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:00.541923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:00.561724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:00.562709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:00.571977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:00.572814 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87a281a4-b85d-4472-8a19-0a2eb74791c6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.953663 Jul 19 20:09:00.577336 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2319/4728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:59 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:00.578517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.579778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:00.585111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.630311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f0faff4e-c6db-458e-b4a5-edc9fe25cf96 req-4c6bab79-deb4-4f6c-b4a4-6f8f297ac789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb5f490-9d12-4e0f-987c-663df22737b4", "tag": "a0456225-f8b3-407e-879e-a2e83988936c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:00.666241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f0faff4e-c6db-458e-b4a5-edc9fe25cf96 req-4c6bab79-deb4-4f6c-b4a4-6f8f297ac789 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:00.666919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f0faff4e-c6db-458e-b4a5-edc9fe25cf96 req-4c6bab79-deb4-4f6c-b4a4-6f8f297ac789 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.714466 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f0faff4e-c6db-458e-b4a5-edc9fe25cf96 req-4c6bab79-deb4-4f6c-b4a4-6f8f297ac789 service nova] Creating event network-changed:a0456225-f8b3-407e-879e-a2e83988936c for instance beb5f490-9d12-4e0f-987c-663df22737b4 on n-h1-843861-3 Jul 19 20:09:00.727529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f0faff4e-c6db-458e-b4a5-edc9fe25cf96 req-4c6bab79-deb4-4f6c-b4a4-6f8f297ac789 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104895 Jul 19 20:09:00.734615 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2320/4729] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:01.273661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1035134103", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "54b26bce-f122-4a71-890d-c75b417ec719"}, {"port": "2e04abcc-cf0d-40e7-9ff0-9148189849c0", "tag": "port-1"}, {"port": "9aba40e6-cab2-4180-b28b-61e0f930d0ff", "tag": "port-2"}, {"uuid": "9bc861e3-1376-4a83-b237-db9b539451ad", "tag": "net-1"}, {"uuid": "9bc861e3-1376-4a83-b237-db9b539451ad"}, {"uuid": "13ec0afe-5109-46ef-a4fe-e3ea3ddbbfc4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "13ec0afe-5109-46ef-a4fe-e3ea3ddbbfc4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9b87ac44-9bb0-474a-ac2d-d672c2d145e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4449cc4d-4f00-4370-a48c-6d52de6d91d8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "939d3e76-3aef-4966-acfd-bc803edb153d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--257939613"}], "key_name": "tempest-keypair-620098174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:01.456381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:01.474435 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6c58673-3713-4400-b169-ce12bd6eba27 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1317 microversion: 2.1 time: 0.917999 Jul 19 20:09:01.477726 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2410/4730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:00 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1317 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:01.659575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] validate_networks() for [('54b26bce-f122-4a71-890d-c75b417ec719', None, None, None, None, None), (None, None, '2e04abcc-cf0d-40e7-9ff0-9148189849c0', None, None, None), (None, None, '9aba40e6-cab2-4180-b28b-61e0f930d0ff', None, None, None), ('9bc861e3-1376-4a83-b237-db9b539451ad', None, None, None, None, None), ('9bc861e3-1376-4a83-b237-db9b539451ad', None, None, None, None, None), ('13ec0afe-5109-46ef-a4fe-e3ea3ddbbfc4', '10.2.2.100', None, None, None, None), ('13ec0afe-5109-46ef-a4fe-e3ea3ddbbfc4', '10.2.2.200', None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:01.827976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-260930010", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:02.001720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:02.002882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:02.003395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:02.009706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:02.010915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:02.032795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.033857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:02.036730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.040634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:02.102491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Getting quotas for project 2774c08a6a7744c2ba064853cd2cf31e. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:02.152964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Getting quotas for user 0b173e1279bb496499203ff6706a8913 and project 2774c08a6a7744c2ba064853cd2cf31e. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:02.186458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:02.188997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:02.303954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e61eae21-0a95-4728-b639-5f31f5d31235 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.824478 Jul 19 20:09:02.305388 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2411/4731] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:09:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:09:02.328205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:02.332484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:02.362778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.363249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:02.368232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.371557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.071996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:03.107237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:03.118011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:03.121798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3643db6b-f3c6-408d-ae6e-19f4d9da9e88 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.815100 Jul 19 20:09:03.122433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2412/4732] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:02 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:03.150988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:03.152185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:03.179945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:03.184290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.192057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:03.194656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.010001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:05.038323 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b57825a1-19a1-4e7b-a08a-801036f8ccf8 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 1.908618 Jul 19 20:09:05.047859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2413/4733] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:03 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:05.086332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:05.088140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:05.112561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:05.113608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.114918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:05.116667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.568238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:05.602709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:05.610431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:05.614577 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1677b104-69af-4b87-91ce-c29021add967 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 200 len: 1335 microversion: 2.47 time: 0.563641 Jul 19 20:09:05.650860 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2414/4734] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:05 2022] GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 1335 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:05.664257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:05.670226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:05.699491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:05.702218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.705421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:05.706135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:06.512188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:06.531747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94c0f2aa-23ea-4f0e-b4ac-1a424ee56333 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1317 microversion: 2.1 time: 0.872018 Jul 19 20:09:06.534197 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2415/4735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:05 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:06.541916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:06.542705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:06.559016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:06.559743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:06.565635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:06.566325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.409911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:07.424656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:07.429572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:07.431688 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa0100b1-ac6d-4947-a441-a85d76254970 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.895471 Jul 19 20:09:07.433092 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2416/4736] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:06 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:07.438824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-327501360", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:07.602873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:07.604139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:07.604875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:07.608152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:07.608859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:07.655789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.659954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.673148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.685894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.707660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Getting quotas for project 2774c08a6a7744c2ba064853cd2cf31e. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:07.721660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Getting quotas for user 0b173e1279bb496499203ff6706a8913 and project 2774c08a6a7744c2ba064853cd2cf31e. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:07.803752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:07.818564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:07.906356 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a3762c1-4f3d-49a8-8f7c-017b374d0de4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.471618 Jul 19 20:09:07.907957 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2417/4737] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:09:07.917362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:07.918650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:07.937609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.939689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.941572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.942591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:08.763351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:08.777388 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ea458e1-2502-4740-83d9-72f4df0cecdc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.867682 Jul 19 20:09:08.783219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2418/4738] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:07 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:08.801940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-88533d79-a3cd-43f9-9142-0004a78e17ff req-17301737-7c8e-4960-967d-5ef5d68baeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb5f490-9d12-4e0f-987c-663df22737b4", "name": "network-vif-plugged", "status": "completed", "tag": "a0456225-f8b3-407e-879e-a2e83988936c"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:08.837214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-88533d79-a3cd-43f9-9142-0004a78e17ff req-17301737-7c8e-4960-967d-5ef5d68baeae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:08.838222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-88533d79-a3cd-43f9-9142-0004a78e17ff req-17301737-7c8e-4960-967d-5ef5d68baeae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:08.892031 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-88533d79-a3cd-43f9-9142-0004a78e17ff req-17301737-7c8e-4960-967d-5ef5d68baeae service nova] Creating event network-vif-plugged:a0456225-f8b3-407e-879e-a2e83988936c for instance beb5f490-9d12-4e0f-987c-663df22737b4 on n-h1-843861-3 Jul 19 20:09:08.922582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-88533d79-a3cd-43f9-9142-0004a78e17ff req-17301737-7c8e-4960-967d-5ef5d68baeae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125332 Jul 19 20:09:08.932298 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2419/4739] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:08.961896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:08.966241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:08.999617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.000548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.005605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.006589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.956923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:09.977766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-433dd432-0462-4c42-a836-a1c269e6c2f9 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1317 microversion: 2.1 time: 1.036759 Jul 19 20:09:09.977766 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2420/4740] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:08 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1317 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:09.993382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:09.995272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.016444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.017526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.022562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.023697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.091035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1927eb68-67ea-48b4-a9c0-da09d9bf9448 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "PUT /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 991 microversion: 2.47 time: 0.111484 Jul 19 20:09:10.092297 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2421/4741] 10.222.0.33 () {62 vars in 1296 bytes} [Tue Jul 19 20:09:09 2022] PUT /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:09:10.098601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:10.099449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.115488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.116887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.121946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.122418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.475856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.487864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.489683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.491764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-299b4509-28b4-4408-8bab-6f0981a7d105 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1740 microversion: 2.20 time: 0.398013 Jul 19 20:09:10.507412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2422/4742] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:10 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:10.517860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:10.521579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.533092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.533926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.534886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.535491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.713058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=81 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:10.870877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.876405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:10.889733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb293020-0c44-433e-9cf6-1a4c322252b0 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1734 microversion: 2.1 time: 0.376007 Jul 19 20:09:10.903457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2423/4743] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:10 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1734 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:10.917710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:10.918353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.947720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.948126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.950739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.957142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.088592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.103083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.104910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.106279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9149e29-8ca7-4d53-853d-f1470f5a9f62 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1337 microversion: 2.47 time: 0.201521 Jul 19 20:09:11.109142 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2424/4744] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:10 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1337 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:11.124689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:11.125568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:11.138739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.139194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.140028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.140668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.612603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.648413 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ca68571-8d6d-4474-8ce9-83af338a55a5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1505 microversion: 2.1 time: 0.534485 Jul 19 20:09:11.655410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2425/4745] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:11 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:11.665596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:11.666379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:11.677966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.678959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.680677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.681448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.595610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:12.596832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:12.597174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:12.597848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:12.598539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:12.598954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:12.614837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.615486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.617077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.618086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.621629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:12.627266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:12.628887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5cb21fe4-fdd6-4fbb-a112-e1d84a912bd6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1722 microversion: 2.20 time: 0.970113 Jul 19 20:09:12.630004 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2426/4746] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:11 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1722 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:12.649405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:12.650802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:12.667702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.668437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.670894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Getting quotas for project 0f91a15924e04c8c8c173dd0975e7f01. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:12.676891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.677222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Getting quotas for user b862a0aa0096490c9c8bc84fc44d0412 and project 0f91a15924e04c8c8c173dd0975e7f01. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:12.677367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.020599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:13.024198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9b87ac44-9bb0-474a-ac2d-d672c2d145e5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4449cc4d-4f00-4370-a48c-6d52de6d91d8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='939d3e76-3aef-4966-acfd-bc803edb153d',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:13.108956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.117794 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-babc21b1-bcc9-49d9-84b4-6872bfde3d7b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1505 microversion: 2.1 time: 0.483271 Jul 19 20:09:13.131065 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2427/4747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:12 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:13.152256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:13.153194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:13.161649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.165910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.166751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.167199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.765385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.794932 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e849f89a-7096-4f6b-b33b-547ce55cb3be tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1714 microversion: 2.1 time: 0.662611 Jul 19 20:09:13.820516 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2428/4748] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:13 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1714 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:13.826387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:13.827228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:13.833176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:13.835558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.836225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.837446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.838039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.965469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.990517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.995403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.998929 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3f228f9b-7822-4a30-9ece-9c90dafdb627 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1335 microversion: 2.47 time: 0.176141 Jul 19 20:09:14.001416 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2429/4749] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:13 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1335 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:14.018488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:14.056119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3e07a86-adec-4d7c-a5f1-491914c2b5ff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 12.790111 Jul 19 20:09:14.057117 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2321/4750] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Jul 19 20:09:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 12793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:09:14.062653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.063478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.070867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.072530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.073138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.074232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.074821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.095157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.095897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.100600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.104367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.290064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73466b6f-1db4-4720-ad43-26c51549954a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "PUT /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1077 microversion: 2.1 time: 0.284910 Jul 19 20:09:14.291893 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2430/4751] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:09:14 2022] PUT /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1077 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:14.297438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.298348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.440445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.446647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.453143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.459610 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18acec58-2b05-4d12-a4e9-f1ad668b47a9 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1285 microversion: 2.32 time: 0.165299 Jul 19 20:09:14.461477 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2431/4752] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:14 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:14.469999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.473365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.474740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.485845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.486991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.487175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.490785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.491661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.493047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.498203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5fe5874-79db-4099-ad82-9f54d0a6b8f5 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1722 microversion: 2.20 time: 0.436411 Jul 19 20:09:14.502844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2322/4753] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:14 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:14.528313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.528939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.545462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.546383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.551288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.553120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.699151 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Cannot 'detach_volume' instance 7fac2431-a538-4423-b3f7-ebb74df16f1a while it is in vm_state rescued Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments/308f2996-34a4-4cad-9656-6275c5a4e4e3 HTTP/1.1 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'detach_volume' instance 7fac2431-a538-4423-b3f7-ebb74df16f1a while it is in vm_state rescued Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '7fac2431-a538-4423-b3f7-ebb74df16f1a', 'id': '308f2996-34a4-4cad-9656-6275c5a4e4e3'} Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7fac2431-a538-4423-b3f7-ebb74df16f1a while it is in vm_state rescued Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:09:14.702790 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7fac2431-a538-4423-b3f7-ebb74df16f1a while it is in vm_state rescued Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 409 to user: Cannot 'detach_volume' instance 7fac2431-a538-4423-b3f7-ebb74df16f1a while it is in vm_state rescued {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:09:14.707697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74e49ac0-f028-41bb-8aa6-7894ecc2a5f9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments/308f2996-34a4-4cad-9656-6275c5a4e4e3" status: 409 len: 152 microversion: 2.1 time: 0.236188 Jul 19 20:09:14.709730 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2432/4754] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:09:14 2022] DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments/308f2996-34a4-4cad-9656-6275c5a4e4e3 => generated 152 bytes in 247 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:09:14.720325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:14.726082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.737252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.738366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.739946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.741476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.887839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-72eaf733-b647-4846-ba92-211a358b110f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/action" status: 202 len: 0 microversion: 2.1 time: 0.172758 Jul 19 20:09:14.892552 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2433/4755] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:09:14 2022] POST /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:09:14.905603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.906582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.920266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.921188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.922336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.922948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.175258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.184372 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a3e4895-5f5a-4409-8d97-af3e9b7bcb4b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1503 microversion: 2.1 time: 0.677004 Jul 19 20:09:15.186266 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2323/4756] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:14 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1503 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:15.203366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:15.204373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:15.217924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.218389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.227313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.228086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.675291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.695194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.700104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.704937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-61deed2a-7e6c-48c6-958a-22d03f616f1b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1335 microversion: 2.47 time: 0.514249 Jul 19 20:09:15.708037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2324/4757] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:15 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1335 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:15.717844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:15.724426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:15.744234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.745853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.746969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.747404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.767178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.786924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecd0b971-7ae6-40e4-86bb-56285b6a087d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1722 microversion: 2.1 time: 0.885884 Jul 19 20:09:15.788170 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2434/4758] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:14 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1722 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:15.807507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-491cf1a1-71a2-44f5-bff1-ea7f56c8cc96 req-e50fb6e5-b5ab-4f77-ac1c-b3c62b51f901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "name": "network-vif-unplugged", "status": "completed", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:15.829628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-491cf1a1-71a2-44f5-bff1-ea7f56c8cc96 req-e50fb6e5-b5ab-4f77-ac1c-b3c62b51f901 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.830097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-491cf1a1-71a2-44f5-bff1-ea7f56c8cc96 req-e50fb6e5-b5ab-4f77-ac1c-b3c62b51f901 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.857787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.compute.server_external_events [req-491cf1a1-71a2-44f5-bff1-ea7f56c8cc96 req-e50fb6e5-b5ab-4f77-ac1c-b3c62b51f901 service nova] Unable to find a host for instance 00bf3a02-8ecc-4df0-b623-df28efee120b. Dropping event network-vif-unplugged {{(pid=126008) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:09:15.863305 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-491cf1a1-71a2-44f5-bff1-ea7f56c8cc96 req-e50fb6e5-b5ab-4f77-ac1c-b3c62b51f901 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072173 Jul 19 20:09:15.867465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2435/4759] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 20:09:15.883453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:15.886773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:15.908729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.909761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:15.910589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:15.913220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.140084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.156822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.158920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.162628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c915970-c395-417e-b7d1-4bf0deab1c54 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1527 microversion: 2.32 time: 0.292512 Jul 19 20:09:16.165672 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2436/4760] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:15 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:16.178822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:16.179475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.195011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.195468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.204472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.204941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.322652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.340030 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77cd3b66-2823-450b-879e-fc44ef11da9b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1503 microversion: 2.1 time: 0.629362 Jul 19 20:09:16.356488 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2325/4761] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:15 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1503 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:16.363197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:16.366197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.373345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.374994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.376154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.376564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.478118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.500645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.502798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.504768 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a338dbba-758b-4716-9e97-3e72dfa6878b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1665 microversion: 2.20 time: 0.337285 Jul 19 20:09:16.506102 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2437/4762] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:16 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1665 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:16.533392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ca8f295-f732-4b8d-923d-ea742440f565"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:16.535087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.553470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:16.554047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:16.554760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:16.555283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.555775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.556607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.557050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.572276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:16.573202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:16.761397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.776633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.777099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.781837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.794227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.893052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a5b64bd-1074-4bdb-ae71-5b3ab68b3f36 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "POST /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4/action" status: 202 len: 1109 microversion: 2.1 time: 0.535214 Jul 19 20:09:16.895934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2326/4763] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:09:16 2022] POST /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4/action => generated 1109 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 20:09:16.903696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:16.904640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.913295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.914079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.915133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.915732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.032743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:17.197536 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a25c1a3b-e2ad-471c-a19f-bd61809f8ed6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.676107 Jul 19 20:09:17.199138 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2438/4764] 10.222.0.33 () {62 vars in 1363 bytes} [Tue Jul 19 20:09:16 2022] POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments => generated 188 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:09:17.234530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:17.235195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:17.281293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.282165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.282762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.283206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.324782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:17.367769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:17.377713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:17.382412 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb930bb2-90c9-4180-98e1-656e4ea367cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1356 microversion: 2.47 time: 0.484588 Jul 19 20:09:17.383835 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2327/4765] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:16 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1356 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:17.402933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:17.403856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:17.417707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.423231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.424178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.425602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.689728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:17.923190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:17.935611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-707e2eeb-b134-4e31-b559-29c5b95f6f96 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1722 microversion: 2.1 time: 0.734239 Jul 19 20:09:17.939897 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2439/4766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:17 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1722 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:17.953362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:17.961156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:17.969251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.970496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:17.974858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:17.975598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.102375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.123168 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf09a852-9db0-4d53-9d67-3714d6dca5cb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.725731 Jul 19 20:09:18.124713 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2328/4767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:17 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:18.136016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:18.137471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:18.177297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.177781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.178627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.179070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.202790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.228826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.235830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.239557 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83313e57-1581-4a07-9e47-ad554ed9acfa tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1593 microversion: 2.32 time: 0.297766 Jul 19 20:09:18.240820 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2440/4768] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:17 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1593 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:18.246753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:18.248217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:18.256439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.257259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.259762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.260497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.436765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:18.437514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:18.437514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:18.437960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:18.442094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:18.673502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:18.698988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.699357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.701164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.701164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.767467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5cb610c9-824b-49ac-bf56-7d04bf77d7a1 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "POST /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f/action" status: 202 len: 1078 microversion: 2.47 time: 0.641284 Jul 19 20:09:18.780556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2329/4769] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 20:09:18 2022] POST /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f/action => generated 1078 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 20:09:18.791101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:18.792017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:18.803495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.809446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.810990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.815286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.959400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.972849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.974576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:18.977271 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d58e479-f68e-444b-9c3d-f8c385179848 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.190183 Jul 19 20:09:18.980750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2330/4770] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:18 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:18.995661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:18.996368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:19.023013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.028762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.033591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.034025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.102018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e7c6f97-dc46-4104-b41d-d125f998a68b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments/8ca8f295-f732-4b8d-923d-ea742440f565" status: 202 len: 0 microversion: 2.20 time: 0.859725 Jul 19 20:09:19.107074 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2441/4771] 10.222.0.33 () {60 vars in 1456 bytes} [Tue Jul 19 20:09:18 2022] DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments/8ca8f295-f732-4b8d-923d-ea742440f565 => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:09:19.156752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:19.158361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:19.207510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.214097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.218146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.225039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.587453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:19.605664 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d77524e-3c29-43e7-8bf8-f212054bf63f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1722 microversion: 2.1 time: 0.623582 Jul 19 20:09:19.609073 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2331/4772] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:18 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1722 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:19.622896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:19.628826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:19.660771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.661552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.670192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.672722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.750838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:19.766589 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9932c39a-3df0-420e-bd99-fed147101456 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.611789 Jul 19 20:09:19.770510 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2442/4773] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:19 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:19.784122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:19.788765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:19.799024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.799758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:19.801416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:19.802045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.013017 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e691a931-40ca-4471-a270-399592e49112 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/action" status: 202 len: 0 microversion: 2.20 time: 0.240566 Jul 19 20:09:20.016599 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2443/4774] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 19 20:09:19 2022] POST /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:09:20.036274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:20.038303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:20.041661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.054245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.063021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.065862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.066175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.067417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.067853 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e542e0ab-7d65-4f39-bf4e-39ab9d236683 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1660 microversion: 2.32 time: 0.455188 Jul 19 20:09:20.069193 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2332/4775] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:19 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1660 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:20.073705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.096541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:20.101017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:20.117834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.118295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.119094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.119517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.482827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.493104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.494771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.495948 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9737601a-d036-426d-9403-14d22130ed80 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.477927 Jul 19 20:09:20.496534 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2444/4776] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:20 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:20.631242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:20.632896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:20.634928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.645101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.646613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.648308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.649670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.650003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.651535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:20.652785 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-243be34b-8c2a-4870-9335-86b14555f5c1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1673 microversion: 2.20 time: 0.565218 Jul 19 20:09:20.653369 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2333/4777] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:20 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1673 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:20.790244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:20.791126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:20.810893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.811351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.812190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.812635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.851763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:21.406384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:21.418424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95d4d881-3180-4459-80c2-e3a2bffdfa69 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1728 microversion: 2.1 time: 0.794641 Jul 19 20:09:21.431342 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2445/4778] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:20 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1728 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:21.431342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:21.431342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:21.449213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.451374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:21.454573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.455246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:21.520471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:21.531914 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b8b01d0-1bf4-4575-ba44-69875ac237b7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.747131 Jul 19 20:09:21.538375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2334/4779] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:20 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:21.550416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:21.550924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:21.561480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.561935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:21.562809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.563253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:21.829368 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9435c905-b6b5-45f3-9f1b-cf6bab3ee6d5 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289776 Jul 19 20:09:21.830665 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2335/4780] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:09:21 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:21.835658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:21.838690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:21.855039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.861751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:21.863259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:21.864095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.306205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.327422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.331957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.339180 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30e85716-e8e7-4042-828d-d62ee1fd8897 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1706 microversion: 2.32 time: 0.914531 Jul 19 20:09:22.341423 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2446/4781] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:21 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1706 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:22.357282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:22.358278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:22.380944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.381835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.385168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.388389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.551749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.573181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.581217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.584856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5fc8128-e1ab-4620-9718-878ceeb968f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.750693 Jul 19 20:09:22.585471 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2336/4782] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:21 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:22.604972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:22.610167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:22.620217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.620688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.625973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.626689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.669438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:22.696978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:22.846029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.866760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.880918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:22.884651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e664f4ed-08aa-4472-81c9-756d4f9e92cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.539737 Jul 19 20:09:22.885281 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2447/4783] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:22 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:23.051233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:23.063651 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c53eb43a-d9dc-44cc-a61e-036bb5bafc67 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.471996 Jul 19 20:09:23.065948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2337/4784] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:22 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:23.361408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:23.362799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:23.379348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:23.380421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:23.385292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:23.387210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:23.610657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:23.611216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:23.629497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:23.641609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:23.644827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:23.645656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.411319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.436316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.437188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=22 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:24.447047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.452609 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1019c730-c223-427f-8819-6282fb716f35 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.845921 Jul 19 20:09:24.457503 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2338/4785] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:23 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:24.483015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:24.485691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:24.527637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.533588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.534902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.540056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.593976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.605882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.618943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.620242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ce900805-0dbf-4f98-93c3-0eebb3c35527 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1706 microversion: 2.32 time: 1.263231 Jul 19 20:09:24.624261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2448/4786] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:23 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1706 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:24.653995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:24.656679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:24.678019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.691424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.696430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.697395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:25.567238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:25.590229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:25.615109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:25.617342 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60d85cc2-e460-4a55-a0b9-78c7a5fafba6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.981769 Jul 19 20:09:25.618073 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2449/4787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:24 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:25.627113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:25.637216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-cfa1521b-f596-4806-b556-ecfb9444b1a3 req-825fcb94-feb5-445c-975f-7ea1ebe08830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:25.637909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d92302a-59a2-45a4-bd70-9e3800e25782 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 1.160450 Jul 19 20:09:25.650525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2339/4788] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:24 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:25.654077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:25.654701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:25.675661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:25.676144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:25.679047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:25.679250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cfa1521b-f596-4806-b556-ecfb9444b1a3 req-825fcb94-feb5-445c-975f-7ea1ebe08830 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:25.683359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cfa1521b-f596-4806-b556-ecfb9444b1a3 req-825fcb94-feb5-445c-975f-7ea1ebe08830 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:25.694281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:25.701712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-cfa1521b-f596-4806-b556-ecfb9444b1a3 req-825fcb94-feb5-445c-975f-7ea1ebe08830 service nova] Creating event network-changed:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:09:25.710700 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-cfa1521b-f596-4806-b556-ecfb9444b1a3 req-825fcb94-feb5-445c-975f-7ea1ebe08830 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079456 Jul 19 20:09:25.712536 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2450/4789] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:25.733357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:25.737171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:25.752471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:25.753733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:25.757447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:25.759386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.107370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.133817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.138609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.140790 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08c44535-b62f-4bc0-a6e4-49c2922d2824 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.500108 Jul 19 20:09:26.145605 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2340/4790] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:25 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:26.186101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-503cc60b-7cc9-4cc1-8c70-5e18024818b0 req-e5596437-33b0-402d-8c12-04a0844a86e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:26.202996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-503cc60b-7cc9-4cc1-8c70-5e18024818b0 req-e5596437-33b0-402d-8c12-04a0844a86e3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.204330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-503cc60b-7cc9-4cc1-8c70-5e18024818b0 req-e5596437-33b0-402d-8c12-04a0844a86e3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.262891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-503cc60b-7cc9-4cc1-8c70-5e18024818b0 req-e5596437-33b0-402d-8c12-04a0844a86e3 service nova] Creating event network-changed:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h2-843861-3 Jul 19 20:09:26.293180 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-503cc60b-7cc9-4cc1-8c70-5e18024818b0 req-e5596437-33b0-402d-8c12-04a0844a86e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112030 Jul 19 20:09:26.297895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2341/4791] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:26.646697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:26.649566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:26.679436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.696615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.698377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.698834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.751872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.755120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:26.793970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.805765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.820504 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb827573-e6b7-4140-9310-b653655034b3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1752 microversion: 2.32 time: 1.105502 Jul 19 20:09:26.827397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2451/4792] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:25 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1752 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:26.857711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:26.870424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:26.901805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.902530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.908934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.909649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:27.559257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:27.571546 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fde808a9-cd59-4b28-9f0c-fa79e524668c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.940437 Jul 19 20:09:27.577482 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2342/4793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:26 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:27.588338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:27.606521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:27.621922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:27.626715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:27.632253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:27.635327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.118174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.135234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.143571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.157461 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63444c80-0c62-422a-a08e-a5e3cd9a3332 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 1.324477 Jul 19 20:09:28.165158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2452/4794] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:26 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:28.191275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b3dbe064-01bc-47bf-b0cb-d9fca47dcb43 req-0c103bfd-feee-49f1-85aa-5eb566f93356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:28.224904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b3dbe064-01bc-47bf-b0cb-d9fca47dcb43 req-0c103bfd-feee-49f1-85aa-5eb566f93356 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:28.229461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b3dbe064-01bc-47bf-b0cb-d9fca47dcb43 req-0c103bfd-feee-49f1-85aa-5eb566f93356 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.281729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b3dbe064-01bc-47bf-b0cb-d9fca47dcb43 req-0c103bfd-feee-49f1-85aa-5eb566f93356 service nova] Creating event network-changed:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:09:28.304978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b3dbe064-01bc-47bf-b0cb-d9fca47dcb43 req-0c103bfd-feee-49f1-85aa-5eb566f93356 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138049 Jul 19 20:09:28.312765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2453/4795] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:28.332354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:28.334756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:28.350821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:28.351490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.356882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:28.358804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.734015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.756994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.764451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.773458 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7af60ee5-c7c9-465e-8a0c-0bbaecac1d60 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 1.193919 Jul 19 20:09:28.778045 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2343/4796] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:27 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:28.792180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:28.792917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:28.812158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:28.814060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.815484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:28.816130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.911186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.933404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.936045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.945106 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-494e2874-cc76-4434-a7e2-6c33f76bc8d0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1798 microversion: 2.32 time: 0.623531 Jul 19 20:09:28.949233 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2454/4797] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:28 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1798 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:29.183273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:29.184018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:29.241041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.241730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.245967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.246525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.543742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:29.559667 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c198f0f1-1916-498f-be0f-630c71d739e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.775489 Jul 19 20:09:29.575919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2344/4798] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:28 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:29.727484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:29.737294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:29.761736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:29.764930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3f6b6e3-cf58-4436-8298-1dc0d671d7b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.585975 Jul 19 20:09:29.771961 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2455/4799] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:29 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:29.804870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:29.815024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:29.837524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:29.853069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.854351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.854351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.855005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.971686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:29.972711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:30.004368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:30.008937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:30.012483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:30.015902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:30.517162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:30.564802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:30.573799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:30.581697 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1af9f07-4496-4513-a6ea-252023d8f567 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.784356 Jul 19 20:09:30.594596 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2345/4800] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:29 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:30.619699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:30.631499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:30.680471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:30.681473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:30.683068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:30.684235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:31.354138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:31.376992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:31.386729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:31.393527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e65f0f21-94a7-4497-b859-fc4495682a7a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1844 microversion: 2.32 time: 1.423822 Jul 19 20:09:31.407378 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2456/4801] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:29 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1844 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:31.431211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:31.436718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:31.489683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:31.490226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:31.495193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:31.495784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:32.325310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.338912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d826073-5905-4bb6-9d3b-6863dc78bd39 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 1.737977 Jul 19 20:09:32.346641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2346/4802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:30 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:32.371594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:32.380064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:32.417635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:32.419590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:32.420830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:32.421636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:32.910201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.924229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.929620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.931087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41897948-9473-45f6-9703-9f19590ac6a0 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.566552 Jul 19 20:09:32.944740 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2347/4803] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:32 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:32.952884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-18b90f2c-d53e-4105-98f0-e0ec76eca75d req-94f709fb-7296-4376-ae20-fdf53406ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "82b499e7-3534-4427-9fd5-db274d819339"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:32.969584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.981645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18b90f2c-d53e-4105-98f0-e0ec76eca75d req-94f709fb-7296-4376-ae20-fdf53406ea37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:32.983451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.987961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.989206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18b90f2c-d53e-4105-98f0-e0ec76eca75d req-94f709fb-7296-4376-ae20-fdf53406ea37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:32.996457 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e9b4ab3-03f7-4b15-9cef-f1ebb2e83aff tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 1.584635 Jul 19 20:09:33.013433 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2457/4804] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:31 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:33.024017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:33.034485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:33.049207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-18b90f2c-d53e-4105-98f0-e0ec76eca75d req-94f709fb-7296-4376-ae20-fdf53406ea37 service nova] Creating event network-changed:82b499e7-3534-4427-9fd5-db274d819339 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:33.057890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.058719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:33.059697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.061661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-18b90f2c-d53e-4105-98f0-e0ec76eca75d req-94f709fb-7296-4376-ae20-fdf53406ea37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113432 Jul 19 20:09:33.062456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:33.071493 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2348/4805] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:33.369872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:33.370615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:33.398596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.398933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:33.399791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.400400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:35.783348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:35.796611 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78906c22-836c-4307-8c23-8b4c38a5dbbd tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 2.429328 Jul 19 20:09:35.798651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2349/4806] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:33 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:35.805667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:35.810951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:35.814774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:35.829411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:35.835128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:35.836722 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19a0c829-4610-41d5-b574-a8b188f5fef3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1865 microversion: 2.32 time: 2.821883 Jul 19 20:09:35.839655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2458/4807] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:33 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1865 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:35.851216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:35.852924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:35.864077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:35.867975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:35.868968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:35.869424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:35.871335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:35.874176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:35.876822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:35.877632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.084202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.101583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.104293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.105728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc3e338b-651a-44ef-b1bc-04e095165d41 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.304672 Jul 19 20:09:36.107590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2350/4808] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:35 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:36.567243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.580209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Calling method '.version_select at 0x7fb88cb62dc0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:36.581360 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:09:36.581360 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:09:36.582967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.584221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.590014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.600094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:36.604781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-108b1262-d326-407b-8533-ca8af2653f26 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.763733 Jul 19 20:09:36.607530 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2459/4809] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:35 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:36.624130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.624601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.633787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3a01adbd-16c8-4074-b8eb-1730a1ca8e09 req-ef89685d-a7a0-4cd2-8a3d-917089a04760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "2e04abcc-cf0d-40e7-9ff0-9148189849c0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:36.658446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.659006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.660809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3a01adbd-16c8-4074-b8eb-1730a1ca8e09 req-ef89685d-a7a0-4cd2-8a3d-917089a04760 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.664001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3a01adbd-16c8-4074-b8eb-1730a1ca8e09 req-ef89685d-a7a0-4cd2-8a3d-917089a04760 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.675286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c685b60-1dec-46c6-b8d4-9c21fc596d2c tempest-PortsAdminExtendedAttrsTestJSON-2135901276 tempest-PortsAdminExtendedAttrsTestJSON-2135901276-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.566275 Jul 19 20:09:36.681807 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2351/4810] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:09:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:36.747343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3a01adbd-16c8-4074-b8eb-1730a1ca8e09 req-ef89685d-a7a0-4cd2-8a3d-917089a04760 service nova] Creating event network-changed:2e04abcc-cf0d-40e7-9ff0-9148189849c0 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:36.777803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3a01adbd-16c8-4074-b8eb-1730a1ca8e09 req-ef89685d-a7a0-4cd2-8a3d-917089a04760 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148314 Jul 19 20:09:36.780699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2460/4811] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:36.815970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:36.816767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:36.848865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.849870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.850739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.852966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.861242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:36.863596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:36.882601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.886222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.889440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.891212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.948973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:37.894456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:37.903903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76705a36-7575-4eac-9735-e9f9b44a7bb2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 1.091932 Jul 19 20:09:37.908944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2352/4812] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:36 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:37.917086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:37.926268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:37.943739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:37.946014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:37.947587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:37.949647 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b41d8ecf-b153-44c5-81b0-36281a049684 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 1.096490 Jul 19 20:09:37.952717 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2461/4813] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:36 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:37.966751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:37.967655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:37.968389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:37.968899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:37.970713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:37.971328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:37.985893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:37.986669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:37.987729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:37.988429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:38.078015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.097555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.099697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.100949 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e394700-b2a3-43ca-893d-d7c244d30641 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.190798 Jul 19 20:09:38.101517 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2353/4814] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:37 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:38.305877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.315526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.317450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.319540 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c72f2b90-93fc-41f1-b222-f093d72934cb tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.365655 Jul 19 20:09:38.320830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2462/4815] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:37 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:38.889466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ff55420e-d255-4b81-a265-27fad70e814e req-242ee091-ba3f-4cc1-acd9-ca0b14908343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "9aba40e6-cab2-4180-b28b-61e0f930d0ff"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:38.928824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:38.929980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:38.942236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ff55420e-d255-4b81-a265-27fad70e814e req-242ee091-ba3f-4cc1-acd9-ca0b14908343 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:38.943443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ff55420e-d255-4b81-a265-27fad70e814e req-242ee091-ba3f-4cc1-acd9-ca0b14908343 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:38.956095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:38.956460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:38.957473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:38.957809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:39.007152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ff55420e-d255-4b81-a265-27fad70e814e req-242ee091-ba3f-4cc1-acd9-ca0b14908343 service nova] Creating event network-changed:9aba40e6-cab2-4180-b28b-61e0f930d0ff for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:39.057317 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ff55420e-d255-4b81-a265-27fad70e814e req-242ee091-ba3f-4cc1-acd9-ca0b14908343 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181743 Jul 19 20:09:39.079349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2354/4816] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:39.109486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:39.110197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:39.133975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:39.134445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:39.140492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:39.155310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:39.680669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:39.718671 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27b5abec-c7bc-4efe-9aab-1ac5d21de924 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.796634 Jul 19 20:09:39.730052 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2463/4817] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:38 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:39.735249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:39.745752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:39.780600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:39.783490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:39.788329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:39.789291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:39.984025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.006389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.013452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.017038 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80a629eb-cdd0-4f28-935f-512be98bb52b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 0.932142 Jul 19 20:09:40.020061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2355/4818] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:39 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:40.037558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:40.042470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:40.058696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.059407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:40.063788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.068955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:40.099602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.126307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.131704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.168946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91f401e6-7d0e-4b39-aac1-a34d7e05f3c8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.436417 Jul 19 20:09:40.173653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2464/4819] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:39 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:40.604209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.613985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.623683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.628766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d0bbad47-e197-47ff-90ed-772cc1ac5ec9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.603829 Jul 19 20:09:40.631942 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2356/4820] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:40 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:40.747025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:40.747683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:40.759224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.764243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:40.765218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.765677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.040425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:41.041850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:41.048671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:41.058536 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aacc8644-6026-4aab-b241-3ff240a91f9c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.315492 Jul 19 20:09:41.059997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2465/4821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:40 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:41.074318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.075645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.077927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.079135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.202252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:41.207068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:41.231280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.237334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.243837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.249639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.424319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:41.437497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:41.445496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:41.447279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97b5124b-8906-4b5f-8a2c-c6af1df6789c tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.252769 Jul 19 20:09:41.449286 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2466/4822] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:41 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:41.456842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-13955fa3-3c75-41bf-a5c2-baa1e7627109 req-6d4f43e2-bbf7-4fc6-8167-e6fb23c3bcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "ec712b1a-b532-45f3-91d6-8d7b68a473ac"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:41.477434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-13955fa3-3c75-41bf-a5c2-baa1e7627109 req-6d4f43e2-bbf7-4fc6-8167-e6fb23c3bcbe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.479021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-13955fa3-3c75-41bf-a5c2-baa1e7627109 req-6d4f43e2-bbf7-4fc6-8167-e6fb23c3bcbe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.515407 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-13955fa3-3c75-41bf-a5c2-baa1e7627109 req-6d4f43e2-bbf7-4fc6-8167-e6fb23c3bcbe service nova] Creating event network-changed:ec712b1a-b532-45f3-91d6-8d7b68a473ac for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:41.536685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-13955fa3-3c75-41bf-a5c2-baa1e7627109 req-6d4f43e2-bbf7-4fc6-8167-e6fb23c3bcbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085366 Jul 19 20:09:41.542004 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2467/4823] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:41.673371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:41.678392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:41.708781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.710021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:41.714254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:41.715698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:42.124985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.143212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.156958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.160090 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d3061f0-615f-4217-a67a-68ab0c91b1c2 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 1.125163 Jul 19 20:09:42.167949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2357/4824] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:41 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:42.186559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:42.187220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:42.207762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:42.208715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:42.209761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:42.210368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:42.420865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.431832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.433377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.438758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2d7dac0-485a-452c-8f2f-4c13483a3902 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.783638 Jul 19 20:09:42.440404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2468/4825] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:41 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:42.467537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:42.468218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:42.475675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:42.476698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:42.477841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:42.478838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:42.638996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.655266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.659737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:42.673361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f775c0e7-9a79-4c5c-950e-11dd686e9511 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.200846 Jul 19 20:09:42.676134 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2469/4826] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:42 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:43.025014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:43.049105 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-93b3ed4c-5353-48cc-9e34-9c5c7e7791a7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.879069 Jul 19 20:09:43.052793 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2358/4827] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:42 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:43.182885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:43.183408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:43.204005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.208128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:43.209244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.209854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:43.260981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:43.461328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:43.463978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:43.480855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.483187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:43.484483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.499232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:44.170168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.230977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.235201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.239043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be36d37a-78c1-4439-8327-84f84c56a885 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 1.058326 Jul 19 20:09:44.242492 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2470/4828] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:43 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:44.250496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:44.261191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:44.270226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=88 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:44.280265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:44.281594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:44.283323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:44.284359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:44.356650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.371021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.396333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.396333 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eb0d8825-c905-43ae-bd59-a8dce4c35144 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.938842 Jul 19 20:09:44.408263 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2359/4829] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:43 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:44.431399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e2f32ab3-086b-45c0-8eaf-8fa81fc6c5e1 req-c60534c5-d6e8-49d8-8d76-e3de47ac908a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "f637c253-bae6-449a-bf39-e2333c9d4de4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:44.435252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.466430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.471032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e2f32ab3-086b-45c0-8eaf-8fa81fc6c5e1 req-c60534c5-d6e8-49d8-8d76-e3de47ac908a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:44.471943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e2f32ab3-086b-45c0-8eaf-8fa81fc6c5e1 req-c60534c5-d6e8-49d8-8d76-e3de47ac908a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:44.475374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:44.488873 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea09c513-f15a-4aca-aa0e-63aeaaf4ba84 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.238503 Jul 19 20:09:44.492536 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2471/4830] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:44 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:44.525493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:44.527292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:44.534328 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e2f32ab3-086b-45c0-8eaf-8fa81fc6c5e1 req-c60534c5-d6e8-49d8-8d76-e3de47ac908a service nova] Creating event network-changed:f637c253-bae6-449a-bf39-e2333c9d4de4 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:44.550840 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e2f32ab3-086b-45c0-8eaf-8fa81fc6c5e1 req-c60534c5-d6e8-49d8-8d76-e3de47ac908a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141100 Jul 19 20:09:44.551859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2360/4831] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:44.555136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:44.556280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:44.557893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:44.562188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:45.263618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:45.264071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:45.294105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:45.294721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:45.297841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:45.298412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:45.438135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:45.449644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd383981-bb1e-49d8-b39b-4ceafd5f933c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.951691 Jul 19 20:09:45.463826 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2472/4832] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:44 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:45.480502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:45.487992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:45.507083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:45.509686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:45.512517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:45.514740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.133390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.154523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.155073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.156346 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9676b0c9-a16a-4eda-bb42-50604a8c153c tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.690297 Jul 19 20:09:46.158008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.167374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2473/4833] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:45 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:46.174512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:46.176048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:46.180963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.184551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.185001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.185904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.186340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.193556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.195042 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1b0dca2-1f00-45da-bcbd-fb6fbaeec829 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 0.937649 Jul 19 20:09:46.215435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2361/4834] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:45 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:46.383139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.405887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.419562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.425046 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d8df702-d32a-400d-815a-dd7f9e2891ba tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.256436 Jul 19 20:09:46.431788 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2474/4835] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:46 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:46.479632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:46.480279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:46.492233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.493254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.495225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.507280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.861360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:46.872349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffe04fc9-7809-475b-bfa2-da1534e20b43 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.396531 Jul 19 20:09:46.874593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2362/4836] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:46 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:47.180109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:47.183184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:47.202714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.207615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.208908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.209483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.220871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:47.222362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:47.237119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.237675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.242969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.246134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.611114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.622064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.625441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.629165 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30949a0d-65ac-498a-9610-087b59e79467 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.458549 Jul 19 20:09:47.630945 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2475/4837] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:47 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:47.645377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0e9de186-edd0-4af5-88d3-f9e2889d9144 req-aa3af10d-6b9c-44b6-8aec-7d48e6a73e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "82e7fe0f-3b91-48e4-84d9-6e2ad64b993b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:47.662372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0e9de186-edd0-4af5-88d3-f9e2889d9144 req-aa3af10d-6b9c-44b6-8aec-7d48e6a73e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.664065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0e9de186-edd0-4af5-88d3-f9e2889d9144 req-aa3af10d-6b9c-44b6-8aec-7d48e6a73e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.691195 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0e9de186-edd0-4af5-88d3-f9e2889d9144 req-aa3af10d-6b9c-44b6-8aec-7d48e6a73e16 service nova] Creating event network-changed:82e7fe0f-3b91-48e4-84d9-6e2ad64b993b for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:47.701563 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0e9de186-edd0-4af5-88d3-f9e2889d9144 req-aa3af10d-6b9c-44b6-8aec-7d48e6a73e16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065851 Jul 19 20:09:47.703677 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2476/4838] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:47.725548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:47.726407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:47.741286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.741858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.742772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.743754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.926171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.939336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.941425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.947122 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ae01773-8d12-43a4-b848-e64fd6867e27 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.241929 Jul 19 20:09:47.947920 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2477/4839] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:47 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:47.962648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:47.963444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:47.974172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.980643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.990029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.994298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:47.996111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.003030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.005649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.018628 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ba863e4-e467-4844-bb2b-b22e5aa2dad4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 0.801181 Jul 19 20:09:48.019691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2363/4840] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:47 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:48.470627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.480166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-867176c5-35f0-429b-a587-77b8b3d0e97d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1514 microversion: 2.1 time: 0.530929 Jul 19 20:09:48.481508 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2478/4841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:47 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1514 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:48.652257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:48.653703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:48.667747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.668897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.669900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.670538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.893280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.911988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.915293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.918286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-609b0d06-4eb6-40cd-80bd-49103243197b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.272897 Jul 19 20:09:48.919114 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2364/4842] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:48 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:48.966076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:48.966866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:48.978000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.980438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.982089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.983459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.041614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:49.042671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:49.052641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.071621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.072582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.073030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.122954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.132295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.139305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.153389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32dfbdfe-4cc8-48c4-b551-d9f2c600e3b8 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.191173 Jul 19 20:09:49.157783 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2479/4843] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:48 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:49.483282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.496443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.498091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.499655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:49.500370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83e0e0ca-7859-43a7-b551-8d6bdb99ba9d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 0.463612 Jul 19 20:09:49.500619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:49.500824 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2365/4844] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:49 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:49.510355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.512091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.513264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.517586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.736634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-cea6e586-3f44-48e6-b973-cac55fe6f86c req-9f1c1d91-58ed-4364-8f71-34f24f3c4e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "70af8460-088e-4bf6-877b-0da5ae8d4875"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:49.763270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cea6e586-3f44-48e6-b973-cac55fe6f86c req-9f1c1d91-58ed-4364-8f71-34f24f3c4e8d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.763730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cea6e586-3f44-48e6-b973-cac55fe6f86c req-9f1c1d91-58ed-4364-8f71-34f24f3c4e8d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.803031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-cea6e586-3f44-48e6-b973-cac55fe6f86c req-9f1c1d91-58ed-4364-8f71-34f24f3c4e8d service nova] Creating event network-changed:70af8460-088e-4bf6-877b-0da5ae8d4875 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:09:49.819839 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-cea6e586-3f44-48e6-b973-cac55fe6f86c req-9f1c1d91-58ed-4364-8f71-34f24f3c4e8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091733 Jul 19 20:09:49.822601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2366/4845] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:09:49.879105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.891076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b487c226-688f-40c1-8bf8-44daadfa569e tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1520 microversion: 2.1 time: 0.396272 Jul 19 20:09:49.891950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2480/4846] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:49 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:49.939591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:49.940555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:49.950884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.951574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.952536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.953126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.178934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:50.180807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:50.187609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.188382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.189356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.189948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.201164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.218506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.221882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.224514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6decf97-312d-4df1-8e7c-4e8ae32c1018 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.290076 Jul 19 20:09:50.226750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2367/4847] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:49 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:50.276334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.285268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.287626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.289712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6703240-7105-4d67-9227-b0dd27f865cd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.116208 Jul 19 20:09:50.290868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2481/4848] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:50 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:50.527445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:50.529142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:50.554654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.554654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.556149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.556838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.911182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:50.911920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:50.931628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.933231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.934962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.935406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.654653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.669747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.675800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.676464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.681767 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab85df34-d055-4ac8-95ae-8331b30e1a2a tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 1.160838 Jul 19 20:09:51.693466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2368/4849] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:50 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:51.698657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:51.704797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:51.706942 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b024f20-febe-46a7-9a2e-5b550f77b6e2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1520 microversion: 2.1 time: 0.789951 Jul 19 20:09:51.709074 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2482/4850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:50 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1520 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:51.716480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:51.718566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.719237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.720239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.720368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:51.732740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.740860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.741528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.742711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.743372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.963248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.973802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.975647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.977268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e7444899-1a66-4c3d-bd17-cc87e8ea6523 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1365 microversion: 2.47 time: 0.266827 Jul 19 20:09:51.989600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2483/4851] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:51 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:52.259006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:52.269114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:52.277269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:52.278803 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c0ee6fb-133f-41d2-98ba-a9dfbf87ce9b tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.584064 Jul 19 20:09:52.280614 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2369/4852] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:51 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:52.701493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:52.702258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:52.710444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.711417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:52.712583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.713217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:52.724799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:52.725412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:52.739748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.740563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:52.741519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.742120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.233073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.252899 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4db8448-ec8c-401b-a437-d2c0982c5638 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1520 microversion: 2.1 time: 0.531845 Jul 19 20:09:53.266051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2370/4853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:52 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1520 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:53.289829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.292759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:53.296049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:53.304211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.308057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.311786 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f62e9d5c-bb92-4a2e-b199-e943bf60ffc5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1886 microversion: 2.32 time: 0.614838 Jul 19 20:09:53.314799 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2484/4854] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:52 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1886 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:53.321318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.323368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.324941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.326588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.326940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:53.328825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:53.343160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:53.347264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.349315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.352125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.352651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.567017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.584122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.585810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.591754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e47480d7-1635-45a2-9a14-88c68e82f4e9 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.321604 Jul 19 20:09:53.592582 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2371/4855] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:53 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:53.691517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.702137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.705520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.707727 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-124c8d91-da77-494c-9824-ff591db7c8f6 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.391611 Jul 19 20:09:53.709300 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2485/4856] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:53 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:53.784996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-23fbc544-315f-497e-82aa-3214c031aec0 req-2e5d7c78-82da-4a80-95b9-d460441dfd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb5f490-9d12-4e0f-987c-663df22737b4", "name": "network-vif-plugged", "status": "completed", "tag": "a0456225-f8b3-407e-879e-a2e83988936c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:53.797242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-23fbc544-315f-497e-82aa-3214c031aec0 req-2e5d7c78-82da-4a80-95b9-d460441dfd12 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.797777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-23fbc544-315f-497e-82aa-3214c031aec0 req-2e5d7c78-82da-4a80-95b9-d460441dfd12 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.820276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-23fbc544-315f-497e-82aa-3214c031aec0 req-2e5d7c78-82da-4a80-95b9-d460441dfd12 service nova] Creating event network-vif-plugged:a0456225-f8b3-407e-879e-a2e83988936c for instance beb5f490-9d12-4e0f-987c-663df22737b4 on n-h1-843861-3 Jul 19 20:09:53.826852 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-23fbc544-315f-497e-82aa-3214c031aec0 req-2e5d7c78-82da-4a80-95b9-d460441dfd12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050859 Jul 19 20:09:53.828640 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2372/4857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:54.273840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:54.274641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:54.288842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.289392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.290317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.290835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.338525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:54.339226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:54.346805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.347778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.348900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.349581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.745642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:54.776963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0881d452-efc3-4f78-9d2f-d3c2bd042b38 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1520 microversion: 2.1 time: 0.507385 Jul 19 20:09:54.777768 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2486/4858] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:54 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:54.794054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:54.794803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:54.804670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.805235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.806086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.807026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.849641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:54.878155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:54.897513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:54.900982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a584027d-c775-4e33-bb56-10f1b70ad6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.567355 Jul 19 20:09:54.902353 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2373/4859] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:54 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:54.907735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:54.908726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:54.917995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.918640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.920646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.921306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.019575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.022955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:55.035136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.037685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.039292 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29f897e9-1ab6-4c59-8780-fc7ea06d51e3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.258693 Jul 19 20:09:55.053371 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2487/4860] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:54 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:55.059378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:55.060128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:55.069182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.069904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.071129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.072374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.191108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'services' on Instance uuid 7fac2431-a538-4423-b3f7-ebb74df16f1a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:09:55.227321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.244337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.247419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.257953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7facb792-8ba9-429a-89cc-7cb90153f543 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.351350 Jul 19 20:09:55.259020 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2374/4861] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:54 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:55.306075 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a7b837c-b495-4171-a870-68d4886f3dea tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments/308f2996-34a4-4cad-9656-6275c5a4e4e3" status: 202 len: 0 microversion: 2.1 time: 0.250867 Jul 19 20:09:55.309896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2488/4862] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:09:55 2022] DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments/308f2996-34a4-4cad-9656-6275c5a4e4e3 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:09:55.315019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:55.316246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:55.322623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.323072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.323905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.324303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.359276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-499f027d-0b7f-46f3-a471-79f97d8b7c9d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Jul 19 20:09:55.360417 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2375/4863] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:09:55 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:55.799920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:55.801247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:55.813664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.814335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.816422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.817049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.921668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:55.922887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:55.934645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.935106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.936398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:55.938576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.013190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.033918 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f516f43-4cac-4c3f-8c4b-d5500da11708 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1505 microversion: 2.1 time: 0.245072 Jul 19 20:09:56.036218 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2489/4864] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:55 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:56.430970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.446541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.453044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.455463 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48b649b0-9d9e-4e74-b79f-bc20e757d9e7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.538259 Jul 19 20:09:56.457125 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2376/4865] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:55 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:56.465214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:56.466791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:56.485111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.485851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.486822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.487530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.595472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-233290468", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "f69843aa-fe79-4f1c-8272-5de728033cf2"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:56.687566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] validate_networks() for [('f69843aa-fe79-4f1c-8272-5de728033cf2', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:56.736683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.747710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-699461a2-cad3-4986-b0bd-c45feff0f78a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 200 len: 1505 microversion: 2.1 time: 0.288983 Jul 19 20:09:56.748359 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2377/4866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:56 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:56.760955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:56.761940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:56.777163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.777835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.780576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.782155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.903886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.917619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.921832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.926656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1225025-8af0-44e1-9693-d56d7cc08cf3 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.173263 Jul 19 20:09:56.941582 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2378/4867] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:56 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:56.947509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:56.948521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:56.957071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.958413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:56.959726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:56.960409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.257716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:57.278953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:57.280503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:57.281691 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-29c00962-5141-49e5-9380-fd168725ceaf tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.338549 Jul 19 20:09:57.282259 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2379/4868] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:56 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:57.291907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:57.295329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:57.303214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.303772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.304674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.305730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.349465 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a80667d-2116-4f1e-8837-cc44f894c0b4 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063332 Jul 19 20:09:57.354002 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2380/4869] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:09:57 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:57.359599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:57.360243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:57.368005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.368376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.369647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.370096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.406489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:09:57.423441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:57.424036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:57.424765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:57.425456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:57.425949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:57.436803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.438939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.440085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.440762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.466387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Getting quotas for project 0a34a576524847bb90e45fb432206e13. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:57.481988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Getting quotas for user 78d0b2907ad8450eafa0b3a745c07270 and project 0a34a576524847bb90e45fb432206e13. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:57.500911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:57.503762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:57.525053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e9534d9-7cf6-4507-b6aa-8a3c3080ad87 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 204 len: 0 microversion: 2.1 time: 0.169129 Jul 19 20:09:57.526312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2381/4870] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:09:57 2022] DELETE /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:09:57.537529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:57.538447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:57.549797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.550347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.552200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.552694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.578635 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e0f7dff7-e17e-41f8-a87e-ce7376bca344 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541102 Jul 19 20:09:57.579565 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2490/4871] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:09:57.589858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba47bc97-8de6-41e3-bb8b-0e2649418733 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:57.592045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba47bc97-8de6-41e3-bb8b-0e2649418733 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:57.758580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba47bc97-8de6-41e3-bb8b-0e2649418733 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:57.780756 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba47bc97-8de6-41e3-bb8b-0e2649418733 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1213 microversion: 2.1 time: 0.194686 Jul 19 20:09:57.784849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2491/4872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:57 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:57.791947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-705799006", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5b99d575-5525-42b0-bce9-76c4b839720c"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:57.890431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] validate_networks() for [('5b99d575-5525-42b0-bce9-76c4b839720c', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:58.122023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.136351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.152950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.159288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-878703fd-0985-4f3b-b1d8-e02b0699ec00 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.627986 Jul 19 20:09:58.170464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2382/4873] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:57 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:58.188095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:58.188714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:58.197344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.198082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.200042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.200835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.326362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.350536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.353737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.356382 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f310a39-3632-464f-856e-37a88ea8acce tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.172443 Jul 19 20:09:58.357383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2383/4874] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:58 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:58.362784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:58.363851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:58.380250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.385308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.388351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.388897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.875644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.889815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.891981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:58.894087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26e1b5f6-9cd0-41d7-8406-9b04968537a9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.535180 Jul 19 20:09:58.894948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2384/4875] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:58 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:09:58.900243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:58.900819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:58.901512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:58.902108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:58.902808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:58.914439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.915121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.916243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.916896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.920505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:58.921579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:58.930983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.931617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.932960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:58.933481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:58.951403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:58.959552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Getting quotas for user fc1c7582f89d40549e8ddeb39285c030 and project 0a2cbfc4f9d54ef3baa5e824c6a2d5ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:58.974473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:58.977453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:58.984006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f800e64-429d-4a1f-93ed-0b993c2e4607 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087307 Jul 19 20:09:58.984806 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2385/4876] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:09:58 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:58.990332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:58.991898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:59.001074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.002221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.003093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.003608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.038717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bbc2b37f-f837-4b3a-aaaa-1dd96311cc7d tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.252680 Jul 19 20:09:59.039714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2492/4877] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:09:59.049974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe80d48b-feb4-4dd5-83ad-af9a2db64249 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:59.050975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe80d48b-feb4-4dd5-83ad-af9a2db64249 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:59.135921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.139698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:59.149598 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2bc97194-dc43-478b-8798-693959684614 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1265 microversion: 2.1 time: 0.163534 Jul 19 20:09:59.169838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2386/4878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:58 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:59.180252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fe80d48b-feb4-4dd5-83ad-af9a2db64249 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.190488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:59.191116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:59.197515 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe80d48b-feb4-4dd5-83ad-af9a2db64249 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1217 microversion: 2.1 time: 0.152006 Jul 19 20:09:59.198126 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2493/4879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:59 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:59.218141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.222293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.223464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.228781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.376097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:59.376848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:59.404592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.405645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.406739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.407400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.799692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.816999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.819555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.824154 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1462354-f4c2-429b-8591-76b36853d17f tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.452482 Jul 19 20:09:59.826535 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2494/4880] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:59 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:09:59.913453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:59.914903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:59.930650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.931588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.932940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.933652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.123454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.149373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.151943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.153572 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6774362-f86a-42ae-9530-e49c32ecbf96 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.967075 Jul 19 20:10:00.160185 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2387/4881] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:59 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:10:00.180533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:00.182245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.184669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:00.195028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.195491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.196364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.196848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.292804 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38711a7d-c5e8-4ee9-bfe5-4742a1cf77f6 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117753 Jul 19 20:10:00.294282 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2388/4882] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:10:00 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:00.352823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b3ad174c-eb32-432c-a37a-11fc5fe35104 req-465d0794-1a7b-49e6-a51c-1f94584ba7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "name": "network-vif-plugged", "status": "completed", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:00.412556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b3ad174c-eb32-432c-a37a-11fc5fe35104 req-465d0794-1a7b-49e6-a51c-1f94584ba7b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.423668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b3ad174c-eb32-432c-a37a-11fc5fe35104 req-465d0794-1a7b-49e6-a51c-1f94584ba7b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.448482 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b3ad174c-eb32-432c-a37a-11fc5fe35104 req-465d0794-1a7b-49e6-a51c-1f94584ba7b9 service nova] Creating event network-vif-plugged:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h2-843861-3 Jul 19 20:10:00.456759 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b3ad174c-eb32-432c-a37a-11fc5fe35104 req-465d0794-1a7b-49e6-a51c-1f94584ba7b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160877 Jul 19 20:10:00.457641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2389/4883] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:00.469565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:00.470739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.479383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.480198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.481922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.482587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.513165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.528661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.530783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.538389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-98c36170-61bb-45f5-bc16-b5a7849e3ac4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.629080 Jul 19 20:10:00.539709 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2495/4884] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:09:59 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:10:00.556165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:00.563468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.576576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.577407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.578478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.579281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.635463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.645955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89220c96-0078-42a5-af5b-109c09b4c8e2 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1271 microversion: 2.1 time: 0.183816 Jul 19 20:10:00.646580 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2390/4885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:00 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:00.680018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.691854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e986378-4b77-4f14-84ec-2d226866e5d2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1221 microversion: 2.1 time: 0.150174 Jul 19 20:10:00.693089 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2496/4886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:00 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:00.848389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:00.850270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.862736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.863552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.866844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.867551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.029949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.052383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.055640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.057334 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08be10c1-d007-420b-b159-a602d9f6a9c5 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1371 microversion: 2.47 time: 0.215798 Jul 19 20:10:01.058180 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2391/4887] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:00 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:01.186023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.186658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.210629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.216561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.231634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.233380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.311304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.312999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.352512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.352987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.353769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.354215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.465232 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-444e4401-8f16-496e-bcda-f347b3857d7e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160485 Jul 19 20:10:01.478019 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2392/4888] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:01.535352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d148ef16-cf81-4f74-9a7c-3ffdb23f8518 req-f5f90e73-6676-45e5-903f-b9698b9d7423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb5f490-9d12-4e0f-987c-663df22737b4", "name": "network-vif-deleted", "tag": "a0456225-f8b3-407e-879e-a2e83988936c"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:01.558450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d148ef16-cf81-4f74-9a7c-3ffdb23f8518 req-f5f90e73-6676-45e5-903f-b9698b9d7423 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.559153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d148ef16-cf81-4f74-9a7c-3ffdb23f8518 req-f5f90e73-6676-45e5-903f-b9698b9d7423 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.586692 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d148ef16-cf81-4f74-9a7c-3ffdb23f8518 req-f5f90e73-6676-45e5-903f-b9698b9d7423 service nova] Creating event network-vif-deleted:a0456225-f8b3-407e-879e-a2e83988936c for instance beb5f490-9d12-4e0f-987c-663df22737b4 on n-h1-843861-3 Jul 19 20:10:01.601420 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d148ef16-cf81-4f74-9a7c-3ffdb23f8518 req-f5f90e73-6676-45e5-903f-b9698b9d7423 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070109 Jul 19 20:10:01.613981 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2393/4889] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:01.621424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.622492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.636951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.643318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.645575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.647747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.737310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.748957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.751375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.752682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fa159d4-97c1-4720-b33f-a801cb39ad6e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.580905 Jul 19 20:10:01.765203 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2497/4890] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:01.771903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.773032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.782823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.783564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.784584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.785212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:02.884857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:02.909506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:02.912420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:02.913936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ac457d8-025c-4f80-ad34-f1768841b775 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 1.297620 Jul 19 20:10:02.919401 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2394/4891] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:02.937206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:02.938440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:02.946808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:02.948477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:02.949603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:02.950266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.279702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.288731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa50ab90-ab3f-4fed-aebc-2bf4ac834490 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1275 microversion: 2.1 time: 0.367363 Jul 19 20:10:03.291223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2395/4892] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:02 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:03.298045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:03.304476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:03.318328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.320327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.321455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.324244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.530079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.538774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.540691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.542133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-488df54c-4160-455d-9e63-e846429646dd tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1356 microversion: 2.47 time: 0.247923 Jul 19 20:10:03.542947 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2396/4893] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:03 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1356 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:03.552954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:03.557030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:03.573619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.574155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.576441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.577103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.652501 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c135be38-a9d9-420c-8f47-7b218581307b tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108222 Jul 19 20:10:03.671951 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2397/4894] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:10:03 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:03.677231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.686090 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f594cd7e-0c5b-49b5-800b-c668e579c7bc tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 1.918783 Jul 19 20:10:03.689133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2498/4895] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:03.689497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:03.690228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:03.696709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:03.706362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.713536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.715133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.716173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Searching by: {'deleted': False, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:10:03.720962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.721499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.734387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.734998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.736254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:03.738889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.077268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:10:04.183775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.192910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.193640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.215929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.225932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.355584 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d5e7286-4e0e-4a48-98ff-b79a9b2dc917 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.662889 Jul 19 20:10:04.357538 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2499/4896] 10.222.0.33 () {60 vars in 1186 bytes} [Tue Jul 19 20:10:03 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:04.371314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.372144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.384573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.385274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.386786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.386786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.461227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.472949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.474880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.476947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc997d34-57f3-45cf-b64e-192f91705e44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.799994 Jul 19 20:10:04.478034 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2398/4897] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:03 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:04.483310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.484175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.495499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.496360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.497256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.497915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.641085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.650385 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-79b0d5d9-372b-40b7-be80-9290aa4215d5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1275 microversion: 2.1 time: 0.171047 Jul 19 20:10:04.650991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2399/4898] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:04.667121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.667657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.675732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.676443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.678099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.678713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.711728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:04.750681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.759519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.761271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.762751 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b602409-d70e-414f-aa73-7d40a6022f64 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.400236 Jul 19 20:10:04.763332 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2500/4899] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:04.776937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a6687311-d42c-4a41-8a6b-648d1397fc04 req-92a97099-e066-45af-8133-f1651e6651d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63913865-df4f-458e-b533-73d89e43f83d", "tag": "a39c172d-a478-45f2-a4c0-54214a144697"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:04.796836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a6687311-d42c-4a41-8a6b-648d1397fc04 req-92a97099-e066-45af-8133-f1651e6651d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.797218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a6687311-d42c-4a41-8a6b-648d1397fc04 req-92a97099-e066-45af-8133-f1651e6651d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.826728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a6687311-d42c-4a41-8a6b-648d1397fc04 req-92a97099-e066-45af-8133-f1651e6651d3 service nova] Creating event network-changed:a39c172d-a478-45f2-a4c0-54214a144697 for instance 63913865-df4f-458e-b533-73d89e43f83d on n-h1-843861-3 Jul 19 20:10:04.845924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a6687311-d42c-4a41-8a6b-648d1397fc04 req-92a97099-e066-45af-8133-f1651e6651d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072576 Jul 19 20:10:04.846557 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2501/4900] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:04.866956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.867928 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-775543b9-4695-4979-8cdc-59869719e7e4 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 204 len: 0 microversion: 2.47 time: 0.204260 Jul 19 20:10:04.871658 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2400/4901] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:10:04 2022] DELETE /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:10:04.872542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.875017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.875991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.881968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.882418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.883217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.883655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.885265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.886041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.887089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.888359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.940037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-803c91fe-d48d-4fc7-8740-f9d54150a916 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092021 Jul 19 20:10:04.940640 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2502/4902] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:10:04.945427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.946295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.955673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.960383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.961653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.962093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.220448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:05.239941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:05.242354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:05.249712 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd3f4a2b-bd19-48aa-8e2d-11010d7972f6 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1362 microversion: 2.47 time: 0.308015 Jul 19 20:10:05.250946 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2503/4903] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:05.262515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:05.263856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.269327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:05.291228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.292029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.293051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.293719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.328970 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Cannot 'reboot' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action HTTP/1.1 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 28 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: {"reboot": {"type": "HARD"}} Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'reboot' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd3053c3e-b3af-4d1e-bd5f-05fe59b9583e', 'body': {'reboot': {'type': 'HARD'}}} Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:10:05.330949 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.338151 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.340579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 409 to user: Cannot 'reboot' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:05.341789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e65426b0-0c1f-4d2c-bb11-73fa5037ae5f tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action" status: 409 len: 145 microversion: 2.1 time: 0.089549 Jul 19 20:10:05.343527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2504/4904] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:10:05 2022] POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action => generated 145 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:10:05.352912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:05.355031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.363049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.363620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.364695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.365635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.404174 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Cannot 'rebuild' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action HTTP/1.1 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 65 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'rebuild' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd3053c3e-b3af-4d1e-bd5f-05fe59b9583e', 'body': {'rebuild': {'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046'}}} Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:10:05.405843 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued Jul 19 20:10:05.411765 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:05.414039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 409 to user: Cannot 'rebuild' instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e while it is in vm_state rescued {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:05.415158 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-798b0d99-b07b-4b8f-ab71-a1e7773219ba tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action" status: 409 len: 146 microversion: 2.1 time: 0.066705 Jul 19 20:10:05.416269 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2505/4905] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:10:05 2022] POST /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e/action => generated 146 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 20:10:05.427484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:05.428871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.438331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.439340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.440697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.441332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.479755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:05.538782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:05.627922 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9989a8ef-1adf-4869-a616-b84173b3fa0d tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 204 len: 0 microversion: 2.1 time: 0.204712 Jul 19 20:10:05.631475 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2506/4906] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:05 2022] DELETE /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:10:05.646307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:05.647153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.665740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.667503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.670279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.670976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.673209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:05.684360 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b06cb047-dfda-4e3e-a21f-837f8398ef2a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.813573 Jul 19 20:10:05.695546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2401/4907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:05.701611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:05.702533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.710086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.710811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.711832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.712976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.244038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.256673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6ece62e-2782-4565-957b-f4c78317d734 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1688 microversion: 2.1 time: 0.558838 Jul 19 20:10:06.262035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.269029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2402/4908] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:05 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:06.284195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:06.288121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:06.296713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.312302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.313831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f231abc7-a898-47d1-995d-5fd400680856 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.680310 Jul 19 20:10:06.316789 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2507/4909] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:05 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:06.319706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.320284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.323801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.324395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.325798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:06.326565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:06.338719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.339522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.340757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.341501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.390844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:06.541454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.554103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1dce9a57-4784-473a-a265-f7ecb36b2d51 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1275 microversion: 2.1 time: 0.280397 Jul 19 20:10:06.564319 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2403/4910] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:06 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:06.570306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:06.571095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:06.580290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.581037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.582001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.583294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.675662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.684903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.692212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.692434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.698200 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f74a3db7-203b-48aa-8192-7c1632c33064 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1731 microversion: 2.20 time: 0.379999 Jul 19 20:10:06.699112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2508/4911] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:06 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:06.704508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:06.705144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:06.717157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.717528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.718329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.718757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.719484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.721205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.722743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-60c87f83-cb72-4bef-8339-93fe555dbe72 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 200 len: 1362 microversion: 2.47 time: 0.157063 Jul 19 20:10:06.728695 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2404/4912] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:06 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:07.277993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:07.278651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:07.296057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.298305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:07.302834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.304373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:07.542396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:07.551410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cfe54d71-1104-4e99-98da-27ed0defb33e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.851112 Jul 19 20:10:07.552077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2509/4913] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:06 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:07.575441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:07.576072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:07.590632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.591093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:07.592042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.592530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.133538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.143378 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-47dd0fcb-1e79-4d19-999c-952c57ada2fc tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1688 microversion: 2.1 time: 0.871288 Jul 19 20:10:08.149488 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2405/4914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:07 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1688 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:08.162656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:08.166106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:08.181275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.183079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.200647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.203121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.296943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.317269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.321050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.323563 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95a99082-e520-4822-9a91-9e0a1ccceda5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.761231 Jul 19 20:10:08.324893 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2510/4915] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:07 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:08.332167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:08.333853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:08.344732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.345394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.346598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.347226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.755624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.770910 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecedec2a-ede0-4b8d-aff7-480b986a55e8 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.617762 Jul 19 20:10:08.771723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2406/4916] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:08 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:08.780055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:08.780756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: b174bc30-1bf0-4fc8-a2af-be5f25f5380f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:08.787629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.788378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.790254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.791062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.824766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] HTTP exception thrown: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Request method failure captured: Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f HTTP/1.1 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w9c8Otu298GeTSS5LdDX5JWOabiim5iMcORvlROTJQ1hkWQuABx6bUnN-04YLQ-ytsPQxYMkce9g90d5G17pYDkww7sZL3cdxJ6xLF_iGpNsdRrJABbMxXg_1sdY34JA3ogAUWfU9dZ1qyLp_EKGBU2Tjcj6WQ4S2vdn9eV3Fko_js Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 2774c08a6a7744c2ba064853cd2cf31e Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerShowV247Test-293162088 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerShowV247Test-293162088 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 2774c08a6a7744c2ba064853cd2cf31e Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerShowV247Test-293162088 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerShowV247Test-293162088-project Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0b173e1279bb496499203ff6706a8913 Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerShowV247Test-293162088-project Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b174bc30-1bf0-4fc8-a2af-be5f25f5380f'} Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:08.826778 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. Jul 19 20:10:08.831994 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:08.833778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Returning 404 to user: Instance b174bc30-1bf0-4fc8-a2af-be5f25f5380f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:08.834823 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea296035-6dac-4f05-81eb-75d4e19c661d tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f" status: 404 len: 111 microversion: 2.47 time: 0.062041 Jul 19 20:10:08.835918 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2407/4917] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:08 2022] GET /compute/v2.1/servers/b174bc30-1bf0-4fc8-a2af-be5f25f5380f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:10:08.844199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:08.845035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:08.852972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.853424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.854231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.855169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.414701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:09.436261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:09.441372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:09.445524 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f5994b5a-5277-492b-9061-b37ec75ff2c2 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1718 microversion: 2.20 time: 1.117637 Jul 19 20:10:09.449536 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2511/4918] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:08 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1718 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:09.463359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:09.468104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:09.483305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.485705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.486778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.487443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.518756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:09.664632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-336aa9c6-2082-4896-a864-c622d27228df tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 204 len: 0 microversion: 2.47 time: 0.213352 Jul 19 20:10:09.665164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2512/4919] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:10:09 2022] DELETE /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:10:09.672247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:09.673208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:09.689806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.690248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.691301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.691747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.779037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:09.789271 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ab695ec-07be-498f-aed9-c202b4b73058 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.951964 Jul 19 20:10:09.790220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2408/4920] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:08 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:09.795797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:09.796702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:09.803686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.804658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.805859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.806964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.203316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.215404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a87e2f0-29ca-4bd7-a1c7-120837ee4a43 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1688 microversion: 2.1 time: 0.545700 Jul 19 20:10:10.219296 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2513/4921] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:09 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1688 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:10.230529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:10.232861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:10.243319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.246062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.248952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.252367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.287642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.302345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.303928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.305130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4cbe1006-df80-499f-a821-2ddb94611be0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.513631 Jul 19 20:10:10.316867 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2409/4922] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:09 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:10.327222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:10.328148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:10.338282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.338951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.339944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.340541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.438578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.451674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.454598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.456121 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-778e35af-6edd-4fb8-b605-6a55cd8bba7e tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 200 len: 1362 microversion: 2.47 time: 0.233242 Jul 19 20:10:10.457518 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2514/4923] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:10 2022] GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:10.653492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b49372f7-d682-4922-ad8e-4e319150ac75 req-2cc972fe-02aa-48c0-96b5-a7e8ec185d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fac2431-a538-4423-b3f7-ebb74df16f1a", "name": "network-vif-deleted", "tag": "3f2432ad-0f3a-4aee-b2e0-bb947d257c0e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:10.690913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b49372f7-d682-4922-ad8e-4e319150ac75 req-2cc972fe-02aa-48c0-96b5-a7e8ec185d6d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.705746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b49372f7-d682-4922-ad8e-4e319150ac75 req-2cc972fe-02aa-48c0-96b5-a7e8ec185d6d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.755582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b49372f7-d682-4922-ad8e-4e319150ac75 req-2cc972fe-02aa-48c0-96b5-a7e8ec185d6d service nova] Creating event network-vif-deleted:3f2432ad-0f3a-4aee-b2e0-bb947d257c0e for instance 7fac2431-a538-4423-b3f7-ebb74df16f1a on n-h1-843861-3 Jul 19 20:10:10.787903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b49372f7-d682-4922-ad8e-4e319150ac75 req-2cc972fe-02aa-48c0-96b5-a7e8ec185d6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148788 Jul 19 20:10:10.788576 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2515/4924] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:10.811278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:10.812034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:10.854663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.855355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.856301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.856772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.897951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.924216 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3244d14c-8186-412d-8187-ab3b9b7da334 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.611380 Jul 19 20:10:10.928279 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2410/4925] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:10 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:10.984767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3b66090c-2284-4c80-adba-f43c2e90f486 req-8e9b0d4d-921a-46de-847e-ae5e4cea5751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b085f50-4dd9-436d-b586-07bbf743446b", "tag": "3bfae0b9-7e6b-4d66-850a-60bc6edd7151"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:11.021579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b66090c-2284-4c80-adba-f43c2e90f486 req-8e9b0d4d-921a-46de-847e-ae5e4cea5751 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.022287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b66090c-2284-4c80-adba-f43c2e90f486 req-8e9b0d4d-921a-46de-847e-ae5e4cea5751 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.065557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3b66090c-2284-4c80-adba-f43c2e90f486 req-8e9b0d4d-921a-46de-847e-ae5e4cea5751 service nova] Creating event network-changed:3bfae0b9-7e6b-4d66-850a-60bc6edd7151 for instance 7b085f50-4dd9-436d-b586-07bbf743446b on n-h2-843861-3 Jul 19 20:10:11.076511 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3b66090c-2284-4c80-adba-f43c2e90f486 req-8e9b0d4d-921a-46de-847e-ae5e4cea5751 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101671 Jul 19 20:10:11.081172 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2411/4926] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:11.237760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:11.238621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.253595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.257482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.260437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.260978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.294794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:11.307432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43318ad0-08ff-41b1-a59a-cbd0afb5caa6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.501788 Jul 19 20:10:11.309474 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2516/4927] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:10 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:11.333981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:11.336537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.357683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.358620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.359891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.360541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.384875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.393838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.394725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lazy-loading 'fault' on Instance uuid 7fac2431-a538-4423-b3f7-ebb74df16f1a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:10:11.761203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:11.781914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:11.784865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:11.786602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8464fe68-68d5-46b6-a05b-b7191590e98d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.462409 Jul 19 20:10:11.801313 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2517/4928] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:11 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:10:11.814016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:11.814646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.829277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.836468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.837875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.838542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.875858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:11.887425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-daea0bda-4560-4093-ae6f-a3d7d34290c3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 200 len: 1335 microversion: 2.1 time: 0.654155 Jul 19 20:10:11.889261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2412/4929] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:11 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 1335 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:11.946319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:11.948045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.962133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.963508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.967467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.969049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.031279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.047061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.058367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.066214 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81fbb810-5672-491f-8661-a5661b267c0b tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 200 len: 1362 microversion: 2.47 time: 0.263132 Jul 19 20:10:12.066849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2518/4930] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:11 2022] GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:12.329072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:12.329860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:12.344185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.344646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.345446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.345892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.405919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.418554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fdc43b18-ad6d-4b88-a5dd-3139513c62b4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.478049 Jul 19 20:10:12.421512 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2413/4931] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:11 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:12.647619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.655823 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb3fa6c3-22d1-4871-96ec-8f6c3958b249 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.332221 Jul 19 20:10:12.656462 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2519/4932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:12 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:12.808072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:12.809188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:12.820492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.824234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.825232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.826754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.904860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:12.905479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 7fac2431-a538-4423-b3f7-ebb74df16f1a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:12.928973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.930736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.931786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:12.936970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.965710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a HTTP/1.1 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7fac2431-a538-4423-b3f7-ebb74df16f1a'} Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:12.967857 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. Jul 19 20:10:12.972039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:12.973861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 404 to user: Instance 7fac2431-a538-4423-b3f7-ebb74df16f1a could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:12.976231 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0736758f-4b0b-4499-95c0-cdac04b4850a tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a" status: 404 len: 111 microversion: 2.1 time: 0.074106 Jul 19 20:10:12.977327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2520/4933] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:12 2022] GET /compute/v2.1/servers/7fac2431-a538-4423-b3f7-ebb74df16f1a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:12.986440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc17d73e-1fbd-422b-9397-784feb1b61bb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '.version_select at 0x7fb88ceea1f0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.029834 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc17d73e-1fbd-422b-9397-784feb1b61bb tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126717116" status: 202 len: 0 microversion: 2.1 time: 0.045600 Jul 19 20:10:13.035252 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2521/4934] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 19 20:10:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126717116 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:10:13.093976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.094980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.111203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.113041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.115692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.117100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.224842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.225568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.226228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lazy-loading 'fault' on Instance uuid dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:10:13.358462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.372581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.378457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b173e1279bb496499203ff6706a8913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2774c08a6a7744c2ba064853cd2cf31e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.385462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-424a7d1d-4a34-45f8-9072-d7eed297ca74 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 200 len: 1367 microversion: 2.47 time: 0.302454 Jul 19 20:10:13.386446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2522/4935] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:10:13.439082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.440447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.454899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.476074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.481822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.482651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.488232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:13.779958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.803038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.805795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.807687 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72d254d7-235f-4db6-8671-07a310e6ad13 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 1.004421 Jul 19 20:10:13.809026 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2414/4936] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:12 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:13.820405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.824395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.832609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.833436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.834482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.835126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.926152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:14.024089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:14.039448 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96ae8657-174e-4200-9fc2-c2f2b48bf28f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.605443 Jul 19 20:10:14.044950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2523/4937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:14.093666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:14.104443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86123425-9825-4367-be09-670979e36667 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.293793 Jul 19 20:10:14.105596 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2415/4938] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:14.407084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:14.408093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] [instance: dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:14.410081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:14.416977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.417430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.418425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.418862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.437218 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] HTTP exception thrown: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Request method failure captured: Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 HTTP/1.1 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w9c8Otu298GeTSS5LdDX5JWOabiim5iMcORvlROTJQ1hkWQuABx6bUnN-04YLQ-ytsPQxYMkce9g90d5G17pYDkww7sZL3cdxJ6xLF_iGpNsdRrJABbMxXg_1sdY34JA3ogAUWfU9dZ1qyLp_EKGBU2Tjcj6WQ4S2vdn9eV3Fko_js Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 2774c08a6a7744c2ba064853cd2cf31e Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerShowV247Test-293162088 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2774c08a6a7744c2ba064853cd2cf31e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerShowV247Test-293162088 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 2774c08a6a7744c2ba064853cd2cf31e Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerShowV247Test-293162088 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerShowV247Test-293162088-project Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 0b173e1279bb496499203ff6706a8913 Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerShowV247Test-293162088-project Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0'} Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:14.440926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] Returning 404 to user: Instance dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:14.447321 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0d90cd7-de3b-409f-89ff-1fc6ffe6b533 tempest-ServerShowV247Test-293162088 tempest-ServerShowV247Test-293162088-project] 10.222.0.33 "GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0" status: 404 len: 111 microversion: 2.47 time: 0.038960 Jul 19 20:10:14.454936 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2524/4939] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:14 2022] GET /compute/v2.1/servers/dd747e92-e28d-4bf4-9eaf-8b7ee7fd44d0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:10:14.837099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:14.837727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:14.854536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.856112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.859511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.860194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.062759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:15.064371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:15.081712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.082590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.083608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.084529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.325923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.340891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.347228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.350766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5f03ffbf-5189-4d2a-aa06-5abe940487eb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.524018 Jul 19 20:10:15.353683 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2416/4940] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:14 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:15.365577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:15.367269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:15.383169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.385319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.387975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.389063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.424780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.436137 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b61f292-f8a3-474e-952a-8ad8edb1c847 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.377997 Jul 19 20:10:15.439712 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2525/4941] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:15 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:15.719230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d1daca94-6f39-4ec4-8904-bf3e182bbf04 req-9964a75d-1b0a-4a7b-b4a1-f5a7856c3af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63913865-df4f-458e-b533-73d89e43f83d", "name": "network-vif-plugged", "status": "completed", "tag": "a39c172d-a478-45f2-a4c0-54214a144697"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:15.730476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d1daca94-6f39-4ec4-8904-bf3e182bbf04 req-9964a75d-1b0a-4a7b-b4a1-f5a7856c3af8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.731226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d1daca94-6f39-4ec4-8904-bf3e182bbf04 req-9964a75d-1b0a-4a7b-b4a1-f5a7856c3af8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.764410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.768420 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d1daca94-6f39-4ec4-8904-bf3e182bbf04 req-9964a75d-1b0a-4a7b-b4a1-f5a7856c3af8 service nova] Creating event network-vif-plugged:a39c172d-a478-45f2-a4c0-54214a144697 for instance 63913865-df4f-458e-b533-73d89e43f83d on n-h1-843861-3 Jul 19 20:10:15.779236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-04de8b1d-0480-4cf6-b635-21617aea817a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.419513 Jul 19 20:10:15.783587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2417/4942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:15 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:15.784844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d1daca94-6f39-4ec4-8904-bf3e182bbf04 req-9964a75d-1b0a-4a7b-b4a1-f5a7856c3af8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069437 Jul 19 20:10:15.786429 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2526/4943] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:16.382604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:16.383231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:16.397044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.404379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.405382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.405926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.455766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:16.457358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:16.464994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.465891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.467093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.467734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.957834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:16.975109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:16.986983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:16.988170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aeae59a3-6022-40ad-a8fb-849ae2f692f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.536007 Jul 19 20:10:16.990734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:16.992376 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.615234 Jul 19 20:10:17.000099 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2527/4944] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:16 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:17.005372 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2418/4945] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:16 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:17.008364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:17.010361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:17.018726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:17.019432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:17.021475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:17.022117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:17.238913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:17.240797 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c30b341c-d205-463c-a12c-a3ddef9fdb71 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003315 Jul 19 20:10:17.241945 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2419/4946] 10.222.0.33 () {56 vars in 885 bytes} [Tue Jul 19 20:10:17 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 20:10:17.568355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:17.580799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11730333-fb46-4026-827e-498aa1e471f6 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1313 microversion: 2.1 time: 0.578965 Jul 19 20:10:17.581822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2528/4947] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:17 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:18.009569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:18.010185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:18.011978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:18.013105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:18.028548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.029296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.031040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.032039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.032554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.033069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.034888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.035568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.501879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:18.516959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:18.527017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:18.528960 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a244e9df-aefa-4b7d-8524-95e71287c4bc tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.521486 Jul 19 20:10:18.530136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2529/4948] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:18 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:18.537557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9ced0059-14cb-45d7-b7c8-eeec7b737a47 req-8ac3d750-d68c-48fb-b3f4-d34e57e2c594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "82b499e7-3534-4427-9fd5-db274d819339"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:18.567942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9ced0059-14cb-45d7-b7c8-eeec7b737a47 req-8ac3d750-d68c-48fb-b3f4-d34e57e2c594 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.573031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9ced0059-14cb-45d7-b7c8-eeec7b737a47 req-8ac3d750-d68c-48fb-b3f4-d34e57e2c594 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.619978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9ced0059-14cb-45d7-b7c8-eeec7b737a47 req-8ac3d750-d68c-48fb-b3f4-d34e57e2c594 service nova] Creating event network-vif-plugged:82b499e7-3534-4427-9fd5-db274d819339 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:18.633357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9ced0059-14cb-45d7-b7c8-eeec7b737a47 req-8ac3d750-d68c-48fb-b3f4-d34e57e2c594 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101705 Jul 19 20:10:18.637577 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2530/4949] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:18.653129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:18.654891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:18.676257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.676808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.680030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.681861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.687462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:18.700892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-482ea8e6-54cb-4ae6-9043-3870b67d843f tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.698060 Jul 19 20:10:18.712315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2420/4950] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:18 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:18.978042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:18.995789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c0974b89-9613-4d5c-966e-13160b9c471e tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1497 microversion: 2.1 time: 0.353507 Jul 19 20:10:18.998018 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2531/4951] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:18 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1497 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:19.550460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:19.551048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:19.577649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:19.578109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:19.578921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:19.579373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:19.724747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:19.726147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:19.748537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:19.749365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:19.749749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:19.750180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.385758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:20.400117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:20.424296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:20.429866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:20.431130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58bf034e-98ec-47c7-8234-ed7836571f44 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.885148 Jul 19 20:10:20.440269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:20.455015 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2421/4952] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:19 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:20.461032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0ef2102d-86cb-4366-8b61-f6d40d12b4e6 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.740208 Jul 19 20:10:20.461633 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2532/4953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:19 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:20.713515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f2625e2c-b3ee-4f00-aa7a-5e3755c3abff req-088d0c88-f057-4a83-becf-7275c99e775c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "2e04abcc-cf0d-40e7-9ff0-9148189849c0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:20.733720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f2625e2c-b3ee-4f00-aa7a-5e3755c3abff req-088d0c88-f057-4a83-becf-7275c99e775c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.734164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f2625e2c-b3ee-4f00-aa7a-5e3755c3abff req-088d0c88-f057-4a83-becf-7275c99e775c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.791321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f2625e2c-b3ee-4f00-aa7a-5e3755c3abff req-088d0c88-f057-4a83-becf-7275c99e775c service nova] Creating event network-vif-plugged:2e04abcc-cf0d-40e7-9ff0-9148189849c0 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:20.816848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f2625e2c-b3ee-4f00-aa7a-5e3755c3abff req-088d0c88-f057-4a83-becf-7275c99e775c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108595 Jul 19 20:10:20.821703 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2422/4954] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:21.457016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:21.458901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:21.480459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:21.481227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.481746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:21.484122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.485302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.487508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.512934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.513402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.514237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.514681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:22.246399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:22.262725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:22.264269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:22.265436 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fe4f30f-e7ba-4bc6-9e83-575a103e984b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.812547 Jul 19 20:10:22.279848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2533/4955] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:21 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:22.397710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:22.410130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a430e07-77ed-4a66-92cb-c3ebb42e4641 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.934025 Jul 19 20:10:22.415849 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2423/4956] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:21 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:22.862025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-08006d22-333e-48ce-ac06-9c3cd717b6c0 req-d8323ced-7296-483a-a4c2-a35d87e4daab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b085f50-4dd9-436d-b586-07bbf743446b", "name": "network-vif-plugged", "status": "completed", "tag": "3bfae0b9-7e6b-4d66-850a-60bc6edd7151"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:22.904589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08006d22-333e-48ce-ac06-9c3cd717b6c0 req-d8323ced-7296-483a-a4c2-a35d87e4daab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:22.905077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08006d22-333e-48ce-ac06-9c3cd717b6c0 req-d8323ced-7296-483a-a4c2-a35d87e4daab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:22.940575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-08006d22-333e-48ce-ac06-9c3cd717b6c0 req-d8323ced-7296-483a-a4c2-a35d87e4daab service nova] Creating event network-vif-plugged:3bfae0b9-7e6b-4d66-850a-60bc6edd7151 for instance 7b085f50-4dd9-436d-b586-07bbf743446b on n-h2-843861-3 Jul 19 20:10:22.948397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-08006d22-333e-48ce-ac06-9c3cd717b6c0 req-d8323ced-7296-483a-a4c2-a35d87e4daab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093298 Jul 19 20:10:22.954083 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2534/4957] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:23.292211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:23.293615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:23.308011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:23.310236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:23.311241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:23.313532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:23.435886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:23.436919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:23.451454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:23.454598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:23.457329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:23.458736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:23.854147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:23.873184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:23.875651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:23.881307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:23.883959 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52776924-3304-43fb-8987-40bc9e9bb0f3 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.595819 Jul 19 20:10:23.889397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f94a348-7422-4638-ae55-ab5d711cf4d4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.463166 Jul 19 20:10:23.889595 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2424/4958] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:23 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:23.890557 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2535/4959] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:23 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:24.773469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:24.774651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:24.808626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:24.809968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:24.818118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:24.819306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:24.907505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:24.918483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:24.969888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:24.971050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:24.972502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:24.975411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.021560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:25.272235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e8ebf6c-b17a-4213-9498-7e8836840e65 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 204 len: 0 microversion: 2.1 time: 0.505674 Jul 19 20:10:25.281686 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2425/4960] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:24 2022] DELETE /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:10:25.297033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:25.302632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:25.331255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.334534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.338001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.338661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.729583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:25.751638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:25.752285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:25.757214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:25.761766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7f9ab4a-bdbe-4751-ae92-45ebce6fba70 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.862675 Jul 19 20:10:25.762309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00c23f73-620f-4bf1-b945-757abb6fcc00 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1317 microversion: 2.1 time: 0.476805 Jul 19 20:10:25.763024 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2536/4961] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:24 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:25.763240 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2426/4962] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:25 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:25.770891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:25.774991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7a196bee-4eaa-4a19-888a-18bd830b94e2 req-4c8ad332-c754-44d0-baed-d4233bb792f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "70af8460-088e-4bf6-877b-0da5ae8d4875"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:25.778677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:25.787307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.788635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.792126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.794370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.801245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7a196bee-4eaa-4a19-888a-18bd830b94e2 req-4c8ad332-c754-44d0-baed-d4233bb792f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.801694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7a196bee-4eaa-4a19-888a-18bd830b94e2 req-4c8ad332-c754-44d0-baed-d4233bb792f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.822853 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7a196bee-4eaa-4a19-888a-18bd830b94e2 req-4c8ad332-c754-44d0-baed-d4233bb792f8 service nova] Creating event network-vif-plugged:70af8460-088e-4bf6-877b-0da5ae8d4875 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:25.831337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7a196bee-4eaa-4a19-888a-18bd830b94e2 req-4c8ad332-c754-44d0-baed-d4233bb792f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060150 Jul 19 20:10:25.834247 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2537/4963] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:25.842821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:25.845891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:25.886433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.886866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.889597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.890576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.953699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:26.143157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71cdce6f-299e-4810-bb94-4919823a5b0a tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 204 len: 0 microversion: 2.1 time: 0.301534 Jul 19 20:10:26.143157 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2538/4964] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:25 2022] DELETE /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:26.161848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:26.162593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:26.167248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:26.175701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-297425c3-7515-4d3f-abca-7013b584b52e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1508 microversion: 2.1 time: 0.410598 Jul 19 20:10:26.179363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2427/4965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:25 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:26.183561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.184052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.187375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.187853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.497674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:26.506451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65e47f4e-6ce9-4145-bd34-42f1cdf91d6c tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1503 microversion: 2.1 time: 0.354348 Jul 19 20:10:26.522222 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2539/4966] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:26 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:26.784442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:26.785074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:26.792671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:26.793282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:26.801837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.804541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.805621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.808423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.809717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.810942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.812299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.813040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.213033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.221114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-294cc03a-7119-4a1c-bbf1-1363962deab2 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1505 microversion: 2.1 time: 0.433063 Jul 19 20:10:27.234061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2540/4967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:26 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:27.239352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:27.240503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:27.254391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.254886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.255986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.256432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.280546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:27.358020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.367906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.370244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.371621 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-468520b8-f2eb-478d-a554-2b828c812022 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.591262 Jul 19 20:10:27.372641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2428/4968] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:26 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:27.378177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:27.379876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:27.387329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.388071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.389069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.389710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.568448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.581619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-caa9dae3-6dde-47f9-861f-c904a6afe604 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1508 microversion: 2.1 time: 0.346050 Jul 19 20:10:27.583644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2541/4969] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:27 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:27.591795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:27.592841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:27.607062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.607681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.608487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.608957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.799957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:27.808787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-886eab65-27f1-46b3-9a9f-74cbd2ed8a06 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1505 microversion: 2.1 time: 0.434958 Jul 19 20:10:27.814955 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2429/4970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:27 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:27.826701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:27.827985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:27.842565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.843027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.843848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.844358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.993108 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54002578-2f4f-43da-a84a-29b8b5eeaea7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "PUT /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1077 microversion: 2.1 time: 0.171999 Jul 19 20:10:28.000761 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2430/4971] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:10:27 2022] PUT /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1077 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:28.008894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "ec712b1a-b532-45f3-91d6-8d7b68a473ac"}, {"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "f637c253-bae6-449a-bf39-e2333c9d4de4"}, {"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "82e7fe0f-3b91-48e4-84d9-6e2ad64b993b"}, {"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-plugged", "status": "completed", "tag": "9aba40e6-cab2-4180-b28b-61e0f930d0ff"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:28.020258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.020718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.035076 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Creating event network-vif-plugged:ec712b1a-b532-45f3-91d6-8d7b68a473ac for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:28.036296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Creating event network-vif-plugged:f637c253-bae6-449a-bf39-e2333c9d4de4 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:28.036805 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Creating event network-vif-plugged:82e7fe0f-3b91-48e4-84d9-6e2ad64b993b for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:28.037310 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] Creating event network-vif-plugged:9aba40e6-cab2-4180-b28b-61e0f930d0ff for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:28.042957 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-603c5431-2372-4411-a160-c9376285b4c9 req-2bba9e8c-6108-401f-a58b-54ad98153ee2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039557 Jul 19 20:10:28.043571 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2431/4972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:28.050363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:28.051071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:28.053780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:28.059829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.060315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.061095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.061532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.266434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d0b2907ad8450eafa0b3a745c07270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a34a576524847bb90e45fb432206e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:28.276049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f59b6b86-d669-4f94-8dcb-aff808f304ec tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 200 len: 1503 microversion: 2.1 time: 0.690670 Jul 19 20:10:28.280808 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2542/4973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:27 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 1503 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:28.294371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d7e4fd22-6eac-4f34-bfd7-d8960bdb3010 req-fe97b840-9061-4b85-b348-996812b59776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63913865-df4f-458e-b533-73d89e43f83d", "name": "network-vif-deleted", "tag": "a39c172d-a478-45f2-a4c0-54214a144697"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:28.311673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:28.319835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d7e4fd22-6eac-4f34-bfd7-d8960bdb3010 req-fe97b840-9061-4b85-b348-996812b59776 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.323001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d7e4fd22-6eac-4f34-bfd7-d8960bdb3010 req-fe97b840-9061-4b85-b348-996812b59776 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.346743 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d7e4fd22-6eac-4f34-bfd7-d8960bdb3010 req-fe97b840-9061-4b85-b348-996812b59776 service nova] Creating event network-vif-deleted:a39c172d-a478-45f2-a4c0-54214a144697 for instance 63913865-df4f-458e-b533-73d89e43f83d on n-h1-843861-3 Jul 19 20:10:28.353079 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d7e4fd22-6eac-4f34-bfd7-d8960bdb3010 req-fe97b840-9061-4b85-b348-996812b59776 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070986 Jul 19 20:10:28.354149 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2543/4974] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:28.391683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:28.392545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:28.403368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.405778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.409354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.409950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.815462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:28.839541 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-173f59ad-4bec-48b0-a287-6864abc69222 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1503 microversion: 2.1 time: 0.794068 Jul 19 20:10:28.853088 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2432/4975] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:28 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1503 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:28.862690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:28.865055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:28.883468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.884683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.886711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.888076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.148834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:29.158535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:29.159966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:29.161525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ebfb7b8-7387-4d19-b5ee-cb13b449d758 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.774455 Jul 19 20:10:29.162851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2544/4976] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:28 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:10:29.167763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:29.168547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:29.175227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:29.175988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.177724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:29.179052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.441621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:29.451740 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bfef2252-a26f-45a7-bf91-2ba9f7241bee tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1508 microversion: 2.1 time: 0.596600 Jul 19 20:10:29.453029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2433/4977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:28 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1508 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:29.458713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:29.459563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] [instance: 63913865-df4f-458e-b533-73d89e43f83d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:29.466397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:29.466854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.467704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:29.468181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.487897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] HTTP exception thrown: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Request method failure captured: Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d HTTP/1.1 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w-R3ga1iNS_PEY3CeoV7ZG10VbxPHdlqwO7qrnxXNuJvWCDiv9UTJXqerlGIBO-cYTygfrclC66wqAtgDTOvsNKjNZYJYI6TKuvrUFMn-oSeKsGeilXnNrnqBsReaajwjtTHEYWzCA4tdg1xAcJ4HBhQ1qzQJfF7btObW8IaHkw5Ic Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0a34a576524847bb90e45fb432206e13 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesActionsTest-805537180 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a34a576524847bb90e45fb432206e13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a34a576524847bb90e45fb432206e13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a34a576524847bb90e45fb432206e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a34a576524847bb90e45fb432206e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesActionsTest-805537180 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0a34a576524847bb90e45fb432206e13 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesActionsTest-805537180 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesActionsTest-805537180-project Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 78d0b2907ad8450eafa0b3a745c07270 Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesActionsTest-805537180-project Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '63913865-df4f-458e-b533-73d89e43f83d'} Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:29.490510 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. Jul 19 20:10:29.495921 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:29.497211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] Returning 404 to user: Instance 63913865-df4f-458e-b533-73d89e43f83d could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:29.498309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-941c01fc-2e03-4611-b105-a40baccb3417 tempest-VolumesActionsTest-805537180 tempest-VolumesActionsTest-805537180-project] 10.222.0.33 "GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d" status: 404 len: 111 microversion: 2.1 time: 0.044019 Jul 19 20:10:29.499014 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2434/4978] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:29 2022] GET /compute/v2.1/servers/63913865-df4f-458e-b533-73d89e43f83d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:30.152484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:30.164493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4c9eb542-faa2-48c6-8000-7f0a0172f218 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1503 microversion: 2.1 time: 0.999989 Jul 19 20:10:30.165644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2545/4979] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:29 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1503 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:30.194440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:30.194440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:30.202099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:30.202748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.203650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.204673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.205047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:30.205487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.236721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.238359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.241833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.242423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.465374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-524a2d7a-a54b-454e-883f-f77061f66edc tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "PUT /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1079 microversion: 2.1 time: 0.275450 Jul 19 20:10:30.466085 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2435/4980] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:10:30 2022] PUT /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1079 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:30.480428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:30.481509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:30.492592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.492965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.494501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.494948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.015083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.030250 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-90d1625f-1ddb-4716-b7ae-8ad8808273aa tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 200 len: 1466 microversion: 2.1 time: 0.563059 Jul 19 20:10:31.036778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.040589 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2436/4981] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:30 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 1466 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:31.046399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.050717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.053268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.053898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.054673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef653183-93eb-4b3f-b07e-94ec91e4d54e tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1874 microversion: 2.32 time: 0.865473 Jul 19 20:10:31.055330 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2546/4982] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:30 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1874 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:31.061018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.061475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.062430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.062928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.064291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e55231b7-857c-4337-9f08-a5bfc4da71f6 req-59b19354-c969-4eef-b02f-38760920fa74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3053c3e-b3af-4d1e-bd5f-05fe59b9583e", "name": "network-vif-deleted", "tag": "aa9b9422-4c91-4b5e-9bc8-73542b2cd20f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:31.087251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e55231b7-857c-4337-9f08-a5bfc4da71f6 req-59b19354-c969-4eef-b02f-38760920fa74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.087699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e55231b7-857c-4337-9f08-a5bfc4da71f6 req-59b19354-c969-4eef-b02f-38760920fa74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.093996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:31.105542 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e55231b7-857c-4337-9f08-a5bfc4da71f6 req-59b19354-c969-4eef-b02f-38760920fa74 service nova] Creating event network-vif-deleted:aa9b9422-4c91-4b5e-9bc8-73542b2cd20f for instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e on n-h2-843861-3 Jul 19 20:10:31.114149 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e55231b7-857c-4337-9f08-a5bfc4da71f6 req-59b19354-c969-4eef-b02f-38760920fa74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054253 Jul 19 20:10:31.116289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2547/4983] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:31.343140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.350792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16443b97-33e3-4cb1-af79-aba857a4f473 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1505 microversion: 2.1 time: 0.308855 Jul 19 20:10:31.351587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2437/4984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:31 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:31.375381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.380410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.389364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.389820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.390882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.391522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.612008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.624735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3be445f4-2214-47a8-a15e-89a8a1b30ddf tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1505 microversion: 2.1 time: 0.260753 Jul 19 20:10:31.625836 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2548/4985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:31 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:31.641877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.642633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.654175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.654899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.656101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.657216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.699994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:31.866070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-97a40033-44f2-4d52-a4ff-228b400c610a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 204 len: 0 microversion: 2.1 time: 0.228327 Jul 19 20:10:31.880815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.881572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.883076 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2438/4986] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:31 2022] DELETE /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:31.889256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.890139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.891080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.891676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.945996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:31.996753 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.api [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Instance is already in deleting state, ignoring this request Jul 19 20:10:31.997915 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-245da8d8-3784-43b4-b245-c1f1d7ead5e5 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 204 len: 0 microversion: 2.1 time: 0.121753 Jul 19 20:10:32.001459 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2549/4987] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:31 2022] DELETE /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:32.007239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.008308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.014479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.015025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.015926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.016433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.074995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.075934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: d3053c3e-b3af-4d1e-bd5f-05fe59b9583e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.084229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.084803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.085842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.086380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.106820 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e HTTP/1.1 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd3053c3e-b3af-4d1e-bd5f-05fe59b9583e'} Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:32.111892 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. Jul 19 20:10:32.115993 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:32.117678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 404 to user: Instance d3053c3e-b3af-4d1e-bd5f-05fe59b9583e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:32.118838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cb45de72-5da2-475e-9380-83fa392c5e0e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e" status: 404 len: 111 microversion: 2.1 time: 0.053134 Jul 19 20:10:32.119975 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2550/4988] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:32 2022] GET /compute/v2.1/servers/d3053c3e-b3af-4d1e-bd5f-05fe59b9583e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:32.125828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.127295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.135310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.135915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.137913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.138565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.608494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:32.622978 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dbc56baf-4ee6-449e-9954-c98643be5cf4 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1511 microversion: 2.1 time: 0.617695 Jul 19 20:10:32.625782 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2439/4989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:32 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:32.637179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.640909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.643393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:32.654728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:32.656272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:32.657501 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-510e0755-e6ab-4e1d-9791-78aeb46173fb tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2826 microversion: 2.32 time: 0.536253 Jul 19 20:10:32.658061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2551/4990] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:32 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2826 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:32.662482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.662948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.663741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.670504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.691069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.692412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.713307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.713757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.714542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.714981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:32.746757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:32.875715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0cf895f-9959-4e12-a211-402a10025363 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.199013 Jul 19 20:10:32.876377 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2552/4991] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 20:10:32 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619/os-interface => generated 1832 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:32.977512 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df84b62e-3ae3-4b33-8102-f62f1cca2398 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 204 len: 0 microversion: 2.1 time: 0.349241 Jul 19 20:10:32.980248 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2440/4992] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:32 2022] DELETE /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:32.990372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:32.990995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:32.999441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:32.999759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:33.001210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:33.003640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:33.547169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:33.558585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fb61c58e-943b-4859-ad16-50431c281e8e tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.573377 Jul 19 20:10:33.559701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2553/4993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:32 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:33.641350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:33.642907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:33.659526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:33.660374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:33.661460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:33.662127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.297075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:34.304994 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9b8333db-c86f-4ed1-ab32-87a2d0e30c93 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1511 microversion: 2.1 time: 0.668259 Jul 19 20:10:34.308418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2441/4994] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:33 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1511 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:34.578095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:34.579151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:34.597587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:34.598111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.600584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:34.604076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.924521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ab7c4793-e3dd-4624-a07e-0c2f9294d361 req-05e65f96-b22a-465b-8f19-5d29a3b9eb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "tag": "82b499e7-3534-4427-9fd5-db274d819339"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:34.947545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:34.958863 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5287e0e0-8f24-45e7-aed3-1893230e93b9 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 0.383549 Jul 19 20:10:34.960564 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2554/4995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:34 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:34.961694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ab7c4793-e3dd-4624-a07e-0c2f9294d361 req-05e65f96-b22a-465b-8f19-5d29a3b9eb74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:34.962418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ab7c4793-e3dd-4624-a07e-0c2f9294d361 req-05e65f96-b22a-465b-8f19-5d29a3b9eb74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.995488 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ab7c4793-e3dd-4624-a07e-0c2f9294d361 req-05e65f96-b22a-465b-8f19-5d29a3b9eb74 service nova] Creating event network-changed:82b499e7-3534-4427-9fd5-db274d819339 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:10:35.020874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ab7c4793-e3dd-4624-a07e-0c2f9294d361 req-05e65f96-b22a-465b-8f19-5d29a3b9eb74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100563 Jul 19 20:10:35.029475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2442/4996] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:35.325537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:35.327009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:35.342738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:35.345063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:35.345929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:35.349027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:35.930957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:35.942861 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63419c9d-e2ba-45b5-a632-ab0df8209b7a tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1511 microversion: 2.1 time: 0.622127 Jul 19 20:10:35.946158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2555/4997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:35 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:35.981889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:35.982648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:36.007478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.011298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:36.014610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.016207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:36.961641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:36.962333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:36.980383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.988088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:36.993195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.996312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.106662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3116ed1e64fa431684c2f78c794eec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca870fb0242f4961bf3f433a7da6436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:38.132217 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f732b11-d7ff-464c-a187-52590d4bdfd3 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 200 len: 1519 microversion: 2.1 time: 2.155747 Jul 19 20:10:38.132888 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2443/4998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:35 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 1519 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:38.145402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-aadad068-e9fc-428b-bce4-88623082468e req-b74f56ea-0818-4835-bd60-f73e4c3848ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1472b512-4550-4bcb-bb8e-21ed6101cedc", "name": "network-vif-deleted", "tag": "84b864b5-4807-4300-b8c8-13ab2b4ae192"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:38.168614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-aadad068-e9fc-428b-bce4-88623082468e req-b74f56ea-0818-4835-bd60-f73e4c3848ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:38.169704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-aadad068-e9fc-428b-bce4-88623082468e req-b74f56ea-0818-4835-bd60-f73e4c3848ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.193619 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-aadad068-e9fc-428b-bce4-88623082468e req-b74f56ea-0818-4835-bd60-f73e4c3848ef service nova] Creating event network-vif-deleted:84b864b5-4807-4300-b8c8-13ab2b4ae192 for instance 1472b512-4550-4bcb-bb8e-21ed6101cedc on n-h2-843861-3 Jul 19 20:10:38.206046 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-aadad068-e9fc-428b-bce4-88623082468e req-b74f56ea-0818-4835-bd60-f73e4c3848ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069406 Jul 19 20:10:38.226085 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2444/4999] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:38.449322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:38.481213 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a1ba83e-786e-452a-b72b-1064e3c6879b tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1511 microversion: 2.1 time: 1.523173 Jul 19 20:10:38.490215 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2556/5000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:36 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1511 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:39.151332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:39.152625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] [instance: 1472b512-4550-4bcb-bb8e-21ed6101cedc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:39.160394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.161107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.162330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.162933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.204205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] HTTP exception thrown: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Request method failure captured: Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc HTTP/1.1 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w513KygDgY4Zc2S_0e74d_nkWJu6fmYxnVfbPOAIzsK2NWSb42K0rkognm4tnZnfr-joCWWHByjvrZWP1UV3rYcbhZ9KVtO-XOcsE8ce5CTDY4opA41V-AuNrO4wGXKLrksIsymTnGQz2iuIa470jNTKHQD3kn9tPEmhW-diZ741xg Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca870fb0242f4961bf3f433a7da6436f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ca870fb0242f4961bf3f433a7da6436f Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1513594406 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 3116ed1e64fa431684c2f78c794eec58 Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1513594406-project Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1472b512-4550-4bcb-bb8e-21ed6101cedc'} Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:39.206428 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. Jul 19 20:10:39.210683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:39.214170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] Returning 404 to user: Instance 1472b512-4550-4bcb-bb8e-21ed6101cedc could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:39.215339 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7038c038-a945-4efe-b3ed-4df98844f4b2 tempest-ServerRescueNegativeTestJSON-1513594406 tempest-ServerRescueNegativeTestJSON-1513594406-project] 10.222.0.33 "GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc" status: 404 len: 111 microversion: 2.1 time: 0.070416 Jul 19 20:10:39.216227 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2445/5001] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:39 2022] GET /compute/v2.1/servers/1472b512-4550-4bcb-bb8e-21ed6101cedc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:39.350386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-079441be-dfda-4440-8cd2-4ad1d614b03a req-c59b3cd6-96f9-4f74-b71c-3707369c6e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b085f50-4dd9-436d-b586-07bbf743446b", "name": "network-vif-deleted", "tag": "3bfae0b9-7e6b-4d66-850a-60bc6edd7151"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:39.366161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-079441be-dfda-4440-8cd2-4ad1d614b03a req-c59b3cd6-96f9-4f74-b71c-3707369c6e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.370402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-079441be-dfda-4440-8cd2-4ad1d614b03a req-c59b3cd6-96f9-4f74-b71c-3707369c6e16 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.405924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-079441be-dfda-4440-8cd2-4ad1d614b03a req-c59b3cd6-96f9-4f74-b71c-3707369c6e16 service nova] Creating event network-vif-deleted:3bfae0b9-7e6b-4d66-850a-60bc6edd7151 for instance 7b085f50-4dd9-436d-b586-07bbf743446b on n-h2-843861-3 Jul 19 20:10:39.421424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-079441be-dfda-4440-8cd2-4ad1d614b03a req-c59b3cd6-96f9-4f74-b71c-3707369c6e16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076684 Jul 19 20:10:39.427892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2557/5002] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:39.499683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:39.500601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:39.510310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.523994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.524964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.525417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.591281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.591981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.592516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lazy-loading 'fault' on Instance uuid 7b085f50-4dd9-436d-b586-07bbf743446b {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:10:39.735748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1c7582f89d40549e8ddeb39285c030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2cbfc4f9d54ef3baa5e824c6a2d5ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:39.750484 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1389e42-d5ee-4bdc-9d1a-062a3e4552f7 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 200 len: 1307 microversion: 2.1 time: 0.255753 Jul 19 20:10:39.751660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2446/5003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:39 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:40.772768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:40.783499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: 7b085f50-4dd9-436d-b586-07bbf743446b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:40.814816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:40.819682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:40.820633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:40.836085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:40.869831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] HTTP exception thrown: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Request method failure captured: Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b HTTP/1.1 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w7-MxjutdiYp7zqZ28ZuA9PPie9oirJ0giWH1u05nEye7wYAbkCoFYzQs8_EZOSoiUm1VuxSAgn5j5EIOl3gEHEXFq689NDW8WCuN-vFjN7Q2ph1tB0ameYovPyzBDpK9bke4D1o6aNfZ6UIr_BXTglfmTcHODbNHdAmszg7OrYF8o Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fc1c7582f89d40549e8ddeb39285c030 Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7b085f50-4dd9-436d-b586-07bbf743446b'} Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:40.873516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. Jul 19 20:10:40.880678 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.882585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Returning 404 to user: Instance 7b085f50-4dd9-436d-b586-07bbf743446b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:40.886183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54122407-aa68-442e-90a4-77b3e7bbcffb tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b" status: 404 len: 111 microversion: 2.1 time: 0.118678 Jul 19 20:10:40.887404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2558/5004] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:40 2022] GET /compute/v2.1/servers/7b085f50-4dd9-436d-b586-07bbf743446b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:40.899364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:40.900821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:40.936793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:40.937287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:40.938049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:40.949157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:40.986144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] HTTP exception thrown: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Request method failure captured: Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 HTTP/1.1 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w7-MxjutdiYp7zqZ28ZuA9PPie9oirJ0giWH1u05nEye7wYAbkCoFYzQs8_EZOSoiUm1VuxSAgn5j5EIOl3gEHEXFq689NDW8WCuN-vFjN7Q2ph1tB0ameYovPyzBDpK9bke4D1o6aNfZ6UIr_BXTglfmTcHODbNHdAmszg7OrYF8o Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fc1c7582f89d40549e8ddeb39285c030 Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'beb5f490-9d12-4e0f-987c-663df22737b4'} Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:40.990791 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:40.996337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.002796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Returning 404 to user: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:41.004808 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd196b06-01f0-4581-89e2-e77284b76303 tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 404 len: 111 microversion: 2.1 time: 0.111608 Jul 19 20:10:41.007990 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2447/5005] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:40 2022] DELETE /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:41.016437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:41.018296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: beb5f490-9d12-4e0f-987c-663df22737b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:41.037816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.039751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.042144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.045745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.085131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] HTTP exception thrown: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Request method failure captured: Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 HTTP/1.1 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w7-MxjutdiYp7zqZ28ZuA9PPie9oirJ0giWH1u05nEye7wYAbkCoFYzQs8_EZOSoiUm1VuxSAgn5j5EIOl3gEHEXFq689NDW8WCuN-vFjN7Q2ph1tB0ameYovPyzBDpK9bke4D1o6aNfZ6UIr_BXTglfmTcHODbNHdAmszg7OrYF8o Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fc1c7582f89d40549e8ddeb39285c030 Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'beb5f490-9d12-4e0f-987c-663df22737b4'} Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.089963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. Jul 19 20:10:41.095748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.098677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Returning 404 to user: Instance beb5f490-9d12-4e0f-987c-663df22737b4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:41.101586 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71868e85-1c37-4ddb-9cd6-4715d3cb4dfa tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4" status: 404 len: 111 microversion: 2.1 time: 0.090365 Jul 19 20:10:41.104455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2559/5006] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:41 2022] GET /compute/v2.1/servers/beb5f490-9d12-4e0f-987c-663df22737b4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:41.111631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:41.112683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:41.130600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.132585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.134860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.136416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.180806 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] HTTP exception thrown: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Request method failure captured: Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d HTTP/1.1 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w7-MxjutdiYp7zqZ28ZuA9PPie9oirJ0giWH1u05nEye7wYAbkCoFYzQs8_EZOSoiUm1VuxSAgn5j5EIOl3gEHEXFq689NDW8WCuN-vFjN7Q2ph1tB0ameYovPyzBDpK9bke4D1o6aNfZ6UIr_BXTglfmTcHODbNHdAmszg7OrYF8o Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fc1c7582f89d40549e8ddeb39285c030 Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c8b63046-3394-47fd-b567-9a0977c2d05d'} Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:41.186302 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.195760 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.202021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Returning 404 to user: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:41.210095 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc2e77c9-db67-48c8-a837-0faea79883ab tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 404 len: 111 microversion: 2.1 time: 0.103024 Jul 19 20:10:41.210844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2448/5007] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:41 2022] DELETE /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:41.219750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:41.219987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] [instance: c8b63046-3394-47fd-b567-9a0977c2d05d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:41.235089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.240472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.242735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.243430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.286328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] HTTP exception thrown: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Request method failure captured: Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d HTTP/1.1 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w7-MxjutdiYp7zqZ28ZuA9PPie9oirJ0giWH1u05nEye7wYAbkCoFYzQs8_EZOSoiUm1VuxSAgn5j5EIOl3gEHEXFq689NDW8WCuN-vFjN7Q2ph1tB0ameYovPyzBDpK9bke4D1o6aNfZ6UIr_BXTglfmTcHODbNHdAmszg7OrYF8o Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a2cbfc4f9d54ef3baa5e824c6a2d5ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0a2cbfc4f9d54ef3baa5e824c6a2d5ce Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1010853641 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fc1c7582f89d40549e8ddeb39285c030 Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiskConfigTestJSON-1010853641-project Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c8b63046-3394-47fd-b567-9a0977c2d05d'} Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:41.292411 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. Jul 19 20:10:41.297105 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:10:41.298462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] Returning 404 to user: Instance c8b63046-3394-47fd-b567-9a0977c2d05d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:41.301922 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69ff1566-7385-415c-a841-8395f639b63c tempest-ServerDiskConfigTestJSON-1010853641 tempest-ServerDiskConfigTestJSON-1010853641-project] 10.222.0.33 "GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d" status: 404 len: 111 microversion: 2.1 time: 0.087044 Jul 19 20:10:41.305190 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2560/5008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:41 2022] GET /compute/v2.1/servers/c8b63046-3394-47fd-b567-9a0977c2d05d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:52.239589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:52.241044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:52.837719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1790135829", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:52.950702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:10:52.951339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:10:52.960663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:10:52.961463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:10:52.962054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:10:52.985656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:52.986157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:52.987167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:52.987895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:53.034758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Getting quotas for project 6864ad0a29f94354804284f83afe69ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:10:53.053586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Getting quotas for user 9255e13bea4a4bd78cbd7b7e1daf3353 and project 6864ad0a29f94354804284f83afe69ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:10:53.074615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:10:53.085453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:10:53.205673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d425d0e-00cd-4d43-8b02-14c4f5449276 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.973112 Jul 19 20:10:53.215337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2449/5009] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:10:53.220434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:53.221282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:53.257799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=35 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:53.267891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:54.079682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:54.091598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:54.095820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:54.098966 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36309de8-a38e-4c75-a366-aa93d8e356e9 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1278 microversion: 2.54 time: 0.881026 Jul 19 20:10:54.116269 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2561/5010] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:53 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1278 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:55.138881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:55.140291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:55.156224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.168583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.170193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.170862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.431461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:55.490144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:55.504544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:55.512420 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-69f9d0a9-889c-4922-b243-603564057175 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1338 microversion: 2.54 time: 0.378716 Jul 19 20:10:55.532290 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2450/5011] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:55 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1338 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:56.552134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:56.553308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:56.575547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:56.576088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:56.576971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:56.577312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:56.716953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:56.734591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:56.739206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:56.739206 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a257cc9-bd46-403a-9d52-1b178a87b793 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1336 microversion: 2.54 time: 0.191272 Jul 19 20:10:56.745475 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2562/5012] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:56 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:57.765935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:57.766725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:57.790208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:57.792469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:57.794115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:57.795509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:57.971181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:57.982558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:57.984533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:57.985961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bd9730f-82d5-4008-bb7d-baa7bfa43240 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1336 microversion: 2.54 time: 0.227109 Jul 19 20:10:57.999658 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2451/5013] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:57 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:10:59.008778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:59.010275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:59.041523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.041989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.042782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.043217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.331948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:59.347436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:59.351434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:59.353902 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-92fda672-8ed3-4c13-a783-3de2d6e254de tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1336 microversion: 2.54 time: 0.349199 Jul 19 20:10:59.369458 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2563/5014] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:10:59 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:00.379036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:00.380961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:00.390016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:00.390724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:00.391693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:00.392305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:00.514425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:00.533255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:00.534809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:00.536549 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e14303ed-36ff-436e-a144-1662f6482899 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1336 microversion: 2.54 time: 0.161186 Jul 19 20:11:00.548765 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2452/5015] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:00 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:01.556218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:01.557044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:01.578822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.581473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.590859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.593742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.766473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:01.795420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:01.803045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:01.805132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5c2203d-3545-4aaf-814a-dfc9f7149303 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1357 microversion: 2.54 time: 0.254220 Jul 19 20:11:01.808440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2564/5016] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:01 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:01.834037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9156d9e4-a982-4202-87c9-7a00016d9b36 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Action: 'create', calling method: .version_select at 0x7fb893012f70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-914108079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9CMl88stw6kghZoGsdW9/1QUVlk5p+GpAs29Me7WVVvh/tSILQZqbJeDOdholCZ+Kg4EV+DvBfucrtqwwukRxu9/ebZJW/WE+YUys8OCBCptSQWsy1JsQdsBwaCHkBng=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:01.876985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9156d9e4-a982-4202-87c9-7a00016d9b36 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Getting quotas for project 6864ad0a29f94354804284f83afe69ae. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:11:01.897964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-9156d9e4-a982-4202-87c9-7a00016d9b36 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Getting quotas for user 9255e13bea4a4bd78cbd7b7e1daf3353 and project 6864ad0a29f94354804284f83afe69ae. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:11:01.955830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9156d9e4-a982-4202-87c9-7a00016d9b36 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.126683 Jul 19 20:11:01.962287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2453/5017] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 19 20:11:01 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:11:01.968001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-914108079", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:01.971660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:01.987495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.994812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.995912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.996638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.203718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:11:02.208859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:11:02.210746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:11:02.214902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:11:02.215895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:11:02.388998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:02.404705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.405242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.406307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.410580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.475555 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a320070-ef6d-499f-8a35-91064a17801a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "POST /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8/action" status: 202 len: 1139 microversion: 2.54 time: 0.512038 Jul 19 20:11:02.478739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2565/5018] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Jul 19 20:11:01 2022] POST /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8/action => generated 1139 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 19 20:11:02.494224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:02.494839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:02.512221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.512669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.520013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.520992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.751518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:02.762240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:02.769278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:02.770874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4742c62d-cf9b-4dc5-840a-3f8f6201b829 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.280656 Jul 19 20:11:02.783142 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2454/5019] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:02 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:03.793001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:03.794468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:03.812466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.813125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:03.814865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.817602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:04.005960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:04.021844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:04.041121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:04.043053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ca05556-f453-49a2-96ac-f4a0f4b20400 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.255984 Jul 19 20:11:04.044503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2566/5020] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:03 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:05.063156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:05.063783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:05.070899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:05.087087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:05.087537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:05.088365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:05.094375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:05.366479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:05.388679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:05.390934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:05.395744 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2baf3dd-8b7b-4528-a146-e8d8bafcc963 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.335571 Jul 19 20:11:05.397534 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2455/5021] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:05 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:05.467832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:06.296385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-470945860", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:06.391533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] validate_networks() for [('1d2368b8-1ae8-4077-92f6-59fe745d3319', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:11:06.427242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:06.430387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:06.458198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:06.463606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:06.468062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:06.474437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:06.698448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:06.714119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:06.719116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:06.723775 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77996a0f-952a-4a87-a91d-10a69bfdad2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.303854 Jul 19 20:11:06.726653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2456/5022] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:06 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:07.748058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:07.750168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:07.764060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.765166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:07.766216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.766881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:08.015034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.033870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.040045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.045707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e12297c8-3ae6-4db5-b0f2-794b0f827a1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.301200 Jul 19 20:11:08.049634 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2457/5023] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:07 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:08.095228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:11:08.096929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:11:08.098150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:11:08.099330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:11:08.100288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:11:08.119518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:08.120504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:08.121813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:08.122606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:08.169618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Getting quotas for project cd1922a4c28c4a858e24f06ad4ba30ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:11:08.186249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Getting quotas for user 76616d6870784779990c44b483c3d55b and project cd1922a4c28c4a858e24f06ad4ba30ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:11:08.222530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:11:08.228905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:11:08.376833 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60bf1130-a4dd-40b4-9f06-25e47ec753aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.915184 Jul 19 20:11:08.378305 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2567/5024] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:11:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:11:08.390820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a18e1d47-33b6-435c-83b2-db9b4a602b3c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:08.391840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a18e1d47-33b6-435c-83b2-db9b4a602b3c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:08.605961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a18e1d47-33b6-435c-83b2-db9b4a602b3c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.621898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a18e1d47-33b6-435c-83b2-db9b4a602b3c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1213 microversion: 2.1 time: 0.236361 Jul 19 20:11:08.622527 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2458/5025] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:08 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1213 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:09.077282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:09.078060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:09.102860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.105760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.107847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.110012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.343151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:09.366938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:09.373273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:09.378104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ebb94e7a-7469-449b-a0ae-5c798250ceac tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.314617 Jul 19 20:11:09.381591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2568/5026] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:09 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:09.648023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:09.651009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:09.690796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.691789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.692619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.708049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.888979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:09.909878 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e68ca0c-60bd-4aa5-b5d0-8beb4022a51e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1265 microversion: 2.1 time: 0.269178 Jul 19 20:11:09.922093 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2459/5027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:09 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:10.445813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:10.446673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:10.457198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:10.458090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:10.462752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:10.463612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:10.712810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:10.729861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:10.731400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:10.732632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a66f41f-96c9-4a04-8357-37240b3f2751 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.326892 Jul 19 20:11:10.741652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2569/5028] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:10 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:10.930779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:10.931353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:10.940517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:10.940979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:10.941817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:10.942264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.173633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:11.181665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9848cc8-26ab-4f90-9409-7fbfa97b766f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1271 microversion: 2.1 time: 0.255177 Jul 19 20:11:11.182301 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2460/5029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:10 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:11.752165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:11.753013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:11.788751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.789633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.790711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.791834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:12.117474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:12.135136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:12.149198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:12.153923 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ec579e20-3398-41db-8d95-5e54973db3d5 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.405552 Jul 19 20:11:12.155419 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2570/5030] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:11 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:12.236237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:12.237112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:12.280806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:12.290915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:12.299398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:12.300214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:12.478533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:12.495312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d43cdab-fd5e-4763-950f-7decb2cde73b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1271 microversion: 2.1 time: 0.286925 Jul 19 20:11:12.502111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2461/5031] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:12 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:13.173176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:13.173916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:13.183784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.183784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.192862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.193295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.392788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:13.404792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:13.406781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:13.411269 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4264d95f-a28f-44d7-8db7-701cfc813626 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.238911 Jul 19 20:11:13.414390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2571/5032] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:13 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:13.519779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:13.521296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:13.537814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.541823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.542654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.543104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:14.344317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.367593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d608042d-801a-4ea9-863d-6eff7a01f282 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.858448 Jul 19 20:11:14.368891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2462/5033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:13 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:14.432990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:14.434249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:14.446466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:14.452257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:14.454313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:14.458964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:14.641266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.659133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.666121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.670649 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1a56cf8-8d02-45cd-814d-46a037a4ecd1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.243363 Jul 19 20:11:14.672038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2572/5034] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:14 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:15.384515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:15.386035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:15.415779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:15.418823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:15.421349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:15.423431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:15.723798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:15.732695 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e1ff7547-129b-42ab-9653-f6af409d9553 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.352026 Jul 19 20:11:15.741392 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2463/5035] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:15 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:15.747386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:15.748258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:15.762285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:15.763276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:15.766470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:15.766944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:15.925824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6fbe6522-1552-434e-bc5f-118466b22773 req-93d523cb-9405-4425-a187-e84aa0008dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8c6434-6a62-45fb-ad56-2c1da6cf2422", "tag": "7d1e5cb4-a455-46ac-8589-19165417dacb"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:15.937833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:15.945051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6fbe6522-1552-434e-bc5f-118466b22773 req-93d523cb-9405-4425-a187-e84aa0008dbc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:15.945865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6fbe6522-1552-434e-bc5f-118466b22773 req-93d523cb-9405-4425-a187-e84aa0008dbc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:15.950865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:15.953756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:15.958021 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1c08fe56-7269-499d-971e-05b33f0f21aa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.215211 Jul 19 20:11:15.961408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2464/5036] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:15 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:15.981887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6fbe6522-1552-434e-bc5f-118466b22773 req-93d523cb-9405-4425-a187-e84aa0008dbc service nova] Creating event network-changed:7d1e5cb4-a455-46ac-8589-19165417dacb for instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 on n-h1-843861-3 Jul 19 20:11:15.996529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6fbe6522-1552-434e-bc5f-118466b22773 req-93d523cb-9405-4425-a187-e84aa0008dbc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477520 Jul 19 20:11:15.996996 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2573/5037] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:11:16.760242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:16.761721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:16.788861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:16.790118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:16.791302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:16.792138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:16.983337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:16.984259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:16.998895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:16.999697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.000707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.001392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.019208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:17.031058 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eef4753b-0891-4716-ac91-215557e2b800 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.284335 Jul 19 20:11:17.032759 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2465/5038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:16 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:17.126103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:17.138226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:17.141757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:17.147597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-031bad70-2e52-49f9-91fd-dc90fac2f20c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.165473 Jul 19 20:11:17.150176 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2574/5039] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:16 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:17.712143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:17.714150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:17.734572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.735193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.736119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.736747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.053777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:18.055638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:18.066733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.067646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.069699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.070345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.160327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:18.246149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:18.470336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.493321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.494938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.496406 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6729b223-d9eb-4578-85e9-ef07cb42cb73 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2944 microversion: 2.32 time: 0.790127 Jul 19 20:11:18.497180 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2466/5040] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:17 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2944 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:18.502505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:18.509356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:18.534055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.534709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.536543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.537405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.617244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:18.795851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.805835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.823067 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e123081b-a532-47fe-b9d8-4d65f4d5a9a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.777764 Jul 19 20:11:18.823852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2575/5041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:18 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:18.828973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:18.834222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:18.841482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.844037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:18.844872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.845543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.846829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5b3f3b0-5881-4e7b-a429-8ac5f1716417 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.348501 Jul 19 20:11:18.848285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2467/5042] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:18 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:18.849946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.851024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.256942 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-27d3c252-9b06-4363-b68b-de8c3be19220 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.431868 Jul 19 20:11:19.257968 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2576/5043] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 20:11:18 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619/os-interface => generated 1832 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:19.848171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:19.849140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:19.878365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:19.879969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:19.899696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:19.900427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.901295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:19.901742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.902285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:19.904409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.908584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:19.911329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.984952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:20.128130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:20.147796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:20.157536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:20.175851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:20.185874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-251a6183-a205-4565-9e2d-75c028813995 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.319270 Jul 19 20:11:20.190511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2577/5044] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:19 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:20.474129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:20.500231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-232f2cbb-ab98-43f8-aaf9-fe8dfd19d8ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.658374 Jul 19 20:11:20.500948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2468/5045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:19 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:21.213938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:21.215428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:21.237529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.249444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:21.251071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.251995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:21.444080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:21.484433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:21.487911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:21.490737 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-089e16f7-24ee-46b8-83b8-d3120db60e55 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.283791 Jul 19 20:11:21.502174 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2578/5046] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:21 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:21.521694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:21.522812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:21.584851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.586934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:21.588488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.589834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:21.938561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:21.952490 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-337fd162-d8b3-4efe-8096-8908d41ea872 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.438139 Jul 19 20:11:21.953924 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2469/5047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:21 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:22.510871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:22.512150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:22.525705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:22.532612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:22.533471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:22.533923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:22.700597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:22.714612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:22.716749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:22.727528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8758d010-0d51-4794-8a28-e39ee6cefca4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.220353 Jul 19 20:11:22.742451 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2579/5048] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:22 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:22.972221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:22.973325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:22.983854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:22.987506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:22.989899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:22.991039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.111998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5d4d0672-a656-44a2-9664-8853b6aa9189 req-160f5024-35da-4329-ae67-036f351f307a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8c6434-6a62-45fb-ad56-2c1da6cf2422", "name": "network-vif-plugged", "status": "completed", "tag": "7d1e5cb4-a455-46ac-8589-19165417dacb"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:23.128014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:23.138410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d4d0672-a656-44a2-9664-8853b6aa9189 req-160f5024-35da-4329-ae67-036f351f307a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.143452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d4d0672-a656-44a2-9664-8853b6aa9189 req-160f5024-35da-4329-ae67-036f351f307a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.166341 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5d4d0672-a656-44a2-9664-8853b6aa9189 req-160f5024-35da-4329-ae67-036f351f307a service nova] Creating event network-vif-plugged:7d1e5cb4-a455-46ac-8589-19165417dacb for instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 on n-h1-843861-3 Jul 19 20:11:23.186311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5d4d0672-a656-44a2-9664-8853b6aa9189 req-160f5024-35da-4329-ae67-036f351f307a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.466641 Jul 19 20:11:23.192117 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2470/5049] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:11:23.453551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:23.465682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb852337-36d3-4192-98fa-00b58b7b9197 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 0.498762 Jul 19 20:11:23.480620 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2580/5050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:22 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:23.749854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:23.750481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:23.767235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.767698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.768621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.768966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.935223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:23.945096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:23.949414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:23.955727 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0e588e7-9617-426c-a340-47ab50a605f4 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.212491 Jul 19 20:11:23.973871 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2471/5051] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:23 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:24.489958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:24.490572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:24.508268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:24.510074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:24.511153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:24.512141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:24.512739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:24.980631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:24.981279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:25.012788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:25.013372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:25.018569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:25.023203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:25.634417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:25.650387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:25.652299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:25.653701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f70a5172-05f9-4318-b241-a33144602600 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.678439 Jul 19 20:11:25.674558 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2472/5052] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:24 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:25.735948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:25.747900 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7aff8061-df57-41d5-a384-b5cfa75d7f84 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1313 microversion: 2.1 time: 1.263065 Jul 19 20:11:25.748720 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2581/5053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:24 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1313 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:26.672385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:26.673650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:26.682961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:26.685281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:26.690361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.700325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.701091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.701604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.707140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.708264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.710487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.715056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.820074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c53c11ff-4d68-462e-94e7-1a03513ba42e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.141776 Jul 19 20:11:26.821082 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2473/5054] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 19 20:11:26 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:26.843696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:26.844896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:26.862127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.863960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.865511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.866770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.994953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:27.011014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:27.018911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:27.022602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a7059d0-011b-4a5a-a6e5-269b9b15af70 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.349240 Jul 19 20:11:27.023720 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2582/5055] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:26 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:27.035672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:27.036140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:27.056202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.056662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.057449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.060093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.112179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:11:27.151323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:27.167778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f910d704-cf83-4513-931d-28046a1690b0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1500 microversion: 2.1 time: 0.340505 Jul 19 20:11:27.169943 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2474/5056] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:26 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1500 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:27.195792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:27.203594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:27.214375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.215162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.217212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.218006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.278495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78f9d09a-24e6-42f3-bf1a-55ebe21001b1 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 204 len: 0 microversion: 2.20 time: 0.251697 Jul 19 20:11:27.290357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lazy-loading 'flavor' on Instance uuid 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:11:27.302336 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2583/5057] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:11:27 2022] DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:11:27.328825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:27.333067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:27.352594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.354225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.358479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.362205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.501428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e76074f-4bbd-475e-9dcc-44dfad0b7a81 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "POST /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422/action" status: 200 len: 32 microversion: 2.1 time: 0.318361 Jul 19 20:11:27.514321 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2475/5058] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:11:27 2022] POST /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:11:27.551100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:27.553579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:27.567841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.569070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.570706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:27.571770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:28.076538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.090022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.091938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.096789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffd1c156-9a17-43f9-afb2-e8a2ffffea80 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.786822 Jul 19 20:11:28.110307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2584/5059] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:27 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:28.112143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:28.113057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:28.132762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:28.135908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:28.136964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:28.138359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:28.273938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.314751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ebb2a47-26b5-44d0-9bb3-c8fb999b556d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.797933 Jul 19 20:11:28.322428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2476/5060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:27 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:28.336870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.351014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.356689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.359709 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8d0808e-95fd-4e68-9082-35f17d19c37b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.259756 Jul 19 20:11:28.360354 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2585/5061] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:28 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:29.119502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:29.120144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:29.141681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.160974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.162765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.164359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.381869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:29.383278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:29.393733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.395562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.396809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.397644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.533321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.567369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.569280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.570687 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2385231-3553-41a7-bdfc-5a7d676fcb1d tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.195346 Jul 19 20:11:29.572109 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2586/5062] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:29 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:29.577972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:29.578825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:29.589659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.591858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.594487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.595201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.917841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.931343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.932923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.934260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cc55cc2-5350-483e-9b5f-c7ae98ff6ce9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1724 microversion: 2.20 time: 0.819149 Jul 19 20:11:29.936227 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2477/5063] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:29 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1724 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:30.124589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:30.139266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f1b952a-57da-429f-b8b7-0f0b8fc6849c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.565112 Jul 19 20:11:30.144842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2587/5064] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:29 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:30.593308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:30.594426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:30.621547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.625282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:30.627061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.627791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:30.965236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:30.966103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:30.979327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.979788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:30.981278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.985693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.074098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.085193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.087420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.089170 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3ccfe05-42cc-47b8-8348-cd390a986eb1 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.500853 Jul 19 20:11:31.090365 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2478/5065] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:30 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:31.165945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:31.167975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:31.174330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:31.174782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.176243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:31.176909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.209845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.223854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.237852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.251597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d628c8b5-03a7-4196-b908-feac066c6326 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1656 microversion: 2.20 time: 0.279724 Jul 19 20:11:31.251597 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2588/5066] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:30 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1656 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:31.889136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.900204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0ef8a30-1888-491a-8cb5-f618b716e495 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.742162 Jul 19 20:11:31.901318 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2479/5067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:31 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:32.113890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:32.114483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:32.132705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.133165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.133960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.134399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.259061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:32.260364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:32.269670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.272372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.273371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.275171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.448402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.529676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.529970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.537653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.544780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a199770-f4a4-4d36-9eaa-0fce72b4cbfa tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.435926 Jul 19 20:11:32.546521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.553126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61fded06139c4a678720e043ef773dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcff3b941e4198a38cd8b20b306ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:32.554462 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87c459c9-12cd-443f-b535-b911d8e31a00 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 200 len: 1656 microversion: 2.20 time: 0.299430 Jul 19 20:11:32.556325 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2480/5068] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:32 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 1656 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:32.561631 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2589/5069] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:32 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:32.565337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-18f0e22d-0b8e-4a17-8b7b-ccc199333c1e req-cc1da470-17e7-4681-9099-a53178e05f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf3a02-8ecc-4df0-b623-df28efee120b", "name": "network-vif-deleted", "tag": "3f636120-6ee4-4db9-a6a9-7207e629cbca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:32.575526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18f0e22d-0b8e-4a17-8b7b-ccc199333c1e req-cc1da470-17e7-4681-9099-a53178e05f11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.576855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18f0e22d-0b8e-4a17-8b7b-ccc199333c1e req-cc1da470-17e7-4681-9099-a53178e05f11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.607564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-18f0e22d-0b8e-4a17-8b7b-ccc199333c1e req-cc1da470-17e7-4681-9099-a53178e05f11 service nova] Creating event network-vif-deleted:3f636120-6ee4-4db9-a6a9-7207e629cbca for instance 00bf3a02-8ecc-4df0-b623-df28efee120b on n-h2-843861-3 Jul 19 20:11:32.620025 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-18f0e22d-0b8e-4a17-8b7b-ccc199333c1e req-cc1da470-17e7-4681-9099-a53178e05f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061735 Jul 19 20:11:32.621324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2481/5070] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:11:32.925691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:32.926394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:32.933357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.933816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.936759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.937400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.426068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.436710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-381c4ac6-91bb-4869-8d65-c7cbd9403c4a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.513357 Jul 19 20:11:33.439091 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2590/5071] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:32 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:33.573697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:33.574236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:33.574760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:33.574964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:33.585022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.585489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.586385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.586834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.591376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.592190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.593776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.596337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.645403 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b HTTP/1.1 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '00bf3a02-8ecc-4df0-b623-df28efee120b'} Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:33.647670 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:33.653612 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:33.654910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:33.658524 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a160f071-755e-4b66-aa34-60a061e9dbf4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 404 len: 111 microversion: 2.20 time: 0.088799 Jul 19 20:11:33.663618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2591/5072] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:33 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:11:33.680156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7384baa9-cce0-4921-ae1a-bf1c8bc17fce tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '.version_select at 0x7fb88cb9d9d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:33.725243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7384baa9-cce0-4921-ae1a-bf1c8bc17fce tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365589661" status: 204 len: 0 microversion: 2.20 time: 0.054913 Jul 19 20:11:33.730582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2592/5073] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Jul 19 20:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365589661 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:11:33.839975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.854983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.857430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.861382 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-425d1781-c6ba-4027-8184-15d9e37a9e72 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1408 microversion: 2.54 time: 0.291567 Jul 19 20:11:33.865056 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2482/5074] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:33 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:34.462021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:34.463226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:34.499547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.507174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.519943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.520847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.888929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:34.889652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:34.922790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.926167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.929660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.933411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:35.125341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.139801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.143326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.145708 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a9819f07-b1bb-4f9d-b197-e1f472fc3f12 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1414 microversion: 2.54 time: 0.260429 Jul 19 20:11:35.146865 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2483/5075] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:34 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1414 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:35.367166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.395927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e730a4ed-0b3e-43b5-ac97-4ba163c6a084 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.940490 Jul 19 20:11:35.413047 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2593/5076] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:34 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:36.166857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:36.167641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:36.192466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.194469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.200551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.203097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.273110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:36.399271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.415094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.417325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.418737 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8426b37d-ea55-4aa1-9754-a8b5560b5c0b tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1414 microversion: 2.54 time: 0.256329 Jul 19 20:11:36.418861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:36.419386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:36.420845 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2484/5077] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:36 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1414 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:36.449312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.450536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.454900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.455726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.527267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:36.827082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.858803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dcd4d8bd-f0f9-4111-ab55-2d5b9e840124 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.441802 Jul 19 20:11:36.874038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2594/5078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:36 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:37.443849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:37.444779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:37.461665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.464633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:37.466504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.467572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:37.668215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:37.682184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:37.685032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:37.694260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c385511d-236f-4933-9b93-012522873440 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1414 microversion: 2.54 time: 0.250592 Jul 19 20:11:37.708404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2485/5079] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:37 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1414 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:37.888365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:37.892408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:37.908573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.913866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:37.915082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.916040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.397083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:38.411457 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d59c246-7ad3-47a4-867a-62705b886976 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.529402 Jul 19 20:11:38.412823 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2595/5080] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:37 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:38.725763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:38.730379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:38.750294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.751035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.756207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.756986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.954124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.006158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.022080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.027273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecb318c9-2791-4a08-bf6a-2c68984a3174 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1414 microversion: 2.54 time: 0.308633 Jul 19 20:11:39.032339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2486/5081] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:38 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1414 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:39.439859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:39.440494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:39.451800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.452281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.453065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.453494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.864341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.905454 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-edfdb52b-8661-4474-b7ed-09618f7464d8 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.470171 Jul 19 20:11:39.915699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2596/5082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:39 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:40.057988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.060925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:40.091200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.093793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.097919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.098607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.291751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:40.304673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:40.317428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:40.319296 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c0fafb7-560b-473e-bbbb-7a975f254521 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1399 microversion: 2.54 time: 0.271878 Jul 19 20:11:40.324679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2487/5083] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:40 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1399 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:40.350020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d50eb67f-92b6-46ff-8558-23901ea07a2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '.version_select at 0x7fb88d36c0d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.378787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.379439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:40.389167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.391666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.393371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.394154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.403088 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d50eb67f-92b6-46ff-8558-23901ea07a2e tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-914108079" status: 204 len: 0 microversion: 2.54 time: 0.060659 Jul 19 20:11:40.404211 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2597/5084] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 19 20:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-914108079 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:11:40.435751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.436697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:40.442447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b HTTP/1.1 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '00bf3a02-8ecc-4df0-b623-df28efee120b'} Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:40.444366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.449156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.452057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:40.453218 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-380bdbd4-c99c-4566-b8d7-1f65c0517bc9 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 404 len: 111 microversion: 2.20 time: 0.078853 Jul 19 20:11:40.456039 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2488/5085] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:11:40 2022] DELETE /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:11:40.480783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.484618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 00bf3a02-8ecc-4df0-b623-df28efee120b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:40.486963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.499058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.505365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.505904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.514736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.515203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.516125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.521747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.560171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:11:40.575200 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b HTTP/1.1 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '00bf3a02-8ecc-4df0-b623-df28efee120b'} Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.581722 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. Jul 19 20:11:40.586887 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:40.591344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 00bf3a02-8ecc-4df0-b623-df28efee120b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:40.601408 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08358dd2-fcdb-498d-bc3b-a024dc0dfdc4 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b" status: 404 len: 111 microversion: 2.20 time: 0.139760 Jul 19 20:11:40.605001 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2489/5086] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:40 2022] GET /compute/v2.1/servers/00bf3a02-8ecc-4df0-b623-df28efee120b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:11:40.729516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a776eee-c7ab-4095-9b8c-b4d15a14de8a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 204 len: 0 microversion: 2.54 time: 0.294157 Jul 19 20:11:40.733412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2598/5087] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:11:40 2022] DELETE /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:11:40.751404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.752189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:40.795035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.796474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.807457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:40.808939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.946740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:40.953769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:41.012750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.013406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:41.021373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.026028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:41.499848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:41.519692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:41.521826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:41.523443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-823fad3d-4b6d-474f-8dae-cdabe9bacc0c tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1405 microversion: 2.54 time: 0.785187 Jul 19 20:11:41.528207 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2490/5088] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:40 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1405 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:42.233916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.244366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e75720d-7327-4b61-bbf5-442a45635ffb tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 1.306481 Jul 19 20:11:42.265656 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2599/5089] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:40 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:42.548639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:42.550035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:42.574238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.575859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.582212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.584250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.799721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.834179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.835940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.837206 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfc8178c-32fa-4ca8-841d-91ab74ea2e14 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1405 microversion: 2.54 time: 0.292531 Jul 19 20:11:42.848189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2491/5090] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:42 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:11:43.278344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:43.281662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:43.317990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.320077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.325016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.328496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.858776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:43.859408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:43.897804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.898283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.899073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.908052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:44.058738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.077199 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6b2e68e-bd11-4628-9d8e-3693a8108c83 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.806706 Jul 19 20:11:44.078602 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2600/5091] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:43 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:44.456590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.468351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.474065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9255e13bea4a4bd78cbd7b7e1daf3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6864ad0a29f94354804284f83afe69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.480592 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3fc0f955-ca09-4b60-9d12-004618d1be3a tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 200 len: 1405 microversion: 2.54 time: 0.625719 Jul 19 20:11:44.488723 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2492/5092] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:43 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 1405 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:11:45.106910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:45.108579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:45.147092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.148747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.151844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.153433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.503336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:45.504500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] [instance: 28d1a961-cd4b-401c-b12b-addacfaa37e8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:45.518925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.519382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.520214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.526117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.584312 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] HTTP exception thrown: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Request method failure captured: Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 HTTP/1.1 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w_Mt_gMbDy-IKUY4PjpvZuIO2NjwW1mS9Ui2ZbB2FRwdJBfSvk2jmyHvmNH0DzYQTigVOeMqYdu3skN965kzJPECUOFu6r6BcM6KFnqYsk56rAXh5bTWia1fTrk2fONLTA_v_IONzQQeuhwKQSWMeBg83e_5tJB6q_r47BY0dju3Q8 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.54 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6864ad0a29f94354804284f83afe69ae Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerShowV254Test-1976325042 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6864ad0a29f94354804284f83afe69ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6864ad0a29f94354804284f83afe69ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6864ad0a29f94354804284f83afe69ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6864ad0a29f94354804284f83afe69ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerShowV254Test-1976325042 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6864ad0a29f94354804284f83afe69ae Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerShowV254Test-1976325042 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerShowV254Test-1976325042-project Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9255e13bea4a4bd78cbd7b7e1daf3353 Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerShowV254Test-1976325042-project Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '28d1a961-cd4b-401c-b12b-addacfaa37e8'} Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:45.591261 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] Returning 404 to user: Instance 28d1a961-cd4b-401c-b12b-addacfaa37e8 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0fcbf11b-fd37-46b8-a4ea-c8f22afa70f6 tempest-ServerShowV254Test-1976325042 tempest-ServerShowV254Test-1976325042-project] 10.222.0.33 "GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8" status: 404 len: 111 microversion: 2.54 time: 0.094059 Jul 19 20:11:45.599912 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2493/5093] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:45 2022] GET /compute/v2.1/servers/28d1a961-cd4b-401c-b12b-addacfaa37e8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:11:46.081173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:46.164691 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1f5c831-a825-4208-b4be-e5f4be7550a7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 1.070170 Jul 19 20:11:46.167791 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2601/5094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:45 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:47.185181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:47.185796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:47.200601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.201064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.204446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.204899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.917104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:47.919058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:47.938540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.939294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.940501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.966828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.972680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:48.005897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b14b955-57bf-47bb-869c-63a982b71f9a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.821374 Jul 19 20:11:48.009746 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2494/5095] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:47 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:48.020871 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 HTTP/1.1 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '21e5b374-dea7-4797-9d14-c0350b8fb054'} Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:48.026922 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.031944 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.034840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:48.042528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-335d2587-aabc-4bc5-b6c5-be6aafe32556 tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 404 len: 111 microversion: 2.20 time: 0.130835 Jul 19 20:11:48.046064 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2602/5096] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:11:47 2022] DELETE /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:11:48.055186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:48.056317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] [instance: 21e5b374-dea7-4797-9d14-c0350b8fb054] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:48.076484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:48.080881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:48.085530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:48.086522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:48.142870 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] HTTP exception thrown: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Request method failure captured: Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 HTTP/1.1 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w33wukuGtq2wEo71YYNRgKxmMKMsTZU1v6s5buUAOabsJnH2G-br9UIoijNOlhvpH9McdTY5FKCUnRaVMRxbo1UJKnA3QsYNM4Wi2HCU95iiEoP0b0Wnj0H5quV5EfKf5n8o6R-PcPhhJCmWofqO-rBoq-0G-oXPYycOmhHMqkvy2Q Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2bcff3b941e4198a38cd8b20b306ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a2bcff3b941e4198a38cd8b20b306ac8 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599486578 Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 61fded06139c4a678720e043ef773dfa Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599486578-project Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '21e5b374-dea7-4797-9d14-c0350b8fb054'} Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.146852 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. Jul 19 20:11:48.151633 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:11:48.154241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] Returning 404 to user: Instance 21e5b374-dea7-4797-9d14-c0350b8fb054 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:48.155413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b303cd0-a203-48bd-bb76-7711373d791e tempest-AttachVolumeShelveTestJSON-1599486578 tempest-AttachVolumeShelveTestJSON-1599486578-project] 10.222.0.33 "GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054" status: 404 len: 111 microversion: 2.20 time: 0.106421 Jul 19 20:11:48.156264 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2495/5097] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:11:48 2022] GET /compute/v2.1/servers/21e5b374-dea7-4797-9d14-c0350b8fb054 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:11:49.026839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:49.047924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:49.106857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.109897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.110864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.111314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:50.632961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:50.648256 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3df68bd-7a76-4a29-aa08-e77ac1102095 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 1.625933 Jul 19 20:11:50.656959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2603/5098] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:49 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:51.667455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:51.668799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:51.686165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:51.686621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:51.687405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:51.687855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:52.480523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:52.488664 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8643692b-1171-4c24-b906-255c6e1a6d7f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.826677 Jul 19 20:11:52.489271 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2496/5099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:51 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:53.514968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:53.517456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:53.536096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:53.537817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:53.565444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:53.569341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:54.705865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:54.720201 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e7bddfe-f62f-4433-a9d9-fcce441d234e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 1.212470 Jul 19 20:11:54.722569 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2604/5100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:53 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:55.744025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:55.745379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:55.765292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=54 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:55.788246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.788770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:55.789652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.790226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:56.591431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:56.606195 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7084beab-d754-4675-9d45-ed86f466b37a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1506 microversion: 2.1 time: 0.869221 Jul 19 20:11:56.621544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2497/5101] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:55 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:57.645981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:57.646822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:57.657652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:57.663043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.666373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.667362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.668010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.000168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:58.022559 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b107c8ff-bfb1-43e5-89ed-6dfd044676a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1486 microversion: 2.1 time: 0.382601 Jul 19 20:11:58.030288 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2605/5102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:57 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1486 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:58.298225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-634805565", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:58.439721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] validate_networks() for [('1d2368b8-1ae8-4077-92f6-59fe745d3319', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:12:00.108557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:12:00.109197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:12:00.109482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:12:00.109893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:12:00.110341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:12:00.128715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:00.129175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:00.130117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:00.130562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:00.176387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Getting quotas for project cd1922a4c28c4a858e24f06ad4ba30ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:12:00.193996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Getting quotas for user 76616d6870784779990c44b483c3d55b and project cd1922a4c28c4a858e24f06ad4ba30ce. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:12:00.208787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:12:00.211211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:12:00.310266 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83dfa733-b5aa-46c9-9b6c-67cfa4e47dfc tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.017268 Jul 19 20:12:00.311277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2498/5103] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:11:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:12:00.328569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c4af44b1-7987-433d-8e85-5b59d3b04f6f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:00.329213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c4af44b1-7987-433d-8e85-5b59d3b04f6f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:00.425053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c4af44b1-7987-433d-8e85-5b59d3b04f6f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:00.443424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c4af44b1-7987-433d-8e85-5b59d3b04f6f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1213 microversion: 2.1 time: 0.124237 Jul 19 20:12:00.445591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2606/5104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:00 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:01.464913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-671322ab-b6b6-4f4c-9a88-c60617b669a3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:01.465620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-671322ab-b6b6-4f4c-9a88-c60617b669a3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:01.810530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-671322ab-b6b6-4f4c-9a88-c60617b669a3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:01.822218 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-671322ab-b6b6-4f4c-9a88-c60617b669a3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1213 microversion: 2.1 time: 0.360640 Jul 19 20:12:01.825150 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2499/5105] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:01 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1213 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:02.851362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:02.860089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:02.893634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:02.904578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:02.905721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:02.907223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:03.398360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:03.413171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ab4e429-c459-471c-93ae-1e988eb399af tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1273 microversion: 2.1 time: 0.567601 Jul 19 20:12:03.419331 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2607/5106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:02 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1273 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:04.441702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:04.442326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:04.467122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.468006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.469056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.471391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.829923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:04.860923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f3cce3e-4846-4bbc-a73b-25f9d90c7486 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1271 microversion: 2.1 time: 0.419522 Jul 19 20:12:04.873335 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2500/5107] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:04 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1271 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:05.904038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:05.910820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.930895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.932034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.937323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.937990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.772947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:06.775894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:06.806590 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83b893b5-53cf-481e-9352-d2848a505dbf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.916552 Jul 19 20:12:06.812926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2608/5108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:05 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:07.835395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:07.836394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:07.851875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.852529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.853471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.854289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.887930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=75 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:08.311532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:08.320933 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d00e696f-3f51-47ed-a79f-320e20797772 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.490273 Jul 19 20:12:08.321838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2501/5109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:07 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:08.931722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2d24d465-421b-4991-8677-00b1eaea749a req-f7978d18-41ea-412d-b850-1a445fa5dc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f01d8ca-2068-4fa7-a7b0-bef9fafb315c", "tag": "312107c0-ff29-4072-9db0-1771f24d9e99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:08.946560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2d24d465-421b-4991-8677-00b1eaea749a req-f7978d18-41ea-412d-b850-1a445fa5dc21 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:08.947791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2d24d465-421b-4991-8677-00b1eaea749a req-f7978d18-41ea-412d-b850-1a445fa5dc21 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:08.970233 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2d24d465-421b-4991-8677-00b1eaea749a req-f7978d18-41ea-412d-b850-1a445fa5dc21 service nova] Creating event network-changed:312107c0-ff29-4072-9db0-1771f24d9e99 for instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c on n-h2-843861-3 Jul 19 20:12:08.996776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2d24d465-421b-4991-8677-00b1eaea749a req-f7978d18-41ea-412d-b850-1a445fa5dc21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066842 Jul 19 20:12:09.001446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2609/5110] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:09.343231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:09.347039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:09.363491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:09.364532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:09.365500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:09.366179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:09.634416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:09.645529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ece95726-e8a1-40b2-87af-f0b0e29e3160 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.308678 Jul 19 20:12:09.646170 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2502/5111] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:09 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:10.436433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:10.682706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:10.683870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:10.702121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:10.708718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:10.711272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:10.714530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:10.716053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:11.062622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cc5bdc8-91f6-4f8a-bbac-d41bfdbdf5e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Action: 'create', calling method: .version_select at 0x7fb88cb40c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-718875353"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:11.085347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:11.131678 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-839ac97c-4597-4694-ad0a-21107a7b4db3 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.463432 Jul 19 20:12:11.133904 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2503/5112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:10 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:11.860964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7cc5bdc8-91f6-4f8a-bbac-d41bfdbdf5e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.476104 Jul 19 20:12:11.861762 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2610/5113] 10.222.0.33 () {60 vars in 1154 bytes} [Tue Jul 19 20:12:10 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1478 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 20:12:11.877028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a82f568-cb82-49cf-b91a-a75d3a49b9ad tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88ddc1700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:11.901163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:12.063136 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a82f568-cb82-49cf-b91a-a75d3a49b9ad tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.191380 Jul 19 20:12:12.063975 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2504/5114] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:11 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:12.151448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:12.152645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:12.168250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.169153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:12.171374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.173255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:13.087950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f3885092-45ea-45f2-b805-ae8c7cb86edc tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88db62820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:13.235476 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f3885092-45ea-45f2-b805-ae8c7cb86edc tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.159236 Jul 19 20:12:13.236839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2505/5115] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:13 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:13.590641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:13.605874 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1f48e69d-5ce8-4cbb-9682-b800bfa5e5a5 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 1.457748 Jul 19 20:12:13.610485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2611/5116] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:12 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:14.252472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-452d1499-b329-4fc0-9f6b-3248d14937fd tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dcbb550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.493542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-452d1499-b329-4fc0-9f6b-3248d14937fd tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 345 microversion: 2.1 time: 0.245996 Jul 19 20:12:14.494762 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2506/5117] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:14.510280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3fe73d63-6322-41eb-bd1f-a20070f35c23 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Action: 'create', calling method: .version_select at 0x7fb88cb5b0d0>, body: {"snapshot": {"volume_id": "c8ff95d7-f766-4e43-935f-74857179a8b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1033393885"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:14.631214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.633735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.673623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.676221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.677570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.683300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.970130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3fe73d63-6322-41eb-bd1f-a20070f35c23 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.464068 Jul 19 20:12:14.970749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2612/5118] 10.222.0.33 () {60 vars in 1161 bytes} [Tue Jul 19 20:12:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:14.984227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd7f37b7-79b0-4243-b60d-ea8ac236790d tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88cb61280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.093040 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd7f37b7-79b0-4243-b60d-ea8ac236790d tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.112944 Jul 19 20:12:15.094356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2613/5119] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:15.114014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0d6c4c90-65a2-478f-bd55-1503955bf50e tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88cb5b430>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.271006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0d6c4c90-65a2-478f-bd55-1503955bf50e tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.165496 Jul 19 20:12:15.272159 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2614/5120] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:15.291656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1774d0c3-2c34-4f5b-883d-af2d2c47c741 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88d254b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.402896 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1774d0c3-2c34-4f5b-883d-af2d2c47c741 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.120106 Jul 19 20:12:15.403772 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2615/5121] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:15.541078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:15.549790 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5654156-5efd-46b2-90dd-be14f8a207cf tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.925647 Jul 19 20:12:15.550795 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2507/5122] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:16.418720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cbc1d78d-8afd-4e8d-a971-f61e5e28f6b5 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88cb5b5e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:16.492513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cbc1d78d-8afd-4e8d-a971-f61e5e28f6b5 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.077865 Jul 19 20:12:16.493369 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2616/5123] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:16 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:16.575467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:16.577857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:16.600195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:16.603444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:16.606552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:16.609163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:17.152811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:17.173056 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8ea80ad-5cec-4890-bf99-7ae7c357677c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.603297 Jul 19 20:12:17.174406 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2508/5124] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:16 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:17.514101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-425ae82e-47d0-4d70-924c-7bb6bd24ec9c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88e114280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:17.599449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-425ae82e-47d0-4d70-924c-7bb6bd24ec9c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.095872 Jul 19 20:12:17.601527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2617/5125] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:17 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:18.192786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:18.193992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:18.230974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:18.236766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:18.241143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:18.242577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:18.617304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cbc806c7-ecce-4528-84e9-559713cf9646 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88cb630d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:18.771424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cbc806c7-ecce-4528-84e9-559713cf9646 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.162969 Jul 19 20:12:18.773877 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2618/5126] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:18 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:18.791282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-908bf304-15d2-43e5-97da-147c795a4194 req-383cfa23-6b2e-4c2b-8cd3-a68caa77310e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f01d8ca-2068-4fa7-a7b0-bef9fafb315c", "name": "network-vif-plugged", "status": "completed", "tag": "312107c0-ff29-4072-9db0-1771f24d9e99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:18.814800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-908bf304-15d2-43e5-97da-147c795a4194 req-383cfa23-6b2e-4c2b-8cd3-a68caa77310e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:18.819771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-908bf304-15d2-43e5-97da-147c795a4194 req-383cfa23-6b2e-4c2b-8cd3-a68caa77310e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:18.839265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:18.863449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c1e1b16-1040-4994-b26a-498d0763fc79 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.671421 Jul 19 20:12:18.866396 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2509/5127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:18 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:18.904107 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-908bf304-15d2-43e5-97da-147c795a4194 req-383cfa23-6b2e-4c2b-8cd3-a68caa77310e service nova] Creating event network-vif-plugged:312107c0-ff29-4072-9db0-1771f24d9e99 for instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c on n-h2-843861-3 Jul 19 20:12:18.920948 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-908bf304-15d2-43e5-97da-147c795a4194 req-383cfa23-6b2e-4c2b-8cd3-a68caa77310e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144896 Jul 19 20:12:18.929859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2619/5128] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:19.787179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c03c446-6a41-4f2d-bc1d-5fe08d9e8e58 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88d4bdee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.883869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.884581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:19.896589 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c03c446-6a41-4f2d-bc1d-5fe08d9e8e58 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 288 microversion: 2.1 time: 0.115447 Jul 19 20:12:19.899153 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2510/5129] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:19 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:19.903254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.903709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.908925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.910238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.913534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca8032a5-252b-4807-b2f6-bc5c6bd44b50 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dddb160>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:20.034039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca8032a5-252b-4807-b2f6-bc5c6bd44b50 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 202 len: 0 microversion: 2.1 time: 0.127903 Jul 19 20:12:20.035189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2511/5130] 10.222.0.33 () {58 vars in 1253 bytes} [Tue Jul 19 20:12:19 2022] DELETE /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:12:20.044572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1bbbc6f-1444-4298-9c33-a40ec7dd1d7c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dddbca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:20.086721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1bbbc6f-1444-4298-9c33-a40ec7dd1d7c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.046541 Jul 19 20:12:20.087975 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2512/5131] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:20 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:20.383867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:20.401280 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3dcb2726-0ea6-415f-9451-f2ceb050c36b tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1313 microversion: 2.1 time: 0.521706 Jul 19 20:12:20.408940 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2620/5132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:19 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:21.106868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-424a9fec-0e90-443b-ac68-4e5fd9018f3c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dc67550>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:21.221700 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-424a9fec-0e90-443b-ac68-4e5fd9018f3c tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.124100 Jul 19 20:12:21.222593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2513/5133] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:21 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:21.419300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:21.420111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:21.454883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:21.455060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:21.459425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:21.459914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.163657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:22.186938 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4112e800-fa8d-4609-baf1-1a8a4f872f4e tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1499 microversion: 2.1 time: 0.768999 Jul 19 20:12:22.193128 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2621/5134] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:21 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1499 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:22.219438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:22.220531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:22.238322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-40a554db-736e-44c5-ad02-afa57dc72516 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88cea95e0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:22.291951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.292460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.297866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.298329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.381050 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-40a554db-736e-44c5-ad02-afa57dc72516 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.148091 Jul 19 20:12:22.381777 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2622/5135] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:22 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:22.441532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lazy-loading 'flavor' on Instance uuid 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:22.619722 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1e09b6ce-e335-4042-bbb2-d22994503447 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "POST /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c/action" status: 200 len: 32 microversion: 2.1 time: 0.408288 Jul 19 20:12:22.623099 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2514/5136] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:12:22 2022] POST /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:12:22.638566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:22.643559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:22.681435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.683392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.686243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.689316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:23.402243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86eabed9-0c97-48e5-a8d3-18c372833b21 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88e22e700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:23.458302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:23.480173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59f6d63b-f219-40cb-925a-c0f8970e0b3f tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.849422 Jul 19 20:12:23.481966 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2623/5137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:22 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:23.496936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86eabed9-0c97-48e5-a8d3-18c372833b21 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 200 len: 287 microversion: 2.1 time: 0.105234 Jul 19 20:12:23.498349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2515/5138] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:23 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:24.500424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:24.501150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:24.523668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2945cea-7b5e-4a32-a407-6d2424291b68 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dddb9d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:24.528937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.529745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:24.530714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.532432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:24.622567 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b2945cea-7b5e-4a32-a407-6d2424291b68 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] HTTP exception thrown: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2945cea-7b5e-4a32-a407-6d2424291b68 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Request method failure captured: Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 HTTP/1.1 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xAatqRR2iyAArD1QoQ3mkJCDaf1UQSyWkuhA-9EACPNLvNY3kOS6urZYeNaJrod8btQGWK7FeuJuXSgKQlN8xIze_0hgnkXogEmcTvpIkbU1uEeggnaDWCBG97jHgzL4aIdff2-jphmk07C9DH7-cAFXR99Ocx3v3DOxymcdmrMpjI Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4853dbd2a2f44ba3952a1b5e56d26eaf Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: exception: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'fa78d2eb-a01d-467e-8ed7-f4924b813f78'} Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. (HTTP 404) (Request-ID: req-fdad4e40-e7a1-4ffb-93f6-46423584e224) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:12:24.647551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2945cea-7b5e-4a32-a407-6d2424291b68 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Returning 404 to user: Snapshot fa78d2eb-a01d-467e-8ed7-f4924b813f78 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:24.664359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2945cea-7b5e-4a32-a407-6d2424291b68 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78" status: 404 len: 111 microversion: 2.1 time: 0.145175 Jul 19 20:12:24.673303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2516/5139] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:12:24 2022] GET /compute/v2.1/os-snapshots/fa78d2eb-a01d-467e-8ed7-f4924b813f78 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:24.677052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a63ae50-24e6-4538-aa30-2d255e574041 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88d5a3940>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:24.938930 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a63ae50-24e6-4538-aa30-2d255e574041 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 202 len: 0 microversion: 2.1 time: 0.270262 Jul 19 20:12:24.947347 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2517/5140] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:12:24 2022] DELETE /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:12:24.992234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-537a27ed-df20-4ab1-aacb-f4fd04676113 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88dddbca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:25.319233 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-537a27ed-df20-4ab1-aacb-f4fd04676113 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.365076 Jul 19 20:12:25.320616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2518/5141] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:24 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:26.014448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:26.079758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bca2b4a5-6ad3-4275-a672-6b2c4d449dd0 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.578006 Jul 19 20:12:26.099554 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2624/5142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:24 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:26.351909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-773f40c0-56da-44ab-945b-ef800046eaf2 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88e9f59d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:26.497778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-773f40c0-56da-44ab-945b-ef800046eaf2 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.157258 Jul 19 20:12:26.505030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2519/5143] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:26 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:27.114515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:27.115838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:27.136392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:27.136925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:27.144269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:27.145393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:27.516773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4cc85fc5-fe29-45be-819b-6bdb0bec13da tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88e36baf0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:27.745832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4cc85fc5-fe29-45be-819b-6bdb0bec13da tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.237244 Jul 19 20:12:27.752247 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2520/5144] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:27 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:28.586474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:28.607186 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11feb5f3-8fb3-4868-9cfc-02c2ca09c7aa tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.499018 Jul 19 20:12:28.630198 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2625/5145] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:27 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:28.764589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83af14e7-ea42-46c3-8092-534d3145f75f tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88db62f70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:28.904652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83af14e7-ea42-46c3-8092-534d3145f75f tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.147001 Jul 19 20:12:28.911254 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2521/5146] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:28 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:29.651544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:29.653055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:29.659955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=26 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:29.676784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:29.684557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:29.685720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:29.696937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:29.919274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0c78167-31a0-4d9c-820f-c7ee085648f8 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88e22e0d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:30.012900 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0c78167-31a0-4d9c-820f-c7ee085648f8 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 200 len: 344 microversion: 2.1 time: 0.098228 Jul 19 20:12:30.013983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2522/5147] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:29 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:30.110190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:30.118226 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97b97fd6-d3d3-413a-abdd-8415d36ca76c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.485913 Jul 19 20:12:30.118921 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2626/5148] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:29 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:31.059078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0daf8f95-187d-418b-a949-a9a0e5c88f43 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88d538790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:31.135832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:31.136462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:31.155488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:31.156263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:31.157250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:31.157858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:31.270084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0daf8f95-187d-418b-a949-a9a0e5c88f43 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] HTTP exception thrown: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0daf8f95-187d-418b-a949-a9a0e5c88f43 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Request method failure captured: Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 HTTP/1.1 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xAatqRR2iyAArD1QoQ3mkJCDaf1UQSyWkuhA-9EACPNLvNY3kOS6urZYeNaJrod8btQGWK7FeuJuXSgKQlN8xIze_0hgnkXogEmcTvpIkbU1uEeggnaDWCBG97jHgzL4aIdff2-jphmk07C9DH7-cAFXR99Ocx3v3DOxymcdmrMpjI Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4853dbd2a2f44ba3952a1b5e56d26eaf Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c8ff95d7-f766-4e43-935f-74857179a8b2'} Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. (HTTP 404) (Request-ID: req-d7068216-7129-42fd-a18e-48d3177c8fbe) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:12:31.274295 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.278753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0daf8f95-187d-418b-a949-a9a0e5c88f43 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Returning 404 to user: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:31.288202 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0daf8f95-187d-418b-a949-a9a0e5c88f43 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 404 len: 109 microversion: 2.1 time: 0.255998 Jul 19 20:12:31.289053 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2523/5149] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:31 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 109 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:31.306022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-acf7c8cd-1b76-4a17-9056-f19168a833aa tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb892f941f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:31.410059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-acf7c8cd-1b76-4a17-9056-f19168a833aa tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] HTTP exception thrown: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-acf7c8cd-1b76-4a17-9056-f19168a833aa tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Request method failure captured: Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 HTTP/1.1 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xAatqRR2iyAArD1QoQ3mkJCDaf1UQSyWkuhA-9EACPNLvNY3kOS6urZYeNaJrod8btQGWK7FeuJuXSgKQlN8xIze_0hgnkXogEmcTvpIkbU1uEeggnaDWCBG97jHgzL4aIdff2-jphmk07C9DH7-cAFXR99Ocx3v3DOxymcdmrMpjI Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4853dbd2a2f44ba3952a1b5e56d26eaf Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c8ff95d7-f766-4e43-935f-74857179a8b2'} Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. (HTTP 404) (Request-ID: req-0b70b3ef-2ce0-4fa4-bcdf-0fdd14e0f2b2) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:12:31.415015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.422993 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.432817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-acf7c8cd-1b76-4a17-9056-f19168a833aa tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Returning 404 to user: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:31.432817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-acf7c8cd-1b76-4a17-9056-f19168a833aa tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 404 len: 109 microversion: 2.1 time: 0.129447 Jul 19 20:12:31.445096 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2524/5150] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:12:31 2022] DELETE /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:31.459192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6afab17-d20d-4a18-aac7-2c92e01773e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Calling method '.version_select at 0x7fb88d5a3820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:31.608380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a6afab17-d20d-4a18-aac7-2c92e01773e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] HTTP exception thrown: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6afab17-d20d-4a18-aac7-2c92e01773e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Request method failure captured: Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 HTTP/1.1 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xAatqRR2iyAArD1QoQ3mkJCDaf1UQSyWkuhA-9EACPNLvNY3kOS6urZYeNaJrod8btQGWK7FeuJuXSgKQlN8xIze_0hgnkXogEmcTvpIkbU1uEeggnaDWCBG97jHgzL4aIdff2-jphmk07C9DH7-cAFXR99Ocx3v3DOxymcdmrMpjI Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ebde4e8518524cd8bcf02c6a387d2f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ebde4e8518524cd8bcf02c6a387d2f95 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1264068618 Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4853dbd2a2f44ba3952a1b5e56d26eaf Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1264068618-project Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c8ff95d7-f766-4e43-935f-74857179a8b2'} Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. (HTTP 404) (Request-ID: req-53138098-509e-4bd1-ad4c-bd27d434c80e) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:12:31.614685 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6afab17-d20d-4a18-aac7-2c92e01773e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] Returning 404 to user: Volume c8ff95d7-f766-4e43-935f-74857179a8b2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:31.622833 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6afab17-d20d-4a18-aac7-2c92e01773e1 tempest-VolumesSnapshotsTestJSON-1264068618 tempest-VolumesSnapshotsTestJSON-1264068618-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2" status: 404 len: 109 microversion: 2.1 time: 0.166978 Jul 19 20:12:31.638660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2525/5151] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:12:31 2022] GET /compute/v2.1/os-volumes/c8ff95d7-f766-4e43-935f-74857179a8b2 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:12:32.096379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:32.107843 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e20c4839-4081-436f-be94-33f64d0d6870 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.975903 Jul 19 20:12:32.113437 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2627/5152] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:31 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:33.138333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:33.139602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:33.147054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:33.150683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:33.187737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:33.192931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:33.195631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:33.200705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:34.716747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:34.739453 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa6ac574-a6e7-4de3-8c9a-4c026296a070 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.600842 Jul 19 20:12:34.739877 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2526/5153] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:33 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:35.767189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:35.768484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:35.798801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:35.799262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:35.813049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:35.813521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:36.783210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:36.842895 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f37c698-687e-491b-b023-d6b08aad0457 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.065299 Jul 19 20:12:36.844049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2628/5154] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:35 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:37.863738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:37.865025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:37.885721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.886177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:37.886981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.887431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:38.987700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:39.000480 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05541c14-ce63-4e28-b449-14ad85f7cdd7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.142141 Jul 19 20:12:39.001096 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2527/5155] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:37 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:40.097150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:40.104367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=60 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:40.673450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:40.695938 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-39ee52a9-8334-4e79-862e-7ab9a6641796 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.671554 Jul 19 20:12:40.696634 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2629/5156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:40 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:41.717170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:41.717994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:41.737596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:41.738385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:41.739905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:41.740779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:42.803744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:42.841073 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-82ba21fd-a866-4285-9b02-ce4c8997ae76 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.128489 Jul 19 20:12:42.863876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2528/5157] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:41 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:43.875098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:43.875783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:43.899247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:43.900686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:43.902693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:43.904626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:44.479612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:44.491744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f23f8781-7a19-489d-8fff-00050e61981a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.623145 Jul 19 20:12:44.499852 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2630/5158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:43 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:45.521168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:45.521884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:45.542765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:45.543498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:45.548197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:45.548720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:46.475758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:46.485161 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65d0f58e-34de-40b4-a7c8-4c3ad7204ecd tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.969809 Jul 19 20:12:46.487700 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2529/5159] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:45 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:47.512460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:47.513839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:47.544818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:47.545399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:47.546360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:47.547104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:48.708300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:48.734779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8866b38a-491f-45f5-afeb-a515f2ce1776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.220903 Jul 19 20:12:48.736047 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2631/5160] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:47 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:49.763528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:49.765026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:49.792900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:49.793473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:49.797065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:49.797065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.617420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:50.634619 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f093d6cc-586d-4430-91b1-5f88b98d8e2c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.875568 Jul 19 20:12:50.636356 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2530/5161] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:49 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:51.658117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:51.659428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:51.684013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.685864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:51.687348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.687871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:52.500276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:52.513731 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-afcb893a-958e-4d77-976a-493876683776 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.855788 Jul 19 20:12:52.519556 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2632/5162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:51 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:53.545656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:53.557922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:53.585962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:53.586468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:53.589634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:53.592562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.432136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:55.497028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2810990-47c3-4720-8429-ae4893834af7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1485 microversion: 2.1 time: 1.955756 Jul 19 20:12:55.516952 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2531/5163] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:53 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1485 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:55.542199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:55.542851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:55.584464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.584914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.585701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.586207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.964745 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fb8a7aef-4152-4a66-b414-c0864c98104d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "POST /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c/action" status: 202 len: 0 microversion: 2.1 time: 0.428850 Jul 19 20:12:55.980624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:55.987326 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2633/5164] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:12:55 2022] POST /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:12:55.988548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:56.034302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:56.035146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:56.039583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:56.040440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.042118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:57.075379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b82ae7d-f1d4-4a3d-9440-62e8a570da8d tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1493 microversion: 2.1 time: 1.103754 Jul 19 20:12:57.079312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2532/5165] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:55 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1493 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:58.103922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:58.104986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:58.142830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.147391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.150616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.153011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:59.079149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:59.096379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-105e1cb2-db0b-40ba-bf84-68c62fba140a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1493 microversion: 2.1 time: 1.002194 Jul 19 20:12:59.102922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2634/5166] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:58 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1493 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:00.123010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:00.124929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:00.141176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:00.142853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:00.144583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:00.148379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:00.770118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:00.803178 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5845d5a-612f-444a-8eed-eb50653d25b7 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1493 microversion: 2.1 time: 0.684073 Jul 19 20:13:00.803779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2533/5167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:00 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1493 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:13:01.828854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:01.832323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:01.843480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:01.851489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:01.852203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:01.853271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:01.854844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.785511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:02.795128 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ee9b137-3c38-4028-9ed1-d1f136584229 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1499 microversion: 2.1 time: 0.974431 Jul 19 20:13:02.801386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2635/5168] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:01 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1499 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:02.828064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:02.828912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:02.856857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.857660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.859097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.859879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.943532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:03.160570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e36f91e-59cb-4e6c-a137-588eb77911f9 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 204 len: 0 microversion: 2.1 time: 0.339077 Jul 19 20:13:03.166232 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2534/5169] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:13:02 2022] DELETE /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:13:03.171630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:03.172291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:03.195160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.198480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:03.213400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.216518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:03.547105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:03.561110 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f72b95c8-1c6c-4480-aae7-8eba251cfe0c tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 0.388953 Jul 19 20:13:03.562457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2636/5170] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:03 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:04.579728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:04.580740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:04.599478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:04.602363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:04.610620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:04.618782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:04.621708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:04.645084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:05.754122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:05.790379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a789e71-a300-4c35-bfc7-7e0fbdb9d6ec tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.214960 Jul 19 20:13:05.793119 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2535/5171] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:04 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:06.825879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:06.829051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:06.866546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.880226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:06.883858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.889165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:08.591014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:08.604038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-face9c58-f173-48cd-8ece-9ba30d2b1a80 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1505 microversion: 2.1 time: 1.785100 Jul 19 20:13:08.616675 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2637/5172] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:06 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1505 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:13:09.634537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:09.635614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:09.667959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.668423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:09.669232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.669680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:10.059071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5daadfbc-acc5-4f7e-be28-674dfdc777d6 req-7b1ba44a-856a-4e48-b1a3-27a3eaeab134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f01d8ca-2068-4fa7-a7b0-bef9fafb315c", "name": "network-vif-deleted", "tag": "312107c0-ff29-4072-9db0-1771f24d9e99"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:10.081285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5daadfbc-acc5-4f7e-be28-674dfdc777d6 req-7b1ba44a-856a-4e48-b1a3-27a3eaeab134 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:10.081734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5daadfbc-acc5-4f7e-be28-674dfdc777d6 req-7b1ba44a-856a-4e48-b1a3-27a3eaeab134 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:10.100614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:10.131280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:10.140604 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5daadfbc-acc5-4f7e-be28-674dfdc777d6 req-7b1ba44a-856a-4e48-b1a3-27a3eaeab134 service nova] Creating event network-vif-deleted:312107c0-ff29-4072-9db0-1771f24d9e99 for instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c on n-h2-843861-3 Jul 19 20:13:10.152065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ddebacf2-42d9-440a-b659-943b08099de4 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 200 len: 1463 microversion: 2.1 time: 0.516872 Jul 19 20:13:10.153998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2536/5173] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:09 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 1463 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:10.157792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5daadfbc-acc5-4f7e-be28-674dfdc777d6 req-7b1ba44a-856a-4e48-b1a3-27a3eaeab134 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102550 Jul 19 20:13:10.164816 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2638/5174] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:11.184338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:11.186233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:11.242090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.242869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.244322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.245080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.292119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] HTTP exception thrown: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Request method failure captured: Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c HTTP/1.1 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w_ZZJIfrmM155A27k_XvQCb2iN3yJzUYN7WVs_QEBuLMSPdbDG09gL2ddXdFnKsjLCCHYw0AcIo6AHw3jdQ7B5TNppSncn_YEbNf_3Fh5mSVgGiSn27G0fWvO_zS7vFofsHGi2H3NGbowwrHAP_-pAzwqrnvVUQ2thAqHtJDbO9xx0 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: cd1922a4c28c4a858e24f06ad4ba30ce Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: cd1922a4c28c4a858e24f06ad4ba30ce Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerRescueTestJSON-2084847491-project Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 76616d6870784779990c44b483c3d55b Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerRescueTestJSON-2084847491-project Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1f01d8ca-2068-4fa7-a7b0-bef9fafb315c'} Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:11.294592 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. Jul 19 20:13:11.302015 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:11.305036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Returning 404 to user: Instance 1f01d8ca-2068-4fa7-a7b0-bef9fafb315c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:11.306205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-626b269b-7415-41a0-998d-7a5ed41b0574 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c" status: 404 len: 111 microversion: 2.1 time: 0.137326 Jul 19 20:13:11.311868 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2537/5175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:11 2022] GET /compute/v2.1/servers/1f01d8ca-2068-4fa7-a7b0-bef9fafb315c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:13:11.318405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:11.320135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:11.353114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.354845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.358386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.360567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.452476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:11.817426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-453f8dba-6b2d-4057-8975-a8cc7b92b0ed tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 204 len: 0 microversion: 2.1 time: 0.503906 Jul 19 20:13:11.824955 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2639/5176] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:13:11 2022] DELETE /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:13:11.860534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:11.861871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:11.905741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.906433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.915753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.916761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:13.137713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:13.165679 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0564a205-c909-42dd-9736-479f237bf11a tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1492 microversion: 2.1 time: 1.326985 Jul 19 20:13:13.174005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2538/5177] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:11 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1492 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:14.196467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:14.199011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:14.254301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:14.272577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:14.274364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:14.285607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:16.255913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:16.282658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-344fa8d1-663d-45da-b1f2-86b67bd0f412 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1492 microversion: 2.1 time: 2.093716 Jul 19 20:13:16.284537 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2640/5178] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:14 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1492 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:16.867719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-50a2b8d5-81e7-4bf4-9715-b92f374ab287 req-fd68b40b-0b18-4f54-a8a4-a5780ba81685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8c6434-6a62-45fb-ad56-2c1da6cf2422", "name": "network-vif-deleted", "tag": "7d1e5cb4-a455-46ac-8589-19165417dacb"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:16.934958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-50a2b8d5-81e7-4bf4-9715-b92f374ab287 req-fd68b40b-0b18-4f54-a8a4-a5780ba81685 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:16.935992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-50a2b8d5-81e7-4bf4-9715-b92f374ab287 req-fd68b40b-0b18-4f54-a8a4-a5780ba81685 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:16.983896 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-50a2b8d5-81e7-4bf4-9715-b92f374ab287 req-fd68b40b-0b18-4f54-a8a4-a5780ba81685 service nova] Creating event network-vif-deleted:7d1e5cb4-a455-46ac-8589-19165417dacb for instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 on n-h1-843861-3 Jul 19 20:13:17.004055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-50a2b8d5-81e7-4bf4-9715-b92f374ab287 req-fd68b40b-0b18-4f54-a8a4-a5780ba81685 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153083 Jul 19 20:13:17.006727 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2539/5179] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:17.308267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:17.309100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:17.337560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.356399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.358529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.364457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.568837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.578904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.579957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lazy-loading 'fault' on Instance uuid 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:13:17.790577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76616d6870784779990c44b483c3d55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1922a4c28c4a858e24f06ad4ba30ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:17.804415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22e64d2b-bafa-4c48-be80-26a8afe1e313 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 200 len: 1303 microversion: 2.1 time: 0.500221 Jul 19 20:13:17.805772 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2641/5180] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:17 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 1303 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:18.852434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:18.866027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] [instance: 3f8c6434-6a62-45fb-ad56-2c1da6cf2422] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:18.918775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:18.929655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:18.931999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:18.957147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:19.019516 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] HTTP exception thrown: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Request method failure captured: Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 HTTP/1.1 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w_ZZJIfrmM155A27k_XvQCb2iN3yJzUYN7WVs_QEBuLMSPdbDG09gL2ddXdFnKsjLCCHYw0AcIo6AHw3jdQ7B5TNppSncn_YEbNf_3Fh5mSVgGiSn27G0fWvO_zS7vFofsHGi2H3NGbowwrHAP_-pAzwqrnvVUQ2thAqHtJDbO9xx0 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: cd1922a4c28c4a858e24f06ad4ba30ce Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd1922a4c28c4a858e24f06ad4ba30ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: cd1922a4c28c4a858e24f06ad4ba30ce Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerRescueTestJSON-2084847491 Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerRescueTestJSON-2084847491-project Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 76616d6870784779990c44b483c3d55b Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerRescueTestJSON-2084847491-project Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3f8c6434-6a62-45fb-ad56-2c1da6cf2422'} Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:19.025884 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. Jul 19 20:13:19.030555 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:13:19.034147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] Returning 404 to user: Instance 3f8c6434-6a62-45fb-ad56-2c1da6cf2422 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:19.035403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2092eac-52ab-42f7-b0df-cb0f5d7066d1 tempest-ServerRescueTestJSON-2084847491 tempest-ServerRescueTestJSON-2084847491-project] 10.222.0.33 "GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422" status: 404 len: 111 microversion: 2.1 time: 0.210191 Jul 19 20:13:19.041393 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2540/5181] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:18 2022] GET /compute/v2.1/servers/3f8c6434-6a62-45fb-ad56-2c1da6cf2422 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:13:24.219183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c1bbe7c-a22d-46ca-a967-10528d36fbdc tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-587761067", "availability_zone": "foo_zone"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:24.337490 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:24.337490 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:24.347890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.aggregate [None req-6c1bbe7c-a22d-46ca-a967-10528d36fbdc tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Generated uuid 4a284d0b-f821-48cc-9403-dd8c1a3b4059 for aggregate {{(pid=126008) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 20:13:24.431026 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c1bbe7c-a22d-46ca-a967-10528d36fbdc tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.300782 Jul 19 20:13:24.449694 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2642/5182] 10.222.0.33 () {60 vars in 1163 bytes} [Tue Jul 19 20:13:23 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:24.476240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e78ba17a-1ccb-44f5-816d-47fcb67086a6 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:24.481029 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:24.481029 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:24.557361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e78ba17a-1ccb-44f5-816d-47fcb67086a6 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.099814 Jul 19 20:13:24.564542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2643/5183] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 20:13:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:24.604440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:24.618887 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:24.618887 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:24.631839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.653510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.657261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.660996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.813430 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-463a147a-e4e1-4729-88f8-cfdbfdc6abe1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.233019 Jul 19 20:13:24.825407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2644/5184] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Jul 19 20:13:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:24.835148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64689d72-60ec-4d25-86bf-3fca1c74ae7f tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:24.836074 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:24.836074 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:24.850356 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64689d72-60ec-4d25-86bf-3fca1c74ae7f tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.018442 Jul 19 20:13:24.851187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2645/5185] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Jul 19 20:13:24 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:13:24.885194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da69c228-4012-4cb3-ab63-8705b019259d tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843861-3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:24.887624 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:24.887624 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:24.930804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da69c228-4012-4cb3-ab63-8705b019259d tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.931635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da69c228-4012-4cb3-ab63-8705b019259d tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.450651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:25.451316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:25.489265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.493472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.504061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.508220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.670234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:26.102923 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-88b1b102-f4f1-4651-884c-786a62024440 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 204 len: 0 microversion: 2.32 time: 1.876071 Jul 19 20:13:26.109079 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2541/5186] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:13:24 2022] DELETE /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 0 bytes in 1879 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:13:26.119672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:26.122272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:26.138119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.139596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.142346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.143633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.430648 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da69c228-4012-4cb3-ab63-8705b019259d tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 1.565215 Jul 19 20:13:26.436964 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2646/5187] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 20:13:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:26.483484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc9e1990-0c31-435e-9b2c-8d64fcb8e369 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:26.485597 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:26.485597 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:26.531715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc9e1990-0c31-435e-9b2c-8d64fcb8e369 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.086272 Jul 19 20:13:26.536227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2647/5188] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:13:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:26.571278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57cd5998-64b5-4693-8be0-0467110b216b tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-837591069", "availability_zone": "foo_zone"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:26.600959 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:26.600959 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:26.752308 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57cd5998-64b5-4693-8be0-0467110b216b tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.203596 Jul 19 20:13:26.770485 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2648/5189] 10.222.0.33 () {60 vars in 1172 bytes} [Tue Jul 19 20:13:26 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:26.793218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8171b5dc-2c38-4ba7-90ad-549e852e21c1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:26.797171 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:26.797171 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:26.824347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.844838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.852554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.858905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8171b5dc-2c38-4ba7-90ad-549e852e21c1 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.086939 Jul 19 20:13:26.861449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ca758e6-97eb-4c34-9a7c-20158feda6ed tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2950 microversion: 2.32 time: 0.747114 Jul 19 20:13:26.864664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2542/5190] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:26 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2950 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:26.874413 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2649/5191] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 20:13:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:26.876738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-741c7128-9c87-4511-bccb-f46691b5a051 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:26.882495 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:26.882495 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:13:26.918223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-741c7128-9c87-4511-bccb-f46691b5a051 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.043335 Jul 19 20:13:26.921015 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2543/5192] 10.222.0.33 () {58 vars in 1151 bytes} [Tue Jul 19 20:13:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:26.931677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8d82deb-6228-4e6b-952a-71234e7cff00 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843861-3"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:26.933075 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:26.933075 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:13:26.952452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8d82deb-6228-4e6b-952a-71234e7cff00 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.952926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8d82deb-6228-4e6b-952a-71234e7cff00 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.182161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8d82deb-6228-4e6b-952a-71234e7cff00 tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.255763 Jul 19 20:13:27.185080 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2650/5193] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 19 20:13:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:27.196287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-94ea2c3d-a704-434b-8752-46dca7ebe11e tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:27.197103 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:13:27.197103 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:13:27.245148 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-94ea2c3d-a704-434b-8752-46dca7ebe11e tempest-TestAggregatesBasicOps-1361527899 tempest-TestAggregatesBasicOps-1361527899-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.052879 Jul 19 20:13:27.246220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2544/5194] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 19 20:13:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 20:13:27.924190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:27.924948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:27.936688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.937511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.938868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.943995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.851703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.897956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.906521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.910191 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8880059-3a0a-4a29-add8-eb7469f3ae4d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2950 microversion: 2.32 time: 1.998240 Jul 19 20:13:29.932144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2651/5195] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:27 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2950 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:30.959091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:30.961596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:30.985148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.985619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.986968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.987427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.941176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:31.973863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:31.975458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:31.985793 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38476aeb-8f9f-48a5-9e98-030e60545817 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2950 microversion: 2.32 time: 1.043090 Jul 19 20:13:32.004346 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2545/5196] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:30 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2950 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:33.005851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:33.006959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:33.010901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:33.035788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:33.037564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.039026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:33.039899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.527374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8bafd293-77e3-4cfa-9d47-edabf4244d7b req-8ce61484-3a34-41f0-8528-ded52c3d7000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-unplugged", "status": "completed", "tag": "82b499e7-3534-4427-9fd5-db274d819339"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:33.563092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8bafd293-77e3-4cfa-9d47-edabf4244d7b req-8ce61484-3a34-41f0-8528-ded52c3d7000 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:33.563707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8bafd293-77e3-4cfa-9d47-edabf4244d7b req-8ce61484-3a34-41f0-8528-ded52c3d7000 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.640891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8bafd293-77e3-4cfa-9d47-edabf4244d7b req-8ce61484-3a34-41f0-8528-ded52c3d7000 service nova] Creating event network-vif-unplugged:82b499e7-3534-4427-9fd5-db274d819339 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:33.718029 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8bafd293-77e3-4cfa-9d47-edabf4244d7b req-8ce61484-3a34-41f0-8528-ded52c3d7000 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181083 Jul 19 20:13:33.719500 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2546/5197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:13:34.716532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:35.301554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:35.328745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:35.343408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:35.349220 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cf9d48e-937e-4532-bc76-80a390b2d804 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2929 microversion: 2.32 time: 2.345211 Jul 19 20:13:35.352579 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2652/5198] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:33 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2929 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:35.863255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5eafca35-c446-4b0a-85fe-290b07f74f45 req-30fbcc50-a3aa-49b9-a724-5533f63f7878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-unplugged", "status": "completed", "tag": "82e7fe0f-3b91-48e4-84d9-6e2ad64b993b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:35.877630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:35.883606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5eafca35-c446-4b0a-85fe-290b07f74f45 req-30fbcc50-a3aa-49b9-a724-5533f63f7878 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:35.890513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5eafca35-c446-4b0a-85fe-290b07f74f45 req-30fbcc50-a3aa-49b9-a724-5533f63f7878 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:35.907689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:35.911430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5eafca35-c446-4b0a-85fe-290b07f74f45 req-30fbcc50-a3aa-49b9-a724-5533f63f7878 service nova] Creating event network-vif-unplugged:82e7fe0f-3b91-48e4-84d9-6e2ad64b993b for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:35.932497 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5eafca35-c446-4b0a-85fe-290b07f74f45 req-30fbcc50-a3aa-49b9-a724-5533f63f7878 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073276 Jul 19 20:13:35.944984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2547/5199] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:36.375508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:36.376354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:36.401608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.405354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.409720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.411183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.806453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.821944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.835979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.849407 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3df311d0-c38f-4382-85fc-dffa9391438c tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2908 microversion: 2.32 time: 1.480976 Jul 19 20:13:37.853226 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2653/5200] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:36 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2908 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:38.089890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-unplugged", "status": "completed", "tag": "f637c253-bae6-449a-bf39-e2333c9d4de4"}, {"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-unplugged", "status": "completed", "tag": "ec712b1a-b532-45f3-91d6-8d7b68a473ac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:38.109309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:38.111079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:38.141274 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] Creating event network-vif-unplugged:f637c253-bae6-449a-bf39-e2333c9d4de4 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:38.142059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] Creating event network-vif-unplugged:ec712b1a-b532-45f3-91d6-8d7b68a473ac for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:38.149612 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b709a54a-a252-44df-9db4-241a6f7dbcc2 req-111633a9-3512-4096-862c-3d24a89d4d11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.064314 Jul 19 20:13:38.150763 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2548/5201] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:38.875193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:38.875918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:38.889148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:38.890732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:38.897108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:38.897778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:40.756388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a2898148-5135-4c29-8dfe-3fee420df0df req-06853f17-01a7-4721-89d9-2680ebcee626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-unplugged", "status": "completed", "tag": "70af8460-088e-4bf6-877b-0da5ae8d4875"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:40.774372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a2898148-5135-4c29-8dfe-3fee420df0df req-06853f17-01a7-4721-89d9-2680ebcee626 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:40.781333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a2898148-5135-4c29-8dfe-3fee420df0df req-06853f17-01a7-4721-89d9-2680ebcee626 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:40.833275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a2898148-5135-4c29-8dfe-3fee420df0df req-06853f17-01a7-4721-89d9-2680ebcee626 service nova] Creating event network-vif-unplugged:70af8460-088e-4bf6-877b-0da5ae8d4875 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:40.844235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a2898148-5135-4c29-8dfe-3fee420df0df req-06853f17-01a7-4721-89d9-2680ebcee626 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092260 Jul 19 20:13:40.857435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2549/5202] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:13:41.204811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:41.225261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:41.243789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:41.247345 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16ba59c9-459f-4c3f-a8af-d0689f54e0c8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2908 microversion: 2.32 time: 2.376790 Jul 19 20:13:41.254224 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2654/5203] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:38 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2908 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:41.437047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5b1c273f-516b-4509-9903-686894c4ab88 req-0551d20f-ba6d-4f58-adb9-3cef2b407ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-deleted", "tag": "70af8460-088e-4bf6-877b-0da5ae8d4875"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:41.462714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5b1c273f-516b-4509-9903-686894c4ab88 req-0551d20f-ba6d-4f58-adb9-3cef2b407ebd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:41.465243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5b1c273f-516b-4509-9903-686894c4ab88 req-0551d20f-ba6d-4f58-adb9-3cef2b407ebd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:41.499470 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5b1c273f-516b-4509-9903-686894c4ab88 req-0551d20f-ba6d-4f58-adb9-3cef2b407ebd service nova] Creating event network-vif-deleted:70af8460-088e-4bf6-877b-0da5ae8d4875 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:41.521924 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5b1c273f-516b-4509-9903-686894c4ab88 req-0551d20f-ba6d-4f58-adb9-3cef2b407ebd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092221 Jul 19 20:13:41.539789 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2550/5204] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:42.274111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:42.274910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:42.293070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:42.295968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:42.300159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:42.300617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:42.423884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:43.537878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:43.568457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:43.572307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:43.577234 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-abeae682-7f97-4cbe-a673-960ee3572ad7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2748 microversion: 2.32 time: 1.305743 Jul 19 20:13:43.578104 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2655/5205] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:42 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2748 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:44.605285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:44.606010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:44.639355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:44.647012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:44.663428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:44.665496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:45.582508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:45.597882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:45.601801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:45.605083 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2478f30-4298-49e6-97de-bad76c1654d8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2702 microversion: 2.32 time: 1.005574 Jul 19 20:13:45.609779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2551/5206] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:44 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2702 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:45.832817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5f994a52-1f05-4649-9b9f-25e3c85590bd req-c25bd397-0c30-4b68-bb42-8f05961feb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-deleted", "tag": "82b499e7-3534-4427-9fd5-db274d819339"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:45.861057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5f994a52-1f05-4649-9b9f-25e3c85590bd req-c25bd397-0c30-4b68-bb42-8f05961feb52 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:45.864620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5f994a52-1f05-4649-9b9f-25e3c85590bd req-c25bd397-0c30-4b68-bb42-8f05961feb52 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:45.893051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5f994a52-1f05-4649-9b9f-25e3c85590bd req-c25bd397-0c30-4b68-bb42-8f05961feb52 service nova] Creating event network-vif-deleted:82b499e7-3534-4427-9fd5-db274d819339 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:45.911018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5f994a52-1f05-4649-9b9f-25e3c85590bd req-c25bd397-0c30-4b68-bb42-8f05961feb52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082072 Jul 19 20:13:45.914519 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2656/5207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:46.630088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:46.630875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:46.653369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:46.658150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:46.659353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:46.664079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:47.238454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:47.254795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:47.256590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:47.258309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d4c20466-28dd-4350-9cea-26529f8833da tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2370 microversion: 2.32 time: 0.633309 Jul 19 20:13:47.259079 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2552/5208] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:46 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2370 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:47.957798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-53773d8e-5246-455d-b9da-0f6323424a6b req-30e093ba-0241-4887-8784-16a7a03a83f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-deleted", "tag": "82e7fe0f-3b91-48e4-84d9-6e2ad64b993b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:47.974933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-53773d8e-5246-455d-b9da-0f6323424a6b req-30e093ba-0241-4887-8784-16a7a03a83f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:47.975382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-53773d8e-5246-455d-b9da-0f6323424a6b req-30e093ba-0241-4887-8784-16a7a03a83f2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:48.000130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-53773d8e-5246-455d-b9da-0f6323424a6b req-30e093ba-0241-4887-8784-16a7a03a83f2 service nova] Creating event network-vif-deleted:82e7fe0f-3b91-48e4-84d9-6e2ad64b993b for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:48.006945 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-53773d8e-5246-455d-b9da-0f6323424a6b req-30e093ba-0241-4887-8784-16a7a03a83f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058724 Jul 19 20:13:48.010079 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2657/5209] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:48.280619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:48.281916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:48.300848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:48.302154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:48.310205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:48.311195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:49.566020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:49.605046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:49.613669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:49.616883 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a40df30a-7e88-4b44-aecf-7ec2f2180cd5 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2212 microversion: 2.32 time: 1.339815 Jul 19 20:13:49.617663 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2553/5210] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:48 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2212 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:50.186568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3c14915d-2ec9-4cc7-a62d-0eac998846c8 req-cb84fef9-584f-4e45-bbe2-9bed6037444c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-deleted", "tag": "f637c253-bae6-449a-bf39-e2333c9d4de4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:50.197173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3c14915d-2ec9-4cc7-a62d-0eac998846c8 req-cb84fef9-584f-4e45-bbe2-9bed6037444c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:50.197426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3c14915d-2ec9-4cc7-a62d-0eac998846c8 req-cb84fef9-584f-4e45-bbe2-9bed6037444c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:50.234518 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3c14915d-2ec9-4cc7-a62d-0eac998846c8 req-cb84fef9-584f-4e45-bbe2-9bed6037444c service nova] Creating event network-vif-deleted:f637c253-bae6-449a-bf39-e2333c9d4de4 for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:50.245431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3c14915d-2ec9-4cc7-a62d-0eac998846c8 req-cb84fef9-584f-4e45-bbe2-9bed6037444c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065160 Jul 19 20:13:50.248177 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2658/5211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:50.639177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:50.640517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:50.652813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:50.654108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:50.655790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:50.656700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:51.416859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:51.438909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:51.443274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:51.446351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f902d2af-b32a-4e11-be98-202b5a3f20e6 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 2053 microversion: 2.32 time: 0.812460 Jul 19 20:13:51.451216 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2554/5212] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:50 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 2053 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:52.473108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:52.473809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:52.486766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:52.487217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:52.504277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:52.504852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:52.515449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-27b3f644-c8ce-4ad4-b2a9-05d655c3197f req-a92b60c5-1a9b-4290-9ed2-0165f2196b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af9630f-5d57-43d8-bc10-1c53cfb3b619", "name": "network-vif-deleted", "tag": "ec712b1a-b532-45f3-91d6-8d7b68a473ac"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:52.545054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-27b3f644-c8ce-4ad4-b2a9-05d655c3197f req-a92b60c5-1a9b-4290-9ed2-0165f2196b7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:52.545523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-27b3f644-c8ce-4ad4-b2a9-05d655c3197f req-a92b60c5-1a9b-4290-9ed2-0165f2196b7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:52.593738 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-27b3f644-c8ce-4ad4-b2a9-05d655c3197f req-a92b60c5-1a9b-4290-9ed2-0165f2196b7e service nova] Creating event network-vif-deleted:ec712b1a-b532-45f3-91d6-8d7b68a473ac for instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 on n-h1-843861-3 Jul 19 20:13:52.624131 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-27b3f644-c8ce-4ad4-b2a9-05d655c3197f req-a92b60c5-1a9b-4290-9ed2-0165f2196b7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109989 Jul 19 20:13:52.628470 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2555/5213] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:52.998121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:53.010016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:53.012800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:53.014564 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60064265-5a22-465e-becf-6e4e5616b7bd tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1986 microversion: 2.32 time: 0.546518 Jul 19 20:13:53.028511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2659/5214] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:52 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1986 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:54.038543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:54.039995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:54.063181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:54.064807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:54.069703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:54.072484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:54.618356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:54.629770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:54.639425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:54.641223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6cc92ec-a430-4a82-a4fe-66c52221d84f tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.610738 Jul 19 20:13:54.658306 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2556/5215] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:54 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:55.666877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:55.668946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:55.692063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:55.692703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:55.695848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:55.697495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:55.911004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:55.944698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:55.980641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:56.000516 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9eac687c-c414-4732-89eb-e46051ca67b7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.330533 Jul 19 20:13:56.001351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2660/5216] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:55 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:57.024380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:57.025655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:57.039084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:57.039971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:57.043182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:57.044073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:57.222615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:57.250227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:57.251847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:57.256758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db62e61a-0d92-491c-aa60-05bc627531d7 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.237174 Jul 19 20:13:57.268883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2557/5217] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:57 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:58.276688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:58.279236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:58.292301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:58.296362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:58.297685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:58.298321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:58.508319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:58.529682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:58.532902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:58.534668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d60fb3d-a247-45d8-8e90-17d8b083bb0b tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.262607 Jul 19 20:13:58.535379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2661/5218] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:58 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:59.555651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:59.556406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:59.574426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:59.575008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:59.575911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:59.577010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:59.961460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:59.985702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:00.000008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:00.008307 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0a52282-b33f-473c-873a-10a98405ee04 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.458686 Jul 19 20:14:00.019147 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2558/5219] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:59 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:01.035517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:01.038471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:01.069443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:01.070145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:01.071118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:01.071722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:01.530141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:01.544962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:01.547686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:01.551049 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5fe99112-85ad-404a-a7d0-4eef4d7151ca tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.520314 Jul 19 20:14:01.557164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2662/5220] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:01 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:02.575785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:02.576794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:02.604575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:02.605760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:02.617252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:02.623070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:03.178741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:03.239787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:03.242967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:03.265050 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee8df439-67a0-439f-8b62-2bdf1706fc26 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.696989 Jul 19 20:14:03.266157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2559/5221] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:02 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:04.304823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:04.306383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:04.322077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=22 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:04.338233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:04.338894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:04.339941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:04.340552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:04.802225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:04.818681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:04.822428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:04.825222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52ac1f26-d40a-4fe8-87f8-e1bcf29840a4 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.531020 Jul 19 20:14:04.829618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2663/5222] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:04 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:05.847469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:05.848698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:05.858462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:05.861822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:05.876484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:05.879570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:06.345464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2090354074", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:06.484066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] validate_networks() for [('0502ee9f-936f-4533-bf2e-8ac8a74af9df', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:14:06.542448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:06.565360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:06.574692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:06.578426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b28fa692-3c6e-42f1-9ec5-43ab837cf00d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.735759 Jul 19 20:14:06.583039 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2560/5223] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:05 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:07.609620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:07.612083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:07.622465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:07.623947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:07.625712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:07.626989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:07.950648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:07.966696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:07.985576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:07.988221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ce77149-9846-42f6-aba1-da7636ca583d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.389890 Jul 19 20:14:07.999574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2561/5224] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:07 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:09.023207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:09.024778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:09.029526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=30 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:09.046852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:09.057184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:09.061557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:09.062236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:09.084683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=70 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:09.775617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:09.799950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:09.807930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:09.817939 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-971d7af6-0db4-4420-80c0-96a2aeef54c0 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.799849 Jul 19 20:14:09.819686 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2562/5225] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:09 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:10.477452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:14:10.479026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:14:10.479656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:14:10.480234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:14:10.480798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:14:10.521150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:10.526051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:10.529504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:10.530812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:10.639088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Getting quotas for project bdcae3b8c24b47acab1c69e5b6a12a32. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:14:10.651759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Getting quotas for user ac019c69b5f74b218c26fc1294676e19 and project bdcae3b8c24b47acab1c69e5b6a12a32. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:14:10.697505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:14:10.710056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:14:10.823108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-550ea656-4024-4b60-abc1-bb03fa0b4bb6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.957709 Jul 19 20:14:10.826668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2664/5226] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:14:10.837117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41db7aa3-dde0-4490-bf2e-8ef03a5b0626 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:10.837945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41db7aa3-dde0-4490-bf2e-8ef03a5b0626 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:10.847514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:10.871240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:10.896875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:10.897331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:10.914358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:10.915208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:11.156158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41db7aa3-dde0-4490-bf2e-8ef03a5b0626 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:11.159472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:11.170203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41db7aa3-dde0-4490-bf2e-8ef03a5b0626 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1217 microversion: 2.1 time: 0.337731 Jul 19 20:14:11.193721 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2563/5227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:10 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1217 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:11.194558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:11.196425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:11.197566 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b010dcdb-a600-4c7f-8556-8164752abaff tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.356175 Jul 19 20:14:11.203876 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2665/5228] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:10 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:12.200436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:12.200980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:12.219511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:12.223737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:12.224485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:12.225342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:12.225608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:12.225788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:12.243406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:12.244572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:12.245757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:12.247052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:12.506959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:12.518432 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57bdfcfc-b7aa-4b37-9433-9c9554e28b3d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1213 microversion: 2.1 time: 0.322069 Jul 19 20:14:12.539247 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2564/5229] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:12 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1213 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:12.737744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:12.740907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=54 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:12.771123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:12.783912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:12.795952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d07b443e-78fb-433c-aa18-6be5731fb67d tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.566673 Jul 19 20:14:12.797376 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2666/5230] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:12 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:13.543044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:13.545231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:13.560090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:13.561777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:13.565980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:13.567106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:13.824794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:13.826026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:13.833563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:13.852657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:13.853890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:13.854623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:13.888501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:13.901496 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bbaa795-345b-4e0c-941e-7467d6b54cd8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1275 microversion: 2.1 time: 0.362560 Jul 19 20:14:13.915797 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2565/5231] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:13 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:14.332293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:14.352238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:14.354270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:14.355644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dfd7e3d9-b3a4-40a7-ab50-8ceea3e82b14 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.534729 Jul 19 20:14:14.358611 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2667/5232] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:13 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:14.922717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:14.924116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:14.946227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:14.950539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:14.953485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:14.954199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:15.363921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:15.391919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:15.393848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:15.411349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0171017-01f8-4c9b-a4e7-a302e6ae9e55 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1275 microversion: 2.1 time: 0.489060 Jul 19 20:14:15.414380 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2566/5233] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:14 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:15.427654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:15.428595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:15.429722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:15.432812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:15.575698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:15.632564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:15.641517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:15.646640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c79624c2-74cf-4a77-b582-d8239b24fde8 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.272216 Jul 19 20:14:15.651784 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2668/5234] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:15 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:16.432326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:16.434278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:16.459964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:16.460970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:16.476977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:16.477732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:16.649913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:16.660339 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5281d88c-a836-411b-b8e2-62f6e0cf5e43 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1275 microversion: 2.1 time: 0.233132 Jul 19 20:14:16.663100 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2567/5235] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:16 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:16.677997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:16.679519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:16.691705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:16.692889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:16.695797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:16.696714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:17.053450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:17.067133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:17.073610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:17.079547 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d5c9e7f-b0cd-4dcc-9d46-ae7672f2d362 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.411446 Jul 19 20:14:17.080986 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2669/5236] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:16 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:17.684188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:17.688392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:17.732345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:17.733078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:17.734057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:17.734924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:18.106670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:18.107880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:18.128099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:18.129025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:18.130131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:18.135846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:18.660578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:18.680860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:18.686031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:18.688936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:18.693237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5469ceff-a309-40c8-8fd5-8cc2a7c4a7db tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.590580 Jul 19 20:14:18.694877 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2670/5237] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:18 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:18.699551 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4a0f9369-fd17-47ba-a000-45b55722be2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 1.023974 Jul 19 20:14:18.705549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2568/5238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:17 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:19.714058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:19.714694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:19.724483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:19.726142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:19.743323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.744347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:19.745629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.746093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:19.746890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.747325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:19.749737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.752273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:20.558639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:20.578306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:20.581854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:20.584132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f421ab5e-cdf4-4a25-b4a5-6633019b9497 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.875561 Jul 19 20:14:20.586000 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2671/5239] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:19 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:20.862281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:20.874264 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7acfaa91-b8bf-40b0-be8d-4f8f5715a238 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 1.155488 Jul 19 20:14:20.876234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2569/5240] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:19 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:21.613121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:21.613747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:21.627624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:21.632700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:21.638970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:21.641837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:21.644240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:21.645059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:21.887982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.899991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:21.902072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:21.910502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.912986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b862a0aa0096490c9c8bc84fc44d0412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f91a15924e04c8c8c173dd0975e7f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.914227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2685f182-08e1-411b-b3d0-017ffae32929 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 200 len: 1604 microversion: 2.32 time: 0.314244 Jul 19 20:14:21.917547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2672/5241] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:21 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 1604 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:21.918238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:21.923113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:21.927252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:21.928340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:21.932872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:22.613444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:22.630970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0907a78f-bf76-40f3-9287-8cefac8d84ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 0.739173 Jul 19 20:14:22.642790 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2570/5242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:21 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:22.929357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-daa1f275-1b08-4f9b-be40-12359e73d90c req-df3ab522-e4ac-493d-819f-bce56e09eb84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:22.933143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:22.933836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:22.949826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:22.950204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:22.951179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:22.951755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:22.952558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-daa1f275-1b08-4f9b-be40-12359e73d90c req-df3ab522-e4ac-493d-819f-bce56e09eb84 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:22.954125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-daa1f275-1b08-4f9b-be40-12359e73d90c req-df3ab522-e4ac-493d-819f-bce56e09eb84 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:22.969377 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-daa1f275-1b08-4f9b-be40-12359e73d90c req-df3ab522-e4ac-493d-819f-bce56e09eb84 service nova] Creating event network-changed:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:14:22.976897 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-daa1f275-1b08-4f9b-be40-12359e73d90c req-df3ab522-e4ac-493d-819f-bce56e09eb84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061786 Jul 19 20:14:22.978655 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2673/5243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:14:22.986891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] HTTP exception thrown: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Request method failure captured: Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 HTTP/1.1 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w8Jljmu8Ll9d6nXUIvP7CcnQRfVTruLL_Z2VV3QfHR1NfgU0mqEuBzbcd6epbiYLfv37NSErVLdzlNYXPcwuu7_AYxR04zvbEp-paAavKzFOiDTEAH6xHcgq3Z9Zmszi-tXU8H68OPhQBTdGNL-pKgi3d0s1virMf8XPkA8dH7Vf1I Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b862a0aa0096490c9c8bc84fc44d0412 Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2af9630f-5d57-43d8-bc10-1c53cfb3b619'} Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:22.988954 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:22.992828 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:22.999676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Returning 404 to user: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:14:23.000716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b5147aa-90c9-49c1-9896-53355035ee76 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 404 len: 111 microversion: 2.32 time: 0.071593 Jul 19 20:14:23.002328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2571/5244] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:22 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:14:23.025385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-84e075d3-8e20-4d10-8825-ad7e8e087252 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '.version_select at 0x7fb88cb5be50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:23.093140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-84e075d3-8e20-4d10-8825-ad7e8e087252 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620098174" status: 204 len: 0 microversion: 2.32 time: 0.084582 Jul 19 20:14:23.099801 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2674/5245] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Jul 19 20:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620098174 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:23.650441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:23.651149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:23.664120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:23.666253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:23.669525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:23.670587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:25.381536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:25.391587 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc660aba-0f7a-44e5-b0b9-3268943f752b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 1.745509 Jul 19 20:14:25.408312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2572/5246] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:23 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:26.414180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:26.414975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:26.429716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:26.430175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:26.435865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:26.436759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:27.113692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:27.122282 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c303fcc1-58c2-4b09-9328-fe02c6a0a762 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 0.711897 Jul 19 20:14:27.130192 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2675/5247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:26 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:28.155594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:28.158424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:28.172734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:28.176973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:28.176973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:28.176973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:28.672599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:28.686050 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc80fced-0592-4551-960a-f64274ff4778 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 0.534853 Jul 19 20:14:28.687333 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2573/5248] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:28 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:29.712392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:29.713654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:29.742680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:29.760640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:29.761909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:29.762527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:31.694126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:31.703415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db1ef2f1-5f8c-4ca2-8faa-c26f891462d6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 2.003198 Jul 19 20:14:31.712680 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2676/5249] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:29 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:32.730518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:32.731435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:32.757591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:32.758055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:32.767167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:32.767632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:33.137030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-06a0165e-4a01-4688-9161-c7109eddcf6e req-9edf9956-7036-4bcf-b02c-7c60d16e2c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "name": "network-vif-plugged", "status": "completed", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:33.157049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-06a0165e-4a01-4688-9161-c7109eddcf6e req-9edf9956-7036-4bcf-b02c-7c60d16e2c8c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:33.157502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-06a0165e-4a01-4688-9161-c7109eddcf6e req-9edf9956-7036-4bcf-b02c-7c60d16e2c8c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:33.192333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-06a0165e-4a01-4688-9161-c7109eddcf6e req-9edf9956-7036-4bcf-b02c-7c60d16e2c8c service nova] Creating event network-vif-plugged:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:14:33.213854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-06a0165e-4a01-4688-9161-c7109eddcf6e req-9edf9956-7036-4bcf-b02c-7c60d16e2c8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080752 Jul 19 20:14:33.214854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2677/5250] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:14:33.702787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:33.720391 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de7b4c7d-9109-4c0a-a824-cbb45c3d5d19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 0.994302 Jul 19 20:14:33.722228 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2574/5251] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:32 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:34.748527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:34.750059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:34.758767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:34.784953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:34.785763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:34.787651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:34.791648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:35.545329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:35.554717 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b9e945e-7da6-4f4b-b0f3-e96839f82ecc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1317 microversion: 2.1 time: 0.818518 Jul 19 20:14:35.566806 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2678/5252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:34 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:36.574229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:36.574746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:36.589820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:36.590276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:36.591094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:36.592470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:37.627590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:37.670397 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-abd86902-35d0-426a-ba36-2e150f2efcd5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.100353 Jul 19 20:14:37.677425 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2575/5253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:36 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:37.919259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-527043083", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:38.018897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] validate_networks() for [('0502ee9f-936f-4533-bf2e-8ac8a74af9df', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:14:38.866283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:38.870325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:38.895757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:38.896986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:38.898031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:38.898815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:38.956758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] HTTP exception thrown: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Request method failure captured: Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 HTTP/1.1 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w8Jljmu8Ll9d6nXUIvP7CcnQRfVTruLL_Z2VV3QfHR1NfgU0mqEuBzbcd6epbiYLfv37NSErVLdzlNYXPcwuu7_AYxR04zvbEp-paAavKzFOiDTEAH6xHcgq3Z9Zmszi-tXU8H68OPhQBTdGNL-pKgi3d0s1virMf8XPkA8dH7Vf1I Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b862a0aa0096490c9c8bc84fc44d0412 Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2af9630f-5d57-43d8-bc10-1c53cfb3b619'} Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:14:38.965240 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Returning 404 to user: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:14:38.973668 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23eacf5a-96b1-4b1a-b7f2-044a83b037fe tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 404 len: 111 microversion: 2.32 time: 0.111462 Jul 19 20:14:38.980328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2576/5254] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:14:38 2022] DELETE /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:14:38.994617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:38.998195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] [instance: 2af9630f-5d57-43d8-bc10-1c53cfb3b619] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:39.015171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.015368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.017119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.018426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.041055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] HTTP exception thrown: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Request method failure captured: Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 HTTP/1.1 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1w8Jljmu8Ll9d6nXUIvP7CcnQRfVTruLL_Z2VV3QfHR1NfgU0mqEuBzbcd6epbiYLfv37NSErVLdzlNYXPcwuu7_AYxR04zvbEp-paAavKzFOiDTEAH6xHcgq3Z9Zmszi-tXU8H68OPhQBTdGNL-pKgi3d0s1virMf8XPkA8dH7Vf1I Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f91a15924e04c8c8c173dd0975e7f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0f91a15924e04c8c8c173dd0975e7f01 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TaggedBootDevicesTest-271128334 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b862a0aa0096490c9c8bc84fc44d0412 Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TaggedBootDevicesTest-271128334-project Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2af9630f-5d57-43d8-bc10-1c53cfb3b619'} Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:39.042905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] Returning 404 to user: Instance 2af9630f-5d57-43d8-bc10-1c53cfb3b619 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-040c2074-5d4b-4f87-b908-4a354285ec53 tempest-TaggedBootDevicesTest-271128334 tempest-TaggedBootDevicesTest-271128334-project] 10.222.0.33 "GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619" status: 404 len: 111 microversion: 2.32 time: 0.062854 Jul 19 20:14:39.052475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2577/5255] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:38 2022] GET /compute/v2.1/servers/2af9630f-5d57-43d8-bc10-1c53cfb3b619 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:14:41.128612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:14:41.129253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:14:41.130314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:14:41.130851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:14:41.131444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:14:41.168729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.183079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.193605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.198465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.285006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Getting quotas for project bdcae3b8c24b47acab1c69e5b6a12a32. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:14:41.310651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Getting quotas for user ac019c69b5f74b218c26fc1294676e19 and project bdcae3b8c24b47acab1c69e5b6a12a32. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:14:41.386679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:14:41.396587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:14:41.650359 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f8cf079-a50a-4e0f-970d-479514755a39 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.734889 Jul 19 20:14:41.657129 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2679/5256] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:14:41.667710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1fdb5dc3-0077-4a44-a32a-9724aa958b17 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:41.668936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1fdb5dc3-0077-4a44-a32a-9724aa958b17 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:41.698396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:41.897647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1fdb5dc3-0077-4a44-a32a-9724aa958b17 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:41.926113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1fdb5dc3-0077-4a44-a32a-9724aa958b17 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1216 microversion: 2.1 time: 0.261176 Jul 19 20:14:41.926730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2578/5257] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:41 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1216 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:42.944050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.944736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:42.967944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.970686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.977547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.980746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.023185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=62 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:43.398641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:43.422974 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c47d597d-55da-497a-8dda-a92ab9b1a469 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1220 microversion: 2.1 time: 0.477021 Jul 19 20:14:43.424380 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2680/5258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:42 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1220 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:44.441898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:44.443281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:44.468365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:44.469076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:44.475465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:44.476359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:44.481713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=78 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:44.840360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:44.852826 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a67b208f-8cf2-499a-adbd-cf8c97e9a3d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1274 microversion: 2.1 time: 0.416211 Jul 19 20:14:44.853628 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2579/5259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:44 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:45.871246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:45.872698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:45.892943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:45.894583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:45.895482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:45.895966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:46.699937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:46.734595 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-567b68d3-96b7-41c8-95a3-97252d738b80 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1274 microversion: 2.1 time: 0.866370 Jul 19 20:14:46.736766 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2681/5260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:45 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1274 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:47.752172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:47.752794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:47.770167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:47.770457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:47.771583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:47.772130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:49.256746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:49.268905 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab98fe33-3692-441a-9941-4d588f63b2e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.521077 Jul 19 20:14:49.272543 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2580/5261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:47 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:50.290395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:50.294798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:50.316489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:50.316942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:50.317751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:50.318189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:51.231792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:51.354941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:51.834475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:51.850905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad72d3bf-0737-4ef9-9491-1badfc1fca53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.565577 Jul 19 20:14:51.851511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2682/5262] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:50 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:52.463649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4c69940e-e439-4618-a1fc-ffd4cdd2b445 req-091ee6cb-dfb5-42b2-83dd-617b04c454b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5b5afc-9fea-4fef-ab27-67b3da4e31d2", "tag": "5a76fc3a-7465-454c-aa52-eed535885cbe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:52.483889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:52.486003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4c69940e-e439-4618-a1fc-ffd4cdd2b445 req-091ee6cb-dfb5-42b2-83dd-617b04c454b7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:52.486881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4c69940e-e439-4618-a1fc-ffd4cdd2b445 req-091ee6cb-dfb5-42b2-83dd-617b04c454b7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:52.515102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4c69940e-e439-4618-a1fc-ffd4cdd2b445 req-091ee6cb-dfb5-42b2-83dd-617b04c454b7 service nova] Creating event network-changed:5a76fc3a-7465-454c-aa52-eed535885cbe for instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 on n-h1-843861-3 Jul 19 20:14:52.529181 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4c69940e-e439-4618-a1fc-ffd4cdd2b445 req-091ee6cb-dfb5-42b2-83dd-617b04c454b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069551 Jul 19 20:14:52.535922 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2581/5263] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:14:52.867792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:52.868442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:52.889561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:52.890456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:52.891374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:52.893193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:54.004643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:54.022274 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e5446a5-fb27-4535-b118-d010fd652c85 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.158203 Jul 19 20:14:54.030615 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2683/5264] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:52 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:55.043511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:55.044960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:55.060618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:55.062067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:55.069836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:55.071364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:55.763033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:55.787513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-88de0c24-7654-44c5-b6d1-71bf49e8fb05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 0.750038 Jul 19 20:14:55.796762 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2582/5265] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:55 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:56.805474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:56.806987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:56.824637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:56.829206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:56.830167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:56.830734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:57.977735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:57.989077 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f398fbe3-8b38-44f9-b6b2-e73eef9a6b6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.187715 Jul 19 20:14:57.989677 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2684/5266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:56 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:59.013250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:59.013250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:59.022872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:59.023631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:59.024189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:59.024638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:00.300025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:00.308610 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b637a9ff-09d2-49f3-887a-73dd10f007cc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.306707 Jul 19 20:15:00.320874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2583/5267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:14:59 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:01.329397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:01.330032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:01.348056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:01.348056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:01.350493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:01.351199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:02.026889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:02.056242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c69c3cf-f34a-47f5-a56c-26b86fee2278 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 0.727554 Jul 19 20:15:02.061069 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2685/5268] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:01 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:02.639835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8c0258a6-d47e-4e4f-8238-79747282c529 req-7d0ab236-0e0b-4d1b-8d1b-f9d31ca4beb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5b5afc-9fea-4fef-ab27-67b3da4e31d2", "name": "network-vif-plugged", "status": "completed", "tag": "5a76fc3a-7465-454c-aa52-eed535885cbe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:02.669933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8c0258a6-d47e-4e4f-8238-79747282c529 req-7d0ab236-0e0b-4d1b-8d1b-f9d31ca4beb8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:02.672806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8c0258a6-d47e-4e4f-8238-79747282c529 req-7d0ab236-0e0b-4d1b-8d1b-f9d31ca4beb8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:02.694405 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8c0258a6-d47e-4e4f-8238-79747282c529 req-7d0ab236-0e0b-4d1b-8d1b-f9d31ca4beb8 service nova] Creating event network-vif-plugged:5a76fc3a-7465-454c-aa52-eed535885cbe for instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 on n-h1-843861-3 Jul 19 20:15:02.703589 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8c0258a6-d47e-4e4f-8238-79747282c529 req-7d0ab236-0e0b-4d1b-8d1b-f9d31ca4beb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075002 Jul 19 20:15:02.706753 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2584/5269] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:03.081797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:03.082595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:03.104338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:03.104807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:03.112482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:03.113438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:05.003931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:05.021276 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-33bebbed-8f24-4372-932f-0e95b0d0e4ab tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1316 microversion: 2.1 time: 1.946886 Jul 19 20:15:05.023204 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2686/5270] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:03 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1316 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:06.042366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:06.043097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:06.063558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:06.065281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:06.066596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:06.068271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:07.914712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:07.923920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aca85a0f-b339-4500-b16a-e4ac6c74d46d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1506 microversion: 2.1 time: 1.887673 Jul 19 20:15:07.935017 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2585/5271] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:06 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1506 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:07.943090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:07.944249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:07.953217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:07.958848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:07.962548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:07.963545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:07.964168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:07.998068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:15:08.134254 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b44e363a-795c-4222-b381-58e5c0af20b8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 204 len: 0 microversion: 2.1 time: 0.194643 Jul 19 20:15:08.136457 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2687/5272] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:15:07 2022] DELETE /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:15:08.146128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:08.147001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:08.163682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:08.166503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:08.171552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:08.172647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:09.112289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:09.145558 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4df62776-e5ba-4f54-b3c3-4bd2abd27abd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1512 microversion: 2.1 time: 1.001688 Jul 19 20:15:09.148204 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2586/5273] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:08 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1512 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:15:10.168410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:10.170557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:10.192647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:10.193389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:10.194364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:10.194983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:11.948778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:11.964100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16aa7010-d640-464a-9e34-d7eb8c14cae5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1512 microversion: 2.1 time: 1.798044 Jul 19 20:15:11.968142 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2688/5274] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:10 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1512 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:12.988795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:12.990289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:13.005420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=20 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:13.013963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:13.014379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:13.017207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:13.017663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:14.012344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:14.024848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51994a4c-af8b-4023-b365-e77667f8ed08 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 200 len: 1512 microversion: 2.1 time: 1.044114 Jul 19 20:15:14.027123 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2587/5275] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:12 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 1512 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:14.282081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-75ec7eec-8c6e-42fc-a433-c98a213ac284 req-dd561273-d8e3-42e4-8892-c45f4e123931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5b5afc-9fea-4fef-ab27-67b3da4e31d2", "name": "network-vif-deleted", "tag": "5a76fc3a-7465-454c-aa52-eed535885cbe"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:14.303403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-75ec7eec-8c6e-42fc-a433-c98a213ac284 req-dd561273-d8e3-42e4-8892-c45f4e123931 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:14.307920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-75ec7eec-8c6e-42fc-a433-c98a213ac284 req-dd561273-d8e3-42e4-8892-c45f4e123931 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:14.346565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:14.352472 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-75ec7eec-8c6e-42fc-a433-c98a213ac284 req-dd561273-d8e3-42e4-8892-c45f4e123931 service nova] Creating event network-vif-deleted:5a76fc3a-7465-454c-aa52-eed535885cbe for instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 on n-h1-843861-3 Jul 19 20:15:14.366153 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-75ec7eec-8c6e-42fc-a433-c98a213ac284 req-dd561273-d8e3-42e4-8892-c45f4e123931 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090639 Jul 19 20:15:14.383112 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2689/5276] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:15.045546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:15.047563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:15.057742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.058718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:15.059968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.060781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:15.080657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=46 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:15.084392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 HTTP/1.1 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '2a5b5afc-9fea-4fef-ab27-67b3da4e31d2'} Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:15.086548 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:15:15.090318 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:15.098289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:15.101137 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c749b96-7fda-45db-b41a-17d0e6ec518b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 404 len: 111 microversion: 2.1 time: 0.061344 Jul 19 20:15:15.102869 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2588/5277] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:15 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:15:15.113402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:15.115340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:15.125829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.127979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:15.129081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.130451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:15.778604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:15.804482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d153eaa7-aee9-430f-9b49-927d91d065f4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.696112 Jul 19 20:15:15.812558 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2690/5278] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:16.088264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34750409-a949-427a-8913-ff3e9bea2058 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34750409-a949-427a-8913-ff3e9bea2058 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 163 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": 12345, "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 12345 Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:15:16.093114 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:15:16.101551 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:16.107758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34750409-a949-427a-8913-ff3e9bea2058 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:16.115012 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34750409-a949-427a-8913-ff3e9bea2058 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.038739 Jul 19 20:15:16.116914 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2589/5279] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:16 2022] POST /compute/v2.1/servers => generated 127 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:16.132664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:16.134231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:16.153159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:16.155096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:16.158121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:16.159260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:17.501266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:17.535372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6dcee111-a88a-420a-beed-2cec7dbd903f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.399881 Jul 19 20:15:17.535372 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2691/5280] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:16 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:17.547470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:17.549101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:17.573881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:17.574899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:17.576098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:17.576705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:18.280802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:18.305717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba50c6a9-ec6a-4b89-82e0-d99e37b0201e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.767783 Jul 19 20:15:18.306546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2590/5281] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:17 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:21.829753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af579602-2240-46de-b152-a3855302647c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805516789", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb381f28-037f-4b74-9397-2ca0e349685f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:21.931541 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-af579602-2240-46de-b152-a3855302647c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af579602-2240-46de-b152-a3855302647c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 357 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805516789", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb381f28-037f-4b74-9397-2ca0e349685f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: exception: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-805516789', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fb381f28-037f-4b74-9397-2ca0e349685f'}], 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:21.941444 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. Jul 19 20:15:21.945743 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:21.951032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af579602-2240-46de-b152-a3855302647c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Block Device fb381f28-037f-4b74-9397-2ca0e349685f is not bootable. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:21.952595 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af579602-2240-46de-b152-a3855302647c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.127114 Jul 19 20:15:21.953607 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2692/5282] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:21.967219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:21.970280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:22.022570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.025489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:22.026926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.027825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:22.867448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:22.880960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb420dfa-1822-4fc3-940d-295f34109a49 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.920892 Jul 19 20:15:22.900000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:22.900543 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2591/5283] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:21 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:22.901742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:22.909587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.910040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:22.910818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.911252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:24.271350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:24.284781 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a611dd44-e314-44bf-b020-9d3cfffb9b4d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.388858 Jul 19 20:15:24.302926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2693/5284] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:22 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:27.344517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dab90c6d-b660-4724-8803-d941e3c7dc37 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1547900098", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "destination_type": "local"}, {"source_type": "volume", "uuid": "dbda406b-1d76-4ed5-b9e7-990be154e532", "destination_type": "invalid"}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dab90c6d-b660-4724-8803-d941e3c7dc37 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 495 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1547900098", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "destination_type": "local"}, {"source_type": "volume", "uuid": "dbda406b-1d76-4ed5-b9e7-990be154e532", "destination_type": "invalid"}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1547900098', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'dbda406b-1d76-4ed5-b9e7-990be154e532', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:27.346078 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dab90c6d-b660-4724-8803-d941e3c7dc37 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dab90c6d-b660-4724-8803-d941e3c7dc37 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011523 Jul 19 20:15:27.352916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2592/5285] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:27 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:27.358705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:27.359493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:27.380055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:27.381818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:27.413194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:27.422409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:27.537780 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:15:27.538219 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:15:28.214051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:28.226724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b2e5b47-f1c9-47d0-8a44-e92aea887941 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.872791 Jul 19 20:15:28.251649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:28.252181 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2694/5286] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:27 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:28.255038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:28.293970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:28.294759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:28.295460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:28.295932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:29.011699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:29.050050 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d5964cf-20f0-4b69-bae4-264d29bc9e99 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.807078 Jul 19 20:15:29.060642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2593/5287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:28 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:29.567378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91e78f5d-a9e4-4cff-80d6-b4e9dcce47e4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2009690071", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91e78f5d-a9e4-4cff-80d6-b4e9dcce47e4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 492 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2009690071", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2009690071', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 19 20:15:29.570877 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:15:29.574006 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:29.576528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91e78f5d-a9e4-4cff-80d6-b4e9dcce47e4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:29.580382 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91e78f5d-a9e4-4cff-80d6-b4e9dcce47e4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016298 Jul 19 20:15:29.581210 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2695/5288] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:29 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:29.591168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:29.592175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:29.606259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:29.607143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:29.611703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:29.612429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:30.543562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:30.552673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07527fa0-38da-45e7-8762-3a609a0abe2d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.966756 Jul 19 20:15:30.572134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:30.573603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:30.591333 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2594/5289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:29 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:30.599161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:30.599639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:30.600811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:30.601303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:31.376641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:31.400426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a9b9d4b-6291-4cb6-815a-d9f965072010 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.833415 Jul 19 20:15:31.425203 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2696/5290] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:30 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:31.697225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51d8a95e-787a-425b-bcb8-00c9e95be513 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51d8a95e-787a-425b-bcb8-00c9e95be513 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 416 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:31.699855 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:15:31.702897 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:31.706274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51d8a95e-787a-425b-bcb8-00c9e95be513 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:31.711778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51d8a95e-787a-425b-bcb8-00c9e95be513 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018554 Jul 19 20:15:31.713216 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2595/5291] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:31 2022] POST /compute/v2.1/servers => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:31.721435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:31.722878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:31.747939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:31.749069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:31.750671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:31.760052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:33.577563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:33.614110 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-10793bb9-976c-4c76-b77b-70a360e86785 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.896544 Jul 19 20:15:33.618314 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2697/5292] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:31 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:15:33.633069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:33.635356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:33.712373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:33.715036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:33.719447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:33.726631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:36.048436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:36.066646 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-700d26ec-9970-4b55-9110-9a1ec279ac62 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.433861 Jul 19 20:15:36.069893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2596/5293] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:33 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:36.236554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eaee67b5-1d02-418b-8374-bfc2496e4fd9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-702437036", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": -1, "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:36.286140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-eaee67b5-1d02-418b-8374-bfc2496e4fd9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Flavor -1 could not be found. Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eaee67b5-1d02-418b-8374-bfc2496e4fd9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 205 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-702437036", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": -1, "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor -1 could not be found. Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-702437036', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': -1, 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:36.296095 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 19 20:15:36.304483 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:36.320355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eaee67b5-1d02-418b-8374-bfc2496e4fd9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:36.324076 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eaee67b5-1d02-418b-8374-bfc2496e4fd9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.092895 Jul 19 20:15:36.330707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2698/5294] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:36 2022] POST /compute/v2.1/servers => generated 73 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:15:36.356688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:36.357422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:36.373431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:36.377645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:36.378753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:36.380986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:37.598884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:37.642260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eab9fe03-abfe-4535-b99f-28fa661f693d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.305405 Jul 19 20:15:37.644310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2597/5295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:36 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:37.680832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:37.681956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:37.711923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:37.718922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:37.736369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:37.738252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:40.002998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:40.031982 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ce59fd4-96bc-4129-ace6-d160e282df66 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.364465 Jul 19 20:15:40.033630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2699/5296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:37 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:40.190339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2cc3638-fcdf-4ddd-a9b3-4ea0ed409bd1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1560068799", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2cc3638-fcdf-4ddd-a9b3-4ea0ed409bd1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 173 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1560068799", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1560068799', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi -1 Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:15:40.211376 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:40.223337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2cc3638-fcdf-4ddd-a9b3-4ea0ed409bd1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:40.250739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d2cc3638-fcdf-4ddd-a9b3-4ea0ed409bd1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.068446 Jul 19 20:15:40.252364 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2598/5297] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:40 2022] POST /compute/v2.1/servers => generated 145 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:40.267657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:40.270723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:40.292999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:40.305304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:40.306862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:40.310408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:40.311586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:41.010475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:41.050084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ee2158a-6ef4-48a8-8c4d-d61f7862213a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.790807 Jul 19 20:15:41.052765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2700/5298] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:40 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:41.126857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:41.129522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:41.234459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:41.239021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:41.248466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:41.252994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:42.946432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:42.989860 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2626884e-7584-4d21-a5dc-a758d2324764 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.898192 Jul 19 20:15:42.993237 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2599/5299] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:41 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:43.330929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25533853-da62-4739-8039-af1c5d2d7bba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1225340851", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:43.339340 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-25533853-da62-4739-8039-af1c5d2d7bba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25533853-da62-4739-8039-af1c5d2d7bba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 216 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1225340851", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1225340851', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:43.344942 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:15:43.348480 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:43.352359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25533853-da62-4739-8039-af1c5d2d7bba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:43.354087 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25533853-da62-4739-8039-af1c5d2d7bba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030567 Jul 19 20:15:43.355885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2701/5300] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:43 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:43.386410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:43.388979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:43.440444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=18 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:43.444433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:43.445509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:43.447099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:43.448062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:44.189352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:44.241152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5e27363-9d4c-49aa-aae0-9602582b961c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.876493 Jul 19 20:15:44.248383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2600/5301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:43 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:44.283778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:44.285339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:44.314612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:44.317010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:44.319030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:44.320322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:45.823561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:45.830433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=54 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:45.838682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a80d84f-90dc-4e86-a11a-2260016c3e09 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.562155 Jul 19 20:15:45.839408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2702/5302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:44 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:46.178963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1772756712", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-key-1791879430", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:46.346582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] validate_networks() for [('0502ee9f-936f-4533-bf2e-8ac8a74af9df', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:15:48.130996 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Invalid key_name provided. Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 247 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1772756712", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-key-1791879430", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid key_name provided. Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1772756712', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'key_name': 'tempest-key-1791879430', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1791879430 not found for user ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:48.133683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid key_name provided. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:48.137656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-938262bc-76ed-417c-8446-2fea68836075 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.964794 Jul 19 20:15:48.142535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2601/5303] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 1967 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:15:48.177133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:48.177907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:48.218365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:48.218810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:48.219705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:48.220244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:49.093920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:49.117401 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5488444e-c03f-47f1-ae7f-d5c1656f73c9 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.972422 Jul 19 20:15:49.118568 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2703/5304] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:48 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:49.149201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:49.149847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:49.221782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:49.222294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:49.229888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:49.230653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:49.315556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=50 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:50.561005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:50.569309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-684de039-700a-4900-9ae8-5e4264af3ba6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.433433 Jul 19 20:15:50.570525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2602/5305] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:49 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:50.789470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-136627703", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:51.329522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.security_group_api [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Neutron security group does_not_exist not found {{(pid=126008) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 19 20:15:51.330730 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 257 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-136627703", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-136627703', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 19 20:15:51.340910 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:51.347561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:51.350796 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-238e5efb-741c-439a-aa4c-23a67d446125 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.576077 Jul 19 20:15:51.350796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2704/5306] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:15:51.358891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:51.360866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:51.394365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:51.396690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:51.401180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:51.404150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:52.161604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:52.186002 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-610756a3-ac36-42ad-aa73-86988e14b07f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.835697 Jul 19 20:15:52.188111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2603/5307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:51 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:52.248179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:52.249319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:52.264543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:52.265384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:52.266516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:52.267177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:53.500674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:53.533140 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-587313bc-a2e8-4fd0-84ef-6afb1b13dfea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.294688 Jul 19 20:15:53.534894 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2705/5308] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:52 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:53.568234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:53.570035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:53.630525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/86b5be51-fd0a-4a87-84b8-0d18bc3ed04f HTTP/1.1 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '86b5be51-fd0a-4a87-84b8-0d18bc3ed04f'} Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:53.636798 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. Jul 19 20:15:53.646128 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:53.651715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 86b5be51-fd0a-4a87-84b8-0d18bc3ed04f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:53.653579 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86127baf-3d5f-4393-8bb1-9d6664b3d53a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86b5be51-fd0a-4a87-84b8-0d18bc3ed04f" status: 404 len: 111 microversion: 2.1 time: 0.099901 Jul 19 20:15:53.655330 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2604/5309] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:15:53 2022] DELETE /compute/v2.1/servers/86b5be51-fd0a-4a87-84b8-0d18bc3ed04f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:15:53.670718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:53.672153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:53.744981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:53.747864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:53.756434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:53.761273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.248190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:56.264304 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e82f90a-0cd8-43da-a315-c1692a50dea5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.597932 Jul 19 20:15:56.265608 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2706/5310] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:53 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:15:56.293397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:56.295021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:56.321866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:56.322665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.324135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:56.329761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.982841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:56.998827 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e26804bb-53e3-46d5-bd31-44f856f9a2bc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.712034 Jul 19 20:15:57.000119 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2605/5311] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:56 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:57.018581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:57.019129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:15:57.019588 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 9223372036854775808 could not be found. Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '9223372036854775808'} Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:57.021231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b89aba24-c495-4a0f-b942-f8274e5d7bef tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009233 Jul 19 20:15:57.025736 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2707/5312] 10.222.0.33 () {58 vars in 1187 bytes} [Tue Jul 19 20:15:57 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 20:15:57.038943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:57.041645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:57.056995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.057842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:57.060435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.061008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:57.763460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:57.798999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4e21cab-a220-4194-81dd-e0f53acba662 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.765396 Jul 19 20:15:57.800599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2606/5313] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:57 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:57.822767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:57.823541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:57.834399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.835483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:57.837514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.838589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:58.794474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:58.808565 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a448dd3-8fdc-402c-a923-70b40c218d07 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.990310 Jul 19 20:15:58.822033 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2708/5314] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:57 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:58.828346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:58.829613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Failed to fetch instance by id -1 {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:15:58.830520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance -1 could not be found. Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance -1 could not be found. Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '-1'} Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:15:58.832591 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:15:58.838979 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:15:58.838979 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:15:58.838979 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 19 20:15:58.838979 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:15:58.840535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:15:58.841613 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7d86e69-79b2-4f65-b8e2-7428be570e48 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018569 Jul 19 20:15:58.846092 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2607/5315] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:15:58 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 20:15:58.863142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:58.864167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:58.880595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:58.881431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:58.884948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:58.885704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:59.742843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:59.792329 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a5a40e3-54e5-4272-a6ab-97895648590e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.936209 Jul 19 20:15:59.794742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2709/5316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:58 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:59.835779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:59.838126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:59.911113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:59.912122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:59.914698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:59.916789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.520102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:01.529756 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ea845a5-491c-4fb6-b516-039501934ff6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.704663 Jul 19 20:16:01.530354 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2608/5317] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:59 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:01.550629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:01.551483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 12e9c327-9443-4ac8-aeb1-1ee703f404e6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:01.563994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/12e9c327-9443-4ac8-aeb1-1ee703f404e6/action HTTP/1.1 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 19 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: {"forceDelete": {}} Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '12e9c327-9443-4ac8-aeb1-1ee703f404e6', 'body': {'forceDelete': {}}} Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:01.569767 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:01.574395 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:01.574395 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:01.574395 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. Jul 19 20:16:01.574395 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.575725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 12e9c327-9443-4ac8-aeb1-1ee703f404e6 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:01.577300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-65b94297-3b5c-4a4b-b25a-71dde00b6427 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/12e9c327-9443-4ac8-aeb1-1ee703f404e6/action" status: 404 len: 111 microversion: 2.1 time: 0.033560 Jul 19 20:16:01.582327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2710/5318] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:01 2022] POST /compute/v2.1/servers/12e9c327-9443-4ac8-aeb1-1ee703f404e6/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:01.615346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:01.617266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:01.634074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.636633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.640968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.643034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:03.168184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:03.194827 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-42e21aa6-0367-42b7-b1b4-1b533e4e798b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.593389 Jul 19 20:16:03.194827 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2609/5319] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:01 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:03.222647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:03.228257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:03.278192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:03.279161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:03.281297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:03.282703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:05.596566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:05.608371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5aa95df9-aa80-44f2-9b1d-6406c259d653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.394387 Jul 19 20:16:05.616162 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2711/5320] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:03 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:05.648532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:05.652660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 5d926e9f-d256-434c-ba05-56ad64d70f05] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:05.667289 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/5d926e9f-d256-434c-ba05-56ad64d70f05/action HTTP/1.1 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 39 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: {"os-getConsoleOutput": {"length": 10}} Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '5d926e9f-d256-434c-ba05-56ad64d70f05', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:05.678231 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. Jul 19 20:16:05.687024 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:05.689706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 5d926e9f-d256-434c-ba05-56ad64d70f05 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:05.694291 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bbf245b8-4d23-48bb-b767-5dabf615841b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/5d926e9f-d256-434c-ba05-56ad64d70f05/action" status: 404 len: 111 microversion: 2.1 time: 0.053607 Jul 19 20:16:05.704675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2610/5321] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:05 2022] POST /compute/v2.1/servers/5d926e9f-d256-434c-ba05-56ad64d70f05/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:05.710645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:05.711952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:05.732213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:05.733629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:05.734723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:05.735524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:06.938778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:06.981217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fd58538-52c8-4078-a02a-c71d13c39c47 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.276846 Jul 19 20:16:06.986256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2712/5322] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:05 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:07.016349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:07.017130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:07.033232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:07.034074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:07.035452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:07.036285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:08.037089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:08.073308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d65b3faf-4d82-400d-82b7-cb234af6c3fe tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.060906 Jul 19 20:16:08.079083 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2611/5323] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:07 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:08.115363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:08.127789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 5447e4d3-0cdd-4328-a661-2399e0819cc2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:08.186417 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/5447e4d3-0cdd-4328-a661-2399e0819cc2 HTTP/1.1 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '5447e4d3-0cdd-4328-a661-2399e0819cc2'} Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:08.200007 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:08.203648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 5447e4d3-0cdd-4328-a661-2399e0819cc2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:08.205958 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-453a1431-98b3-45a8-9155-8c9b485a7e0c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/5447e4d3-0cdd-4328-a661-2399e0819cc2" status: 404 len: 111 microversion: 2.1 time: 0.100713 Jul 19 20:16:08.207780 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2713/5324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:08 2022] GET /compute/v2.1/servers/5447e4d3-0cdd-4328-a661-2399e0819cc2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:16:08.225305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:08.226735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:08.247450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:08.248400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:08.252302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:08.253752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:10.217268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:10.237677 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f2318c2-10b2-4ae6-a648-07657b7230f8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.025155 Jul 19 20:16:10.238310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2612/5325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:08 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:10.280456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:10.291484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:10.322479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:10.325017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:10.330962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:10.331593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:11.741354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:11.754508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a2350ee8-7033-40a4-a809-121b405f6312 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.494576 Jul 19 20:16:11.765582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2714/5326] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:10 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:11.985930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a162a38-9484-4a52-8582-080d9e20c86a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-119073915", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a162a38-9484-4a52-8582-080d9e20c86a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 237 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-119073915", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-119073915', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:16:11.988926 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a162a38-9484-4a52-8582-080d9e20c86a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:11.993903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a162a38-9484-4a52-8582-080d9e20c86a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008661 Jul 19 20:16:12.003663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:12.004542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:12.010371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=26 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:12.010871 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2613/5327] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:16:12.027925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:12.028395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:12.029742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:12.030045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:13.517106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:13.541841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c69dc52-863f-4147-975e-27bb9bef2eff tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.539490 Jul 19 20:16:13.543409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2715/5328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:11 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:13.569810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:13.570638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:13.576782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=26 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:13.587700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:13.592566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:13.594011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:13.595169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:14.528625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:14.539390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77178654-89eb-4243-aa27-f7e03ae4307e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.978606 Jul 19 20:16:14.540030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2614/5329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:13 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:14.627241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8bd94d5-c7c1-434c-92c9-78ae5072fd19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934890593", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8bd94d5-c7c1-434c-92c9-78ae5072fd19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 235 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934890593", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1934890593', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:14.634573 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:16:14.639526 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:14.642952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8bd94d5-c7c1-434c-92c9-78ae5072fd19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:14.646601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8bd94d5-c7c1-434c-92c9-78ae5072fd19 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023457 Jul 19 20:16:14.647940 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2716/5330] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:14 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:16:14.659526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:14.660883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:14.673374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:14.676048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:14.681535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:14.692387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.148284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:15.172159 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e8268e2-9088-480a-85c6-382b66faa579 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.515421 Jul 19 20:16:15.174949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2615/5331] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:14 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:15.196238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:15.196956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:15.216227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.217321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.218535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.219994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.769558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:15.789442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db0ecef6-fe41-4d36-8b9f-4d985e624fea tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.596046 Jul 19 20:16:15.790302 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2717/5332] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:15.811910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:15.813444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 43de9a97-e5f5-4881-b1ff-2107520b665e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:15.839315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/43de9a97-e5f5-4881-b1ff-2107520b665e/action HTTP/1.1 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 13 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: {"pause": {}} Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '43de9a97-e5f5-4881-b1ff-2107520b665e', 'body': {'pause': {}}} Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:15.845554 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 43de9a97-e5f5-4881-b1ff-2107520b665e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc487e2b-d853-42a8-978d-dbfbf11cd150 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/43de9a97-e5f5-4881-b1ff-2107520b665e/action" status: 404 len: 111 microversion: 2.1 time: 0.042705 Jul 19 20:16:15.849398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2616/5333] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:15 2022] POST /compute/v2.1/servers/43de9a97-e5f5-4881-b1ff-2107520b665e/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:15.858517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:15.859143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:15.874925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.876965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.881332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.885328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:16.723748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:16.741166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90930ca2-fac9-4ba8-b940-f0ce001da798 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.886898 Jul 19 20:16:16.743229 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2718/5334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:16.770697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:16.772063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:16.791382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:16.792135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:16.793133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:16.796773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:19.332622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:19.340488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=64 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:19.352492 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-904a90fd-9d6e-4f6b-b7ae-d019a5039197 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.587519 Jul 19 20:16:19.354847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2617/5335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:16 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:19.382347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:19.383611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:19.406053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:19.407335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:19.408511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:19.409107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:19.414358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=68 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:19.549509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ace8fc64-4c0a-4eca-9f77-4c52c4c7ac70 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.169798 Jul 19 20:16:19.553925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2719/5336] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:19 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:16:19.624195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:19.626328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:19.683685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:19.684973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:19.687439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:19.689970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:20.409594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:20.429884 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d6fe658-986e-41d8-8b17-9254ca8bf1a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1511 microversion: 2.1 time: 0.857803 Jul 19 20:16:20.430672 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2618/5337] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:19 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1511 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:21.455144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:21.456754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:21.478989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:21.479455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:21.480277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:21.496942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.126238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:22.135701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70938f10-9d7d-451a-9b1c-0ff49544a60c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1491 microversion: 2.1 time: 0.685524 Jul 19 20:16:22.136514 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2720/5338] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:21 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1491 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:22.174731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:22.175616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:22.242361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.243392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.244986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.246003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.352008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'pause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state paused Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 13 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: {"pause": {}} Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'pause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state paused Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'pause': {}}} Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state paused. Cannot pause while the instance is in this state. Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state paused Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:22.359277 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state paused Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:22.363929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'pause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state paused {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:22.365280 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-896356f0-f291-42a3-baf6-6424188ead6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 143 microversion: 2.1 time: 0.214291 Jul 19 20:16:22.377231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:22.382718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:22.384307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2619/5339] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:22 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 143 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:16:22.407637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.409137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.411325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.412691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.689530 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c9a61245-eef6-40a7-84bf-ea94f5bcf829 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.317636 Jul 19 20:16:22.691178 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2721/5340] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:22 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:16:22.714248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:22.715370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:22.754298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.755442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.758519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.764350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:23.799046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:23.807615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f4e8d6c-d553-4ac2-b6ac-3151b9cd10b6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1498 microversion: 2.1 time: 1.108607 Jul 19 20:16:23.810982 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2620/5341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:22 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1498 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:24.840559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:24.841569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:24.867677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:24.870276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:24.871191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:24.871659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:25.337811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:25.353198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-094f6779-2c59-417f-8a1b-0b4c37f4f246 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.517149 Jul 19 20:16:25.372110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:25.372766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:25.385638 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2722/5342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:24 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:25.386352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:25.386816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:25.387621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:25.388084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:26.443216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:26.474400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca50f9b6-880e-4d16-9725-94fe9ca4e923 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.106430 Jul 19 20:16:26.487773 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2621/5343] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:25 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:26.493560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:26.494357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:26.509944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.510636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:26.511683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.512147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:26.575515 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action HTTP/1.1 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 28 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: {"reboot": {"type": "SOFT"}} Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2a5b5afc-9fea-4fef-ab27-67b3da4e31d2', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:26.584883 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0aabc8b4-e048-4ec2-a3dc-cf92219b16a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action" status: 404 len: 111 microversion: 2.1 time: 0.097009 Jul 19 20:16:26.589639 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2723/5344] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:26 2022] POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:16:26.602618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:26.603981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:26.618153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.618979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:26.620643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.625893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:27.717922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:27.729511 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4885afd2-b831-444c-9b5c-3bc964c69d6a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.136054 Jul 19 20:16:27.731622 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2622/5345] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:26 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:27.765530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:27.767460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:27.791751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:27.793664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:27.795234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:27.795962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:28.982479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:29.003247 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3bb22f7-7535-4fd1-9764-5239ba4a5480 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.253141 Jul 19 20:16:29.006831 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2724/5346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:27 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:29.038070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:29.046592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: b7169c18-80a5-49e3-b675-5ddf91b09ffc] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:29.079515 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/b7169c18-80a5-49e3-b675-5ddf91b09ffc/action HTTP/1.1 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 28 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: {"reboot": {"type": "SOFT"}} Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b7169c18-80a5-49e3-b675-5ddf91b09ffc', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. Jul 19 20:16:29.086863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. Jul 19 20:16:29.091242 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:29.093532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance b7169c18-80a5-49e3-b675-5ddf91b09ffc could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:29.097386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc553ece-0e20-436f-9c08-4ec89b11d89f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/b7169c18-80a5-49e3-b675-5ddf91b09ffc/action" status: 404 len: 111 microversion: 2.1 time: 0.069719 Jul 19 20:16:29.102089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2623/5347] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:29 2022] POST /compute/v2.1/servers/b7169c18-80a5-49e3-b675-5ddf91b09ffc/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:29.109660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:29.110633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:29.120139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.121381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.122591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.123274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.908485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-663588386", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "97d30518-0249-448d-84ac-ea9348e6dbb0"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:29.915631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:29.925617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-395225db-639b-4023-a202-0521ecd0843c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.820090 Jul 19 20:16:29.931954 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2725/5348] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:29 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:29.949638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:29.950542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:29.960347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.963978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.965276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.965894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.989744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] validate_networks() for [('97d30518-0249-448d-84ac-ea9348e6dbb0', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:16:30.816078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:30.841015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78d49b49-239d-4ad0-9c09-d888e9173397 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.895453 Jul 19 20:16:30.841622 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2726/5349] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:29 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:30.859067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:30.861271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:30.877579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:30.880369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:30.882893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:30.883643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:30.959614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action HTTP/1.1 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 65 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2a5b5afc-9fea-4fef-ab27-67b3da4e31d2', 'body': {'rebuild': {'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046'}}} Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:16:30.964185 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:30.970878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0c0d915-1fb0-44d2-b0ef-de5bf7b802ba tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action" status: 404 len: 111 microversion: 2.1 time: 0.112058 Jul 19 20:16:30.973590 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2727/5350] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:30 2022] POST /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:30.990114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:30.997236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:31.017723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:31.018216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:31.025453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:31.027415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:32.645158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:32.666548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1934d10-65c8-498c-ad09-1c0cb0a28220 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.686168 Jul 19 20:16:32.673687 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2728/5351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:30 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:32.694532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:32.695298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:32.712341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:32.713900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:32.723119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:32.723614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:33.179121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:16:33.179887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:16:33.180364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:16:33.180791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:16:33.181216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:16:33.200724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:33.204586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:33.217594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:33.218753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:33.295059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Getting quotas for project 0273d94422c54322a2579c84125f7607. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:33.307982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Getting quotas for user c089007c972547b09430c9925241f3cf and project 0273d94422c54322a2579c84125f7607. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:33.368273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:16:33.371019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:16:33.454225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:33.454888 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2d31913-3eab-4e2e-a67b-cfee55ce6785 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.796531 Jul 19 20:16:33.464050 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2624/5352] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:16:33.467085 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a133e451-291e-4c70-954b-9da9ad67b2da tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.779136 Jul 19 20:16:33.473698 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2729/5353] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:32 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:33.478574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-662ef0ce-d7f5-48c0-a179-a605a0cb4ecc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:33.479495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-662ef0ce-d7f5-48c0-a179-a605a0cb4ecc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:33.487312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:33.490449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: cd63adf1-5d6a-4a7a-930d-e904f821167f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:33.502366 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/cd63adf1-5d6a-4a7a-930d-e904f821167f/action HTTP/1.1 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 65 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'cd63adf1-5d6a-4a7a-930d-e904f821167f', 'body': {'rebuild': {'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046'}}} Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:16:33.506748 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. Jul 19 20:16:33.511322 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:33.518683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance cd63adf1-5d6a-4a7a-930d-e904f821167f could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:33.520278 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eebe9e49-31b5-4cb4-a791-9d2a46c69704 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/cd63adf1-5d6a-4a7a-930d-e904f821167f/action" status: 404 len: 111 microversion: 2.1 time: 0.039644 Jul 19 20:16:33.523623 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2730/5354] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:33 2022] POST /compute/v2.1/servers/cd63adf1-5d6a-4a7a-930d-e904f821167f/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:33.546585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:33.548863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:33.571062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:33.571917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:33.573001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:33.574953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:33.980836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-662ef0ce-d7f5-48c0-a179-a605a0cb4ecc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:33.993188 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-662ef0ce-d7f5-48c0-a179-a605a0cb4ecc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1224 microversion: 2.1 time: 0.527588 Jul 19 20:16:34.004007 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2625/5355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:33 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1224 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:34.211591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:34.236298 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-967e2fcd-180a-4908-99a4-d55d7a3386c6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.708175 Jul 19 20:16:34.238499 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2731/5356] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:33 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:34.265715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:34.267566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:34.287469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:34.288384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:34.289486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:34.290140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:34.741910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:34.753412 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ebc47a4-7e53-4c39-98ef-e0205ca9ffbf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.492756 Jul 19 20:16:34.757720 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2626/5357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:34 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:34.781255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:34.782064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: a993467e-6cf4-491a-aca6-753f583a6b42] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:34.806358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/a993467e-6cf4-491a-aca6-753f583a6b42/action HTTP/1.1 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: {"restore": {}} Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a993467e-6cf4-491a-aca6-753f583a6b42', 'body': {'restore': {}}} Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:34.812438 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:34.817666 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:34.817666 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:34.817666 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. Jul 19 20:16:34.817666 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:34.818655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance a993467e-6cf4-491a-aca6-753f583a6b42 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:34.820983 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6fad7d59-e82c-4bca-ac4b-6c1877b69162 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/a993467e-6cf4-491a-aca6-753f583a6b42/action" status: 404 len: 111 microversion: 2.1 time: 0.045118 Jul 19 20:16:34.845674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2732/5358] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:34 2022] POST /compute/v2.1/servers/a993467e-6cf4-491a-aca6-753f583a6b42/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:34.849233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:34.850063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:34.876857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:34.877444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:34.878699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:34.902970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:35.020911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:35.021625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:35.050280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:35.051524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:35.054862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:35.055529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:35.236746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:35.265928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d479bc3-c4aa-4009-9ae1-e6f1d96b28a2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1276 microversion: 2.1 time: 0.259030 Jul 19 20:16:35.267172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2733/5359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:35 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:35.350947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:35.360678 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9151a8d0-7bdf-4532-905f-740947ea8519 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.515495 Jul 19 20:16:35.367898 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2627/5360] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:34 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:35.407521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:35.408271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:35.421145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:35.423224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:35.426968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:35.429329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.294918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:36.295756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:36.321788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.352288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.353990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.367535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.422803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:36.443826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8670b888-44fc-4c07-abee-f03c2bf34297 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.048518 Jul 19 20:16:36.450770 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2734/5361] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:35 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:36.476004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:36.477002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:36.503596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.504480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.505751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.506409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.542487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'restore' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: {"restore": {}} Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'restore' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'restore': {}}} Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state active. Cannot restore while the instance is in this state. Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:36.545231 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:36.549924 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:36.549924 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:36.549924 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:36.549924 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:36.549924 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:16:36.554261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'restore' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:36.555525 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f6dcf91-8f32-44b4-ad67-a466e5cfa2d4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 145 microversion: 2.1 time: 0.084183 Jul 19 20:16:36.559157 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2735/5362] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:36 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 145 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:16:36.570895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:36.578958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:36.600619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.609102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.613190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:36.616281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:36.973136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:36.984504 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-859143f8-01a5-41f7-8465-4af7b5ee8802 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1282 microversion: 2.1 time: 0.698228 Jul 19 20:16:36.987776 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2628/5363] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:36 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1282 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:37.554697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:37.580994 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-737cf97a-ff69-4be9-8cee-e92def89e503 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.014898 Jul 19 20:16:37.588832 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2736/5364] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:36 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:37.618301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:37.619168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:37.662536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:37.663585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:37.668748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:37.670871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:38.002722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:38.003422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:38.014194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:38.021089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:38.022128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:38.022709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:38.079371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:38.461775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:38.464424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:38.473715 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecf4f546-8712-472d-aa77-ad3003c80e81 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.861186 Jul 19 20:16:38.500299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba55b241-74f0-4a47-87b0-5f53a141d4cf tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1282 microversion: 2.1 time: 0.500450 Jul 19 20:16:38.504013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2629/5365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:37 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:38.507946 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2737/5366] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:37 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1282 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:38.526063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:38.526859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 3572d35e-5528-4568-8202-55f69867475f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:38.544951 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/3572d35e-5528-4568-8202-55f69867475f/action HTTP/1.1 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 14 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: {"resume": {}} Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '3572d35e-5528-4568-8202-55f69867475f', 'body': {'resume': {}}} Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:38.552761 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 3572d35e-5528-4568-8202-55f69867475f could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe0d404f-27df-4c77-b2e5-d5a92cf230e3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/3572d35e-5528-4568-8202-55f69867475f/action" status: 404 len: 111 microversion: 2.1 time: 0.046761 Jul 19 20:16:38.557366 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2630/5367] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:38 2022] POST /compute/v2.1/servers/3572d35e-5528-4568-8202-55f69867475f/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:38.564556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:38.565098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:38.577494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:38.578135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:38.579594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:38.583914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:39.527123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:39.528191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:39.539647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:39.540131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:39.540930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:39.545322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:40.659846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:40.727010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ca735c3-b925-4f44-beb7-2dc9cf3250e8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.167390 Jul 19 20:16:40.731158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2738/5368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:38 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:40.768445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:40.775778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:40.814157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:40.817596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:40.822126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:40.827763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:40.833394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:40.846869 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e848c7ff-3df3-41ee-ac66-149fd0f93e38 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 1.333147 Jul 19 20:16:40.849183 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2631/5369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:39 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:41.432531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:41.442700 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9a8427d-21e6-4582-b30c-5abf4ea986a2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.693691 Jul 19 20:16:41.452408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2739/5370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:40 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:41.460440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:41.460988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:41.469933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.470396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:41.477744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.478381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:41.533584 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'resume' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 14 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: {"resume": {}} Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'resume' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'resume': {}}} Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state active. Cannot resume while the instance is in this state. Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:41.535167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:41.538950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'resume' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:41.542662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-40bffc61-4a3d-4962-93c2-003388d6df46 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 144 microversion: 2.1 time: 0.086288 Jul 19 20:16:41.547752 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2632/5371] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:41 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:16:41.553140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:41.554257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:41.565627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.568698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:41.576014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.576723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:41.870817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:41.871545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:41.886290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.888921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:41.890075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:41.894236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:42.627469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:42.654955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70563cc1-0ded-4d1a-87bd-14031031ecc2 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 0.792257 Jul 19 20:16:42.664844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2633/5372] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:41 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:43.147410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:43.168499 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-37aff140-c9b4-42af-a901-0793691f97a3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.614754 Jul 19 20:16:43.171410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2740/5373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:41 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:43.193084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:43.193731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:43.208501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:43.208970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:43.215832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:43.218865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:43.273808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:43.672993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:43.675274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:43.679834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=50 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:43.696495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:43.696972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:43.703126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:43.704183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:43.985845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:44.441160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:44.456275 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dbca94db-82dd-4688-a027-905e0a2e62ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.263457 Jul 19 20:16:44.457614 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2634/5374] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:43 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:44.656804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba86e716-284d-4cfd-b662-88972865b653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba86e716-284d-4cfd-b662-88972865b653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 160 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0502ee9f-936f-4533-bf2e-8ac8a74af9df"}]}} Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'server': {'name': '', 'imageRef': '7cf63fb3-07fd-4965-a7a1-a7c160992046', 'flavorRef': '452', 'networks': [{'uuid': '0502ee9f-936f-4533-bf2e-8ac8a74af9df'}]}}} Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:16:44.659374 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba86e716-284d-4cfd-b662-88972865b653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba86e716-284d-4cfd-b662-88972865b653 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008572 Jul 19 20:16:44.664421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2635/5375] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:16:44.673553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:44.674182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:44.680872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:44.704989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:44.705441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:44.706248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:44.708876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:44.762974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:44.776500 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b46b5386-aaaa-4aa6-928a-196ed8250b30 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 1.105481 Jul 19 20:16:44.779208 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2741/5376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:43 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:45.348825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:45.364200 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7616fcc5-e112-4c39-897c-bc59ae44e93b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.695797 Jul 19 20:16:45.365290 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2636/5377] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:44 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:45.385577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:45.386197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:45.398056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:45.398527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:45.405277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:45.406027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:45.798237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:45.798857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:45.811775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:45.815402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:45.816364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:45.816818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:46.147722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:46.163506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23db8305-a266-48dc-8ae6-ae10138592d2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.782528 Jul 19 20:16:46.164416 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2742/5378] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:45 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:46.270533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-24b94174-e19c-4604-97e3-24efecc29ca4 req-121f259d-462d-4dea-9fb6-1a58538d7c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7264d5c4-4c91-4791-b878-7dbb9535488d", "tag": "5aff82d6-d29f-49c7-8275-f41d10d92680"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:46.286049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-24b94174-e19c-4604-97e3-24efecc29ca4 req-121f259d-462d-4dea-9fb6-1a58538d7c2e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:46.287186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-24b94174-e19c-4604-97e3-24efecc29ca4 req-121f259d-462d-4dea-9fb6-1a58538d7c2e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:46.299692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:46.313868 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-144661f2-2203-4e7d-bd63-d44f5ad9a035 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 0.520120 Jul 19 20:16:46.318357 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2637/5379] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:45 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:46.326146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-24b94174-e19c-4604-97e3-24efecc29ca4 req-121f259d-462d-4dea-9fb6-1a58538d7c2e service nova] Creating event network-changed:5aff82d6-d29f-49c7-8275-f41d10d92680 for instance 7264d5c4-4c91-4791-b878-7dbb9535488d on n-h1-843861-3 Jul 19 20:16:46.335386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:46.336148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: c567a7e1-204a-469e-a01f-516390c8f0b1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:46.340553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-24b94174-e19c-4604-97e3-24efecc29ca4 req-121f259d-462d-4dea-9fb6-1a58538d7c2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174623 Jul 19 20:16:46.344540 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2743/5380] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:46.347454 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/c567a7e1-204a-469e-a01f-516390c8f0b1/action HTTP/1.1 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 14 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: {"shelve": {}} Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c567a7e1-204a-469e-a01f-516390c8f0b1', 'body': {'shelve': {}}} Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:46.352639 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:46.356763 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:46.356763 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:46.356763 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. Jul 19 20:16:46.356763 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:46.357816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance c567a7e1-204a-469e-a01f-516390c8f0b1 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:46.358860 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de6978b4-4e1b-405f-9368-b6afb7f64c75 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/c567a7e1-204a-469e-a01f-516390c8f0b1/action" status: 404 len: 111 microversion: 2.1 time: 0.039303 Jul 19 20:16:46.361968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2638/5381] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:46 2022] POST /compute/v2.1/servers/c567a7e1-204a-469e-a01f-516390c8f0b1/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:46.371275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:46.372033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:46.384441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:46.385697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:46.386853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:46.387725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:47.337485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:47.338866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:47.387178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:47.390542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:47.393302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:47.396382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:48.553764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:48.562975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b375bee5-a3fa-4fe9-907e-5dc1c0d1a034 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.196920 Jul 19 20:16:48.567637 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2744/5382] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:46 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:48.588308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:48.591777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:48.623683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:48.624649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:48.626268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:48.627857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:48.872144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:48.889000 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-776e2d05-3ccc-4f4c-ac1b-44d360ee695e tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 1.557546 Jul 19 20:16:48.908060 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2639/5383] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:47 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:49.735888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:49.769246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6df72877-464b-48c5-8003-daf45b737c53 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.185359 Jul 19 20:16:49.784193 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2745/5384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:48 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:49.798223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:49.799171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:49.812163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:49.816602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:49.820881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:49.829118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:49.901844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:49.916613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:49.917392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:49.921535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lazy-loading 'flavor' on Instance uuid 1c643c6d-d8ee-491e-be93-eed3733f49d8 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:16:49.925085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:49.938900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:49.948054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:49.948848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:50.694990 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6bc48fde-d2ec-4f18-b287-c360514b88f6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.899983 Jul 19 20:16:50.696280 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2640/5385] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:16:49 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:16:50.714708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:50.716065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:50.735401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:50.736345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:50.737425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:50.739777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:51.350643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:51.364170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-431fb477-3492-49b1-ae6f-c253ac9bdb01 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 1.451285 Jul 19 20:16:51.368235 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2746/5386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:49 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:51.726234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:51.747699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e15b2fa1-08b7-469d-9a0f-5d23b752fd4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 1.046276 Jul 19 20:16:51.748583 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2641/5387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:50 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:52.394535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:52.395172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:52.417126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:52.417744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:52.420859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:52.421302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:52.510587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1018610788", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "da77b4a8-89b0-4a13-992b-58563ab23722", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:52.698814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:16:53.367991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:53.384541 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af9e4470-f2d3-4ba7-adf5-3c535da1e7bc tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 0.996454 Jul 19 20:16:53.385214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2747/5388] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:52 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:53.398675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:53.402394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:53.410329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.411146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.412219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.412904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.718551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:16:53.719078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:16:53.719487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:16:53.720122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:16:53.720699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:16:53.748574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.749397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:53.751372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.755885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.756706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.758962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c7b6cb9-5cca-407b-b057-74dbac9ab37c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.372506 Jul 19 20:16:53.770264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2748/5389] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:53 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:53.799330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:53.811799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:54.031379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:16:54.034698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da77b4a8-89b0-4a13-992b-58563ab23722',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:16:54.368732 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7eec49f7-39a3-4ab5-a585-f6a76983ab0f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862348 Jul 19 20:16:54.380877 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2642/5390] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:16:54.382314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4672a34-475d-407e-ab9f-08f2bd9e8dd5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:54.382971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f4672a34-475d-407e-ab9f-08f2bd9e8dd5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:54.412724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:54.413554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:54.428997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:54.429838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:54.432154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:54.433417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:54.823605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f4672a34-475d-407e-ab9f-08f2bd9e8dd5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:54.832637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4672a34-475d-407e-ab9f-08f2bd9e8dd5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1057 microversion: 2.1 time: 0.456151 Jul 19 20:16:54.833201 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2749/5391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:54 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1057 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:54.916969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:54.925578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c0ce414-ac1d-43c1-9c05-2886a1650c15 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 0.518117 Jul 19 20:16:54.926184 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2643/5392] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:54 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:54.955780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:54.959138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:54.981417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:54.983443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:54.986180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:54.986648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:55.118121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f681b5d-6ab6-4f3c-ab53-b7e42b5cc779 req-fc061ab9-eecf-43d0-a4b6-02d187f859cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7264d5c4-4c91-4791-b878-7dbb9535488d", "name": "network-vif-plugged", "status": "completed", "tag": "5aff82d6-d29f-49c7-8275-f41d10d92680"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:55.142111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f681b5d-6ab6-4f3c-ab53-b7e42b5cc779 req-fc061ab9-eecf-43d0-a4b6-02d187f859cf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:55.142619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f681b5d-6ab6-4f3c-ab53-b7e42b5cc779 req-fc061ab9-eecf-43d0-a4b6-02d187f859cf service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:55.164962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f681b5d-6ab6-4f3c-ab53-b7e42b5cc779 req-fc061ab9-eecf-43d0-a4b6-02d187f859cf service nova] Creating event network-vif-plugged:5aff82d6-d29f-49c7-8275-f41d10d92680 for instance 7264d5c4-4c91-4791-b878-7dbb9535488d on n-h1-843861-3 Jul 19 20:16:55.177032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f681b5d-6ab6-4f3c-ab53-b7e42b5cc779 req-fc061ab9-eecf-43d0-a4b6-02d187f859cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333258 Jul 19 20:16:55.181502 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2750/5393] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:55.809002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:55.819245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0afa3f1e-f71e-4c7c-81f7-e09891397f11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.887024 Jul 19 20:16:55.820163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2644/5394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:54 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:55.867725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:55.868839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:55.895341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:55.895801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:55.905819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:55.908251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:55.945368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:55.946905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:55.957730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:55.958544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:55.959548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:55.960510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:56.283144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:56.302760 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-45cc34a3-c4b0-404f-8f22-1c981ec32d7b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1155 microversion: 2.1 time: 0.453708 Jul 19 20:16:56.303862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2751/5395] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:55 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1155 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:56.586430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:56.596845 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ae568a8-27d4-4ad6-b545-921a745a9486 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1324 microversion: 2.1 time: 0.658024 Jul 19 20:16:56.601596 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2645/5396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:55 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:56.837205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:56.838157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:56.861164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:56.869431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:56.872275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:56.874371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:57.322746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:57.324114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:57.336424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.336886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:57.337688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.341117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:57.403101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:57.423253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e9b0d74-fdc7-4342-b326-1aabdbd4905a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.582068 Jul 19 20:16:57.434518 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2752/5397] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:56 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:57.503908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:57.533801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc92d14d-175e-4a46-adf0-68a340c99be3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1173 microversion: 2.1 time: 0.217034 Jul 19 20:16:57.534971 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2646/5398] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:57 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1173 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:57.616217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:57.617187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:57.628975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.631738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:57.634606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.636559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.369655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:58.380946 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc76cc16-9dcd-4105-90c8-9a735aaf612d tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1521 microversion: 2.1 time: 0.771191 Jul 19 20:16:58.384549 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2753/5399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:57 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1521 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:58.407009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.407982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.420225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.421111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.423792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.424540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.442695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.443514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.459950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.461569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.469800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.472149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.493772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] HTTP exception thrown: Action 999 not found Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Request method failure captured: Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d/os-instance-actions/999 HTTP/1.1 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEdnPgRiTwIzgAGP0WXL3PKiGLYC81S25po8eCtrS8k5mRNPM6zX8y6r_CMr2xc408iaomLC-2uRz30OFKQTrSNrDAZtsz9w22pqEVRf-FhcxGTceY0TPcY19MV6Pghrdt8lUDxFxiHwPSKkEgX1YZChZFtYUSttYjPoOHYY4w9QDM Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0273d94422c54322a2579c84125f7607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0273d94422c54322a2579c84125f7607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: c089007c972547b09430c9925241f3cf Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: exception: Action 999 not found Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '7264d5c4-4c91-4791-b878-7dbb9535488d', 'id': '999'} Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 19 20:16:58.503263 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.508261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Returning 404 to user: Action 999 not found {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:58.509446 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4af1c4ae-8a2c-4943-95cc-df0014f67037 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.108128 Jul 19 20:16:58.511839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2647/5400] 10.222.0.33 () {58 vars in 1307 bytes} [Tue Jul 19 20:16:58 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d/os-instance-actions/999 => generated 66 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:16:58.527022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '.version_select at 0x7fb88e20dca0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.529372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: fa798d25-4e63-4250-9661-b1cc646fd900] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.542656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] HTTP exception thrown: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Request method failure captured: Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/fa798d25-4e63-4250-9661-b1cc646fd900/os-instance-actions HTTP/1.1 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEdnPgRiTwIzgAGP0WXL3PKiGLYC81S25po8eCtrS8k5mRNPM6zX8y6r_CMr2xc408iaomLC-2uRz30OFKQTrSNrDAZtsz9w22pqEVRf-FhcxGTceY0TPcY19MV6Pghrdt8lUDxFxiHwPSKkEgX1YZChZFtYUSttYjPoOHYY4w9QDM Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0273d94422c54322a2579c84125f7607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0273d94422c54322a2579c84125f7607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: c089007c972547b09430c9925241f3cf Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': 'fa798d25-4e63-4250-9661-b1cc646fd900'} Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:58.544652 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. Jul 19 20:16:58.549340 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:16:58.556936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Returning 404 to user: Instance fa798d25-4e63-4250-9661-b1cc646fd900 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:58.558254 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cb1f44f9-367b-4583-8c5a-1b223c9994ae tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/fa798d25-4e63-4250-9661-b1cc646fd900/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.037095 Jul 19 20:16:58.559620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2648/5401] 10.222.0.33 () {58 vars in 1295 bytes} [Tue Jul 19 20:16:58 2022] GET /compute/v2.1/servers/fa798d25-4e63-4250-9661-b1cc646fd900/os-instance-actions => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:16:58.577163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.578191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.595637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.599147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.602496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.603921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.898808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:58.913243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9f48403-8ef3-4c47-a6e2-0dd3c2fdbc91 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.475016 Jul 19 20:16:58.923505 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2754/5402] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:58 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:58.928748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.930668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.954659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.962462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.963695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.964076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.037583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:16:59.086334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:59.212734 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0681754a-2609-4490-a5e0-a65739e40855 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 204 len: 0 microversion: 2.1 time: 0.293752 Jul 19 20:16:59.215285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2755/5403] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:16:58 2022] DELETE /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:16:59.232699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:59.236687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:59.251978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.252918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.255934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.256826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.653622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:59.675224 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba99d0cc-8201-4991-9fcf-ee898a76d454 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1215 microversion: 2.1 time: 1.112940 Jul 19 20:16:59.684844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2649/5404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:58 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1215 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:59.890602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:59.931785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:59.932776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:59.936816 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cee7876-9639-4f14-903a-1e398de07217 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1527 microversion: 2.1 time: 0.684099 Jul 19 20:16:59.938531 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2756/5405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:59 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1527 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:59.943532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.944673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.946219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.947144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:00.528796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:00.540434 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9e3a3ac-f634-49c2-9355-6da3caef45b1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.613312 Jul 19 20:17:00.552667 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2650/5406] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:59 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:00.693954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:00.698643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:00.716530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.717288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:00.718425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.719641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:00.959533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:00.961104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:00.976792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.977678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:00.979054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.984669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:01.081571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:01.101720 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1abd000-a1b3-49be-8e44-657507273e80 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1215 microversion: 2.1 time: 0.405299 Jul 19 20:17:01.103603 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2757/5407] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:00 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1215 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:01.580918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:01.587869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:01.599929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:01.600627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:01.601121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:01.601563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:01.855460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:01.863966 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80e32f40-0c82-4c77-8e84-482388897b91 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1527 microversion: 2.1 time: 0.908191 Jul 19 20:17:01.864610 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2651/5408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:00 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1527 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:02.120329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:02.121786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:02.142641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:02.143315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.147521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:02.148464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.548200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:02.557455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b4c2d671-0e06-4288-9edf-0e330dc62794 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.992148 Jul 19 20:17:02.562778 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2758/5409] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:01 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:02.568472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-65acc240-d090-43f7-b0ef-b6de2632744a req-fbc26d90-c7d8-435a-b596-bb363e4d9a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7264d5c4-4c91-4791-b878-7dbb9535488d", "name": "network-vif-deleted", "tag": "5aff82d6-d29f-49c7-8275-f41d10d92680"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:02.595501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-65acc240-d090-43f7-b0ef-b6de2632744a req-fbc26d90-c7d8-435a-b596-bb363e4d9a3e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:02.603125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-65acc240-d090-43f7-b0ef-b6de2632744a req-fbc26d90-c7d8-435a-b596-bb363e4d9a3e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.633368 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-65acc240-d090-43f7-b0ef-b6de2632744a req-fbc26d90-c7d8-435a-b596-bb363e4d9a3e service nova] Creating event network-vif-deleted:5aff82d6-d29f-49c7-8275-f41d10d92680 for instance 7264d5c4-4c91-4791-b878-7dbb9535488d on n-h1-843861-3 Jul 19 20:17:02.639896 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-65acc240-d090-43f7-b0ef-b6de2632744a req-fbc26d90-c7d8-435a-b596-bb363e4d9a3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074928 Jul 19 20:17:02.643431 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2759/5410] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:02.882648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:02.886209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:02.910073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:02.914864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.915720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:02.924543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.927001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:02.934962 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4689a9db-0d1f-4676-a70d-e7388f591a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1215 microversion: 2.1 time: 0.819712 Jul 19 20:17:02.940013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2652/5411] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:02 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1215 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:03.042485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.050255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.051221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lazy-loading 'fault' on Instance uuid 7264d5c4-4c91-4791-b878-7dbb9535488d {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:17:03.388590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c089007c972547b09430c9925241f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273d94422c54322a2579c84125f7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:03.421410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f0cff59-e621-4f14-a795-9fe453ff5337 tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 200 len: 1314 microversion: 2.1 time: 0.542354 Jul 19 20:17:03.442097 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2760/5412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:02 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:03.590489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:03.599518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:03.632391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.635450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.637118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.638443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.775495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:03.839196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:03.958080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:03.959191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:03.975192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.975650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.977139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.977583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.551432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:04.564981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a24826b8-fbb6-4418-8fa8-74798c635944 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1215 microversion: 2.1 time: 0.612291 Jul 19 20:17:04.566200 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2761/5413] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:03 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1215 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:04.582223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:04.591897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] [instance: 7264d5c4-4c91-4791-b878-7dbb9535488d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:04.603620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:04.604176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.604966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:04.605405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.630179 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] HTTP exception thrown: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Request method failure captured: Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d HTTP/1.1 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEdnPgRiTwIzgAGP0WXL3PKiGLYC81S25po8eCtrS8k5mRNPM6zX8y6r_CMr2xc408iaomLC-2uRz30OFKQTrSNrDAZtsz9w22pqEVRf-FhcxGTceY0TPcY19MV6Pghrdt8lUDxFxiHwPSKkEgX1YZChZFtYUSttYjPoOHYY4w9QDM Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0273d94422c54322a2579c84125f7607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0273d94422c54322a2579c84125f7607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0273d94422c54322a2579c84125f7607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0273d94422c54322a2579c84125f7607 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1476396325 Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: c089007c972547b09430c9925241f3cf Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1476396325-project Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7264d5c4-4c91-4791-b878-7dbb9535488d'} Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:17:04.632287 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] Returning 404 to user: Instance 7264d5c4-4c91-4791-b878-7dbb9535488d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2079bdaf-ed7a-4e8b-9dcc-e622680b85af tempest-InstanceActionsNegativeTestJSON-1476396325 tempest-InstanceActionsNegativeTestJSON-1476396325-project] 10.222.0.33 "GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d" status: 404 len: 111 microversion: 2.1 time: 0.063488 Jul 19 20:17:04.641293 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2762/5414] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:04 2022] GET /compute/v2.1/servers/7264d5c4-4c91-4791-b878-7dbb9535488d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:17:04.705940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d3d930fd-7b12-4287-b121-93a9726aaa60 req-a5dd57b3-b819-4795-b24e-39c3e013febb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaaf8d1a-d418-4373-a0b2-db35bc1466ce", "tag": "fd8dc1f1-20b5-46eb-ae9d-79e09431669e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:04.727136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d3d930fd-7b12-4287-b121-93a9726aaa60 req-a5dd57b3-b819-4795-b24e-39c3e013febb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:04.728329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d3d930fd-7b12-4287-b121-93a9726aaa60 req-a5dd57b3-b819-4795-b24e-39c3e013febb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.767569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d3d930fd-7b12-4287-b121-93a9726aaa60 req-a5dd57b3-b819-4795-b24e-39c3e013febb service nova] Creating event network-changed:fd8dc1f1-20b5-46eb-ae9d-79e09431669e for instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce on n-h2-843861-3 Jul 19 20:17:04.777279 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d3d930fd-7b12-4287-b121-93a9726aaa60 req-a5dd57b3-b819-4795-b24e-39c3e013febb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076831 Jul 19 20:17:04.780415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2763/5415] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:17:04.864752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:04.874744 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfb639d5-995b-4066-9569-d919db1ecc23 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 1.298777 Jul 19 20:17:04.875838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2653/5416] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:03 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:05.587699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:05.589045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:05.601215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:05.604580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.605044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.614008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.614782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.896620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:05.898552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:05.915684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.917098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.920391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.921729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:06.022839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:06.042086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81513ec4-fd83-429a-b542-22da98d6d32f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1215 microversion: 2.1 time: 0.459632 Jul 19 20:17:06.044509 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2764/5417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:05 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1215 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:06.557287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:06.567007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-13ee7f8c-3557-4589-9b11-7e5015626193 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.674657 Jul 19 20:17:06.587904 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2654/5418] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:05 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:07.061833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:07.063093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:07.071086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.071913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.072810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.073354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.325608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:07.343990 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87597bdc-ea1f-469f-a641-2ff3f2960aa1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 0.285944 Jul 19 20:17:07.345741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2765/5419] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:07 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:07.590699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:07.593656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:07.615915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.619910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.622168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.622828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:08.267526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:08.277798 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1aee759-3095-4b99-a144-85c3ef37ee6b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.696444 Jul 19 20:17:08.279998 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2655/5420] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:07 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:08.362286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:08.362898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:08.373664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:08.374118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:08.374930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:08.375369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:08.794997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:08.811635 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0267f4a4-76b8-4513-b205-58de0585b9b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 0.453219 Jul 19 20:17:08.813942 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2766/5421] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:08 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:09.301970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:09.303621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:09.337841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:09.338548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:09.339518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:09.345200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:09.378640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:09.657883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:09.678597 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0cf16699-a98f-47ce-a5d4-63a35bf3405f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.385411 Jul 19 20:17:09.679942 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2656/5422] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:09 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:09.830393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:09.831732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:09.845773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:09.851130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:09.852954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:09.854829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:10.233168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:10.242136 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2be2cbf-6de6-4c26-b0c3-051a8d50fe5b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 0.416288 Jul 19 20:17:10.243238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2767/5423] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:09 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:10.701081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:10.704380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:10.723529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:10.724343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:10.725343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:10.726047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:11.246139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:11.260941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:11.261994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:11.264064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-996b81a5-6293-4d4a-8f73-ca71239f807d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.571462 Jul 19 20:17:11.266236 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2657/5424] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:10 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:11.286986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:11.287745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:11.288749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:11.289348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:12.286229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:12.287384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:12.304684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:12.305893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:12.308293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:12.311589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:12.825722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:12.829316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:12.841518 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e4edfeb-20f5-4981-ad62-3afcd49105e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 1.585132 Jul 19 20:17:12.843055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4699ccde-a1af-43b8-b8fd-09b8ed83aa44 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.562354 Jul 19 20:17:12.843699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2768/5426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:11 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:12.843885 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2658/5426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:12 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:13.861620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:13.862374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:13.871047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:13.872478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:13.876934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:13.888575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:13.889204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:13.890803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:13.891375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:13.912591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:13.924096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:13.926481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:13.928222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.687036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:14.698736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84d1642a-b1ea-44f9-9df6-c858120a42e0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.841660 Jul 19 20:17:14.717429 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2659/5427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:13 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:14.882003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:14.894414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1f514be-bac2-4d4d-8d78-d5f4a578524d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 1.027544 Jul 19 20:17:14.896083 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2769/5428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:13 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:15.740076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:15.740717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:15.751703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:15.770381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:15.770837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:15.771630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:15.777182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:15.916669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:15.921982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:15.950038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:15.952121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:15.956344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:15.958302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:16.766638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:16.783352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ecb152b9-2660-4090-8bff-384693c81616 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 0.873836 Jul 19 20:17:16.794434 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2770/5429] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:15 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:16.911138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:16.936458 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6fa067eb-2e86-4526-9a4c-f08f0994cba2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 1.214698 Jul 19 20:17:16.940861 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2660/5430] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:17.801102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:17.801750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:17.814555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:17.815021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:17.815835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:17.820795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:17.958697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:17.959948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:17.973497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:17.974113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:17.975110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:17.975556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:18.334627 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:17:18.334851 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:17:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce (ip 10.222.0.33) !!! Jul 19 20:17:19.030795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:19.041138 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2997e36b-1ca4-4054-ae9f-1c83cd7c39a2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 1.244475 Jul 19 20:17:19.047992 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2771/5431] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:17 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:19.053314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4d3d6724-044e-4a26-9f6e-1d1a242179a5 req-ce674ff8-831e-499e-a8e8-db61179c7202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf8d1a-d418-4373-a0b2-db35bc1466ce", "name": "network-vif-plugged", "status": "completed", "tag": "fd8dc1f1-20b5-46eb-ae9d-79e09431669e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:19.072598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4d3d6724-044e-4a26-9f6e-1d1a242179a5 req-ce674ff8-831e-499e-a8e8-db61179c7202 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:19.078823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4d3d6724-044e-4a26-9f6e-1d1a242179a5 req-ce674ff8-831e-499e-a8e8-db61179c7202 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:19.112475 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4d3d6724-044e-4a26-9f6e-1d1a242179a5 req-ce674ff8-831e-499e-a8e8-db61179c7202 service nova] Creating event network-vif-plugged:fd8dc1f1-20b5-46eb-ae9d-79e09431669e for instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce on n-h2-843861-3 Jul 19 20:17:19.128972 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4d3d6724-044e-4a26-9f6e-1d1a242179a5 req-ce674ff8-831e-499e-a8e8-db61179c7202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079124 Jul 19 20:17:19.131122 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2772/5432] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:19.175943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:19.206028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-887c2b3c-70db-4ede-be74-55a5e62fdbd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1533 microversion: 2.1 time: 1.249367 Jul 19 20:17:19.208741 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2661/5433] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:17 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1533 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:20.065366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:20.066914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:20.090598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:20.092325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:20.095265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:20.096121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:20.225803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:20.226601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:20.246757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:20.248483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:20.256985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:20.258899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:20.911964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:20.925753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:20.933299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5ea6641c-9ba8-49af-8268-4fe049091267 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1203 microversion: 2.1 time: 0.873403 Jul 19 20:17:20.933663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:20.938682 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2773/5434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:20 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1203 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:20.945867 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f403c426-f8be-470e-9446-ef3534346646 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1533 microversion: 2.1 time: 0.723915 Jul 19 20:17:20.946615 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2662/5435] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:20 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1533 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:21.954581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:21.955341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:21.964946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:21.965689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:21.974428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:21.981150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:21.982309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:21.985163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:21.985844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:21.986447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:21.987646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:21.992379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:22.925555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:22.940567 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df57f11b-2401-4978-bc2c-ea4740102252 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1533 microversion: 2.1 time: 0.980703 Jul 19 20:17:22.941750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2663/5436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:21 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1533 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:23.101076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:23.112053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1df9835-020e-451a-94d1-937f316cd7ab tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1390 microversion: 2.1 time: 1.161294 Jul 19 20:17:23.137813 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2774/5437] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:21 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1390 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:23.150458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:23.152461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:23.161155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:23.161610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:23.170001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:23.170001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:23.711857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:23.749054 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a38a53d3-cdd8-4233-a38f-6b7e193adb3d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1390 microversion: 2.1 time: 0.601335 Jul 19 20:17:23.750234 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2664/5438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:23 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1390 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:23.772788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:23.777462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:23.816844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:23.821701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:23.827244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:23.829500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:23.967220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:23.972232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:24.001577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:24.001869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:24.003723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:24.004544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:24.695131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:24.715190 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53dbbdaf-1ce6-40a0-9446-0d773a8ea9e8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1390 microversion: 2.1 time: 0.952860 Jul 19 20:17:24.718869 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2775/5439] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:23 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1390 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:24.732414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:24.733193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:24.759107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:24.760079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:24.761758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:24.764390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:24.833501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:17:24.906464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:24.915586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc732b85-02c4-4585-afd4-a9a75a2cb33e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.959229 Jul 19 20:17:24.928111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2665/5440] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:23 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:25.081595 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3274de64-6cef-4f25-b546-cee3f2e5de56 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 204 len: 0 microversion: 2.1 time: 0.352797 Jul 19 20:17:25.082758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2776/5441] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:17:24 2022] DELETE /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:17:25.092218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:25.093182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:25.107964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:25.108776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:25.110316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:25.110949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:25.527282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fceb210a-3ec9-4b3c-823a-f6e322960360 req-900892fd-115d-4e86-aabc-eb39a76a6140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "name": "network-vif-plugged", "status": "completed", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:25.541981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fceb210a-3ec9-4b3c-823a-f6e322960360 req-900892fd-115d-4e86-aabc-eb39a76a6140 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:25.547851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fceb210a-3ec9-4b3c-823a-f6e322960360 req-900892fd-115d-4e86-aabc-eb39a76a6140 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:25.576954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fceb210a-3ec9-4b3c-823a-f6e322960360 req-900892fd-115d-4e86-aabc-eb39a76a6140 service nova] Creating event network-vif-plugged:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:17:25.588271 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fceb210a-3ec9-4b3c-823a-f6e322960360 req-900892fd-115d-4e86-aabc-eb39a76a6140 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064964 Jul 19 20:17:25.593133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2777/5442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:17:25.947237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:25.948624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:25.964982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:25.969567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:25.970715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:25.973463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:26.367071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:26.379201 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7baff5ba-b11d-45d7-acd6-3ae73792b0d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1396 microversion: 2.1 time: 1.289304 Jul 19 20:17:26.383327 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2666/5443] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:25 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1396 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:26.968694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:26.976923 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c2cedbd-76a0-4531-b067-1310ffc6c141 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.033943 Jul 19 20:17:26.989193 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2778/5444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:25 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:27.401358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:27.402037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:27.432878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:27.433348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:27.434165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:27.440103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:27.996927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:27.997549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:28.021691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:28.023460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:28.024388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:28.024840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:28.408429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:28.420422 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b40a12f5-3b4d-477e-ab8f-eb8a8b39998a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1396 microversion: 2.1 time: 1.023637 Jul 19 20:17:28.421210 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2667/5445] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:27 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1396 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:28.849718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:28.860888 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b264f94-b758-42fe-b861-20dbabd42d4e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.868219 Jul 19 20:17:28.867272 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2779/5446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:27 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:29.438263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:29.439459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:29.450288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:29.456698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:29.467380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:29.468177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:29.882400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:29.883565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:29.899884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:29.900436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:29.901304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:29.901829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:30.584600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:30.597231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f4cbd48-49f1-45ad-8775-1c62bff6e911 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1396 microversion: 2.1 time: 1.162900 Jul 19 20:17:30.609724 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2668/5447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:29 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1396 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:30.625948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-18156597-fa29-43ae-903e-61ba351346e3 req-a9fa5d32-11a6-4b4a-94f8-b4d644a92fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf8d1a-d418-4373-a0b2-db35bc1466ce", "name": "network-vif-deleted", "tag": "fd8dc1f1-20b5-46eb-ae9d-79e09431669e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:30.650072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18156597-fa29-43ae-903e-61ba351346e3 req-a9fa5d32-11a6-4b4a-94f8-b4d644a92fa1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:30.650072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-18156597-fa29-43ae-903e-61ba351346e3 req-a9fa5d32-11a6-4b4a-94f8-b4d644a92fa1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:30.674347 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-18156597-fa29-43ae-903e-61ba351346e3 req-a9fa5d32-11a6-4b4a-94f8-b4d644a92fa1 service nova] Creating event network-vif-deleted:fd8dc1f1-20b5-46eb-ae9d-79e09431669e for instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce on n-h2-843861-3 Jul 19 20:17:30.681991 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-18156597-fa29-43ae-903e-61ba351346e3 req-a9fa5d32-11a6-4b4a-94f8-b4d644a92fa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070499 Jul 19 20:17:30.683261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2669/5448] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:30.797145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:30.806607 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ac9d3eb-680d-452f-86f3-f383010280a7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.927937 Jul 19 20:17:30.820828 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2780/5449] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:29 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:31.617525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:31.618629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:31.641671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:31.643320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:31.646569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:31.648345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:31.828422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:31.829712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:31.839998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:31.845399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:31.846890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:31.847449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:32.165067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:32.175483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b02d34b-d160-435c-aa2c-00578fbbec8f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 0.562566 Jul 19 20:17:32.180822 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2670/5450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:31 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:32.607378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:32.633354 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d1cd61e-f941-437a-927c-9249d34624b4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.808969 Jul 19 20:17:32.651006 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2781/5451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:31 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:33.197760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:33.198526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:33.220171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:33.229095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:33.234337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:33.240052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:33.422423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:33.435253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65e0ee23-5c7e-4205-a0d8-f05216565cd6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 0.241979 Jul 19 20:17:33.447552 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2671/5452] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:33 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:33.674124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:33.674663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:33.706506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:33.709557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:33.710601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:33.713804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:34.253743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:34.265536 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-694ce43b-7918-4f47-8a29-64e265ddfb02 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.598668 Jul 19 20:17:34.277785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2782/5453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:33 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:34.455964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:34.457763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:34.478153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:34.478992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:34.480726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:34.484598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:35.297853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:35.299204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:35.313679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:35.314830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:35.316735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:35.317776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:35.906248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:35.922911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e9501f0-1ab0-4b1c-8bcb-ac6d2881b87b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 1.469359 Jul 19 20:17:35.926638 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2672/5454] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:34 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:36.559239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:36.573155 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f59dcd8-6473-4835-bbd2-4f6ada67f88a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.277270 Jul 19 20:17:36.574144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2783/5455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:35 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:36.941962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:36.942642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:36.958563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:36.959374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:36.960528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:36.962864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:37.309530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:37.324615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:37.333320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ebb4c92-df35-4ce3-a528-0b19a71980e5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 0.396348 Jul 19 20:17:37.337581 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2673/5456] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:36 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:37.609574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:37.611309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:37.632987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:37.633345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:37.635090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:37.669438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:38.355559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:38.356353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:38.394542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:38.395748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:38.396943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:38.397625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:38.608724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:38.618713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5b1c409-0f72-44cb-a2fe-d3ab4a314f8f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.024085 Jul 19 20:17:38.622438 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2784/5457] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:37 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:38.792390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:38.809219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4449e3de-53d4-41a4-befb-65edaa110126 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 0.457270 Jul 19 20:17:38.810162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2674/5458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:38 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:39.639090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:39.639728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:39.659740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:39.661794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:39.662635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:39.663089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:39.827294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:39.828000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:39.842867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:39.843357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:39.844194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:39.844644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:40.350682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:40.378862 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5741d099-5a0d-46f9-8e93-edad3a253b2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 200 len: 1188 microversion: 2.1 time: 0.556092 Jul 19 20:17:40.383255 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2675/5459] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:39 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 1188 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:40.784013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:40.799506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-053a5cd1-ddcb-4177-b38e-4890685c7847 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.161057 Jul 19 20:17:40.804561 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2785/5460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:39 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:41.400296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:41.401508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: eaaf8d1a-d418-4373-a0b2-db35bc1466ce] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:41.412027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:41.418645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:41.419717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:41.420352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:41.436864 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce HTTP/1.1 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'eaaf8d1a-d418-4373-a0b2-db35bc1466ce'} Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:41.439390 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. Jul 19 20:17:41.443411 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:17:41.445438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance eaaf8d1a-d418-4373-a0b2-db35bc1466ce could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:17:41.446623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e41c81f0-a694-4d5a-b4ff-3d7f3f3d9a37 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce" status: 404 len: 111 microversion: 2.1 time: 0.050483 Jul 19 20:17:41.448000 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2676/5461] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:41 2022] GET /compute/v2.1/servers/eaaf8d1a-d418-4373-a0b2-db35bc1466ce => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:17:41.817537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:41.818856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:41.832372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:41.833142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:41.836164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:41.837948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:43.146516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:43.156742 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ddd52ae-cd8f-4c92-92bf-fde1c49a0da7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.342570 Jul 19 20:17:43.162320 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2786/5462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:41 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:44.179857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:44.181878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:44.209013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:44.211641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:44.230992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:44.235543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:44.566722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-928024187", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "42106405-d614-41cb-9947-5195cecd391d"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:44.612924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:44.696779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] validate_networks() for [('42106405-d614-41cb-9947-5195cecd391d', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:17:45.159475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:45.172383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31a9b006-8114-4fa6-a457-0cdcac8704a4 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.992757 Jul 19 20:17:45.175255 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2677/5463] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:44 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:46.193661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:46.194697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:46.199305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:46.201768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:17:46.202430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:17:46.203071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:17:46.203613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:17:46.204062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:17:46.216551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.225567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.233840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.235241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.253898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.254356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.255163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.255600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.363842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Getting quotas for project 7b7303c595824c0c9c55979ec48ca20f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:17:46.393542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Getting quotas for user 5df6228cb5354745ad5b6c45db74eda6 and project 7b7303c595824c0c9c55979ec48ca20f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:17:46.451116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:17:46.462476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:17:46.589452 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [25cda6fe-cf40-445c-a60d-09f4b672ed50] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:17:46.950037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:46.973965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c3962c4-11a1-47b2-94a2-fcd9cdae1686 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 0.785823 Jul 19 20:17:46.974763 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2678/5464] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:46 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:47.599562 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [25cda6fe-cf40-445c-a60d-09f4b672ed50] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36286. Jul 19 20:17:47.605375 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-357d778d-0755-4833-9849-16335be600c8 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.211426 Jul 19 20:17:47.606365 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2787/5465] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:17:47.616218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5811eb4a-2e31-40dd-b43b-61af4425b006 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:47.616860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5811eb4a-2e31-40dd-b43b-61af4425b006 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:47.851363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5811eb4a-2e31-40dd-b43b-61af4425b006 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:47.858677 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5811eb4a-2e31-40dd-b43b-61af4425b006 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1216 microversion: 2.1 time: 0.246421 Jul 19 20:17:47.862491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2679/5466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:47 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:47.992155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:47.993245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:48.021421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:48.025634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:48.032314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:48.032708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:48.878159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18880568-1d6e-49d2-aa15-dc076a75eb1e tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:48.878793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-18880568-1d6e-49d2-aa15-dc076a75eb1e tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:49.535670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-18880568-1d6e-49d2-aa15-dc076a75eb1e tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:49.550019 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18880568-1d6e-49d2-aa15-dc076a75eb1e tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1216 microversion: 2.1 time: 0.675656 Jul 19 20:17:49.563412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2680/5467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:48 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1216 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:50.570922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:50.571643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:50.585499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.586039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:50.587434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.590037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:50.604196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:50.625415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba8941af-fb26-4246-844d-9e3df3c7f2c8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 2.634262 Jul 19 20:17:50.630125 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2788/5468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:47 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:51.162258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:51.176797 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-01ae641e-52ba-42db-9d9b-331d20288d37 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1274 microversion: 2.1 time: 0.611119 Jul 19 20:17:51.180237 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2681/5469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:50 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1274 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:51.645149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:51.645805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:51.678094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:51.679357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:51.686590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:51.690476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:52.204217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:52.204938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:52.230787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:52.240303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:52.241475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:52.242159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:52.755693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:52.771524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-00f64342-e4df-4516-a864-792529ed9460 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1274 microversion: 2.1 time: 0.571868 Jul 19 20:17:52.772539 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2682/5470] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:52 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1274 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:52.909619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:52.916781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:52.926486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c2d867e-5d09-4651-9f2d-a2c9021a1786 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.286566 Jul 19 20:17:52.927477 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2789/5471] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:51 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:53.797605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:53.799089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:53.850907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:53.852584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:53.854356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:53.855801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:53.946572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:53.948052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:53.970024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:53.979375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:53.982613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:53.983749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:55.123338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:55.138312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-46fbb74e-14b0-4543-a712-95c99922f085 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 1.197003 Jul 19 20:17:55.147374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2790/5472] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:53 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:55.255772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:55.268430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b498ecd1-55c0-451f-b2ed-02cece262477 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.480220 Jul 19 20:17:55.269025 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2683/5473] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:53 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:56.168891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:56.169477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:56.191573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:56.192065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:56.192862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:56.193295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:56.288718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:56.289392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:56.331321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:56.334182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:56.339909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:56.340072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:56.340450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:56.431228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:58.047465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:58.060578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-965466e2-ad26-4e39-aa46-603c905436c6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.777775 Jul 19 20:17:58.072245 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2684/5474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:56 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:58.348558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:58.359542 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8280044-e72e-4d2c-b90d-bf65955f2411 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1528 microversion: 2.1 time: 2.194669 Jul 19 20:17:58.366902 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2791/5475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:56 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1528 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:59.078944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:59.079723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:59.099043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:59.099609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:59.100637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:59.104070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:59.228521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-011f6dff-3390-40a8-8516-4a92ca604417 req-668326a9-b7b5-4bec-999f-e627f1201dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99fd6fc-979f-44bb-b7d2-ee7107d5f677", "tag": "1424758b-91c1-466d-aa3c-950969966d2b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:59.245776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-011f6dff-3390-40a8-8516-4a92ca604417 req-668326a9-b7b5-4bec-999f-e627f1201dbc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:59.246225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-011f6dff-3390-40a8-8516-4a92ca604417 req-668326a9-b7b5-4bec-999f-e627f1201dbc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:59.294844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-011f6dff-3390-40a8-8516-4a92ca604417 req-668326a9-b7b5-4bec-999f-e627f1201dbc service nova] Creating event network-changed:1424758b-91c1-466d-aa3c-950969966d2b for instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 on n-h1-843861-3 Jul 19 20:17:59.314188 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-011f6dff-3390-40a8-8516-4a92ca604417 req-668326a9-b7b5-4bec-999f-e627f1201dbc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094891 Jul 19 20:17:59.318528 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2792/5476] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:59.385951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:59.387417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:59.402374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:59.402741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:59.409813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:59.411235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:59.540937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:00.070436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:00.083262 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a714196e-642d-4f43-ac46-9524cef8726c tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.008506 Jul 19 20:18:00.094116 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2685/5477] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:59 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:00.250833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:00.261160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af6294f1-1593-4968-ae96-eaafa441135e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1510 microversion: 2.1 time: 0.879030 Jul 19 20:18:00.280016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2793/5478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:59 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1510 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:01.104006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:01.104006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:01.116759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:01.117216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:01.123194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:01.125001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:01.289562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:01.290196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:01.313744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:01.314211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:01.315058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:01.315495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:02.561313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:02.574355 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-298997eb-db5b-4979-b961-a252c763c28f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.476235 Jul 19 20:18:02.590368 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2686/5479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:01 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:02.659545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:02.673772 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ba71761-263f-4e4b-bf98-33e5b5379bb2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1510 microversion: 2.1 time: 1.388160 Jul 19 20:18:02.678345 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2794/5480] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:01 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1510 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:02.939003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-76381321-2185-46fe-bb9e-3a9047b59a8c req-0e3f8638-b575-4787-8033-32ed159848f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "name": "network-vif-unplugged", "status": "completed", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:02.959153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-76381321-2185-46fe-bb9e-3a9047b59a8c req-0e3f8638-b575-4787-8033-32ed159848f5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:02.960082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-76381321-2185-46fe-bb9e-3a9047b59a8c req-0e3f8638-b575-4787-8033-32ed159848f5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:03.017074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-76381321-2185-46fe-bb9e-3a9047b59a8c req-0e3f8638-b575-4787-8033-32ed159848f5 service nova] Creating event network-vif-unplugged:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:18:03.027603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-76381321-2185-46fe-bb9e-3a9047b59a8c req-0e3f8638-b575-4787-8033-32ed159848f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092635 Jul 19 20:18:03.039905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2687/5481] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:03.606323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:03.606939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:03.624999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.625461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:03.626241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.626850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:03.697358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:03.698774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:03.707526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.708412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:03.709443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.710121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:04.323898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:04.344197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8ca852ed-b83a-45a8-ba73-e8b6e9159379 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1510 microversion: 2.1 time: 0.651470 Jul 19 20:18:04.345655 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2688/5482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:03 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:04.373359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:04.402670 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e732da4-8f4b-49de-84ac-c8b0dd235cc6 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 0.795788 Jul 19 20:18:04.403494 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2795/5483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:03 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:05.366346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:05.371469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:05.397598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:05.398158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:05.414671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:05.415416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:05.426064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:05.427918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:05.445188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:05.446870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:05.448138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:05.449254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.118673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:06.134701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-38e06b7c-e6eb-461c-a0b7-2a96788801bf tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1513 microversion: 2.1 time: 0.776367 Jul 19 20:18:06.141792 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2689/5484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:05 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1513 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:06.165039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:06.166623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:06.175584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.176407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.181171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.182264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.429454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:06.454039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d82e1e6-b598-4d23-bf34-8b7f33b47424 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.031992 Jul 19 20:18:06.469576 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2796/5485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:05 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:06.657761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:06.675447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-11d157fc-bbea-4771-9699-b5a325db5899 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1453 microversion: 2.1 time: 0.515809 Jul 19 20:18:06.676299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2690/5486] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:06 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1453 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:06.763862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:06.767362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:06.789118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.791370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.795893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.801149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.856329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lazy-loading 'flavor' on Instance uuid 1c643c6d-d8ee-491e-be93-eed3733f49d8 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:18:06.877157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'shelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state shelved_offloaded Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 14 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: {"shelve": {}} Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'shelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state shelved_offloaded Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'shelve': {}}} Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 19 20:18:06.884183 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state shelved_offloaded Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state shelved_offloaded Jul 19 20:18:06.888432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:06.891142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'shelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state shelved_offloaded {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:18:06.892747 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee336b8a-45b2-4106-8e57-096067f8ec6e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 155 microversion: 2.1 time: 0.137145 Jul 19 20:18:06.894162 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2797/5487] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:06 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 155 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:18:06.907442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:06.908813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:06.922460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.923619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:06.925430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:06.926555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:07.203784 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-313d7d09-181e-4c2d-ace2-54e3bcb8b96d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.303866 Jul 19 20:18:07.236423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:07.237299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:07.241811 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2691/5488] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:06 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:18:07.245607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:07.246262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:07.247232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:07.247900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:07.475960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:07.476968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:07.495500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:07.496495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:07.498116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:07.501414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:08.232356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:08.251037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aa6d939e-e68c-47df-9042-3bbbbfc7643f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1461 microversion: 2.1 time: 1.037760 Jul 19 20:18:08.251980 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2798/5489] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:07 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1461 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:08.526964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:08.533938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:08.568244 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-583f34c3-a643-4171-b55a-4227020c7c94 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.096353 Jul 19 20:18:08.587077 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2692/5490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:07 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:09.301308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:09.301916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:09.320259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1a032994-a89c-4f93-b245-2a514a3b8c42 req-d01b814f-55fd-4cd4-9bb9-f0cde61c98ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99fd6fc-979f-44bb-b7d2-ee7107d5f677", "name": "network-vif-plugged", "status": "completed", "tag": "1424758b-91c1-466d-aa3c-950969966d2b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:09.351234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:09.370853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a032994-a89c-4f93-b245-2a514a3b8c42 req-d01b814f-55fd-4cd4-9bb9-f0cde61c98ac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:09.371539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:09.372566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:09.373371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:09.373853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a032994-a89c-4f93-b245-2a514a3b8c42 req-d01b814f-55fd-4cd4-9bb9-f0cde61c98ac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:09.403716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1a032994-a89c-4f93-b245-2a514a3b8c42 req-d01b814f-55fd-4cd4-9bb9-f0cde61c98ac service nova] Creating event network-vif-plugged:1424758b-91c1-466d-aa3c-950969966d2b for instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 on n-h1-843861-3 Jul 19 20:18:09.428035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1a032994-a89c-4f93-b245-2a514a3b8c42 req-d01b814f-55fd-4cd4-9bb9-f0cde61c98ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118817 Jul 19 20:18:09.432908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2693/5491] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:09.605508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:09.607035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:09.626841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:09.628047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:09.629280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:09.629878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:11.160569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:11.180764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:11.209550 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-333c5b5e-78f3-403c-b0ae-c0e5bfa81518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1461 microversion: 2.1 time: 1.930657 Jul 19 20:18:11.220307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2799/5492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:09 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1461 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:11.220636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-81c67ee7-e03d-47f3-af51-62430ed3d929 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.613372 Jul 19 20:18:11.231759 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2694/5493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:09 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:12.230910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:12.232215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:12.241722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:12.242548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.242913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:12.243701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.244173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:12.246135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:12.267584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.272504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:12.273663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.274353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:13.551535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:13.552503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:13.562159 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6195cf56-1f75-45ff-abf4-8aa249ade59f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.338966 Jul 19 20:18:13.576223 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2800/5494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:12 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:13.584389 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b5cbf4f6-5a8c-4eb7-925a-06061ed6227f tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1316 microversion: 2.1 time: 1.347036 Jul 19 20:18:13.600084 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2695/5495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:12 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1316 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:14.614674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:14.616800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:14.625717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:14.627526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:14.670077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:14.679936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.692552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.693817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:14.695290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.696017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:14.696173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:14.698396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.701177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.533112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:15.559352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e19112b-8c60-4878-9859-9f97a040337a tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 0.974965 Jul 19 20:18:15.570747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2801/5496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:14 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:15.638053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:15.687583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc9c50cc-6d84-4304-a81d-6bb33c856b3b tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1504 microversion: 2.1 time: 1.079801 Jul 19 20:18:15.693621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2696/5497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:14 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1504 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:15.721749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:15.722661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:15.756574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.757749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.760863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.773453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.846472 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a2d0532-58be-4965-9610-c06e0cc35e24 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips" status: 200 len: 108 microversion: 2.1 time: 0.131666 Jul 19 20:18:15.847773 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2802/5498] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:18:15 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips => generated 108 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:18:15.862929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:15.863902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:15.886371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.887291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.888562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.889160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.988253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f394df54-d02a-41ad-8f50-4108cfffa0ad tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips" status: 200 len: 108 microversion: 2.1 time: 0.131207 Jul 19 20:18:15.991181 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2697/5499] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:18:15 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips => generated 108 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:16.002781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:16.003465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:16.027456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.028936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.030248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.035737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.157503 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef7037de-b978-4f6a-9ba6-b06533519bb0 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips/tempest-ServerAddressesTestJSON-473869219-network" status: 200 len: 93 microversion: 2.1 time: 0.159595 Jul 19 20:18:16.158925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2803/5500] 10.222.0.33 () {58 vars in 1397 bytes} [Tue Jul 19 20:18:15 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677/ips/tempest-ServerAddressesTestJSON-473869219-network => generated 93 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:18:16.171234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:16.172524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:16.195267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.199908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.201493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.202145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.312359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:18:16.618926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:16.621919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:16.689585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.690069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=48 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:16.717165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.720064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.721571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.776242 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bcdc139b-0089-47c1-8d98-b15c0597c082 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 204 len: 0 microversion: 2.1 time: 0.607228 Jul 19 20:18:16.785967 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2698/5501] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:18:16 2022] DELETE /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:18:16.842149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:16.845675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:16.868348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.869046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.870122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.873863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:18.431589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:18.440514 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c63bfd98-dce9-4928-82e0-0d2e053d03d8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.864824 Jul 19 20:18:18.443588 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2804/5502] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:16 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:18.558180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:18.579254 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6829f49b-49ef-4834-a668-23a8cfa28665 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1510 microversion: 2.1 time: 1.771052 Jul 19 20:18:18.580282 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2699/5503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:16 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1510 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:19.462742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:19.463368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:19.474743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:19.475199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:19.476024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:19.476523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:19.604289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:19.604884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:19.618526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:19.618974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:19.626505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:19.626956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:22.300592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:22.340409 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-644d4c7a-cb63-4881-b271-1666de403e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 2.881085 Jul 19 20:18:22.341246 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2805/5504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:19 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 2883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:22.762314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8d3a8f2c-d39a-4ad1-ad0b-fa8247ea193b req-fe9cb50b-c7d0-4fca-820d-58aeac3b9c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99fd6fc-979f-44bb-b7d2-ee7107d5f677", "name": "network-vif-unplugged", "status": "completed", "tag": "1424758b-91c1-466d-aa3c-950969966d2b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:22.786456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d3a8f2c-d39a-4ad1-ad0b-fa8247ea193b req-fe9cb50b-c7d0-4fca-820d-58aeac3b9c7b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:22.799072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8d3a8f2c-d39a-4ad1-ad0b-fa8247ea193b req-fe9cb50b-c7d0-4fca-820d-58aeac3b9c7b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:22.854655 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8d3a8f2c-d39a-4ad1-ad0b-fa8247ea193b req-fe9cb50b-c7d0-4fca-820d-58aeac3b9c7b service nova] Creating event network-vif-unplugged:1424758b-91c1-466d-aa3c-950969966d2b for instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 on n-h1-843861-3 Jul 19 20:18:22.884157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8d3a8f2c-d39a-4ad1-ad0b-fa8247ea193b req-fe9cb50b-c7d0-4fca-820d-58aeac3b9c7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126285 Jul 19 20:18:22.896331 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2806/5505] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:23.375573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:23.385134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:23.413577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:23.456465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:23.457239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:23.458184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:23.480863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:23.493048 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-521675b7-106e-4f22-80d8-05fb6a4b87d1 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1510 microversion: 2.1 time: 3.854237 Jul 19 20:18:23.498116 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2700/5506] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:19 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1510 bytes in 3898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:24.523450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:24.526881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:24.574654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:24.575376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:24.576521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:24.598592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:25.226976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:25.251310 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e131a012-49ea-4d0f-b512-d096677087d9 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1468 microversion: 2.1 time: 0.734660 Jul 19 20:18:25.271618 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2701/5507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:24 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1468 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:25.697812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:25.711500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:25.754623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61b8262b-06f5-4280-8069-0e9cc55ff198 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 2.388179 Jul 19 20:18:25.766838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2807/5508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:23 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:26.198475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-cc870301-5241-486f-801c-3d0e36105ed7 req-d946317a-663c-46f2-9efe-4694112c9c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99fd6fc-979f-44bb-b7d2-ee7107d5f677", "name": "network-vif-deleted", "tag": "1424758b-91c1-466d-aa3c-950969966d2b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:26.254693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cc870301-5241-486f-801c-3d0e36105ed7 req-d946317a-663c-46f2-9efe-4694112c9c22 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.284769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:26.285933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cc870301-5241-486f-801c-3d0e36105ed7 req-d946317a-663c-46f2-9efe-4694112c9c22 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.289230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:26.331413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.332307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.333486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.338976 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-cc870301-5241-486f-801c-3d0e36105ed7 req-d946317a-663c-46f2-9efe-4694112c9c22 service nova] Creating event network-vif-deleted:1424758b-91c1-466d-aa3c-950969966d2b for instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 on n-h1-843861-3 Jul 19 20:18:26.341466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.374198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-cc870301-5241-486f-801c-3d0e36105ed7 req-d946317a-663c-46f2-9efe-4694112c9c22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183289 Jul 19 20:18:26.380706 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2702/5509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:26.528160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6228cb5354745ad5b6c45db74eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7303c595824c0c9c55979ec48ca20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:26.552893 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3a859fd-09c7-44d1-a519-795064111f03 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 200 len: 1301 microversion: 2.1 time: 0.276299 Jul 19 20:18:26.569570 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2808/5510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:26 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 1301 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:26.793470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:26.794450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:26.821370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.825671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.826805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.832631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:27.578379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:27.579322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] [instance: d99fd6fc-979f-44bb-b7d2-ee7107d5f677] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:27.618273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:27.645055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:27.649811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:27.650475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:27.714002 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] HTTP exception thrown: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Request method failure captured: Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 HTTP/1.1 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xFnyPIrqf9Dqidq2LBFvlGhr0YlRwIrTtFCiZPgtmkEwEmPjD2dRZTnPqLYKwxelrf45XpJNKZn1IgbxSBIoSzh9LW_jVKZc1Xkw38WeIkRJiX4DZLjPgjOrfIIIea42Xdu_jxeTCtRcEcpmYKU18hlZm4Uob8XyTClB2ctXCCMv1Q Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 7b7303c595824c0c9c55979ec48ca20f Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerAddressesTestJSON-788702192 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b7303c595824c0c9c55979ec48ca20f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b7303c595824c0c9c55979ec48ca20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b7303c595824c0c9c55979ec48ca20f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b7303c595824c0c9c55979ec48ca20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerAddressesTestJSON-788702192 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 7b7303c595824c0c9c55979ec48ca20f Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerAddressesTestJSON-788702192 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerAddressesTestJSON-788702192-project Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5df6228cb5354745ad5b6c45db74eda6 Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerAddressesTestJSON-788702192-project Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd99fd6fc-979f-44bb-b7d2-ee7107d5f677'} Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:27.737275 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. Jul 19 20:18:27.747117 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:27.756981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] Returning 404 to user: Instance d99fd6fc-979f-44bb-b7d2-ee7107d5f677 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:18:27.760548 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53dd62b6-3adb-428b-83f4-fee53aa8a0d5 tempest-ServerAddressesTestJSON-788702192 tempest-ServerAddressesTestJSON-788702192-project] 10.222.0.33 "GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677" status: 404 len: 111 microversion: 2.1 time: 0.188302 Jul 19 20:18:27.761470 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2809/5511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:27 2022] GET /compute/v2.1/servers/d99fd6fc-979f-44bb-b7d2-ee7107d5f677 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:18:29.370208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:29.384731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10923fbf-45a2-4678-bc68-77afbf4f35af tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 2.595714 Jul 19 20:18:29.386734 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2703/5512] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:26 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:30.408517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:30.409846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:30.442258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:30.463662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:30.465071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:30.466799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:31.675042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:31.699932 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a284b66-2585-4db3-9d68-dba9d5e412dc tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.298699 Jul 19 20:18:31.700405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2810/5513] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:30 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:32.733096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:32.734357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:32.809233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:32.810006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:32.826868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:32.828421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:33.845132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:33.872383 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43237b95-25eb-4447-9f98-6f05820fec3c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.149955 Jul 19 20:18:33.896189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2704/5514] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:32 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:34.906763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:34.907562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:34.921896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:34.924705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:34.928742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:34.929349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:35.833146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:35.860130 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b72fd17e-2d6d-4410-b5b2-d3dcbb615c38 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 0.958323 Jul 19 20:18:35.861251 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2811/5515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:34 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:36.880466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:36.881190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:36.895047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:36.902446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:36.907264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:36.909545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:38.989563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:39.012445 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b344f3f-9648-4ca6-ac1f-bf57c12a4821 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 2.133952 Jul 19 20:18:39.023542 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2705/5516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:36 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:40.032845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:40.034552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:40.053931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:40.054666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:40.060076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:40.060782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:40.916142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:40.930757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bdd3f2a2-c42e-4b2d-bbf8-6d9c2aa52a95 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 0.902943 Jul 19 20:18:40.931359 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2812/5517] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:40 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:41.961966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:41.963013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:41.982142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:41.982705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:41.985464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:41.986072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:42.007768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:42.156547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-731925529", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "632e2641-76f8-4c85-8bfe-2fa420cca1cb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:42.358995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:18:43.125889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:43.229910 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cfbaa275-af74-46c9-8de4-79157d5bb0cb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.271981 Jul 19 20:18:43.250752 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2706/5518] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:41 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:44.278550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:44.281087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:44.305089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.307363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.308399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.309377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.725949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:18:44.726510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:18:44.727637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:18:44.733540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:18:44.734301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:18:44.767794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.768864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.769728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.770143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.820803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=28 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:44.837299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:18:44.853234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:18:44.856098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:44.882948 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-afaf33f2-92a6-41a1-be81-0b2a173bbad1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 0.591293 Jul 19 20:18:44.884211 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2707/5519] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:44 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:44.893152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:18:44.902468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='632e2641-76f8-4c85-8bfe-2fa420cca1cb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:18:45.081814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a54a8644-900d-45e5-b13c-801a3a63a421 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930773 Jul 19 20:18:45.082986 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2813/5520] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:18:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:18:45.093464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e92f5b7-e873-4b65-991b-a5135dfbad2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:45.094264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9e92f5b7-e873-4b65-991b-a5135dfbad2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:45.208462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e92f5b7-e873-4b65-991b-a5135dfbad2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:45.230545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e92f5b7-e873-4b65-991b-a5135dfbad2f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1056 microversion: 2.1 time: 0.141728 Jul 19 20:18:45.237819 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2708/5521] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:45 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1056 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:45.323847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4592b22b-e176-44cf-a21d-5212319af438 req-aec811f3-e801-4193-9c1e-a9003cdf4f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "name": "network-vif-plugged", "status": "completed", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:45.343873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4592b22b-e176-44cf-a21d-5212319af438 req-aec811f3-e801-4193-9c1e-a9003cdf4f51 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:45.346914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4592b22b-e176-44cf-a21d-5212319af438 req-aec811f3-e801-4193-9c1e-a9003cdf4f51 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:45.392451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4592b22b-e176-44cf-a21d-5212319af438 req-aec811f3-e801-4193-9c1e-a9003cdf4f51 service nova] Creating event network-vif-plugged:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:18:45.408646 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4592b22b-e176-44cf-a21d-5212319af438 req-aec811f3-e801-4193-9c1e-a9003cdf4f51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087849 Jul 19 20:18:45.409479 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2814/5522] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:45.901187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:45.902544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:45.926948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:45.929089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:45.931570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:45.934230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:46.257807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:46.263869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:46.286475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:46.291353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:46.293098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:46.293874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:46.529146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:46.537381 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f466ce93-b0fd-40ad-bd7b-b672455f7a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1052 microversion: 2.1 time: 0.288626 Jul 19 20:18:46.546985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2815/5523] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:46 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1052 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:46.758551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:46.770596 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b2a2525-5cfe-463d-b820-a9cc5bff5db3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 0.873504 Jul 19 20:18:46.774653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2709/5524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:45 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:47.527982 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:18:47.529193 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:18:47.560047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:47.562922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:47.574153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.575031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.576229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.576894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.813213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:47.813839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:47.818105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:47.830733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.831390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.835764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.836256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.919170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:47.930600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73a55c31-c233-45ce-8e50-56e35b7bab6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1116 microversion: 2.1 time: 0.379277 Jul 19 20:18:47.931225 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2816/5525] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:47 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1116 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:48.967890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:48.968594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:49.016095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:49.016551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:49.017343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:49.017778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:49.393171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:49.416371 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-279d6314-1bb1-48ef-ab66-73d6bbc22dd7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1519 microversion: 2.1 time: 1.605705 Jul 19 20:18:49.429968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2710/5526] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:47 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1519 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:49.520657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:49.556617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e79f28b-62f0-47a3-b3b1-c4aac343af6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1126 microversion: 2.1 time: 0.593201 Jul 19 20:18:49.557508 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2817/5527] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:48 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1126 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:50.436912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:50.438671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:50.487202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:50.487779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:50.488586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:50.491440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:50.579715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:50.580374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:50.595527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:50.596017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:50.596816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:50.597253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:50.987955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:51.003037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6e5f93f-8d5e-4d74-a42a-ee93268890f6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1126 microversion: 2.1 time: 0.424873 Jul 19 20:18:51.005296 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2818/5528] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:50 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1126 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:51.296641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:51.326260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9cd4131-aa1d-4fbb-a8db-be7f7abe3bb7 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.894644 Jul 19 20:18:51.345031 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2711/5529] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:50 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:51.363304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:51.364389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:51.371300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:51.371761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:51.372625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:51.373075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:51.875994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-951037931", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": "none"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:51.992536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:18:51.992969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:18:51.993450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:18:51.993875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:18:51.994279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:18:52.012671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:52.013111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:52.016509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:52.017290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:52.113110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Getting quotas for project 506f2a5e2c94453296501b4714b2503c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:18:52.146009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Getting quotas for user bed5484e921f40659ad29259e2b64c4b and project 506f2a5e2c94453296501b4714b2503c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:18:52.198202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:18:52.200592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:18:52.323738 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7e03d927-5751-4f04-b490-c3d792675948 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.766446 Jul 19 20:18:52.325446 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2712/5530] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 19 20:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:18:52.334067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:52.339751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:52.354470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:52.356342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:52.357309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:52.374943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:53.528853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:53.569761 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf5a03a2-41af-4d49-8190-773079d1ddcb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 2.216046 Jul 19 20:18:53.574881 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2819/5531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:51 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:53.597599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:53.599601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:53.622617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:53.623468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:53.627670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:53.629291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:54.055653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:54.070081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:54.076060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:54.078064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a7248552-0742-40f6-9f76-b984e7b0d1c5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1273 microversion: 2.57 time: 0.501588 Jul 19 20:18:54.099232 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2820/5532] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:18:53 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1273 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:18:54.108055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:54.115010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:54.125568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:54.130115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:54.131275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:54.135250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:54.458816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:54.470529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ca4b251-128e-407f-a1bb-ffd4a29e50c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 2.141907 Jul 19 20:18:54.471895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2713/5533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:52 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:54.798351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:54.878387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:55.117724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:55.122314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:55.159519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.160269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:55.161803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.163977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:55.444019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:55.464015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb528361-4015-4430-857e-8a6833f902ed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.357407 Jul 19 20:18:55.467435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2821/5534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:54 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:55.500191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48195b24-e2ba-4414-a511-b8193a3ca784 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:55.523222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-48195b24-e2ba-4414-a511-b8193a3ca784 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48195b24-e2ba-4414-a511-b8193a3ca784 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/2c668d54-2287-4349-8d7e-7d9b1eb7de32/action HTTP/1.1 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: {"os-stop": {}} Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2c668d54-2287-4349-8d7e-7d9b1eb7de32', 'body': {'os-stop': {}}} Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:18:55.545338 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48195b24-e2ba-4414-a511-b8193a3ca784 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2c668d54-2287-4349-8d7e-7d9b1eb7de32 has no mapping to a cell. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:18:55.549623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48195b24-e2ba-4414-a511-b8193a3ca784 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/2c668d54-2287-4349-8d7e-7d9b1eb7de32/action" status: 404 len: 117 microversion: 2.1 time: 0.067042 Jul 19 20:18:55.550463 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2822/5535] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:55 2022] POST /compute/v2.1/servers/2c668d54-2287-4349-8d7e-7d9b1eb7de32/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:18:55.555675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:55.581541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:55.603427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:55.610374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.611790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:55.612831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.613449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:55.635121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:55.637219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:55.638413 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9d6f7f8-f8c9-45c8-a7d6-14acbcc7828b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1335 microversion: 2.57 time: 0.535333 Jul 19 20:18:55.639006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2714/5536] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:18:55 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1335 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:18:55.653605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:55.668694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:55.693679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.695149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:55.697557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:55.698283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:56.321371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:56.339758 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc54ec37-034c-44e1-85ae-b25a985b1de1 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.689719 Jul 19 20:18:56.372363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2715/5537] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:55 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:56.379677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:56.380776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:56.446791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:56.447261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:56.451826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:56.452391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:56.871924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:56.878102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=78 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:56.913968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-651fad2d-fd57-42ad-ab2c-b5ca74596bde tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.358087 Jul 19 20:18:56.935407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2823/5538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:55 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:56.970872 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ad165003-f0a5-4347-af65-4e9c9fc8d0a8 req-8603e4c0-fff9-4c91-8f72-903203f833a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93af1938-d296-462b-868d-ee10cd30b7d7", "tag": "10a1d8f0-d599-4786-a904-ba1828f9d03f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:57.026574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ad165003-f0a5-4347-af65-4e9c9fc8d0a8 req-8603e4c0-fff9-4c91-8f72-903203f833a1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:57.027036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ad165003-f0a5-4347-af65-4e9c9fc8d0a8 req-8603e4c0-fff9-4c91-8f72-903203f833a1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:57.140116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ad165003-f0a5-4347-af65-4e9c9fc8d0a8 req-8603e4c0-fff9-4c91-8f72-903203f833a1 service nova] Creating event network-changed:10a1d8f0-d599-4786-a904-ba1828f9d03f for instance 93af1938-d296-462b-868d-ee10cd30b7d7 on n-h1-843861-3 Jul 19 20:18:57.162917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ad165003-f0a5-4347-af65-4e9c9fc8d0a8 req-8603e4c0-fff9-4c91-8f72-903203f833a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219905 Jul 19 20:18:57.164629 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2824/5539] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:57.200943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:57.201715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:57.233956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:57.234923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:57.236123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:57.254239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:57.710254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:57.731143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:57.740081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:57.743365 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cdf020e-54bd-4e6a-a804-5083fa69b644 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1335 microversion: 2.57 time: 0.575729 Jul 19 20:18:57.770121 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2825/5540] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:18:57 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1335 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:18:57.915388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:57.936749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-160ea3fe-d777-45ab-87b6-dc88c77cdb86 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.559281 Jul 19 20:18:57.937630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2716/5541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:56 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:57.958974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:57.960865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:57.961783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:57.962313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1a683608-cb8b-4f32-81a5-14c340e5e4f8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:57.975031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1a683608-cb8b-4f32-81a5-14c340e5e4f8/action HTTP/1.1 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 15 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: {"suspend": {}} Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1a683608-cb8b-4f32-81a5-14c340e5e4f8', 'body': {'suspend': {}}} Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:57.978152 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:57.982905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:18:57.982905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:18:57.982905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. Jul 19 20:18:57.982905 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:18:57.986654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 1a683608-cb8b-4f32-81a5-14c340e5e4f8 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:18:57.988945 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0798965-ce34-4d91-b968-7bd18603cde6 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1a683608-cb8b-4f32-81a5-14c340e5e4f8/action" status: 404 len: 111 microversion: 2.1 time: 0.034241 Jul 19 20:18:57.998095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:57.998559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:57.999408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2717/5542] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:57 2022] POST /compute/v2.1/servers/1a683608-cb8b-4f32-81a5-14c340e5e4f8/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:18:58.010482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:58.011063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:58.020338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:58.021316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:58.054855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:58.058515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:58.066346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:58.069223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:59.248296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:59.288136 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e0911a1-54f9-4eda-8a23-80226ea2c020 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.281469 Jul 19 20:18:59.292983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2718/5543] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:57 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:59.330396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:59.331077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:59.412000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:59.412507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:59.413334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:59.415251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:59.656390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:59.711395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:59.721006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:59.729581 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e58f7270-1f92-4161-a68a-1778355f3259 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1335 microversion: 2.57 time: 0.431270 Jul 19 20:18:59.756712 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2719/5544] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:18:59 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1335 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:18:59.788931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:59.797592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:59.819541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:59.824468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:59.828095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:59.831699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:59.833683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:59.864877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8e6ae91-0184-4a32-babd-b0aea23d7edf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.912126 Jul 19 20:18:59.883606 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2826/5545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:57 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:00.764505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:00.765702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:00.785102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:00.785923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:00.787042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:00.787684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:01.435436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:01.461929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-78714ac7-57d3-4046-8882-b3514918369e tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.699201 Jul 19 20:19:01.466383 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2720/5546] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:59 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:01.485156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:01.489151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:01.541388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:01.543444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:01.545371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:01.545899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:01.601319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:01.696611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:01.720530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:01.726930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-799993f3-1600-4ec1-a5ba-c297bc55a3ed tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1356 microversion: 2.57 time: 0.965721 Jul 19 20:19:01.730464 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2827/5547] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:00 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1356 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:01.782686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:01.783688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:01.835256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:01.846116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:01.856381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:01.875236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.001896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lazy-loading 'flavor' on Instance uuid 1c643c6d-d8ee-491e-be93-eed3733f49d8 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:19:02.042710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:02.180741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:02.343659 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-825683e7-53be-416c-bad3-cb3db2e43da8 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.588817 Jul 19 20:19:02.346105 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2828/5548] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:01 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:19:02.383559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:02.392969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:02.442424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.460116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.461714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.465401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.860894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:19:02.870268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:19:02.877880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:19:02.885818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:19:02.886930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:19:03.225057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:03.300285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.300845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.302004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.302684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.330554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:03.342636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d38376b8-9140-4f4b-8933-a863375070ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.867070 Jul 19 20:19:03.347891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2721/5549] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:01 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:03.360938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:03.369008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:03.399723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.408214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.414852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.415497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.483483 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af8f1212-4c39-4c74-9623-b0274335c49b tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "POST /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890/action" status: 202 len: 1137 microversion: 2.57 time: 1.122017 Jul 19 20:19:03.485442 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2829/5550] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Jul 19 20:19:02 2022] POST /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890/action => generated 1137 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 20:19:03.511354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:03.512647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:03.547063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.547535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.551316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.553066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.822716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:03.866412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:03.878382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:03.884674 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-621d1d3f-7765-4322-86d0-494deedf7142 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.386539 Jul 19 20:19:03.885169 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2830/5551] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:03 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:04.160420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:04.170686 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd944538-8cd6-4453-8ebb-bf1498373a03 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1514 microversion: 2.1 time: 0.821282 Jul 19 20:19:04.179455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2722/5552] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:03 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:04.370761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:04.371662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:04.383460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:04.384976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:04.385627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:04.390883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:04.904738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:04.913720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:04.918031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:04.931440 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83f4a10e-d1b6-49fc-accb-3ee94b161c30 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.567976 Jul 19 20:19:04.938147 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2831/5553] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:04 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:04.967390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:04.980394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:04.984919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:04.988741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:05.199712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:05.200376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:05.215904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:05.219233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:05.220161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:05.220617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:06.201021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:06.219247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:06.223260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:06.228070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f12a4dca-d5ba-47ae-9ee9-09c1faed48c4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 1.322008 Jul 19 20:19:06.229682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2723/5554] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:04 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:06.238143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:06.241983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:06.265652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:06.267795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:06.270170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:06.272186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:06.945280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:06.964080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-239aeed1-73a6-4606-b0b4-4a0ad3f15a7c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1497 microversion: 2.1 time: 1.768363 Jul 19 20:19:06.981016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2832/5555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:05 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1497 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:07.337986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:07.346983 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab122d08-45ac-44cb-81a2-fceaffb49c8e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.115983 Jul 19 20:19:07.347593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2724/5556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:06 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:07.375615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:07.382405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:07.404321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.404791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.407008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.409023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.504269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:07.699328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:07.699964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:07.707504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.708003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.709025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.709471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.771574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lazy-loading 'flavor' on Instance uuid 1c643c6d-d8ee-491e-be93-eed3733f49d8 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:19:07.798368 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'suspend' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state suspended Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: {"suspend": {}} Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'suspend' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state suspended Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'suspend': {}}} Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 19 20:19:07.801380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state suspended Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state suspended Jul 19 20:19:07.805899 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:07.807993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'suspend' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state suspended {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:07.809070 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-360dde21-de95-4e57-b2c6-a0b24d5051ad tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 148 microversion: 2.1 time: 0.814697 Jul 19 20:19:07.814772 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2833/5557] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:06 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 148 bytes in 816 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:19:07.820366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:07.821334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:07.834691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.835478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.838016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:07.839069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.966495 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5dd07c7-beca-4815-80b8-e66e0118892d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 202 len: 0 microversion: 2.1 time: 0.149910 Jul 19 20:19:07.969847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2834/5558] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:07 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:19:08.013607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:08.021024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:08.039653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.042609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:08.059203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.059999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:08.566208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:08.589169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:08.591172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:08.592753 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1155e2e8-07c2-41dd-82c7-0b756fcfa916 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 1.232400 Jul 19 20:19:08.596630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2725/5559] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:07 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:08.615030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:08.630923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:08.650396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.651124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:08.652129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.652761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:09.807932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:09.840615 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-20580f0a-6214-41d5-a37b-859a769c90f2 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1503 microversion: 2.1 time: 1.865355 Jul 19 20:19:09.844338 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2835/5560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:07 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1503 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:09.861665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:09.864150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:09.872810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:09.924576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:09.924988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:09.927281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35a8b791-a869-45b3-8767-e10664c01a31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.318625 Jul 19 20:19:09.928339 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2726/5561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:08 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:09.945572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:09.946352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:10.045550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:10.549846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:10.565935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:10.571456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:10.576311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e673ac0-d822-4d8b-a638-4c3724a2790a tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.729864 Jul 19 20:19:10.582200 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2836/5562] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:09 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:10.878755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:10.883159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:10.897642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:10.900350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:10.901569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:10.904392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:10.962204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:10.963254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:10.988992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:11.002808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:11.004076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:11.008003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:11.508337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:11.532377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a160c3c5-049f-4cda-ae20-3124b1c36b40 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1503 microversion: 2.1 time: 0.660894 Jul 19 20:19:11.539879 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2727/5563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:10 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1503 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:11.579066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:11.606559 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7474b997-5553-44d4-8ad6-e8c5b4477867 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.649093 Jul 19 20:19:11.610597 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2837/5564] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:10 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:11.620654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:11.629755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:11.662951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:11.663939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:11.666561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:11.668154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:12.142720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:12.192752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:12.214445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:12.228551 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-01c99507-30de-40fc-8cbf-924b67406066 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.625280 Jul 19 20:19:12.229505 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2728/5565] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:11 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:12.561009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:12.561988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:12.586909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:12.587541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:12.588945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:12.601034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:12.636251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:12.637241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:12.664284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:12.671085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:12.685208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:12.686081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.476409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:13.509640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a02f290-0d41-4b09-8ef7-21e3a0343e11 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.953696 Jul 19 20:19:13.513585 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2838/5566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:12 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:13.539489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:13.541700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:13.561007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.562219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.565271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.569528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.709845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:13.718588 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fbb2243-9144-4092-aa85-b46c0ff37d11 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.087116 Jul 19 20:19:13.719186 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2729/5567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:12 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:13.760451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:13.761387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:13.773051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.783563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.784544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.784990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.879656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:13.893200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:13.894857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:13.907761 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2c5791a-0382-4df5-b655-739654aad2df tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.386161 Jul 19 20:19:13.908779 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2839/5568] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:13 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:14.376617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:14.388319 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-baf9c991-715f-4d9a-8f5d-a6efad544669 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.648572 Jul 19 20:19:14.393592 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2730/5569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:13 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:14.412046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:14.412904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: d3b06c8e-c4d2-4b0a-a389-243e0596ac7d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:14.423925 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/d3b06c8e-c4d2-4b0a-a389-243e0596ac7d/action HTTP/1.1 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: {"unpause": {}} Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd3b06c8e-c4d2-4b0a-a389-243e0596ac7d', 'body': {'unpause': {}}} Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:14.426432 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:14.430466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:14.430466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:14.430466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. Jul 19 20:19:14.430466 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:14.436881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance d3b06c8e-c4d2-4b0a-a389-243e0596ac7d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:14.441255 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-88173bb5-e1e7-4c12-ba21-f4c8ea43d0a0 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/d3b06c8e-c4d2-4b0a-a389-243e0596ac7d/action" status: 404 len: 111 microversion: 2.1 time: 0.031961 Jul 19 20:19:14.443922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2840/5570] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:14 2022] POST /compute/v2.1/servers/d3b06c8e-c4d2-4b0a-a389-243e0596ac7d/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:14.459973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:14.460620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:14.474435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.474891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.487386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.487867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.738076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:14.739364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:14.749363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:14.774866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b74c381f-3fb1-41eb-aab0-84623ca76445 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.326169 Jul 19 20:19:14.777843 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2731/5571] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:14 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:14.784270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.787569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.790769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.791234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.798559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:14.799178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:14.820462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.821050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.821978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:14.822420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.115243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.125687 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-445b8d3b-69be-40e3-9873-35983342d5eb tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.328421 Jul 19 20:19:15.126984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2732/5572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:14 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:15.151693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:15.152603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.164271 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8436a9e0-c566-4631-8b0e-a87b28143c62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.430988 Jul 19 20:19:15.166122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.168184 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2841/5573] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:14 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:15.174467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:15.175202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.186729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.187478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.188712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.189401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.195666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:15.197995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.198742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.204134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.204779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.255619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'unpause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 15 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: {"unpause": {}} Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: exception: Cannot 'unpause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'unpause': {}}} Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state active. Cannot unpause while the instance is in this state. Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.277142 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:15.283171 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:15.283171 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:15.283171 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:15.283171 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:15.283171 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.286869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'unpause' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:15.289068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c8a762f-e366-4f63-baa2-ad61744e7090 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 145 microversion: 2.1 time: 0.119708 Jul 19 20:19:15.300982 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2842/5574] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:15 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 145 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:19:15.310831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:15.311557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.319906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.320773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.321306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.322181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.322930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.341355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.345312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.349107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d7605df-6043-4928-84f1-0a54710c5057 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.221294 Jul 19 20:19:15.349714 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2733/5575] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:15 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:15.501206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.513376 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc7ddfb5-8c1f-424d-bace-a0ac62aec833 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.205260 Jul 19 20:19:15.515297 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2843/5576] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:15.536373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:15.537547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.546441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.546898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.547687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.550301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.776386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:15.790901 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9db0d1b7-a22c-4c86-ba01-a7b95431dc18 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.256688 Jul 19 20:19:15.791454 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2734/5577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:15.817209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:15.818865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.833803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808/action HTTP/1.1 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 18 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: {"unshelve": null} Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808', 'body': {'unshelve': None}} Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.840380 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. Jul 19 20:19:15.844815 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:15.846997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:15.850204 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-53b28b0d-f78f-42a5-9d4d-7efa6aa86851 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808/action" status: 404 len: 111 microversion: 2.1 time: 0.040324 Jul 19 20:19:15.851346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2844/5578] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:15 2022] POST /compute/v2.1/servers/bbfe20e9-a233-4fdf-a9a0-4cfe2a00c808/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:15.861790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:15.862635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.875084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.875552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.876378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.876997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.194426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:16.195590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:16.210463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.211222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.212993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.214084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.458495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:16.469746 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d01c6525-9373-475e-8908-a0595c00f02c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.613761 Jul 19 20:19:16.474207 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2735/5579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:15 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:16.488485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:16.489239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:16.504981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.507343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.508832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.511762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.585993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:16.605488 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24b27ed4-0208-413b-b714-450dac1b7c71 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.414669 Jul 19 20:19:16.613077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2845/5580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:16 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:16.631063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:16.631730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:16.658016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.658560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.659403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.659882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.686942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:16.698962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:16.701100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:16.707959 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23aac0e2-ca37-443e-ae72-2ebe79db6f27 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.229859 Jul 19 20:19:16.709261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2736/5581] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:16 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:17.017004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:17.028227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16bddde9-28d2-4444-a27b-845ef085191c tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.413902 Jul 19 20:19:17.036169 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2846/5582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:16 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:17.045659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:17.046793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.064020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.064491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.065311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.065758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.118850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Cannot 'unshelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action HTTP/1.1 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 18 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: {"unshelve": null} Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: exception: Cannot 'unshelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'unshelve': None}} Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 in vm_state active. Cannot unshelve while the instance is in this state. Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:19:17.121012 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 409 to user: Cannot 'unshelve' instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 while it is in vm_state active {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09832e13-2b0f-4ee3-b00d-b85c37f1ecc5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action" status: 409 len: 146 microversion: 2.1 time: 0.081435 Jul 19 20:19:17.125602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2737/5583] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:19:17 2022] POST /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8/action => generated 146 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:19:17.133814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:17.134464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.144571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.145069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.145879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.146523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.347380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:17.358372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8704c3a-b1b3-4e7c-bbc9-aa182e381518 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.229530 Jul 19 20:19:17.370644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2847/5584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:17 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:17.378034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:17.384731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.401366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.402551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.404417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.405240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.624849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:17.625736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.643590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.644614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.644971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.645405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.831766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:17.848207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd635c2f-73cb-4e96-8c14-19037b09e8d3 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.473112 Jul 19 20:19:17.866115 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2738/5585] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:17 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:17.879188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:17.880301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.882603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:17.932522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.937430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.939000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.939706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.101758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.115086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.119789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.123236 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6bf59680-b49d-4a1e-b414-8a0442dbb729 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.254719 Jul 19 20:19:18.126110 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2739/5586] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:17 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:18.135856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.136527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-629234120_updated"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:18.137804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 9b148a42-4ff9-4774-919b-127bec5a6a7c] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:18.155080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7cbd66a-c532-4396-905d-1b3f409c16df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.533259 Jul 19 20:19:18.157543 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2848/5587] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:17 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:18.164571 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/servers/9b148a42-4ff9-4774-919b-127bec5a6a7c HTTP/1.1 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 80 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-629234120_updated"}} Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '9b148a42-4ff9-4774-919b-127bec5a6a7c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-629234120_updated'}}} Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 20:19:18.167598 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. Jul 19 20:19:18.172087 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.177383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 9b148a42-4ff9-4774-919b-127bec5a6a7c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:18.178790 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff5c1fb5-38fb-41dd-84ed-8918ae39da41 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "PUT /compute/v2.1/servers/9b148a42-4ff9-4774-919b-127bec5a6a7c" status: 404 len: 111 microversion: 2.1 time: 0.051577 Jul 19 20:19:18.180479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2740/5588] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:19:18 2022] PUT /compute/v2.1/servers/9b148a42-4ff9-4774-919b-127bec5a6a7c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:18.190557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:18.191592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:18.201543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.202935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.203977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.204905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.443173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.456682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-918f7707-dd72-41ad-bc9a-603d80618288 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.272044 Jul 19 20:19:18.460505 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2849/5589] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:18 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:18.475687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:18.476749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:18.485698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.486317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.487290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.488155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.696369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:18.707089 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56d3b285-7c7b-4239-913a-3290e2b18195 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.234974 Jul 19 20:19:18.708714 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2741/5590] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:18 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:18.730549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f53a9ece-63fa-4e18-b73d-5e962a73ae7f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f53a9ece-63fa-4e18-b73d-5e962a73ae7f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: request: PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 HTTP/1.1 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 280 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.734853 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:19:18.738926 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:18.742448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f53a9ece-63fa-4e18-b73d-5e962a73ae7f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:18.745162 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f53a9ece-63fa-4e18-b73d-5e962a73ae7f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 400 len: 619 microversion: 2.1 time: 0.018897 Jul 19 20:19:18.746014 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2850/5591] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Jul 19 20:19:18 2022] PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:19:18.759610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:18.760504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:18.769431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.770340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.772086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.772889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:19.067966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-857276709", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:19.156505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] validate_networks() for None {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:19:19.183927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:19.196314 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1673fbfb-e649-4a50-92e7-1f917e5abd05 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.442196 Jul 19 20:19:19.197772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2742/5592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:18 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:19.216162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:19.217195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:19.229474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:19.230307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:19.232381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:19.235253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:19.261679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:19.424923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:19.445460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:19.449661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:19.452584 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b94e2b80-6111-4361-9dd8-d0d7ac9606c2 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.253562 Jul 19 20:19:19.468462 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2743/5593] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:19 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:19.482763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:19.487318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:19.499406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:19.500766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:19.502039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:19.502802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.006251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:19:20.006668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:19:20.007221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:19:20.007632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:19:20.008076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:19:20.031622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.032768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.034793 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.036148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.065002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Getting quotas for project c6bf7ebdf57344d6b86765cf17e1c25f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:19:20.073904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Getting quotas for user ada63a3f97114b62b16af9f62de54407 and project c6bf7ebdf57344d6b86765cf17e1c25f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:19:20.088624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.098264 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3608e84f-b0ed-44d9-9bc8-4b390725eafd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 0.627362 Jul 19 20:19:20.102331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:19:20.103834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2744/5594] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:19 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:20.106823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:19:20.124837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.127282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.149505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.149973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.152752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.154890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.192723 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-755ee7c4-6463-453e-8703-8c92e9d713b5 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131798 Jul 19 20:19:20.198749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2851/5595] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:19:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:19:20.232354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fdb6ed3-f134-4b15-a578-db9c28cb4ecb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.234170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fdb6ed3-f134-4b15-a578-db9c28cb4ecb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.589221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fdb6ed3-f134-4b15-a578-db9c28cb4ecb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.606479 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fdb6ed3-f134-4b15-a578-db9c28cb4ecb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1213 microversion: 2.1 time: 0.400695 Jul 19 20:19:20.612801 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2852/5596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1213 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:20.668171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.669685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.692889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.695891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.696809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.697266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.847049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.854926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.863322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.867705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.870222 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d9d044b-c654-4fa1-a5f9-3aeee4c79bed tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 0.764953 Jul 19 20:19:20.870707 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b80c2087-95ae-4ff5-bd9e-c60c25774785 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.251865 Jul 19 20:19:20.883769 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2745/5598] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:20.888505 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2853/5598] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:20.891620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a35c4733-5f62-42d0-aeb7-aa45642bf876 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a35c4733-5f62-42d0-aeb7-aa45642bf876 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: request: PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 HTTP/1.1 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 24 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: {"server": {"name": ""}} Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8', 'body': {'server': {'name': ''}}} Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:19:20.913835 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:19:20.918922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:20.924162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a35c4733-5f62-42d0-aeb7-aa45642bf876 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:20.928152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a35c4733-5f62-42d0-aeb7-aa45642bf876 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 400 len: 108 microversion: 2.1 time: 0.042728 Jul 19 20:19:20.928996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2746/5599] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:19:20 2022] PUT /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:19:20.940864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.941517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.957178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.960434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.962543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.963231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:21.117804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:21.118615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:21.146497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:21.150024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:21.152929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:21.171474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.301088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.314178 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-faa578fd-1c7b-4498-bd20-d6c7e7f35765 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1168 microversion: 2.1 time: 1.201136 Jul 19 20:19:22.323901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.326632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2747/5600] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:21 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1168 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:22.332082 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ea9a02a-ccc1-4a9c-a4a3-37bdacdfe37b tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1506 microversion: 2.1 time: 1.397930 Jul 19 20:19:22.332684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2854/5601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1506 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:22.339118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:22.340049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:22.350190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:22.350644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.350852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:22.351445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.352421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.353086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.381150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.382478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.383757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.384379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.571218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.587029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.593560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.597069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7797a39f-2613-4798-b867-34e1ebfb0a6e tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.251463 Jul 19 20:19:22.598201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.598974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2855/5602] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:22 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:22.606452 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc70454e-6f0f-4c40-b89e-6a3815648dae tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1271 microversion: 2.1 time: 0.276758 Jul 19 20:19:22.611702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2748/5603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:22 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:23.354671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:23.355294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:23.364088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.372576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.374376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.375050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.617480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:23.620292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:23.635958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.637241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.638242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.639041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.732602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:23.745320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0badb084-8d41-4a24-8f62-d732af888019 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1214 microversion: 2.1 time: 0.418562 Jul 19 20:19:23.746236 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2856/5604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:23 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1214 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:23.751113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:23.767994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:23.785068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.785817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.786778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.787376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.986109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:23.995310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:24.002544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:24.004062 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ef1640c-5e0e-4dcf-95dc-5dcd05cc69fb tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.390496 Jul 19 20:19:24.008228 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2749/5605] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:23 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:24.070020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:24.084470 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6dbee2fb-4462-489c-9745-11489f1404bb tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1271 microversion: 2.1 time: 0.333570 Jul 19 20:19:24.085345 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2857/5606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:23 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1271 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:24.762646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:24.763395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:24.775733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.777355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:24.785927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.786767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:25.026897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:25.028150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:25.059032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:25.076621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:25.078513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:25.079150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:25.128438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=100 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:25.392002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.410985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.414674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.434578 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df40edfb-282b-4e37-976d-edb86ca03a22 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.411769 Jul 19 20:19:25.441718 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2858/5607] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:25 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:25.449689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:25.453127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:25.482849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:25.494779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:25.501852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:25.504010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:25.781674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.797632 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6413ac70-942d-4e91-93e7-009fb2e0c7e2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 1.038875 Jul 19 20:19:25.807867 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2750/5608] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:24 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:25.892557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.916527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-847c95ec-aa0c-475e-9552-d1a7910f214c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.473374 Jul 19 20:19:25.920122 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2859/5609] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:25 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:26.455423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:26.456458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:26.468773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.474618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.475897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.478381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.677212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:26.700222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:26.706372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:26.709374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-995531aa-3bec-43d6-8d1a-fc7c3afd3bd5 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.257332 Jul 19 20:19:26.724304 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2751/5610] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:26 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:26.820086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:26.820720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:26.837035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.837481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.838279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.838767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.954535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:26.955872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:26.997150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.997941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.999316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.999778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.468313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:27.476920 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1605d6c-1df2-4650-99bc-3c900c5bfe6d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.662159 Jul 19 20:19:27.481062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2860/5611] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:26 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:27.729025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:27.730060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:27.763121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:27.763571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.764446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:27.765394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.139194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:28.157861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:28.163384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:28.173361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0b6b422-3a2d-416b-a3bf-37be0f137c01 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.448279 Jul 19 20:19:28.174511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2861/5612] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:27 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:28.211579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:28.262417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdf302f8-e33a-4257-b459-e5180b3f9215 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 1.322013 Jul 19 20:19:28.270503 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2752/5613] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:26 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:28.498242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:28.499165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:28.532091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.532540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.544107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.546851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.903718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c8af7baf-05ea-4e16-b65e-5b666f87e567 req-8c6f45a4-fa89-4b24-a666-6d2a560b08ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d70d9a5-5473-4edf-b34f-807af0cf2018", "tag": "0d8465c8-cb1e-460b-ae77-0659bde2d83b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:28.930280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c8af7baf-05ea-4e16-b65e-5b666f87e567 req-8c6f45a4-fa89-4b24-a666-6d2a560b08ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.937034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c8af7baf-05ea-4e16-b65e-5b666f87e567 req-8c6f45a4-fa89-4b24-a666-6d2a560b08ed service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.983458 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c8af7baf-05ea-4e16-b65e-5b666f87e567 req-8c6f45a4-fa89-4b24-a666-6d2a560b08ed service nova] Creating event network-changed:0d8465c8-cb1e-460b-ae77-0659bde2d83b for instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 on n-h1-843861-3 Jul 19 20:19:29.003839 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c8af7baf-05ea-4e16-b65e-5b666f87e567 req-8c6f45a4-fa89-4b24-a666-6d2a560b08ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103395 Jul 19 20:19:29.025298 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2753/5614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:29.241637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:29.242450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:29.257162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.257609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.262988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.263456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.497974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.506330 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1391d24f-99ca-41d7-9455-35228c77066f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 1.012803 Jul 19 20:19:29.506933 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2862/5615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:28 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:29.542253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:29.542874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:29.573698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.581065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.582332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.584790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.642261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.660868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.663347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.664825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b0607fd-d0ab-4d6e-9349-0206733855a6 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1365 microversion: 2.57 time: 0.471837 Jul 19 20:19:29.665962 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2754/5616] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:29 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1365 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:30.048322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:30.158179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:30.167617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54889da6-e40d-4f41-8dad-ccb25b3f424a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.640146 Jul 19 20:19:30.171711 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2863/5617] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:29 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:30.526148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:30.527986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:30.552534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.555410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.557444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.562258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.685358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:30.686110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:30.698839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:30.712473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.716473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.720633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.721268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:31.018697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.044246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.052769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.055527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9038305f-2d89-4e5b-8f22-daa45fa241f3 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1383 microversion: 2.57 time: 0.374859 Jul 19 20:19:31.058748 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2864/5618] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:30 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1383 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:31.188111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:31.189116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:31.203432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:31.204476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:31.205521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:31.206209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:31.291441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.304812 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4dc122f5-3c65-4bc2-be79-87fc84fd925d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.784139 Jul 19 20:19:31.312171 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2755/5619] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:30 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:31.457848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.473554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f60ca7e1-3162-44a7-8662-53fcbd4ae695 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.289989 Jul 19 20:19:31.475328 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2865/5620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:31 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:32.078303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.081764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.111237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.112832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.116875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.118071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.283124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:32.293462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:32.299548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:32.305460 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4fe81d6d-0055-4701-8b39-022f7dbaec57 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1371 microversion: 2.57 time: 0.233266 Jul 19 20:19:32.306056 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2756/5621] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:32.322381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.323519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.346219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.346678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.347542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.348018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.493186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.493812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.501272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.501725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.502501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.502933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.660494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:32.672862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-831066fe-e91f-4b01-8013-e45499d025a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.354852 Jul 19 20:19:32.678521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2866/5622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:32.855090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.855725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.872477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.875474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.876490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.877017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.917038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 HTTP/1.1 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2a5b5afc-9fea-4fef-ab27-67b3da4e31d2'} Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:32.924900 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:32.929104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-295c7613-b47e-4897-bcbd-37aab7f8cb21 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 404 len: 111 microversion: 2.1 time: 0.081913 Jul 19 20:19:32.934409 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2867/5623] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:19:32 2022] DELETE /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:32.947203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.949570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.966424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.968563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.969605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.971390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.000191 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 HTTP/1.1 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2a5b5afc-9fea-4fef-ab27-67b3da4e31d2'} Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:33.002130 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. Jul 19 20:19:33.007334 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:33.009795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:33.010864 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c5a7443-1120-4d0f-909e-03da6eb3588d tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2" status: 404 len: 111 microversion: 2.1 time: 0.074712 Jul 19 20:19:33.012120 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2868/5624] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/2a5b5afc-9fea-4fef-ab27-67b3da4e31d2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:33.022003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:33.022880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:33.035584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.036653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.038065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.038725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.105663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:19:33.228594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5dc1ecb4-4645-49a4-bb93-fe2085698621 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 204 len: 0 microversion: 2.1 time: 0.211030 Jul 19 20:19:33.234982 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2869/5625] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:19:33 2022] DELETE /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:19:33.236710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:33.243065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:33.244146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:33.252567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.253630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.254679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.255366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.256711 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-29170f1d-4dff-4df9-b1e2-5b4a9d0661b7 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.769950 Jul 19 20:19:33.265291 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2757/5626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:33.330105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:33.331584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:33.351743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.354875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.355696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.356233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.543177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:33.557974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:33.559859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:33.563455 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ce338dfc-eded-42bb-8ccc-3d82e8db9dff tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1371 microversion: 2.57 time: 0.237775 Jul 19 20:19:33.567047 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2758/5627] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:33 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:33.694840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:33.695762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:33.711262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.711749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.713539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:33.715635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:33.886485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:33.903312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd866bf8-b177-4999-b3aa-b0bb3780de4f tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.659709 Jul 19 20:19:33.906994 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2870/5628] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:33 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:34.033176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.046162 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f170e90-847a-4b1a-b212-4c3461b6820e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.354811 Jul 19 20:19:34.046775 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2759/5629] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:33 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:34.274675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:34.275350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:34.289330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.289788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.291531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.292815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.586071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:34.586653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:34.602206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.602408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.602753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.603538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.604002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.614043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-549202a6-7f07-40be-8e15-4bda8d70107f tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.343769 Jul 19 20:19:34.615212 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2871/5630] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:34 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:34.968610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.968610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.968610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.968610 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-410173e3-87ae-48a3-b307-5bee6cb47342 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1371 microversion: 2.57 time: 0.284150 Jul 19 20:19:34.968610 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2760/5631] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:34 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:34.972969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.072113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:35.073006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:35.098154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.098507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.102147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.102970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.521658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:35.534829 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8cceaf09-c6ef-4008-bceb-3e2c99f1e8dd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.616970 Jul 19 20:19:35.548511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2872/5632] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:34 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:35.549420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:35.565785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:35.568704 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f6e9160-664e-4b19-9b55-3e88658c8e90 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.509839 Jul 19 20:19:35.579513 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2761/5633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:35 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:35.631828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:35.632473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:35.645127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.645619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.646493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.647121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.783415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-13ad8453-5c34-4b3d-ae9a-a1b655cc9842 req-d3f1829e-9838-42c9-8781-2f6ef4c08b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93af1938-d296-462b-868d-ee10cd30b7d7", "name": "network-vif-plugged", "status": "completed", "tag": "10a1d8f0-d599-4786-a904-ba1828f9d03f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:35.806220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-13ad8453-5c34-4b3d-ae9a-a1b655cc9842 req-d3f1829e-9838-42c9-8781-2f6ef4c08b2c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.809710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-13ad8453-5c34-4b3d-ae9a-a1b655cc9842 req-d3f1829e-9838-42c9-8781-2f6ef4c08b2c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.853832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-13ad8453-5c34-4b3d-ae9a-a1b655cc9842 req-d3f1829e-9838-42c9-8781-2f6ef4c08b2c service nova] Creating event network-vif-plugged:10a1d8f0-d599-4786-a904-ba1828f9d03f for instance 93af1938-d296-462b-868d-ee10cd30b7d7 on n-h1-843861-3 Jul 19 20:19:35.861803 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-13ad8453-5c34-4b3d-ae9a-a1b655cc9842 req-d3f1829e-9838-42c9-8781-2f6ef4c08b2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084077 Jul 19 20:19:35.863534 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2762/5634] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:35.886609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:35.902035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:35.920154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.921685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.927295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.928392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.987566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.002255 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8950896-147d-492f-b0da-fe31c50db40a tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.374966 Jul 19 20:19:36.005494 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2873/5635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:35 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:36.082592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.101265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.116010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.123604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0499cdf7-c38e-4a48-b8fd-f87564f17945 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1371 microversion: 2.57 time: 0.242601 Jul 19 20:19:36.124261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2763/5636] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:35 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:19:36.559589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:36.560762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:36.587843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:36.588761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:36.602041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:36.603408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:36.604193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:36.606796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:36.608039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:36.608921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:36.609462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:36.610225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:36.685401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:37.213999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:37.224252 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d36c61d1-c830-4b32-bf5d-28743409f437 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1202 microversion: 2.1 time: 0.641368 Jul 19 20:19:37.239911 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2764/5637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:36 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1202 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:37.245223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.246085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.253608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.254397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.255391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.256094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.279223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:37.296664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-83a03482-06de-4ecb-b010-50f6a65d1453 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1512 microversion: 2.1 time: 0.742202 Jul 19 20:19:37.299542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2874/5638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:36 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:37.324008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.324825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.332799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.333807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.334824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.336386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.488426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:37.501710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:37.503751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:37.506080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48c54054-f479-44e0-b04b-df23fc5bf9dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1356 microversion: 2.57 time: 0.204040 Jul 19 20:19:37.507177 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2875/5639] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:37 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:37.532519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.533027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.544128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.547041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.550267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.550726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.596015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:19:37.770552 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-747d2c8e-7c14-459f-a564-2dcc6cb92715 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 204 len: 0 microversion: 2.57 time: 0.242856 Jul 19 20:19:37.775432 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2876/5640] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 19 20:19:37 2022] DELETE /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:19:37.784308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.785087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.805077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.805975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.820170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.821012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.278066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.291577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ad39c74-f25a-42e8-8c8e-55cf4a69bc68 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 1.050080 Jul 19 20:19:38.292820 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2765/5641] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:37 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:38.304274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2158c41a-aa5c-4b0c-b051-369c3f998bfb req-13975b54-a084-454a-b597-0c2b3173bc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d70d9a5-5473-4edf-b34f-807af0cf2018", "name": "network-vif-plugged", "status": "completed", "tag": "0d8465c8-cb1e-460b-ae77-0659bde2d83b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:38.304734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.339961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2158c41a-aa5c-4b0c-b051-369c3f998bfb req-13975b54-a084-454a-b597-0c2b3173bc06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.341450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2158c41a-aa5c-4b0c-b051-369c3f998bfb req-13975b54-a084-454a-b597-0c2b3173bc06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.341812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.343572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.344864 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c86d04ce-6f00-4e5d-aa77-9988e1113876 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1362 microversion: 2.57 time: 0.567517 Jul 19 20:19:38.359184 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2877/5642] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:37 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:38.364398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:38.365032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:38.374394 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2158c41a-aa5c-4b0c-b051-369c3f998bfb req-13975b54-a084-454a-b597-0c2b3173bc06 service nova] Creating event network-vif-plugged:0d8465c8-cb1e-460b-ae77-0659bde2d83b for instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 on n-h1-843861-3 Jul 19 20:19:38.380668 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2158c41a-aa5c-4b0c-b051-369c3f998bfb req-13975b54-a084-454a-b597-0c2b3173bc06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085821 Jul 19 20:19:38.381674 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2766/5643] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:38.400268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.400852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.401706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.406673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:38.407678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.408693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:38.431033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.434273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.437026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.440798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.654640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.668674 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef74c324-7897-42a0-bc86-c1117cda6c89 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1302 microversion: 2.1 time: 0.284823 Jul 19 20:19:38.670168 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2767/5644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:38 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:38.677445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d5e45140-35ae-4edf-b18d-f9f0a28f9972 req-a4cfed95-cd35-48f3-b1ee-afff745dbeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c643c6d-d8ee-491e-be93-eed3733f49d8", "name": "network-vif-deleted", "tag": "99aaf93f-db00-4b27-8db0-9a40e8793a84"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:38.690147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d5e45140-35ae-4edf-b18d-f9f0a28f9972 req-a4cfed95-cd35-48f3-b1ee-afff745dbeb0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.690779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d5e45140-35ae-4edf-b18d-f9f0a28f9972 req-a4cfed95-cd35-48f3-b1ee-afff745dbeb0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.710214 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d5e45140-35ae-4edf-b18d-f9f0a28f9972 req-a4cfed95-cd35-48f3-b1ee-afff745dbeb0 service nova] Creating event network-vif-deleted:99aaf93f-db00-4b27-8db0-9a40e8793a84 for instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 on n-h2-843861-3 Jul 19 20:19:38.719321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d5e45140-35ae-4edf-b18d-f9f0a28f9972 req-a4cfed95-cd35-48f3-b1ee-afff745dbeb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046878 Jul 19 20:19:38.720810 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2768/5645] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:38.761466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:38.771659 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60fc7495-6b14-4a09-a830-3f426e991062 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1388 microversion: 2.1 time: 0.410144 Jul 19 20:19:38.772689 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2878/5646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:38 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1388 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:38.789571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:38.790472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:38.799450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.804413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.806435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:38.807027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.068031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.080706 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a734b1e2-45eb-4138-888a-6209801c64f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1388 microversion: 2.1 time: 0.295801 Jul 19 20:19:39.081663 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2769/5647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:38 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1388 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:39.098686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:39.099497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:39.103450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:39.115729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.116052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.117108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.117898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.310419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:39.311055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:39.320294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.320688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.321481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.324929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.549196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.568560 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22c40042-b789-4f37-a6e0-35fd1205934f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1388 microversion: 2.1 time: 0.474290 Jul 19 20:19:39.570902 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2879/5648] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:39 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1388 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:39.576073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:39.576919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:39.625826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.628846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.629907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.630461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.673713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.683742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-66f5398b-ae07-4089-b3bc-107dd23f7a51 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1313 microversion: 2.1 time: 0.378162 Jul 19 20:19:39.697156 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2770/5649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:39 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:39.703081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:39.710245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:39.727975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.733791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.734927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.735588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.782060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.783378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.784422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lazy-loading 'fault' on Instance uuid 1c643c6d-d8ee-491e-be93-eed3733f49d8 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:19:39.879203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.882316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac019c69b5f74b218c26fc1294676e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdcae3b8c24b47acab1c69e5b6a12a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.891736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e55f12c-9638-43d9-9519-439a784c3af5 tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 200 len: 1307 microversion: 2.1 time: 0.193134 Jul 19 20:19:39.893074 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2771/5650] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:39 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:39.899996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:39.900810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:39.905641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.907481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.910521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.911279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.912325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:39.913007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:39.920928 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66da1eac-b387-4615-97b1-3d4cc87347dd tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1362 microversion: 2.57 time: 0.336631 Jul 19 20:19:39.924067 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2880/5651] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:39 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:39.968748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:19:40.134006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-892dafde-d030-4777-9863-bf6fd5d836da tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 204 len: 0 microversion: 2.1 time: 0.239005 Jul 19 20:19:40.135332 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2772/5652] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:19:39 2022] DELETE /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:19:40.145369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:40.153422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:40.184221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.191522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.192680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.193299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.577471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:40.586002 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-45fec5a9-c983-4b81-8d28-b1b1a21b98fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1394 microversion: 2.1 time: 0.444747 Jul 19 20:19:40.596715 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2881/5653] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:40 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1394 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:40.705463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:40.706332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:40.723497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.724161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.726759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.728911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.910575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:40.912897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] [instance: 1c643c6d-d8ee-491e-be93-eed3733f49d8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:40.932198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.932927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.941401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.944092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.010181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] HTTP exception thrown: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Request method failure captured: Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 HTTP/1.1 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xCNAwkchHaKsj7QrI1wT9HHoKHAqGUpXi8slP1IUPoxdHA5qXlqD7D9NqH_37WI1ylLRRrlc6gvbRTPXXzkLPYATYfS18QZfG5zO-Tl1GV6c7hUn01dWZcNnG5xanDugAp7BtLWyNwjSmuzYiwoGFvsLn-XUuK79f-yzJzcCPBaxkc Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bdcae3b8c24b47acab1c69e5b6a12a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bdcae3b8c24b47acab1c69e5b6a12a32 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1042425535 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ac019c69b5f74b218c26fc1294676e19 Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1042425535-project Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '1c643c6d-d8ee-491e-be93-eed3733f49d8'} Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:41.013528 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. Jul 19 20:19:41.019403 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:19:41.023917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] Returning 404 to user: Instance 1c643c6d-d8ee-491e-be93-eed3733f49d8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:41.025332 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4740456c-41f5-440a-af02-99178bb3eabd tempest-ServersNegativeTestJSON-1042425535 tempest-ServersNegativeTestJSON-1042425535-project] 10.222.0.33 "GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8" status: 404 len: 111 microversion: 2.1 time: 0.119847 Jul 19 20:19:41.027228 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2882/5654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:40 2022] GET /compute/v2.1/servers/1c643c6d-d8ee-491e-be93-eed3733f49d8 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:41.036782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:41.037842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:41.048217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.048939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.049933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.050595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.061221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.091873 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4e7b834-8927-402a-8c82-7c6ea3a09b5b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1463 microversion: 2.1 time: 0.390365 Jul 19 20:19:41.092121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.093606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.094222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lazy-loading 'fault' on Instance uuid a2469674-4ebb-407f-a336-03b7d66e9890 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:19:41.105999 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2773/5655] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:40 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1463 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:41.114854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "097cba90-4a6c-48e8-80fc-225c62fbd7a3", "device": "/dev/sdb"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:41.116446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:41.129500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.130078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.133234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.135522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.243482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.252726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.264726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed5484e921f40659ad29259e2b64c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506f2a5e2c94453296501b4714b2503c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.265848 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3c6be76-6923-4e17-a6e9-ac2c53f06de8 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 200 len: 1367 microversion: 2.57 time: 0.237028 Jul 19 20:19:41.276062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2883/5656] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:41 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:19:41.605783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:41.607151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:41.620904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.622728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.624645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.625491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.834921 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0d6cf67-8a5f-4465-b671-06d86c37ad4c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "POST /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724859 Jul 19 20:19:41.836128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2774/5657] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:19:41 2022] POST /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:42.288962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:42.289664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] [instance: a2469674-4ebb-407f-a336-03b7d66e9890] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:42.293372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:42.316766 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67c92ffc-90b2-447d-b663-36c19ddcdb5e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1394 microversion: 2.1 time: 0.716977 Jul 19 20:19:42.319006 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2884/5658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:41 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1394 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:42.319739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:42.322560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:42.323525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:42.324795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:42.356998 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] HTTP exception thrown: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Request method failure captured: Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 HTTP/1.1 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xGrjyxkI2fhwb0Sp1pbvipMX7J8n9cAC1fVJ3bYsAUYxSZM2mAGtUCm0pJFCqsrmBQoUezBN80cbeJguduen2Ln9LnHdy1F857w1mBkOjETFoZodaSoYSc76hf2UCLBqby_h4JNlY-vhfHFt2ygdQasEPw8m_c4KsS3oXEgaDmv-Ao Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Openstack-Nova-Api-Version: 2.57 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 506f2a5e2c94453296501b4714b2503c Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerShowV257Test-489978500 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/506f2a5e2c94453296501b4714b2503c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/506f2a5e2c94453296501b4714b2503c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/506f2a5e2c94453296501b4714b2503c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_506f2a5e2c94453296501b4714b2503c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerShowV257Test-489978500 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 506f2a5e2c94453296501b4714b2503c Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerShowV257Test-489978500 Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerShowV257Test-489978500-project Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: bed5484e921f40659ad29259e2b64c4b Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerShowV257Test-489978500-project Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a2469674-4ebb-407f-a336-03b7d66e9890'} Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:42.366936 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. Jul 19 20:19:42.377345 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:19:42.379426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] Returning 404 to user: Instance a2469674-4ebb-407f-a336-03b7d66e9890 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:42.380730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7515091b-f6c0-4213-b240-2bc6061e4ce4 tempest-ServerShowV257Test-489978500 tempest-ServerShowV257Test-489978500-project] 10.222.0.33 "GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890" status: 404 len: 111 microversion: 2.57 time: 0.095946 Jul 19 20:19:42.381794 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2775/5659] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 19 20:19:42 2022] GET /compute/v2.1/servers/a2469674-4ebb-407f-a336-03b7d66e9890 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:19:43.334046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:43.334640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:43.346546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:43.347041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:43.347843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:43.350121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:43.671122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:43.684520 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57fd386d-593d-4251-99cd-4eff703cdb65 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1352 microversion: 2.1 time: 0.351954 Jul 19 20:19:43.689595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2885/5660] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:43 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:43.978063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-21ede4fe-999f-4012-afa3-d76625a9574e req-a8140530-4079-41df-8d38-cb7d2790e38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93af1938-d296-462b-868d-ee10cd30b7d7", "name": "network-vif-deleted", "tag": "10a1d8f0-d599-4786-a904-ba1828f9d03f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:43.999050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-21ede4fe-999f-4012-afa3-d76625a9574e req-a8140530-4079-41df-8d38-cb7d2790e38a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:44.002037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-21ede4fe-999f-4012-afa3-d76625a9574e req-a8140530-4079-41df-8d38-cb7d2790e38a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:44.032795 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-21ede4fe-999f-4012-afa3-d76625a9574e req-a8140530-4079-41df-8d38-cb7d2790e38a service nova] Creating event network-vif-deleted:10a1d8f0-d599-4786-a904-ba1828f9d03f for instance 93af1938-d296-462b-868d-ee10cd30b7d7 on n-h1-843861-3 Jul 19 20:19:44.050191 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-21ede4fe-999f-4012-afa3-d76625a9574e req-a8140530-4079-41df-8d38-cb7d2790e38a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074275 Jul 19 20:19:44.054969 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2776/5661] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:44.709444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:44.710267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:44.736023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:44.737098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:44.738170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:44.738753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:44.951523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:44.964092 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32872415-0891-4141-b3f7-f72ef8694713 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.261348 Jul 19 20:19:44.966688 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2886/5662] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:44 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:45.986764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:45.988125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:46.006381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:46.008389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:46.009439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:46.011995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:46.285046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:46.310485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db58af60-9c22-4e00-8c11-5e24512a5acd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.320846 Jul 19 20:19:46.313409 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2777/5663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:45 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:47.339512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:47.342769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:47.377783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:47.378523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:47.379517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:47.380448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:47.872319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:47.888997 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b45d093d-9b9c-4234-84da-ca072790e674 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.556045 Jul 19 20:19:47.892840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2887/5664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:47 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:48.908868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:48.909514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:48.912927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:48.935115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:48.935631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:48.936918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:48.937363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:48.980498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:49.879184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:49.915529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65fa66d9-82b3-4924-a7a5-638785accb9a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 1.010830 Jul 19 20:19:49.934747 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2778/5665] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:48 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:50.933701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:50.934941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:50.948208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:50.951619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:50.954112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:50.954734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:51.171709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:51.187100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-233643a3-c390-4bb2-841f-d3d74d47933d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.253056 Jul 19 20:19:51.187932 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2888/5666] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:50 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:52.206465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:52.207098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:52.224786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:52.229682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:52.231834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:52.233757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:52.440695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:52.455707 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f78228ba-5004-4ae4-a542-c49d7afea806 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.254745 Jul 19 20:19:52.457654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2779/5667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:52 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:53.475468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:53.476124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:53.494508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:53.494977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:53.500767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:53.501231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:54.014525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:54.027598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:54.035897 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a06de5b-e1c3-4078-9784-ab9f9c78283b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.564580 Jul 19 20:19:54.037678 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2889/5668] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:53 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:55.053714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:55.055231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:55.069853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:55.079864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:55.080738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:55.081181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:55.624583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:55.658462 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b6d9cc71-04f4-47f9-b9bc-f5ab3ecb9d38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.608476 Jul 19 20:19:55.660867 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2780/5669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:55 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:56.679900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:56.680429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:56.706557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:56.711228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:56.712386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:56.713850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:56.862975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:56.874934 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.200817 Jul 19 20:19:56.875545 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2890/5670] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:56 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:57.891971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:57.892600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:57.912790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:57.913717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:57.914852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:57.915351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:58.027045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:58.037625 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d48d071d-2c72-40d1-9b86-0b638257e295 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.149661 Jul 19 20:19:58.038600 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2781/5671] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:57 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:58.123296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:58.127132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c450a1fc-6e17-4081-bd16-ca302f0c31c9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006233 Jul 19 20:19:58.128382 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2891/5672] 10.222.0.33 () {56 vars in 885 bytes} [Tue Jul 19 20:19:58 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 19 20:19:59.056525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:59.057209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:59.077772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:59.078227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:59.079010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:59.079446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:59.244104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:59.262078 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-167e9ebb-12d9-4cc8-a49a-77e09ef80293 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.206808 Jul 19 20:19:59.272154 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2782/5673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:59 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:00.310173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:00.311650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:00.346981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:00.351089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:00.352058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:00.352509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:00.548848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:00.566968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f603edc6-4715-4fb7-b1b8-a690823bcf7c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 200 len: 1187 microversion: 2.1 time: 0.287105 Jul 19 20:20:00.569150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2892/5674] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:00 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 1187 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:01.586913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:01.587536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:01.599497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:01.601665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:01.602547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:01.604419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:01.644041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 HTTP/1.1 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93af1938-d296-462b-868d-ee10cd30b7d7'} Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:01.646019 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:01.650180 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ee54f1f-071a-4def-b174-d73d228d4ad3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 404 len: 111 microversion: 2.1 time: 0.065775 Jul 19 20:20:01.656818 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2783/5675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:01 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:01.925757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b4eaef0-03d8-4827-b767-839d90d8d6ac tempest-ComputeTenantNetworksTest-1444140754 tempest-ComputeTenantNetworksTest-1444140754-project] Calling method '.version_select at 0x7fb88d1feee0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:02.104086 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b4eaef0-03d8-4827-b767-839d90d8d6ac tempest-ComputeTenantNetworksTest-1444140754 tempest-ComputeTenantNetworksTest-1444140754-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.506448 Jul 19 20:20:02.105120 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2893/5676] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 20:20:01 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:20:02.115258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2826dd4c-1dfd-4161-a9b8-30ed0d8d6bd8 tempest-ComputeTenantNetworksTest-1444140754 tempest-ComputeTenantNetworksTest-1444140754-project] Calling method '.version_select at 0x7fb88ce49430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:02.520044 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2826dd4c-1dfd-4161-a9b8-30ed0d8d6bd8 tempest-ComputeTenantNetworksTest-1444140754 tempest-ComputeTenantNetworksTest-1444140754-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/332d5e3e-8e17-411d-a739-bdf6be7578d1" status: 200 len: 140 microversion: 2.1 time: 0.408876 Jul 19 20:20:02.526120 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2784/5677] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:20:02 2022] GET /compute/v2.1/os-tenant-networks/332d5e3e-8e17-411d-a739-bdf6be7578d1 => generated 140 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:10.099577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Action: 'create', calling method: .version_select at 0x7fb88d3e4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1073288412", "metadata": {"Type": "work"}}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:10.347061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:10.557383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=13 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:10.784013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:10.785242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:10.815863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.823050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:10.824881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.827793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:10.892914 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 HTTP/1.1 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93af1938-d296-462b-868d-ee10cd30b7d7'} Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:20:10.897719 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:10.902920 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:10.905764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:10.909489 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15b7cad0-080d-480f-a14f-73f2948dba26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 404 len: 111 microversion: 2.1 time: 0.135055 Jul 19 20:20:10.916092 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2785/5678] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:20:10 2022] DELETE /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:20:10.929331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:10.931699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 93af1938-d296-462b-868d-ee10cd30b7d7] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:10.949018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.952392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:10.953619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.954292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:11.006384 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 HTTP/1.1 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '93af1938-d296-462b-868d-ee10cd30b7d7'} Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:11.010537 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. Jul 19 20:20:11.015443 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:11.020580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 93af1938-d296-462b-868d-ee10cd30b7d7 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:11.022659 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be5fa87a-9063-4159-85f0-9b806ca598fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7" status: 404 len: 111 microversion: 2.1 time: 0.105282 Jul 19 20:20:11.029327 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2786/5679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:10 2022] GET /compute/v2.1/servers/93af1938-d296-462b-868d-ee10cd30b7d7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:11.030414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.860995 Jul 19 20:20:11.031082 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2894/5680] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 19 20:20:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1863 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 20:20:11.050295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88d458700>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.284193 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.245365 Jul 19 20:20:11.289163 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2787/5681] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:11.493487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.495496 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001898 Jul 19 20:20:11.495761 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2895/5682] 10.222.0.33 () {56 vars in 885 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 20:20:11.502478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.503846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001864 Jul 19 20:20:11.504772 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2788/5683] 10.222.0.33 () {54 vars in 1034 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 19 20:20:11.512833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.515176 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d906114d-f7e9-4871-898d-72b68a47b44d tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002776 Jul 19 20:20:11.522404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2896/5684] 10.222.0.33 () {54 vars in 1040 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/v2.1/ => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:11.523612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.524804 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-230a532c-4f23-4b3b-9245-5bf103d0ba78 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001521 Jul 19 20:20:11.525762 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2789/5685] 10.222.0.33 () {56 vars in 885 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 19 20:20:12.296765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67962832-05e3-404d-b37d-1def725db9bf tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88e4caf70>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:12.454336 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67962832-05e3-404d-b37d-1def725db9bf tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.161307 Jul 19 20:20:12.459838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2897/5686] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:12 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:13.469262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2bc63c5-8968-495d-967a-b054d0f91727 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88cb470d0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:13.585202 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2bc63c5-8968-495d-967a-b054d0f91727 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.122288 Jul 19 20:20:13.586612 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2790/5687] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:13 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:14.604552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b5366242-75c8-423d-8f35-2d9522005014 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88fb99d30>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:14.809703 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b5366242-75c8-423d-8f35-2d9522005014 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 354 microversion: 2.1 time: 0.213939 Jul 19 20:20:14.810508 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2898/5688] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:14 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:14.825370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31c101f4-e5ad-4a93-9bcb-01ab719cfd53 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88e20d5e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:14.941237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31c101f4-e5ad-4a93-9bcb-01ab719cfd53 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 354 microversion: 2.1 time: 0.123147 Jul 19 20:20:14.942848 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2791/5689] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:14 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:20:14.955548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f35b6ae9-2e91-40b2-b548-24f2d8c949f8 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88d1b9b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:15.160288 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f35b6ae9-2e91-40b2-b548-24f2d8c949f8 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 202 len: 0 microversion: 2.1 time: 0.209729 Jul 19 20:20:15.161479 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2899/5690] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:20:14 2022] DELETE /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:20:15.171486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9808df38-7ef6-47ad-a83d-5f598bffebeb tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88cb478b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:15.375255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9808df38-7ef6-47ad-a83d-5f598bffebeb tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.209819 Jul 19 20:20:15.376223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2792/5691] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:15 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:16.394230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca1368dc-a30d-4111-a31a-b7a4a9beb802 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88d1fee50>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:16.563061 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca1368dc-a30d-4111-a31a-b7a4a9beb802 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.177220 Jul 19 20:20:16.564422 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2900/5692] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:16 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:17.580051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-18e6db88-bb79-44e2-a958-11b8fcb51cd0 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88d44ab80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:17.736764 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-18e6db88-bb79-44e2-a958-11b8fcb51cd0 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.163058 Jul 19 20:20:17.742077 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2793/5693] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:17 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:18.753629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e8e9865c-219c-4c92-a652-e1220a3a4f8e tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb89318cb80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:18.824003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65491ca2-ef92-411b-91c8-59add7a77d99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Action: 'create', calling method: .version_select at 0x7fb88e291790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1717613128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEgOjJdpmrPMfyA4g0xGuTR+/ZjxSw1yjgdRDDD2mOibtcovRQp2548fpADXHBYZwt6BzAJXhR4x1OXaLgOqwq10ZsCPrWQHE+Oq3wimh/JCJTq3oWUdkAXlYizMVi++Q=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:18.866335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-65491ca2-ef92-411b-91c8-59add7a77d99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Getting quotas for project be10a3d37c1048569e927507f0b8aae1. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:20:18.879655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-65491ca2-ef92-411b-91c8-59add7a77d99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Getting quotas for user 87438b5e69e64bef9df0a7ab3e692ac9 and project be10a3d37c1048569e927507f0b8aae1. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:20:18.900318 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e8e9865c-219c-4c92-a652-e1220a3a4f8e tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.154513 Jul 19 20:20:18.901270 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2901/5694] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:18 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:18.928630 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65491ca2-ef92-411b-91c8-59add7a77d99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.112824 Jul 19 20:20:18.936787 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2794/5695] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:20:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:19.921966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-caeb0a06-a418-4696-a5f5-5f71537766d0 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88d254040>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:20.142622 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-caeb0a06-a418-4696-a5f5-5f71537766d0 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 200 len: 353 microversion: 2.1 time: 0.232572 Jul 19 20:20:20.143625 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2902/5696] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:19 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:21.156325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbb5a61a-cec4-42f4-a73e-77dbbfa0fad1 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Calling method '.version_select at 0x7fb88ca7c040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:21.178260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=33 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:21.257286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fbb5a61a-cec4-42f4-a73e-77dbbfa0fad1 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] HTTP exception thrown: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbb5a61a-cec4-42f4-a73e-77dbbfa0fad1 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Request method failure captured: Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a HTTP/1.1 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xH5v3ewizJxlYM8Jttv79uiEig3Ypz4JtT_4ThXziLyzxnlGJL9tKcRAHjRWHxoWFgDQvn1ayWrr4G0yX_g3PaaePU3VYhzRx6dl23mM54ZiurEELVq4TvlCAj8ezyzjUDamYwdlnPtlWELavFhkcQU3eIL2JycgPFhPVVXst2MaRY Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: ba988cde87bd472cb0ae85e6e3c950a4 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesGetTestJSON-1246802399 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba988cde87bd472cb0ae85e6e3c950a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba988cde87bd472cb0ae85e6e3c950a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba988cde87bd472cb0ae85e6e3c950a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba988cde87bd472cb0ae85e6e3c950a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesGetTestJSON-1246802399 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: ba988cde87bd472cb0ae85e6e3c950a4 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesGetTestJSON-1246802399 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesGetTestJSON-1246802399-project Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 0371e702bd934878baa64857f5e71c83 Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesGetTestJSON-1246802399-project Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f01640b6-8e69-437a-94be-c3b1ff96291a'} Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. (HTTP 404) (Request-ID: req-36422c6a-802e-41d7-9ef9-9ae338243879) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:20:21.259882 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. Jul 19 20:20:21.265357 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:21.268235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbb5a61a-cec4-42f4-a73e-77dbbfa0fad1 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] Returning 404 to user: Volume f01640b6-8e69-437a-94be-c3b1ff96291a could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:21.269801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbb5a61a-cec4-42f4-a73e-77dbbfa0fad1 tempest-VolumesGetTestJSON-1246802399 tempest-VolumesGetTestJSON-1246802399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a" status: 404 len: 109 microversion: 2.1 time: 0.117790 Jul 19 20:20:21.273273 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2795/5697] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:21 2022] GET /compute/v2.1/os-volumes/f01640b6-8e69-437a-94be-c3b1ff96291a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:25.052457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-69945359", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7ff56a93-228a-484d-8e73-79cc02ac3b18", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1717613128", "security_groups": [{"name": "tempest-secgroup-smoke-369818125"}], "networks": [{"uuid": "b418ee01-ff13-4753-b2dd-363868039dc4"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:25.481444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] validate_networks() for [('b418ee01-ff13-4753-b2dd-363868039dc4', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:20:28.356063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f18cb6f-8b52-4140-8ba2-7135feb3d7e2 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Action: 'create', calling method: .version_select at 0x7fb88ca7cb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1373529165", "metadata": {"Type": "work"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f18cb6f-8b52-4140-8ba2-7135feb3d7e2 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 122 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1373529165", "metadata": {"Type": "work"}}} Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1373529165', 'metadata': {'Type': 'work'}}}} Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:20:28.359922 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.365668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f18cb6f-8b52-4140-8ba2-7135feb3d7e2 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:28.370662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f18cb6f-8b52-4140-8ba2-7135feb3d7e2 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.600845 Jul 19 20:20:28.396005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2796/5698] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 19 20:20:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 630 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:20:28.412591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-605b3096-2a51-4290-a608-f4290ba3e4fb tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Action: 'create', calling method: .version_select at 0x7fb88ca35430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-105653986", "metadata": {"Type": "work"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-605b3096-2a51-4290-a608-f4290ba3e4fb tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 119 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-105653986", "metadata": {"Type": "work"}}} Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-105653986', 'metadata': {'Type': 'work'}}}} Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '0' Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:20:28.423200 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:20:28.430729 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.433972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-605b3096-2a51-4290-a608-f4290ba3e4fb tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:28.438325 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-605b3096-2a51-4290-a608-f4290ba3e4fb tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040911 Jul 19 20:20:28.439328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2797/5699] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 19 20:20:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:20:28.456981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75e5f982-55b0-4e27-a610-3457f771b693 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Action: 'create', calling method: .version_select at 0x7fb88ca2ad30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1806117540", "metadata": {"Type": "work"}}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75e5f982-55b0-4e27-a610-3457f771b693 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 119 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1806117540", "metadata": {"Type": "work"}}} Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1806117540', 'metadata': {'Type': 'work'}}}} Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:20:28.460990 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:20:28.465851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.473100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75e5f982-55b0-4e27-a610-3457f771b693 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:28.475952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75e5f982-55b0-4e27-a610-3457f771b693 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028128 Jul 19 20:20:28.479224 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2798/5700] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 19 20:20:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:20:28.491724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20023ed5-6b33-4313-97cb-b10dcabf06f5 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Calling method '.version_select at 0x7fb88ca35040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:28.582379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-20023ed5-6b33-4313-97cb-b10dcabf06f5 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] HTTP exception thrown: Volume tempest-invalid-1743518388 could not be found. Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20023ed5-6b33-4313-97cb-b10dcabf06f5 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1743518388 HTTP/1.1 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume tempest-invalid-1743518388 could not be found. Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'tempest-invalid-1743518388'} Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1743518388 could not be found. (HTTP 404) (Request-ID: req-c5e4e2db-f3ee-4471-b80f-0eb08004fb1b) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:28.586569 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1743518388 could not be found. Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1743518388 could not be found. Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1743518388 could not be found. Jul 19 20:20:28.592670 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.598960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20023ed5-6b33-4313-97cb-b10dcabf06f5 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 404 to user: Volume tempest-invalid-1743518388 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:28.601655 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20023ed5-6b33-4313-97cb-b10dcabf06f5 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1743518388" status: 404 len: 99 microversion: 2.1 time: 0.115236 Jul 19 20:20:28.602756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2799/5701] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:20:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1743518388 => generated 99 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:20:28.624935 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57057a99-c2a1-48f6-a9bc-f810d262df32 tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016002 Jul 19 20:20:28.629677 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2800/5702] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 19 20:20:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 19 20:20:28.642659 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffefc31b-97a3-4acc-8895-0b89b20b80ce tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010351 Jul 19 20:20:28.643541 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2801/5703] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 19 20:20:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 20:20:28.656609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b17ea246-6f98-4ca4-8177-07659e087eca tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Calling method '.version_select at 0x7fb88ca2af70>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:28.727688 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-b17ea246-6f98-4ca4-8177-07659e087eca tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] HTTP exception thrown: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b17ea246-6f98-4ca4-8177-07659e087eca tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/os-volumes/17c142ff-5242-435f-89b7-e7e66236647c HTTP/1.1 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '17c142ff-5242-435f-89b7-e7e66236647c'} Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. (HTTP 404) (Request-ID: req-6a8952cf-7472-4a8f-b22b-5e0b1e951e2d) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:20:28.734467 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. Jul 19 20:20:28.747752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:28.757591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:20:28.757591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:20:28.757591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:20:28.757591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:20:28.757591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:20:28.758823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b17ea246-6f98-4ca4-8177-07659e087eca tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 404 to user: Volume 17c142ff-5242-435f-89b7-e7e66236647c could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:28.758823 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b17ea246-6f98-4ca4-8177-07659e087eca tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/17c142ff-5242-435f-89b7-e7e66236647c" status: 404 len: 109 microversion: 2.1 time: 0.107600 Jul 19 20:20:28.758823 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2802/5704] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 20:20:28 2022] DELETE /compute/v2.1/os-volumes/17c142ff-5242-435f-89b7-e7e66236647c => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:28.796383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0bd89bbe-3861-473f-b6e6-b28e3808666a tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Calling method '.version_select at 0x7fb88ca358b0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:28.813016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:28.840264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:28.841284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:28.841733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:28.890829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:28.916388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Getting quotas for project be10a3d37c1048569e927507f0b8aae1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:20:28.918606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:28.933665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Getting quotas for user 87438b5e69e64bef9df0a7ab3e692ac9 and project be10a3d37c1048569e927507f0b8aae1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:20:29.018446 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0bd89bbe-3861-473f-b6e6-b28e3808666a tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] HTTP exception thrown: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0bd89bbe-3861-473f-b6e6-b28e3808666a tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Request method failure captured: Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/os-volumes/f15699d8-98dc-4e94-944e-ceb2ab20ffab HTTP/1.1 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xILDXZuRb3mIx62fvCOTJGoS-Wvxj4lwa-DNZBh2jfLCZKWfC4phvPdRcizfHwsE9yuT6pZSiR01c8K5WSNi3mz7gvAv3wc3x_nKqomdjkZ6R23mkmgFNl3bgf06cFwY5BoeDczTCNwNJjK8RX7bYrvFkQVeroQOdclXiq1OoqDpHM Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d57a67210bed4c41925eea88a14bbea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: d57a67210bed4c41925eea88a14bbea5 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesNegativeTest-938630914 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 9c4cdaf0f08b48248ddc21028cbf5a35 Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesNegativeTest-938630914-project Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: method: Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: exception: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f15699d8-98dc-4e94-944e-ceb2ab20ffab'} Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. (HTTP 404) (Request-ID: req-b1f13507-4fff-45b4-9e41-21438f370ec9) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:20:29.020546 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. Jul 19 20:20:29.024451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:20:29.029304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0bd89bbe-3861-473f-b6e6-b28e3808666a tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] Returning 404 to user: Volume f15699d8-98dc-4e94-944e-ceb2ab20ffab could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:29.031730 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0bd89bbe-3861-473f-b6e6-b28e3808666a tempest-VolumesNegativeTest-938630914 tempest-VolumesNegativeTest-938630914-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f15699d8-98dc-4e94-944e-ceb2ab20ffab" status: 404 len: 109 microversion: 2.1 time: 0.266043 Jul 19 20:20:29.033319 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2803/5705] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 19 20:20:28 2022] GET /compute/v2.1/os-volumes/f15699d8-98dc-4e94-944e-ceb2ab20ffab => generated 109 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:29.148111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:20:29.150725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ff56a93-228a-484d-8e73-79cc02ac3b18',volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:20:29.553406 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-963f8f28-9084-4a3e-a12f-3abdaeb3f906 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.507173 Jul 19 20:20:29.554618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2903/5706] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:20:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 4509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:20:29.566483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0999ce0-18d8-4866-84be-c2bd441e03ed tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:29.567155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0999ce0-18d8-4866-84be-c2bd441e03ed tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:29.824843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0999ce0-18d8-4866-84be-c2bd441e03ed tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:29.842147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0999ce0-18d8-4866-84be-c2bd441e03ed tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1097 microversion: 2.1 time: 0.281121 Jul 19 20:20:29.859905 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2804/5707] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:29 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1097 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:30.866480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7067e2d1-d52a-4ba6-a5b3-4c409871cc4f tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:30.867713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7067e2d1-d52a-4ba6-a5b3-4c409871cc4f tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:31.263312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7067e2d1-d52a-4ba6-a5b3-4c409871cc4f tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:31.296154 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7067e2d1-d52a-4ba6-a5b3-4c409871cc4f tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1097 microversion: 2.1 time: 0.433649 Jul 19 20:20:31.301271 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2904/5708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:30 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1097 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:32.318157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:32.318870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:32.352280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:32.362129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:32.366131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:32.368283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:33.348901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:33.397699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-972c674f-9be2-44e7-8898-0e29292f4671 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1203 microversion: 2.1 time: 1.080950 Jul 19 20:20:33.404036 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2805/5709] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:32 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1203 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:34.423119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:34.424537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:34.444125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:34.452832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:34.454531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:34.457378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:34.654765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:34.666399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c6c18df9-07bb-4499-a5c1-2133b1f511f7 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1213 microversion: 2.1 time: 0.248069 Jul 19 20:20:34.669615 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2905/5710] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:34 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:35.688039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:35.689184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:35.712925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:35.714884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:35.717062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:35.723578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:37.477426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:37.489139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ba5281f-a3fd-46e0-95eb-fbbedd1888ce tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 1.804564 Jul 19 20:20:37.493652 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2806/5711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:35 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:38.349560 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:20:38.350400 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:20:38.515202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:38.520317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:38.538945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:38.539923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:38.541105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:38.541787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:38.895440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:38.945746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:38.965099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7d30261-dceb-47b0-a2ac-5b84e0950b17 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.456422 Jul 19 20:20:38.973426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2906/5712] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:38 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:39.982401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:39.984410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:39.988564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:40.011948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:40.012644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:40.015588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:40.016419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:41.555896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:41.564301 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f16df4a-6727-4a39-93c7-520db193a208 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 1.585660 Jul 19 20:20:41.567455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2807/5713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:39 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:42.440797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:42.584056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:42.585569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:42.605175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:42.614592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:42.620101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:42.621489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:43.111986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:43.122171 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c3dd4cb4-2c03-48c9-898b-456272767f53 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.542322 Jul 19 20:20:43.135705 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2808/5714] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:42 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:20:43.637135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-83094d9b-7969-4d1b-a8e3-0caf87deb91f req-8a1c2db0-a69a-4190-9b40-34b408b24c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:43.663170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-83094d9b-7969-4d1b-a8e3-0caf87deb91f req-8a1c2db0-a69a-4190-9b40-34b408b24c36 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:43.664326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-83094d9b-7969-4d1b-a8e3-0caf87deb91f req-8a1c2db0-a69a-4190-9b40-34b408b24c36 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:43.683185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-83094d9b-7969-4d1b-a8e3-0caf87deb91f req-8a1c2db0-a69a-4190-9b40-34b408b24c36 service nova] Creating event network-changed:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:20:43.704792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-83094d9b-7969-4d1b-a8e3-0caf87deb91f req-8a1c2db0-a69a-4190-9b40-34b408b24c36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.266823 Jul 19 20:20:43.706865 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2907/5715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:44.140475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:44.141923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:44.161306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:44.164477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:44.169527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:44.180478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:44.705815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:44.724578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b458d52-0c8d-4edd-bb9a-8cbf2e5b4621 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.588410 Jul 19 20:20:44.751436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2809/5716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:44 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:45.766214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:45.768333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:45.831518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:45.832695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:45.841829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:45.847975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:46.277223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:46.288965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9002ab42-982d-4ec1-bc92-b2305d52fdfb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.527432 Jul 19 20:20:46.290434 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2908/5717] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:45 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:47.310964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:47.311841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:47.347109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:47.352171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:47.357084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:47.363248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:47.881869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:47.894347 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-092ec8f7-de9b-4535-a2a9-83fd8d6a2ef6 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.590136 Jul 19 20:20:47.912261 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2810/5718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:47 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:48.913748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:48.914904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:48.938439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:48.943706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:48.948274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:48.949108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.475966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:49.487270 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-14ca84bd-b7f5-4352-92f3-c5df49d02d93 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.579833 Jul 19 20:20:49.494227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2909/5719] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:48 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:50.504963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:50.505943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:50.528647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.540101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.541356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.542208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:51.057760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:51.067392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26d3ed5f-8fe9-4479-a2cc-c737923466fb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.566714 Jul 19 20:20:51.077616 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2811/5720] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:50 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:52.089017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:52.089650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:52.117525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:52.118710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:52.123184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:52.124414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:52.626491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:52.644470 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05d23239-37fa-438f-a338-879f5e1b6155 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.559677 Jul 19 20:20:52.659208 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2910/5721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:52 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:53.665550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:53.666736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:53.683319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.684140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:53.685248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.686546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:54.307345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:54.322443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-08545404-d8b0-456c-a547-4974988cbba2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 0.660903 Jul 19 20:20:54.323051 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2812/5722] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:53 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:55.341049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:55.341676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:55.364840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:55.366476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:55.367990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:55.370113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:55.370582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:55.433068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=35 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:56.557677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:56.571013 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b6d927f-9beb-4e50-8c1c-7f701d270e7b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1280 microversion: 2.1 time: 1.230557 Jul 19 20:20:56.571673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2911/5723] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:55 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1280 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:57.589054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:57.589789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:57.618753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:57.619537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:57.620572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:57.625605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:58.717463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:58.731032 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e419cd34-7083-40a8-bdfc-47002a57a0c8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 1.146138 Jul 19 20:20:58.731630 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2813/5724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:57 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:59.749421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:59.750044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:59.762449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:59.763165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:59.768028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:59.768684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:01.375274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:01.391388 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43ecedb7-b108-46fa-aee1-67bba24a69be tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 1.646058 Jul 19 20:21:01.402819 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2912/5725] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:59 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:02.410575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:02.412308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:02.429807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=23 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:02.452686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:02.454988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:02.459429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:02.460071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:02.485656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=55 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:02.896619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:02.905205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6eaccd5e-83b6-4e0b-ab8b-9f80136e4b62 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.499992 Jul 19 20:21:02.913897 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2814/5726] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:02 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:03.924851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:03.925940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:03.945776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:03.949243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:03.953193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:03.954521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:04.568398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:04.601053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b56afc0-3d7f-42a6-996f-b5cfd0045357 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.682299 Jul 19 20:21:04.603029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2913/5727] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:03 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:05.618646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:05.620035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:05.644559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:05.647077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:05.653807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:05.655636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:06.088635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:06.101450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f209229-648c-44bb-aabc-6735cd588194 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.487122 Jul 19 20:21:06.128291 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2815/5728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:05 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:07.784535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:07.785801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:07.809015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:07.812082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:07.815027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:07.816416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:08.463097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:08.476848 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea8b41b1-100d-4e96-9cce-43d21bf017d2 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 1.344288 Jul 19 20:21:08.478609 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2914/5729] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:07 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:09.495285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:09.497540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:09.512464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:09.516219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:09.518716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:09.520461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.006712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:10.019139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43217d7e-7521-420f-9b46-468c88e8d677 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.525176 Jul 19 20:21:10.025570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2816/5730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:09 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:10.310094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d0ea88ed-94b0-49b2-b163-ca514378cf41 req-f75eee98-5b7a-488a-9d3e-f0df320ca1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "name": "network-vif-plugged", "status": "completed", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:10.369896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0ea88ed-94b0-49b2-b163-ca514378cf41 req-f75eee98-5b7a-488a-9d3e-f0df320ca1c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.390057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d0ea88ed-94b0-49b2-b163-ca514378cf41 req-f75eee98-5b7a-488a-9d3e-f0df320ca1c2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.436311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d0ea88ed-94b0-49b2-b163-ca514378cf41 req-f75eee98-5b7a-488a-9d3e-f0df320ca1c2 service nova] Creating event network-vif-plugged:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:21:10.454575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d0ea88ed-94b0-49b2-b163-ca514378cf41 req-f75eee98-5b7a-488a-9d3e-f0df320ca1c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153203 Jul 19 20:21:10.455458 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2915/5731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:10.800107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-49609226", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1fcf35b4-9775-4408-872f-05c30221d787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:11.039348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:11.040488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:11.052392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:11.070868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:11.072710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:11.073341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:11.280468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:21:11.455032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:11.471465 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9677ab93-4f19-452d-9128-7c6af83fcc99 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.437358 Jul 19 20:21:11.481903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2916/5732] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:11 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:12.490171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:12.490895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:12.503701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:12.509462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:12.510352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:12.513860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:13.122490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:13.136405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aeb7d301-43b8-4d94-abb4-357db10e5a73 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1268 microversion: 2.1 time: 0.650579 Jul 19 20:21:13.137374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2917/5733] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:12 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1268 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:13.240546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:21:13.241110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:21:13.241464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:21:13.242693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:21:13.242693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:21:13.257764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:13.258290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:13.259017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:13.259463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:13.323053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:13.339701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:13.526306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:21:13.530309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fcf35b4-9775-4408-872f-05c30221d787',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:21:13.990927 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd042dc7-f8c5-4bea-8634-910e00002a6b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.189089 Jul 19 20:21:13.993862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2817/5734] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:21:14.003040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6863be53-d853-4cd7-b4c3-019c9ac43e4d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:14.003660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6863be53-d853-4cd7-b4c3-019c9ac43e4d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:14.155923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:14.156557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:14.182898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.183366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.189954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.189954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.292523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6863be53-d853-4cd7-b4c3-019c9ac43e4d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:14.308657 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6863be53-d853-4cd7-b4c3-019c9ac43e4d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1069 microversion: 2.1 time: 0.309363 Jul 19 20:21:14.316344 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2918/5735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:13 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1069 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:14.768094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:14.777407 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe0d2c03-b727-48e2-8f52-4414ec55b035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1457 microversion: 2.1 time: 0.626338 Jul 19 20:21:14.783014 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2818/5736] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:14 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1457 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:14.797120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:14.797935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:14.807852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.815173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.817266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.822947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.326094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:15.326992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:15.342209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.342672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.343451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.343953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.667746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:15.679257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-548ac778-da84-49cd-81ad-329dbf698193 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1111 microversion: 2.1 time: 0.357157 Jul 19 20:21:15.691355 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2819/5737] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:15 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1111 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:15.716884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:15.738585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-06c1dd8d-296e-47ee-b87d-870cf16bfb8b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1457 microversion: 2.1 time: 0.946578 Jul 19 20:21:15.739195 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2919/5738] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:14 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1457 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:16.704663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:16.707656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:16.729199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:16.731360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:16.733116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:16.734223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:17.263668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:17.268533 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c965c90-968b-44dc-a631-f7d895db36f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1185 microversion: 2.1 time: 0.573956 Jul 19 20:21:17.269449 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2820/5739] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:16 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1185 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:18.286844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:18.287495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:18.299774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:18.300260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:18.301067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:18.301509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:19.157319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:19.165475 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b2a9b6f-26d9-4d9a-a4dd-ef423b70aca6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1185 microversion: 2.1 time: 0.883104 Jul 19 20:21:19.168528 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2920/5740] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:18 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1185 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:20.187074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:20.188550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:20.202662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.206608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.207651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.209461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.179027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a8d55575-18fa-4f31-aba1-5787e1751049 req-1086079b-ce4d-4863-b860-533e506bd89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:22.213981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a8d55575-18fa-4f31-aba1-5787e1751049 req-1086079b-ce4d-4863-b860-533e506bd89a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.217242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a8d55575-18fa-4f31-aba1-5787e1751049 req-1086079b-ce4d-4863-b860-533e506bd89a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.258924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a8d55575-18fa-4f31-aba1-5787e1751049 req-1086079b-ce4d-4863-b860-533e506bd89a service nova] Creating event network-changed:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:21:22.265819 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a8d55575-18fa-4f31-aba1-5787e1751049 req-1086079b-ce4d-4863-b860-533e506bd89a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096660 Jul 19 20:21:22.266705 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2921/5741] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:22.355184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:22.363867 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-912f8428-1920-4986-84f0-5ca9afe8f6fc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1227 microversion: 2.1 time: 2.182216 Jul 19 20:21:22.374730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2821/5742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:20 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1227 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:23.385814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:23.388670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:23.413551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.414303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.418166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.418811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:24.299266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:26.020119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:26.026433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=56 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:26.030413 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-528a24db-bde6-486e-802e-3108161b03db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1227 microversion: 2.1 time: 2.652556 Jul 19 20:21:26.040191 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2922/5743] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:23 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1227 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:27.047134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:27.048611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:27.055164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:27.067899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:27.089413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:27.089875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:27.090673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:27.091117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.131841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b06e3bc3-b7b6-4d9d-a487-ca3de33cb696 req-d17a6e0f-5080-41ad-a5e4-6816131c256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91c38bc4-fb19-40d7-ae1b-dea50deb388d", "tag": "7433eb79-7c57-40a4-bed8-90cbd5336fbf"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:28.137666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=26 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:28.173125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b06e3bc3-b7b6-4d9d-a487-ca3de33cb696 req-d17a6e0f-5080-41ad-a5e4-6816131c256a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:28.185923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b06e3bc3-b7b6-4d9d-a487-ca3de33cb696 req-d17a6e0f-5080-41ad-a5e4-6816131c256a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.241438 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b06e3bc3-b7b6-4d9d-a487-ca3de33cb696 req-d17a6e0f-5080-41ad-a5e4-6816131c256a service nova] Creating event network-changed:7433eb79-7c57-40a4-bed8-90cbd5336fbf for instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d on n-h1-843861-3 Jul 19 20:21:28.256617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b06e3bc3-b7b6-4d9d-a487-ca3de33cb696 req-d17a6e0f-5080-41ad-a5e4-6816131c256a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126942 Jul 19 20:21:28.257386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2923/5744] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:29.532048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:29.548872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7be2b20-25ed-4b1f-88b4-398d1311fe1f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1227 microversion: 2.1 time: 2.506024 Jul 19 20:21:29.549460 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2822/5745] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:27 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1227 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:30.568145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:30.569213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:30.588493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:30.591392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:30.609153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:30.610854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.182068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:32.200157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5138f65-d94d-4b96-bc7c-56fdc4596662 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 1.638149 Jul 19 20:21:32.203072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2924/5746] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:30 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:32.344186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6ef3bec4-9450-409c-bafc-5b8fec3493fb req-d10fcbbd-005b-4d0e-82dc-e8de3be1f8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:32.367587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6ef3bec4-9450-409c-bafc-5b8fec3493fb req-d10fcbbd-005b-4d0e-82dc-e8de3be1f8a1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.371302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6ef3bec4-9450-409c-bafc-5b8fec3493fb req-d10fcbbd-005b-4d0e-82dc-e8de3be1f8a1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.404003 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6ef3bec4-9450-409c-bafc-5b8fec3493fb req-d10fcbbd-005b-4d0e-82dc-e8de3be1f8a1 service nova] Creating event network-changed:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:21:32.444597 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6ef3bec4-9450-409c-bafc-5b8fec3493fb req-d10fcbbd-005b-4d0e-82dc-e8de3be1f8a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107401 Jul 19 20:21:32.450291 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2823/5747] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:33.218613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:33.219408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:33.243458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:33.245590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:33.264544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:33.265939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:34.864479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0fa6888d-06bf-442d-8e3f-1191e86a651b req-81f4fa09-ebe3-4ead-9d45-75b97ffa9dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:34.882658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:34.901227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:34.910917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6c43b73-ce0d-4f80-9ee5-e6c7abcc56b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 1.697513 Jul 19 20:21:34.919560 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2925/5748] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:33 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:34.937797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0fa6888d-06bf-442d-8e3f-1191e86a651b req-81f4fa09-ebe3-4ead-9d45-75b97ffa9dab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:34.938957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0fa6888d-06bf-442d-8e3f-1191e86a651b req-81f4fa09-ebe3-4ead-9d45-75b97ffa9dab service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:34.963735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=52 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:35.005028 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0fa6888d-06bf-442d-8e3f-1191e86a651b req-81f4fa09-ebe3-4ead-9d45-75b97ffa9dab service nova] Creating event network-changed:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:21:35.018565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0fa6888d-06bf-442d-8e3f-1191e86a651b req-81f4fa09-ebe3-4ead-9d45-75b97ffa9dab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159588 Jul 19 20:21:35.021315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2824/5749] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:35.935080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:35.937155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:35.945658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.946840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:35.948290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.948988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:36.760144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:36.777229 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-667c2d65-d1f8-496f-8de7-4eac08dd15ce tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 0.846819 Jul 19 20:21:36.781544 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2926/5750] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:35 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:37.801632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:37.802532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:37.822518 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:37.822983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:37.825605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:37.826474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.368440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:38.385410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f038ef00-03e8-426e-b875-fc7ea2aedf9f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 0.587955 Jul 19 20:21:38.387140 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2825/5751] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:37 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:39.409554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:39.410186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:39.426128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.431258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:39.432846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.433599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:39.756190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:39.767577 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43348fd1-82ab-4c22-9317-d7ca12eb060c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 0.362016 Jul 19 20:21:39.775680 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2927/5752] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:39 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:40.793384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:40.795193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:40.808393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:40.809161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:40.812940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:40.813826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:41.389221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:41.407537 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4705c48d-4f13-4b55-9b65-80f0bbeb6122 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 0.616655 Jul 19 20:21:41.411153 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2826/5753] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:40 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:42.437993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:42.439310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:42.449033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:42.449741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:42.450734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:42.452028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.522963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:43.537439 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a479ed2-ae89-427f-a768-88fec9dce5f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 1.108339 Jul 19 20:21:43.538127 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2928/5754] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:42 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:43.760954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-780cddc8-51a1-45d1-a76b-3ba090db847d req-734bb312-a2ca-466b-9ae2-5195eeff593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c38bc4-fb19-40d7-ae1b-dea50deb388d", "name": "network-vif-plugged", "status": "completed", "tag": "7433eb79-7c57-40a4-bed8-90cbd5336fbf"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:43.801670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-780cddc8-51a1-45d1-a76b-3ba090db847d req-734bb312-a2ca-466b-9ae2-5195eeff593c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.802857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-780cddc8-51a1-45d1-a76b-3ba090db847d req-734bb312-a2ca-466b-9ae2-5195eeff593c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.844016 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-780cddc8-51a1-45d1-a76b-3ba090db847d req-734bb312-a2ca-466b-9ae2-5195eeff593c service nova] Creating event network-vif-plugged:7433eb79-7c57-40a4-bed8-90cbd5336fbf for instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d on n-h1-843861-3 Jul 19 20:21:43.872403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-780cddc8-51a1-45d1-a76b-3ba090db847d req-734bb312-a2ca-466b-9ae2-5195eeff593c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118745 Jul 19 20:21:43.875271 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2827/5755] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:44.561416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:44.562041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:44.573891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.574343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.575122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.581391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.914700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:44.943508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe5fb32c-a395-4c5c-a73d-32f49f7e2530 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1215 microversion: 2.1 time: 0.386037 Jul 19 20:21:44.948252 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2929/5756] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:44 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:45.970007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:45.971028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:45.995227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:45.996288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:45.997365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:45.998866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:46.343279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:46.361913 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aabad517-17e4-4e74-b228-5892986f0a96 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1401 microversion: 2.1 time: 0.395356 Jul 19 20:21:46.363996 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2828/5757] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:45 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1401 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:46.382975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:46.384276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:46.393391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:46.394183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:46.395220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:46.395920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:46.655156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:46.666384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58be7923-be28-4e95-b2b7-2fb9ef6f2523 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1401 microversion: 2.1 time: 0.287569 Jul 19 20:21:46.679651 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2930/5758] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:46 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1401 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:46.688271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2084963632"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:46.689339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:46.705293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:46.705877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:46.706706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:46.707157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:46.837700 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Attempting to quiesce instance before volume snapshot. Jul 19 20:21:46.906393 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 19 20:21:47.046727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Creating snapshot from volume 1fcf35b4-9775-4408-872f-05c30221d787. {{(pid=126007) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 19 20:21:49.466682 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a749138b-008b-4bdf-bd08-00e3341c7a1a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d/action" status: 202 len: 0 microversion: 2.1 time: 2.782636 Jul 19 20:21:49.469439 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2829/5759] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:21:46 2022] POST /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d/action => generated 0 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 20:21:50.842878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1581586010", "imageRef": "51715b45-a270-4ffe-8574-adb1c40a589d", "flavorRef": "452", "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:50.998191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:21:52.007745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:21:52.008392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:21:52.008689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:21:52.009106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:21:52.009528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:21:52.030787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.031245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.032090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.032537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.078271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:52.097509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:52.122024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:21:52.126301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ca772e49-4eb1-458b-9049-226e1e750dab',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:21:52.312405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9a51ee2-0b52-4a5e-9c42-a6eabb608e72 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473167 Jul 19 20:21:52.313401 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2931/5760] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:21:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:21:52.325452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-da29a709-8134-4720-a3a7-b0ce9a37f6db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:52.327682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-da29a709-8134-4720-a3a7-b0ce9a37f6db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:52.713525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-da29a709-8134-4720-a3a7-b0ce9a37f6db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:52.723132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-da29a709-8134-4720-a3a7-b0ce9a37f6db tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1230 microversion: 2.1 time: 0.402210 Jul 19 20:21:52.733296 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2830/5761] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:52 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1230 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:53.747461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:53.749936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:53.763147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:53.766254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:53.769125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:53.772803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:53.944447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:53.955728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f61bd8c0-ee3e-4740-a495-5d2dccc0eef2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1226 microversion: 2.1 time: 0.212703 Jul 19 20:21:53.959086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2932/5762] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:53 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1226 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:54.977092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:54.978396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:55.002547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.003030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.003860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.012582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.380983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:55.410003 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d056ca5-aedb-470e-847a-4829e452e1d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1300 microversion: 2.1 time: 0.436787 Jul 19 20:21:55.411934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2831/5763] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:54 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1300 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:55.456342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:55.456859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:55.468529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.471437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.472867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.475033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.605092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:21:55.852990 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9042e20d-6004-4c14-97a7-cd585babb01e tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "DELETE /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 204 len: 0 microversion: 2.1 time: 0.402249 Jul 19 20:21:55.853959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2933/5764] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:21:55 2022] DELETE /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:21:55.866091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:55.868627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:55.886869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.887731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.891407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.892583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:56.026948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7acb36c7-4d28-48ef-ad0b-39722f742097 req-0dcd727f-2ec7-4d26-9c5d-86b15f8a364b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:56.052816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7acb36c7-4d28-48ef-ad0b-39722f742097 req-0dcd727f-2ec7-4d26-9c5d-86b15f8a364b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:56.056230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7acb36c7-4d28-48ef-ad0b-39722f742097 req-0dcd727f-2ec7-4d26-9c5d-86b15f8a364b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:56.123330 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7acb36c7-4d28-48ef-ad0b-39722f742097 req-0dcd727f-2ec7-4d26-9c5d-86b15f8a364b service nova] Creating event network-changed:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:21:56.144276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7acb36c7-4d28-48ef-ad0b-39722f742097 req-0dcd727f-2ec7-4d26-9c5d-86b15f8a364b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.626266 Jul 19 20:21:56.148270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2832/5765] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:56.436980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:56.443991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:56.512026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:56.514012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:56.514908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:56.515363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:58.039616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:58.073860 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59013e72-1620-4b7c-86d4-7758fdcf7de4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1581 microversion: 2.1 time: 2.215114 Jul 19 20:21:58.089435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2934/5766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:55 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1581 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:59.095249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:59.096113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:59.099341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:59.134219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:59.134576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:59.135380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:59.135832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:59.238405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:59.887971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:59.899561 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26740862-fa64-41e1-969c-43dcdc0de958 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 3.472455 Jul 19 20:21:59.905089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2833/5767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:56 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 3479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:59.921688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:59.931400 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f9c21ba-5f4d-43da-830f-643bc6d43035 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1581 microversion: 2.1 time: 0.840695 Jul 19 20:21:59.946186 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2935/5768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:59 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1581 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:00.922350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:00.923135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:00.940271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.941130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:00.942097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.942845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:00.955027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:00.955795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:00.967435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.983427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:00.984463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.987923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:02.051636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:02.115629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:02.360116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:02.372539 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1a5c6895-1dc1-43fc-8fdd-99ee99944ae4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.454873 Jul 19 20:22:02.373173 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2834/5769] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:00 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:02.442342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:02.459243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1adf8eb5-05fe-4a7b-b68b-07fe3c10d39b tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1581 microversion: 2.1 time: 1.507296 Jul 19 20:22:02.472255 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2936/5770] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:00 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1581 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:02.722848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:03.160259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ce215fef-3875-4a24-b5c7-a5cfd33175f7 req-1088c6e3-6e16-4637-9af6-844e4f32342e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "name": "network-vif-deleted", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:03.184036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3b97779d-37a8-42c4-a9f5-e0b63e7f94fe req-2140309c-daf4-4577-80e6-9f9c19bca107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128f132d-137c-456f-bc3d-a728b6ce5316", "name": "network-vif-unplugged", "status": "completed", "tag": "a2512e0d-1980-4ec3-af60-e5543113801b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:03.199941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ce215fef-3875-4a24-b5c7-a5cfd33175f7 req-1088c6e3-6e16-4637-9af6-844e4f32342e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.204531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ce215fef-3875-4a24-b5c7-a5cfd33175f7 req-1088c6e3-6e16-4637-9af6-844e4f32342e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.289240 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ce215fef-3875-4a24-b5c7-a5cfd33175f7 req-1088c6e3-6e16-4637-9af6-844e4f32342e service nova] Creating event network-vif-deleted:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:22:03.295401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b97779d-37a8-42c4-a9f5-e0b63e7f94fe req-2140309c-daf4-4577-80e6-9f9c19bca107 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.301500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3b97779d-37a8-42c4-a9f5-e0b63e7f94fe req-2140309c-daf4-4577-80e6-9f9c19bca107 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.323347 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ce215fef-3875-4a24-b5c7-a5cfd33175f7 req-1088c6e3-6e16-4637-9af6-844e4f32342e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168299 Jul 19 20:22:03.330804 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2937/5771] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:22:03.360506 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3b97779d-37a8-42c4-a9f5-e0b63e7f94fe req-2140309c-daf4-4577-80e6-9f9c19bca107 service nova] Creating event network-vif-unplugged:a2512e0d-1980-4ec3-af60-e5543113801b for instance 128f132d-137c-456f-bc3d-a728b6ce5316 on n-h2-843861-3 Jul 19 20:22:03.371645 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3b97779d-37a8-42c4-a9f5-e0b63e7f94fe req-2140309c-daf4-4577-80e6-9f9c19bca107 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.997196 Jul 19 20:22:03.372338 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2835/5772] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:03.392439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:03.393467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:03.409076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.409715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.412600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.418204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.481242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:03.485371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:03.493263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.494497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.496159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.497509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.882237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:03.898349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-50cc89ae-982f-4dcc-af79-a5723d194513 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.421704 Jul 19 20:22:03.902300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2836/5773] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:03 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:04.151121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:04.169144 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34609d64-ffdf-4c8b-a7cc-eb45bc207c26 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.783090 Jul 19 20:22:04.170749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2938/5774] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:03 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:04.922864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:04.924092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:04.960674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=28 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:04.977559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.979219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.981310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.987439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.998780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:05.187752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:05.188426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:05.209592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:05.239063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.248925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:05.249699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.489332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:05.506119 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-baef477f-7051-4995-af51-caae10b020c9 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.589903 Jul 19 20:22:05.506729 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2837/5775] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:04 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:05.519660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-dfc624e3-a4be-4bc1-816b-8d99c2915f49 req-7db1de66-6d8f-4581-82a4-ea17debcc68b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c67fb3-abee-431f-bbb0-ebb208faf228", "tag": "15761f70-e4de-4b11-9d33-13f6d4da7c74"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:05.537130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dfc624e3-a4be-4bc1-816b-8d99c2915f49 req-7db1de66-6d8f-4581-82a4-ea17debcc68b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:05.545145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-dfc624e3-a4be-4bc1-816b-8d99c2915f49 req-7db1de66-6d8f-4581-82a4-ea17debcc68b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.559608 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-dfc624e3-a4be-4bc1-816b-8d99c2915f49 req-7db1de66-6d8f-4581-82a4-ea17debcc68b service nova] Creating event network-changed:15761f70-e4de-4b11-9d33-13f6d4da7c74 for instance f0c67fb3-abee-431f-bbb0-ebb208faf228 on n-h1-843861-3 Jul 19 20:22:05.585698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-dfc624e3-a4be-4bc1-816b-8d99c2915f49 req-7db1de66-6d8f-4581-82a4-ea17debcc68b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077719 Jul 19 20:22:05.586443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2838/5776] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:06.368518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:06.379633 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d397340d-9db6-4331-8369-781467ea841d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.196496 Jul 19 20:22:06.380266 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2939/5777] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:05 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:06.527665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:06.528665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:06.555057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.557045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.563878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.565457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.876202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:06.907120 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5be22d2-0d4b-439e-8e1b-b129fb620247 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.387029 Jul 19 20:22:06.907839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2839/5778] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:06 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:07.412972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:07.417074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:07.439879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.449400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.452430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.453314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.901080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:07.932166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:07.934462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:07.962567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.964526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.965542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.967000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.978055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-882ce61c-367f-45f4-b1de-a272f8bb4899 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.575435 Jul 19 20:22:07.983415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2940/5779] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:07 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:08.135842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:08.157695 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d21c863-5540-4287-a66d-d4d6bcc1babd tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.231262 Jul 19 20:22:08.158670 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2840/5780] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:07 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:09.011746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:09.013526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:09.021665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.022502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:09.024376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.026637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:09.179753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:09.186106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:09.213322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.217524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:09.218813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.219513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:09.497811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:09.523908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebcd020a-4c52-4204-ad11-cc3de32e7286 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.345695 Jul 19 20:22:09.531421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2841/5781] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:09 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:09.589348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:09.611628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad260920-8159-4d00-ba53-c3a6a67dc9fa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.599142 Jul 19 20:22:09.612647 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2941/5782] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:09 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:10.549994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:10.550665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:10.567960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:10.568814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:10.571753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:10.573133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:10.629562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:10.632129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:10.678361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:10.685636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:10.694141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:10.698182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:11.143535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:11.160798 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86ae6310-9a52-490f-be2e-5b7a3744b59a tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.614334 Jul 19 20:22:11.168475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2842/5783] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:10 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:11.558770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:11.612273 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-775f115c-07bb-430b-9a31-d768199eb8fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.984158 Jul 19 20:22:11.629166 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2942/5784] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:10 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:12.194161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:12.195754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:12.221828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.222868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.227173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.228128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.441571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:12.455013 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c2498d8-676c-4408-a105-7b3892f96144 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.270109 Jul 19 20:22:12.471850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2843/5785] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:12 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:12.669303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:12.684055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:12.737043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.743044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.748330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.754553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:13.476329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:13.477638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:13.499377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:13.500055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:13.500878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:13.501381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:14.042030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:14.069065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-350f0aed-c6bd-44a2-9439-3254f89d40bb tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.598640 Jul 19 20:22:14.076590 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2844/5786] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:13 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:14.137849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:14.171286 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-589e5d12-67ac-4e70-812a-54024f00701d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.523128 Jul 19 20:22:14.174660 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2943/5787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:12 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:15.104188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:15.106127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:15.140669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.142025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.145049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.147053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.201887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:15.203409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:15.233259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.233769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.234618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.236228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.464326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:15.479898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-98fcfd37-331d-4a27-b8f8-c394074fe2b8 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.378976 Jul 19 20:22:15.481962 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2845/5788] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:15 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:15.911111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:15.929272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd8d23f0-7252-4516-82dd-2d87503f198c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.736568 Jul 19 20:22:15.930972 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2944/5789] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:15 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:16.500017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:16.500843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:16.518714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.519203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:16.528657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:16.532440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:16.536960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.541098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:16.572880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.574762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:16.576855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.581217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:16.734608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lazy-loading 'services' on Instance uuid 4d70d9a5-5473-4edf-b34f-807af0cf2018 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:22:16.866108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6273d16e-796a-4936-aa2d-cbedba51589b tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018/os-volume_attachments/097cba90-4a6c-48e8-80fc-225c62fbd7a3" status: 202 len: 0 microversion: 2.1 time: 0.342760 Jul 19 20:22:16.867482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2945/5790] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:22:16 2022] DELETE /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018/os-volume_attachments/097cba90-4a6c-48e8-80fc-225c62fbd7a3 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:22:16.885813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:16.904513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-48eb17b9-91bd-4f10-98bc-78d82cc34346 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.408229 Jul 19 20:22:16.908209 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2846/5791] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:16 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:16.979187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:16.980311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:16.998969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.999840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:17.000898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:17.001723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:17.423514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:17.432325 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-205817cd-21d6-4a23-a04f-7037901247f0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.458476 Jul 19 20:22:17.446165 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2946/5792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:16 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:17.929622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:17.930596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:17.948922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:17.949598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:17.950281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:17.957367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.119693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:18.131926 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-718ba2fb-48d9-4b58-af41-91eb93b3d277 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.206261 Jul 19 20:22:18.133030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2847/5793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:17 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:18.461975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:18.463584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:18.472450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:18.475244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.478758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:18.481290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.760850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:18.775410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be9d5f04-2726-4d99-be7b-6a76b22f7f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.317246 Jul 19 20:22:18.776526 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2947/5794] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:18 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:19.162356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:19.164250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:19.182776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.184892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:19.186829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.188122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:19.326538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:19.350985 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c70aaa68-5883-4c4d-a52c-53975a8037e4 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.200136 Jul 19 20:22:19.352593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2848/5795] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:19 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:19.796181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:19.797196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:19.824935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.826140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:19.828232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.829973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.112949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:20.132982 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-128a9c59-7d69-48c6-9c36-ef6aec091d6e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.341924 Jul 19 20:22:20.145856 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2948/5796] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:19 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:20.371328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:20.373837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:20.412852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.419113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.422529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.423017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.684371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87438b5e69e64bef9df0a7ab3e692ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be10a3d37c1048569e927507f0b8aae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:20.707761 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f609d28-a50a-4d56-b8be-e327a31ac6b3 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 200 len: 1228 microversion: 2.1 time: 0.338966 Jul 19 20:22:20.710026 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2849/5797] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:20 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 1228 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:21.161974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:21.164526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:21.175971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.177245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.178681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.179665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.699689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:21.711181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8757507b-0e18-4597-95e1-2eda7247b0d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.556795 Jul 19 20:22:21.713298 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2949/5798] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:21 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:21.739358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:21.740772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] [instance: 128f132d-137c-456f-bc3d-a728b6ce5316] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:21.755729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.760181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.767290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.768718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.837997 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] HTTP exception thrown: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Request method failure captured: Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 HTTP/1.1 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xDgMiKUpVDv0ryqpPUjkHV7PmCdXL12zzCmEE9N1ewycA27dbi8m8pUPB1RJDnPjNicMjjPFKEOoekZbmwKM94_6TO4Jnq8GxoDkpueI0GqUcsxgGoxFotCXJhKS4yWSM3LGzBoiJ73ncp3ejjeAt2uxSM5-HmhdlnqAAnNPIxdD8M Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: be10a3d37c1048569e927507f0b8aae1 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBackupRestore-757038848 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be10a3d37c1048569e927507f0b8aae1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be10a3d37c1048569e927507f0b8aae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be10a3d37c1048569e927507f0b8aae1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be10a3d37c1048569e927507f0b8aae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBackupRestore-757038848 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: be10a3d37c1048569e927507f0b8aae1 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBackupRestore-757038848 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBackupRestore-757038848-project Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 87438b5e69e64bef9df0a7ab3e692ac9 Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBackupRestore-757038848-project Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '128f132d-137c-456f-bc3d-a728b6ce5316'} Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:22:21.843344 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. Jul 19 20:22:21.850276 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:21.853891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Returning 404 to user: Instance 128f132d-137c-456f-bc3d-a728b6ce5316 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:22:21.857676 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26d2bb0a-b570-4067-ab4e-28a3014e1810 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316" status: 404 len: 111 microversion: 2.1 time: 0.131937 Jul 19 20:22:21.858969 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2850/5799] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:21 2022] GET /compute/v2.1/servers/128f132d-137c-456f-bc3d-a728b6ce5316 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:22:22.367860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-39e5b7b5-cae9-4c03-970e-5428615dc648 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] Calling method '.version_select at 0x7fb88d699790>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:22.492892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-39e5b7b5-cae9-4c03-970e-5428615dc648 tempest-TestVolumeBackupRestore-757038848 tempest-TestVolumeBackupRestore-757038848-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1717613128" status: 202 len: 0 microversion: 2.1 time: 0.130132 Jul 19 20:22:22.497140 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2950/5800] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 20:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1717613128 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:22:22.735095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:22.735750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:22.745715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:22.746510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:22.748952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:22.749480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:23.526310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:23.542036 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4f9b9ab-3c6a-440a-8c13-a9e469d6d67c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.805250 Jul 19 20:22:23.543332 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2851/5801] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:22 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:24.562066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:24.562782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:24.581084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:24.581556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:24.588116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:24.588592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:25.110426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:25.126992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-788e50e7-7a73-4b34-b678-9f300d68dbc3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.570364 Jul 19 20:22:25.128475 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2951/5802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:24 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:26.148740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:26.149538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:26.206357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:26.207084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:26.208182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:26.255176 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:26.741728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:26.759681 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d018806a-7d6d-46f2-a9c5-179eb1da675d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.617340 Jul 19 20:22:26.774331 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2852/5803] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:26 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:27.792350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:27.793400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:27.818732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:27.821599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:27.822546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:27.823067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:28.324675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:28.333838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:28.341770 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd8d9362-209c-4bd8-b8e6-927509529840 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.556794 Jul 19 20:22:28.343046 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2952/5804] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:27 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:29.361612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:29.362321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:29.375236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:29.375696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:29.382215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:29.386001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:29.901395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:29.902565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:29.920398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:29.922822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:29.924632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:29.925828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:29.926639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:29.996466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:22:30.292965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cff9c97e-86a0-4ca0-a2c1-ee60eaf887c0 tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 204 len: 0 microversion: 2.1 time: 0.396798 Jul 19 20:22:30.294912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2953/5805] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:22:29 2022] DELETE /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:22:30.324382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:30.326217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:30.347133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:30.350537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:30.363554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:30.364483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:30.389042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:30.406240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0ea8e39-56ae-41a1-9d6c-44c3e687ec38 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.049383 Jul 19 20:22:30.413878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2853/5806] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:29 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:30.875511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:30.891799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-35240464-489d-41bc-8aa1-65861bed9d5e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1469 microversion: 2.1 time: 0.581956 Jul 19 20:22:30.893306 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2954/5807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:30 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1469 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:31.447296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:31.448544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:31.492954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:31.496889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:31.499722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:31.505031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:31.920152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:31.921504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:31.937848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:31.938308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:31.939102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:31.939541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:32.361353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:32.393735 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-76315597-1c58-4149-b27b-e541dbc437e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.959937 Jul 19 20:22:32.394994 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2854/5808] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:31 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:33.133764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada63a3f97114b62b16af9f62de54407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bf7ebdf57344d6b86765cf17e1c25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:33.149508 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e63d33af-c530-4183-bee9-4754b762378e tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 200 len: 1469 microversion: 2.1 time: 1.234918 Jul 19 20:22:33.150416 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2955/5809] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:31 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 1469 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:33.160221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e276b349-e93f-4ba7-b56e-906503998a1e req-077a2e10-e70d-492d-82b2-276733cc807b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d70d9a5-5473-4edf-b34f-807af0cf2018", "name": "network-vif-deleted", "tag": "0d8465c8-cb1e-460b-ae77-0659bde2d83b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:33.217309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e276b349-e93f-4ba7-b56e-906503998a1e req-077a2e10-e70d-492d-82b2-276733cc807b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:33.218009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e276b349-e93f-4ba7-b56e-906503998a1e req-077a2e10-e70d-492d-82b2-276733cc807b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:33.221900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:33.275118 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e276b349-e93f-4ba7-b56e-906503998a1e req-077a2e10-e70d-492d-82b2-276733cc807b service nova] Creating event network-vif-deleted:0d8465c8-cb1e-460b-ae77-0659bde2d83b for instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 on n-h1-843861-3 Jul 19 20:22:33.294321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e276b349-e93f-4ba7-b56e-906503998a1e req-077a2e10-e70d-492d-82b2-276733cc807b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138888 Jul 19 20:22:33.298798 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2855/5810] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:33.424645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:33.439777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:33.461255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:33.475863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:33.477264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:33.477951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:33.795863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:33.835764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e9af5f0-9498-4e2b-8153-761a738c7f4c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.414682 Jul 19 20:22:33.836513 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2956/5811] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:33 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:34.175308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:34.176956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] [instance: 4d70d9a5-5473-4edf-b34f-807af0cf2018] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:34.217011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:34.219694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:34.221218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:34.227234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:34.283596 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] HTTP exception thrown: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Request method failure captured: Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 HTTP/1.1 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xHCjCkHgtv3fj4XdkLSNlRLNDQNfetxqoHtszHhv5Lht8EXGZ_PXfd1-dfTnkylQXqn0j9zWN2cfxuhObsQ2liTy7fMoUF2Txx_KvKn-mBISbWQlTlkAEIJQ1NOua9ZB7HNPjtCPlEkRaZbpfgksTQo6R6XUJiUBNIqgvWFj7CzBu4 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c6bf7ebdf57344d6b86765cf17e1c25f Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesBackupsTest-1285640485 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c6bf7ebdf57344d6b86765cf17e1c25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c6bf7ebdf57344d6b86765cf17e1c25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c6bf7ebdf57344d6b86765cf17e1c25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c6bf7ebdf57344d6b86765cf17e1c25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesBackupsTest-1285640485 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c6bf7ebdf57344d6b86765cf17e1c25f Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesBackupsTest-1285640485 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesBackupsTest-1285640485-project Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ada63a3f97114b62b16af9f62de54407 Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesBackupsTest-1285640485-project Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4d70d9a5-5473-4edf-b34f-807af0cf2018'} Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:22:34.292278 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. Jul 19 20:22:34.298173 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:22:34.300843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] Returning 404 to user: Instance 4d70d9a5-5473-4edf-b34f-807af0cf2018 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:22:34.309130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-29fd5774-e858-4977-bea5-46c45d9c466c tempest-VolumesBackupsTest-1285640485 tempest-VolumesBackupsTest-1285640485-project] 10.222.0.33 "GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018" status: 404 len: 111 microversion: 2.1 time: 0.140853 Jul 19 20:22:34.311073 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2856/5812] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:34 2022] GET /compute/v2.1/servers/4d70d9a5-5473-4edf-b34f-807af0cf2018 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:22:34.855576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:34.856221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:34.874119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:34.874576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:34.878818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:34.881138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:35.274456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:35.291391 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-488a02d7-4d57-4634-85e8-f105e877f2e0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.440001 Jul 19 20:22:35.302267 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2957/5813] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:34 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:36.309677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:36.310917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:36.327975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=40 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:36.330389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:36.330857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:36.331655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:36.332131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:36.738488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:36.748146 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c4b1e3a2-0f39-43cd-a604-565752529ea1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.442215 Jul 19 20:22:36.764424 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2857/5814] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:36 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:37.767337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:37.768780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:37.785603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:37.788399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:37.791156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:37.807706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:38.396551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:38.423507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-14865ed3-26f6-48d5-938b-0a77faa441dd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.660669 Jul 19 20:22:38.432755 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2958/5815] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:37 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:39.453209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:39.453894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:39.471074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:39.471612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:39.475003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:39.475545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:40.170312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:40.179018 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-896d73ca-6e73-4caa-884a-61fd36c8a990 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.732562 Jul 19 20:22:40.193745 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2858/5816] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:39 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:41.203128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:41.204505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:41.219759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:41.227859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:41.228964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:41.234724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:41.736294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:41.745914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bdbc2673-4961-4f8a-b465-f8d2e3094d59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.548178 Jul 19 20:22:41.746513 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2959/5817] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:41 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:42.763489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:42.764735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:42.785505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:42.786303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:42.787295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:42.805912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:43.864336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:43.874807 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-388c71b2-66a4-4ff7-a66b-1875476d50c7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.115832 Jul 19 20:22:43.880586 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2859/5818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:42 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:44.909858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:44.911163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:44.982591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:44.987859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:44.989339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:44.989803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:45.972309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:45.996863 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b12eb5cc-a36f-443c-b195-7a1b7bce8e49 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.095084 Jul 19 20:22:46.011681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2960/5819] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:44 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:47.019967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:47.021755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:47.051096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:47.054216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:47.061928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:47.065211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:47.623602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:47.651767 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-521c1271-4b11-41bc-80a6-866e3d98a97c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 0.637226 Jul 19 20:22:47.655966 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2860/5820] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:47 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:48.688024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:48.688881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:48.730877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:48.734453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:48.743030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:48.745911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:50.082484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:50.117744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ead2f3e-036e-4e36-9ec6-436dea5004e4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1342 microversion: 2.1 time: 1.441324 Jul 19 20:22:50.126650 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2961/5821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:48 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1342 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:51.149603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:51.151581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:51.190360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:51.191216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:51.193038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:51.198183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:53.212219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:53.250590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa80449d-1e84-4e90-a195-7f7316727edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1388 microversion: 2.1 time: 2.109544 Jul 19 20:22:53.251401 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2861/5822] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:51 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1388 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:54.290247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:54.290247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:54.310075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:54.331107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:54.332454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:54.334847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:55.364393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:55.399037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-86280997-3beb-4dc4-9e15-2ed50762e8ed tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 1.115799 Jul 19 20:22:55.404670 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2962/5823] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:54 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:56.442517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:56.446469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:56.480118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:56.483574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:56.485254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:56.487333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:58.194751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:58.206816 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a00c4f0-5013-493f-949d-7dcde17d6dc5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 1.777775 Jul 19 20:22:58.209448 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2862/5824] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:56 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:59.240313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:59.241686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:59.260016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:59.261002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:59.262093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:59.264353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:00.956121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:00.963253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:00.974677 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b0ca719d-5d15-4d81-b0f2-fdf7e5e41434 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 1.743778 Jul 19 20:23:00.975637 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2963/5825] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:59 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:01.994790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:01.995344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:02.007997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.008490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.009478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.009901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.523368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:02.538858 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16500896-2166-4746-b804-8f100f5d5ab2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 0.550051 Jul 19 20:23:02.553045 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2863/5826] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:01 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:03.562556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:03.563319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:03.566605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:03.621990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:03.622534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:03.623329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:03.623768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:04.093729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c1f86dd6-c033-48a1-bb3c-8bcdec9b6212 req-dd2777ac-aa59-46f0-a54a-2c3805deb129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c67fb3-abee-431f-bbb0-ebb208faf228", "name": "network-vif-plugged", "status": "completed", "tag": "15761f70-e4de-4b11-9d33-13f6d4da7c74"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:04.125828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c1f86dd6-c033-48a1-bb3c-8bcdec9b6212 req-dd2777ac-aa59-46f0-a54a-2c3805deb129 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:04.126593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c1f86dd6-c033-48a1-bb3c-8bcdec9b6212 req-dd2777ac-aa59-46f0-a54a-2c3805deb129 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:04.161169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=46 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:04.166753 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c1f86dd6-c033-48a1-bb3c-8bcdec9b6212 req-dd2777ac-aa59-46f0-a54a-2c3805deb129 service nova] Creating event network-vif-plugged:15761f70-e4de-4b11-9d33-13f6d4da7c74 for instance f0c67fb3-abee-431f-bbb0-ebb208faf228 on n-h1-843861-3 Jul 19 20:23:04.173792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c1f86dd6-c033-48a1-bb3c-8bcdec9b6212 req-dd2777ac-aa59-46f0-a54a-2c3805deb129 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087413 Jul 19 20:23:04.175468 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2864/5827] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:04.781708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:04.798914 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-126370e6-13c5-4602-8492-6bc30a189620 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 1.244097 Jul 19 20:23:04.800465 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2964/5828] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:03 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:05.819581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:05.821202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:05.846284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:05.868435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:05.876084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:05.880122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:07.212880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:07.224450 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-227cc690-5dd9-4931-99db-eb01ea349c31 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1376 microversion: 2.1 time: 1.410186 Jul 19 20:23:07.239122 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2865/5829] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:05 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1376 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:08.247977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:08.249516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:08.274572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:08.275350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:08.281152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:08.283571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:09.900455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:09.920745 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-603e0292-57e9-4546-bc4b-02b7bb5ba710 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1562 microversion: 2.1 time: 1.676229 Jul 19 20:23:09.925041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2965/5830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:08 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1562 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:09.940434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:09.942038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:09.949504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=18 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:09.975854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:09.978253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:09.980783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:09.983677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.456187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:10.465240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-311dbae3-318e-46b9-9ab0-26379d6ce020 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1562 microversion: 2.1 time: 0.529525 Jul 19 20:23:10.465826 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2866/5831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:09 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1562 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:10.652389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:10.653412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:10.666330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.667062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.668066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.672859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.727147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:23:10.886219 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc78d642-1bb2-4381-bec7-22bd8f189e4f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 204 len: 0 microversion: 2.1 time: 0.237173 Jul 19 20:23:10.886844 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2966/5832] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:10 2022] DELETE /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:23:10.896889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:10.897529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:10.910838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.914403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.915571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.916084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.309493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:12.326083 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bbc8127-ae84-4ccd-91f4-70ce85c8c684 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1568 microversion: 2.1 time: 1.433395 Jul 19 20:23:12.332095 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2867/5833] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:10 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1568 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:13.359507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:13.361048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:13.374400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:13.375323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:13.376490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:13.377254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:14.184416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:14.211711 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-99ccac20-4049-435e-86ca-296ad02e3afa tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1568 microversion: 2.1 time: 0.857640 Jul 19 20:23:14.215265 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2967/5834] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:13 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1568 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:15.241109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:15.245803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:15.315079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:15.316069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:15.317547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:15.332574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:15.996041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:16.022017 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2651e595-f253-44ef-8df3-4a282c988e89 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1526 microversion: 2.1 time: 0.792114 Jul 19 20:23:16.044906 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2868/5835] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:15 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1526 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:16.180528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b709b34a-2d66-4f46-9b11-0c9efeeb7532 req-6e1d23f7-e4e6-4078-a5f7-9bbc7dc2a8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c67fb3-abee-431f-bbb0-ebb208faf228", "name": "network-vif-deleted", "tag": "15761f70-e4de-4b11-9d33-13f6d4da7c74"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:16.215771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b709b34a-2d66-4f46-9b11-0c9efeeb7532 req-6e1d23f7-e4e6-4078-a5f7-9bbc7dc2a8fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:16.225585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b709b34a-2d66-4f46-9b11-0c9efeeb7532 req-6e1d23f7-e4e6-4078-a5f7-9bbc7dc2a8fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:16.302985 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b709b34a-2d66-4f46-9b11-0c9efeeb7532 req-6e1d23f7-e4e6-4078-a5f7-9bbc7dc2a8fe service nova] Creating event network-vif-deleted:15761f70-e4de-4b11-9d33-13f6d4da7c74 for instance f0c67fb3-abee-431f-bbb0-ebb208faf228 on n-h1-843861-3 Jul 19 20:23:16.341053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b709b34a-2d66-4f46-9b11-0c9efeeb7532 req-6e1d23f7-e4e6-4078-a5f7-9bbc7dc2a8fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164980 Jul 19 20:23:16.347771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2968/5836] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:23:17.078132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:17.080061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:17.113013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.123553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.125343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.126072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.456715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:17.490414 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7af754b2-7a70-4b4c-b4c9-b8cb26431022 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.433418 Jul 19 20:23:17.517722 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2869/5837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:17 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:18.531652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:18.533279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:18.560938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:18.574332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:18.580091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:18.589915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:18.917360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:18.928376 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36b1598d-9acb-41aa-b5a5-698d2c2a11a7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.401934 Jul 19 20:23:18.944219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2969/5838] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:18 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:19.960617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:19.962373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:19.984235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:19.989554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:19.989554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:19.991970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:20.541626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:20.587127 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f635573-a05b-44bd-b63b-0d476f7cd41f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.627649 Jul 19 20:23:20.591295 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2870/5839] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:19 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:21.631190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:21.632008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:21.654438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:21.655165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:21.656127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:21.656706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:21.778850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:21.793069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af624f03-3f4a-4cd0-9f70-363c228a055b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.160088 Jul 19 20:23:21.795392 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2970/5840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:21 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:22.817229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:22.817946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:22.829011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.832459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.838896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.839476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:23.786238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:23.805039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70f6ff14-6d7e-4515-9989-a09895d5a635 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.991789 Jul 19 20:23:23.828483 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2871/5841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:22 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:24.825240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:24.825945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:24.832684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:24.833536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:24.841614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:24.842206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:25.494257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:25.517367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-101c4e28-967a-433c-8c4f-ff33cc813862 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.696242 Jul 19 20:23:25.521500 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2971/5842] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:24 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:26.540281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:26.550852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:26.573690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:26.577023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:26.578217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:26.578913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:26.872617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:26.885762 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef0692a8-a677-4dfc-80f4-9ffb925fd416 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.351514 Jul 19 20:23:26.897086 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2872/5843] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:26 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:27.915347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:27.917394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:27.939693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:27.940190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:27.940975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:27.941425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:28.525536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:28.535135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0410644a-be40-4a20-989c-54fa3f27d6ac tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 200 len: 1361 microversion: 2.1 time: 0.624263 Jul 19 20:23:28.550072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2972/5844] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:27 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:29.568959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:29.570389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:29.592983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:29.601865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:29.602915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:29.608363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:29.684346 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 HTTP/1.1 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f0c67fb3-abee-431f-bbb0-ebb208faf228'} Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:29.687337 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:23:29.693146 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:29.714773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:29.716889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ceb1b40-43d2-46d1-bfdb-149294998430 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 404 len: 111 microversion: 2.1 time: 0.151348 Jul 19 20:23:29.717787 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2873/5845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:29 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:38.460978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-663295415", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0a5c70e7-37d0-4702-8be9-dc7f3bd43115"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:38.507058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:38.534692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:38.613344 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] validate_networks() for [('0a5c70e7-37d0-4702-8be9-dc7f3bd43115', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:23:40.894017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:23:40.894687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:23:40.894971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:23:40.895322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:23:40.895783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:23:40.913277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:40.913730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:40.914566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:40.915006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:40.979964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Getting quotas for project a7fd76c505754106aa4367d3d53bcccc. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:23:40.986676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Getting quotas for user 67c585c1eafe4ae384e4e38e5352204d and project a7fd76c505754106aa4367d3d53bcccc. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:23:41.028004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:23:41.032133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:23:41.141614 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3dd27100-1dd0-41c6-b599-0d94eef9e3c5 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685379 Jul 19 20:23:41.142680 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2973/5846] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:23:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:23:41.158517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-72a2520e-f8a9-4838-b6de-153143957729 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:41.159180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-72a2520e-f8a9-4838-b6de-153143957729 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:41.161958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=15 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:41.162946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=51 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:41.294396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:41.298117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:41.311725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:41.320236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-72a2520e-f8a9-4838-b6de-153143957729 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:41.333770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:41.335325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:41.339056 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-72a2520e-f8a9-4838-b6de-153143957729 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1213 microversion: 2.1 time: 0.189857 Jul 19 20:23:41.339436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:41.341993 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2874/5847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:41 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1213 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:41.379056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:23:41.514027 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e71135ac-1782-4f86-820e-dab0047de24f tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 204 len: 0 microversion: 2.1 time: 0.228558 Jul 19 20:23:41.524632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:41.525284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:41.530256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2974/5848] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:41 2022] DELETE /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:23:41.541434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:41.542092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:41.542943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:41.543457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:41.806239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:41.819384 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a853fa4-5b80-4897-a62d-63b3ebb18c61 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1407 microversion: 2.1 time: 0.299654 Jul 19 20:23:41.830669 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2875/5849] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:41 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:42.361373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-75918092-df43-4af2-849e-5c6ab1f64153 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:42.362732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-75918092-df43-4af2-849e-5c6ab1f64153 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:42.537605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75918092-df43-4af2-849e-5c6ab1f64153 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:42.552601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-75918092-df43-4af2-849e-5c6ab1f64153 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1213 microversion: 2.1 time: 0.191639 Jul 19 20:23:42.553723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2975/5850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:42 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:42.841526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:42.842172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:42.866491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:42.869238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:42.872481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:42.874251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:43.573789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e44dce3-9abb-4073-a9a4-ddb85018681c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:43.574730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e44dce3-9abb-4073-a9a4-ddb85018681c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:43.693463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7e44dce3-9abb-4073-a9a4-ddb85018681c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:43.707170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e44dce3-9abb-4073-a9a4-ddb85018681c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1213 microversion: 2.1 time: 0.138424 Jul 19 20:23:43.708856 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2976/5851] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:43 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:44.025586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:44.034298 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4d2c1118-6a32-422d-ae28-0dfabe2cd886 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1407 microversion: 2.1 time: 1.197939 Jul 19 20:23:44.034910 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2876/5852] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:42 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1407 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:44.725122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:44.726609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:44.757586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:44.762261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:44.763482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:44.767279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:45.057982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:45.062955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:45.065448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:45.087771 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db4be4de-2095-4481-b673-fc030d2720b6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1217 microversion: 2.1 time: 0.366128 Jul 19 20:23:45.091610 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2977/5853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:44 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1217 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:45.111273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5db115a6-833f-4b27-86fc-3a7f3efde8c7 req-34ff86ab-7089-43f0-b648-e596ba7ee532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c38bc4-fb19-40d7-ae1b-dea50deb388d", "name": "network-vif-deleted", "tag": "7433eb79-7c57-40a4-bed8-90cbd5336fbf"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:45.113614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:45.130282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:45.132109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:45.135835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:45.155826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5db115a6-833f-4b27-86fc-3a7f3efde8c7 req-34ff86ab-7089-43f0-b648-e596ba7ee532 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:45.159107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5db115a6-833f-4b27-86fc-3a7f3efde8c7 req-34ff86ab-7089-43f0-b648-e596ba7ee532 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:45.235208 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5db115a6-833f-4b27-86fc-3a7f3efde8c7 req-34ff86ab-7089-43f0-b648-e596ba7ee532 service nova] Creating event network-vif-deleted:7433eb79-7c57-40a4-bed8-90cbd5336fbf for instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d on n-h1-843861-3 Jul 19 20:23:45.253462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5db115a6-833f-4b27-86fc-3a7f3efde8c7 req-34ff86ab-7089-43f0-b648-e596ba7ee532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145313 Jul 19 20:23:45.255446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2978/5854] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:23:45.530146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:45.558763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ae8fb67-608e-47b0-9078-3f5bc5ffb853 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.506946 Jul 19 20:23:45.566550 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2877/5855] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:45 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:46.109190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:46.109912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:46.138391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:46.138865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:46.139844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:46.140453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:46.592292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:46.596193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:46.614049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:46.616415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:46.617547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:46.618836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:46.652134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:46.674776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3befd7af-e257-461c-83a3-3efc55bea671 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1271 microversion: 2.1 time: 0.571628 Jul 19 20:23:46.682060 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2979/5856] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:46 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1271 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:46.857403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:46.884903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f9476f8-4b0a-40d9-81ac-9cf11c220cb6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.302758 Jul 19 20:23:46.887379 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2878/5857] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:46 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:47.561132 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:23:47.561382 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:23:47.707339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:47.709421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:47.741277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:47.744027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:47.748144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:47.749516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:47.911646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:47.916460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:47.949990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:47.957403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:47.961271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:47.964554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:48.329316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:48.329694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:48.342882 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-15961424-5032-4088-b44a-c0f3af0b4297 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.443705 Jul 19 20:23:48.358041 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2879/5858] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:47 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:48.378535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6033628f-54cc-43a5-a136-ce264dcbecd0 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.676119 Jul 19 20:23:48.380144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2980/5859] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:47 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:49.371582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:49.373672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:49.399049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:49.399667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:49.400017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:49.400837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:49.401914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:49.402604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:49.433766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:49.434253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:49.435198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:49.435639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:49.793309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:49.806043 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef3e2a7f-2058-4e31-bf9d-d3607aa595d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.438466 Jul 19 20:23:49.811210 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2880/5860] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:49 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:50.202226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:50.240163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d630f669-a167-4062-aba5-ba3b0633995a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.840941 Jul 19 20:23:50.241070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2981/5861] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:49 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:50.829141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:50.834331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:50.888372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:50.889644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:50.897579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:50.898838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:51.256917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1f5a70d4-6dbc-4ee4-ac2a-d661ef9688b1 req-bc4fd8c2-c878-44aa-aff8-e097cf9395bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc3e0d4-ea92-48f5-bee4-b7fa4922af99", "tag": "1e993f2a-2d8f-4f63-8507-a8697810e426"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:51.276001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:51.279407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1f5a70d4-6dbc-4ee4-ac2a-d661ef9688b1 req-bc4fd8c2-c878-44aa-aff8-e097cf9395bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:51.280292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1f5a70d4-6dbc-4ee4-ac2a-d661ef9688b1 req-bc4fd8c2-c878-44aa-aff8-e097cf9395bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:51.297372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1f5a70d4-6dbc-4ee4-ac2a-d661ef9688b1 req-bc4fd8c2-c878-44aa-aff8-e097cf9395bb service nova] Creating event network-changed:1e993f2a-2d8f-4f63-8507-a8697810e426 for instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 on n-h2-843861-3 Jul 19 20:23:51.304342 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1f5a70d4-6dbc-4ee4-ac2a-d661ef9688b1 req-bc4fd8c2-c878-44aa-aff8-e097cf9395bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052674 Jul 19 20:23:51.306099 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2982/5862] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:51.313401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:51.314711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:51.337133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:51.347880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:51.351459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:51.354131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:51.355498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:51.452643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:51.477637 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4da88153-9aa3-43fe-96a8-7fbe26d4ec1c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.657863 Jul 19 20:23:51.482556 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2881/5863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:50 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:52.190905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:52.201069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1eb7f77-7e87-455f-9f5f-40a8de1b5a3c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.893371 Jul 19 20:23:52.206601 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2983/5864] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:51 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:52.499993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:52.501362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:52.520013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:52.523909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:52.525165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:52.531865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:52.745534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:52.756745 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2113ab5-2997-4c5e-a7a9-fd502af3caea tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.261055 Jul 19 20:23:52.771524 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2882/5865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:52 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:53.228048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:53.230882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:53.249191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:53.250283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:53.252047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:53.253621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:53.699295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:53.719447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:53.728875 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30ac864e-dcad-45e5-9931-ffacadbfaba6 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.508052 Jul 19 20:23:53.734745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2984/5866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:53 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:53.776667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:53.779795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:53.820898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:53.821378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:53.822239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:53.822695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:53.999294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:54.018750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0abff0c-98b2-45a5-9575-ece631a1e156 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.248252 Jul 19 20:23:54.026157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2883/5867] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:53 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:54.758027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:54.759272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:54.772313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:54.776829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:54.777895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:54.779121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:55.036942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:55.038527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:55.071003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:55.071959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:55.073081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:55.073837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:55.459219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:55.480480 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07c95442-2dcd-4d36-80a9-390a812d2c69 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.725921 Jul 19 20:23:55.483328 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2985/5868] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:54 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:55.505453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:55.526590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2bb232d4-55ea-445d-9537-8ac756e6acba tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.494166 Jul 19 20:23:55.530749 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2884/5869] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:55 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:56.503454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:56.504185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:56.523977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:56.525288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:56.530485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:56.531206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:56.551719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:56.553446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:56.580043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:56.580527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:56.581357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:56.581815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:57.103064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:57.127338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-19b6cab3-693f-4edb-aa14-a7436fcf1336 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 200 len: 1200 microversion: 2.1 time: 0.580349 Jul 19 20:23:57.128236 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2885/5870] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:56 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 1200 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:57.449241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:57.465286 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9620c5c9-6d31-4f59-b97b-d521ae55f96f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.966702 Jul 19 20:23:57.468873 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2986/5871] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:56 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:58.145219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:58.145858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:58.163034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:58.166626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:58.168169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:58.169381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:58.215487 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d HTTP/1.1 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '91c38bc4-fb19-40d7-ae1b-dea50deb388d'} Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:58.218057 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:23:58.222070 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:23:58.223948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:58.225440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-85a33db5-e7ac-4d9a-889f-bb1d2beb0352 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 404 len: 111 microversion: 2.1 time: 0.084210 Jul 19 20:23:58.229895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2886/5872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:58 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:23:58.488320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:58.489144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:58.501622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:58.502261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:58.503920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:58.508483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:58.610570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-74964069", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "a1065208-db12-406e-894a-8fb406c3ab0e"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:58.687558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] validate_networks() for [('a1065208-db12-406e-894a-8fb406c3ab0e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:23:59.123644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:59.131782 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b56934cf-0a38-4ef6-bb0a-a392eea58cbd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 0.648925 Jul 19 20:23:59.138415 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2887/5873] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:58 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:59.144036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5e612a0e-e679-4baa-bc77-1da9cca924dd req-d03d1880-234f-42ec-9299-013d12bb3541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc3e0d4-ea92-48f5-bee4-b7fa4922af99", "name": "network-vif-plugged", "status": "completed", "tag": "1e993f2a-2d8f-4f63-8507-a8697810e426"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:59.170194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5e612a0e-e679-4baa-bc77-1da9cca924dd req-d03d1880-234f-42ec-9299-013d12bb3541 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:59.170824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5e612a0e-e679-4baa-bc77-1da9cca924dd req-d03d1880-234f-42ec-9299-013d12bb3541 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:59.201197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5e612a0e-e679-4baa-bc77-1da9cca924dd req-d03d1880-234f-42ec-9299-013d12bb3541 service nova] Creating event network-vif-plugged:1e993f2a-2d8f-4f63-8507-a8697810e426 for instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 on n-h2-843861-3 Jul 19 20:23:59.206955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5e612a0e-e679-4baa-bc77-1da9cca924dd req-d03d1880-234f-42ec-9299-013d12bb3541 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067204 Jul 19 20:23:59.208208 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2888/5874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:00.096225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:24:00.097065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:24:00.097736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:24:00.098472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:24:00.099097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:24:00.116588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:00.119788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:00.126341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:00.126943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:00.149972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:00.150930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:00.167338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:00.168263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:00.170761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:00.171463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Getting quotas for project a19ed2b1da7c4210ad242a5eff14ef65. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:24:00.174283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:00.200223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Getting quotas for user ea271f7053d64fefa4d25753cf71b0e3 and project a19ed2b1da7c4210ad242a5eff14ef65. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:24:00.238759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:24:00.241886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:24:00.356103 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8d55292a-b573-4133-ba49-f824d3c8bf9c tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989311 Jul 19 20:24:00.363404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2987/5875] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:23:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:24:00.369087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd474b85-3e65-4598-a173-0056f1a03e99 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:00.370009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd474b85-3e65-4598-a173-0056f1a03e99 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:00.710463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dd474b85-3e65-4598-a173-0056f1a03e99 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:00.728710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd474b85-3e65-4598-a173-0056f1a03e99 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1213 microversion: 2.1 time: 0.363599 Jul 19 20:24:00.733424 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2988/5876] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:00 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1213 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:01.118703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:01.154826 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff32a3f2-696f-4493-a916-995e59a08025 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1313 microversion: 2.1 time: 1.007836 Jul 19 20:24:01.156847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2889/5877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:00 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:01.751596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:01.752493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:01.773360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:01.775874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:01.780098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:01.781019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.077320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:02.089846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7193b3b7-9087-48b2-a243-ad412aa283ac tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1209 microversion: 2.1 time: 0.343050 Jul 19 20:24:02.095283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2989/5878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:01 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1209 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:02.193259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:02.199015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:02.289748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.296773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.306414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.312679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.790745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:02.805755 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5a314b2e-2008-43bc-ba0a-946cdd7c35f2 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1497 microversion: 2.1 time: 0.631899 Jul 19 20:24:02.806371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2890/5879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:02 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1497 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:02.868887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:02.869562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:02.884300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.888600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.889676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.890270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.940999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 HTTP/1.1 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f0c67fb3-abee-431f-bbb0-ebb208faf228'} Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:02.945468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:02.949054 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:02.954578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:02.955759 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07d849e5-1c28-48d1-b430-5ce1a43eb742 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 404 len: 111 microversion: 2.1 time: 0.092849 Jul 19 20:24:02.962642 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2990/5880] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:02 2022] DELETE /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:24:02.973487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:02.974273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: f0c67fb3-abee-431f-bbb0-ebb208faf228] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:02.989940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.993405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:02.996539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:02.999832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:03.045183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 HTTP/1.1 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'f0c67fb3-abee-431f-bbb0-ebb208faf228'} Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:03.050353 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:03.053403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance f0c67fb3-abee-431f-bbb0-ebb208faf228 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:03.053999 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df9e7d75-a2ab-4a15-8a4b-fba6bba8696e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228" status: 404 len: 111 microversion: 2.1 time: 0.086855 Jul 19 20:24:03.063376 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2891/5881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:02 2022] GET /compute/v2.1/servers/f0c67fb3-abee-431f-bbb0-ebb208faf228 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:24:03.110619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:03.112224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:03.136589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:03.137072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:03.138509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:03.138899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:03.692168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:03.693711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:03.705819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:03.706969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:03.708245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:03.708920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:03.790072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:24:03.847125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=100 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:03.989345 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09653299-7aa5-4f56-a2de-19686acce672 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 204 len: 0 microversion: 2.1 time: 0.306249 Jul 19 20:24:03.993816 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2892/5882] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:03 2022] DELETE /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:24:04.006034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:04.009546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:04.048750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.054359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.055290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.063200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.542963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:04.553337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-66a9ce92-e9ae-4f5a-a1fb-c415f540ca22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1271 microversion: 2.1 time: 1.447706 Jul 19 20:24:04.554511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2991/5883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:03 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1271 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:04.562104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:04.563230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:04.572320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.573294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.576921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.577535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.601223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d HTTP/1.1 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '91c38bc4-fb19-40d7-ae1b-dea50deb388d'} Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:04.604711 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.607947 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.612862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:04.613962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-94cb454b-3158-4d18-8e66-93702adbe21e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 404 len: 111 microversion: 2.1 time: 0.057502 Jul 19 20:24:04.615138 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2992/5884] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:04 2022] DELETE /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:24:04.627203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:04.631932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 91c38bc4-fb19-40d7-ae1b-dea50deb388d] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:04.647154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.647783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.648864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:04.649464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:04.676847 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d HTTP/1.1 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '91c38bc4-fb19-40d7-ae1b-dea50deb388d'} Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:04.679459 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. Jul 19 20:24:04.683029 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:04.685612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 91c38bc4-fb19-40d7-ae1b-dea50deb388d could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:04.686710 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c6cee8c-1ce9-4fc8-8e37-935c84bc74cc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d" status: 404 len: 111 microversion: 2.1 time: 0.063573 Jul 19 20:24:04.687833 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2993/5885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:04 2022] GET /compute/v2.1/servers/91c38bc4-fb19-40d7-ae1b-dea50deb388d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:24:04.883972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a0437a3-d2ab-468a-85bf-e61d3242eee8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: .version_select at 0x7fb88cd930d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-405241929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa8Zz7fM7pj9LkvTXn6AOhsRVZIMtco3BkCrrRVOPKNe9x46kDI6lUNYewkt7g/zKhK57eiTlNhOV6i8zI8IwmNQBv/43/nzIcCEf48xXdBDlSocqQDgYfg9noMnWXD6w=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:04.922894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:04.928696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0a0437a3-d2ab-468a-85bf-e61d3242eee8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:24:04.943743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0a0437a3-d2ab-468a-85bf-e61d3242eee8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:24:04.947361 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a60f5bb1-d3d8-4c20-abbf-0a5d9d716340 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1503 microversion: 2.1 time: 0.951506 Jul 19 20:24:04.963683 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2893/5886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:03 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1503 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:05.011587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a0437a3-d2ab-468a-85bf-e61d3242eee8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.140818 Jul 19 20:24:05.013851 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2994/5887] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:24:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:24:05.575022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:05.575699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:05.591877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:05.592361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:05.595851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:05.596446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:05.753409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:05.766843 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b163f962-1206-435f-a553-124ee6204af6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1271 microversion: 2.1 time: 0.195910 Jul 19 20:24:05.767547 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2894/5888] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:05 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:05.972189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:05.972851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:05.988052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:05.988815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:05.989856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:05.990641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:06.547483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:06.557504 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-513c6aa4-6f3f-49f2-9e55-f916c25de15c tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1503 microversion: 2.1 time: 0.590415 Jul 19 20:24:06.563275 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2995/5889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:05 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1503 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:06.787010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:06.800863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:06.814296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:06.825516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:06.827482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:06.828580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:07.537461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:07.553743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5b026ec-5805-4291-b452-e2dfe8c146e9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 0.773616 Jul 19 20:24:07.556270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2895/5890] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:06 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:07.585678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:07.586736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:07.599285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:07.599747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:07.602060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:07.604024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:07.679389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:08.574775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:08.578569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:08.602203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:08.608139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:08.609546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:08.615710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:08.617059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:08.627367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c8109d8-b48c-434a-be91-494be93c8a26 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 200 len: 1461 microversion: 2.1 time: 1.049240 Jul 19 20:24:08.629847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2996/5891] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:07 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 1461 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:08.700906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0baaa6df-ca6d-4533-8264-55904de4c764 req-c560884d-d62b-434c-a4bd-e24f5d091f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc3e0d4-ea92-48f5-bee4-b7fa4922af99", "name": "network-vif-deleted", "tag": "1e993f2a-2d8f-4f63-8507-a8697810e426"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:08.715142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:08.742711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0baaa6df-ca6d-4533-8264-55904de4c764 req-c560884d-d62b-434c-a4bd-e24f5d091f79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:08.743222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0baaa6df-ca6d-4533-8264-55904de4c764 req-c560884d-d62b-434c-a4bd-e24f5d091f79 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:08.792847 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0baaa6df-ca6d-4533-8264-55904de4c764 req-c560884d-d62b-434c-a4bd-e24f5d091f79 service nova] Creating event network-vif-deleted:1e993f2a-2d8f-4f63-8507-a8697810e426 for instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 on n-h2-843861-3 Jul 19 20:24:08.817656 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0baaa6df-ca6d-4533-8264-55904de4c764 req-c560884d-d62b-434c-a4bd-e24f5d091f79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122783 Jul 19 20:24:08.821442 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2997/5892] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:24:09.456054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:09.474313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bfcf3a8f-477f-48e9-bb25-745cb281c0ee tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 0.906954 Jul 19 20:24:09.475466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2896/5893] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:08 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:09.655251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:09.656137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:09.677829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:09.678289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:09.679317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:09.680132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:09.712601 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] HTTP exception thrown: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Request method failure captured: Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 HTTP/1.1 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xLFG1whsuqCkxsdMLwk2s7PSVewUK5Y1dLnxJtatn6VMJFU7qQlDpQEeRgeFHcTCQE9djWMR0zFdHIxtCtJcV82jNowptBe92M4P7ieCBMN9vsgy94_be7hGDdtng-P1MeGXhotVhpzJQRhgOW6TIdIomg8TmbsyBYP7lh8YvIDx5k Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: a7fd76c505754106aa4367d3d53bcccc Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: a7fd76c505754106aa4367d3d53bcccc Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesActionsTest-2130501928-project Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 67c585c1eafe4ae384e4e38e5352204d Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesActionsTest-2130501928-project Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2cc3e0d4-ea92-48f5-bee4-b7fa4922af99'} Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:09.715527 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. Jul 19 20:24:09.718902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:24:09.724652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Returning 404 to user: Instance 2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:09.725881 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c3b720c1-7503-40dd-8374-61d939dfe72e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99" status: 404 len: 111 microversion: 2.1 time: 0.075629 Jul 19 20:24:09.727034 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2998/5894] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:09 2022] GET /compute/v2.1/servers/2cc3e0d4-ea92-48f5-bee4-b7fa4922af99 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:24:09.999490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1442387842", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "0a5c70e7-37d0-4702-8be9-dc7f3bd43115"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:10.142242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] validate_networks() for [('0a5c70e7-37d0-4702-8be9-dc7f3bd43115', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:24:10.492660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:10.493318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:10.503323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:10.518478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:10.518937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:10.519744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:10.520215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:11.442038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:11.461944 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d54a90e7-7c45-4a90-b96b-8bcbbc573578 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 0.973994 Jul 19 20:24:11.463404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 2999/5895] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:10 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:11.474239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a0d5e5a0-1dce-47c5-a252-9d6460ef9de6 req-9bce1315-11de-4858-a39d-3f831a703d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38527d5-feea-499a-bd4a-457cef2e6c86", "tag": "d766f851-0d1b-4ef0-b69d-b437ed1cc955"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:11.499377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a0d5e5a0-1dce-47c5-a252-9d6460ef9de6 req-9bce1315-11de-4858-a39d-3f831a703d0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:11.512760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a0d5e5a0-1dce-47c5-a252-9d6460ef9de6 req-9bce1315-11de-4858-a39d-3f831a703d0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:11.535351 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a0d5e5a0-1dce-47c5-a252-9d6460ef9de6 req-9bce1315-11de-4858-a39d-3f831a703d0f service nova] Creating event network-changed:d766f851-0d1b-4ef0-b69d-b437ed1cc955 for instance c38527d5-feea-499a-bd4a-457cef2e6c86 on n-h1-843861-3 Jul 19 20:24:11.560054 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a0d5e5a0-1dce-47c5-a252-9d6460ef9de6 req-9bce1315-11de-4858-a39d-3f831a703d0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094304 Jul 19 20:24:11.567372 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3000/5896] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:12.370043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:24:12.370993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:24:12.372292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:24:12.372872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:24:12.373996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:24:12.378728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:12.424131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.425327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.426335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.428543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.483643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:12.484559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:12.495857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.509406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Getting quotas for project a7fd76c505754106aa4367d3d53bcccc. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:24:12.512526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.513714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.514375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.528994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Getting quotas for user 67c585c1eafe4ae384e4e38e5352204d and project a7fd76c505754106aa4367d3d53bcccc. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:24:12.550660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:24:12.554165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:24:12.708959 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-974495a2-1206-4576-add3-f8e752fad32e tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.711549 Jul 19 20:24:12.711190 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2897/5897] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:24:12.724699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db498e04-e6f1-47a4-a32b-be68382655f7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:12.726241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db498e04-e6f1-47a4-a32b-be68382655f7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:13.069095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db498e04-e6f1-47a4-a32b-be68382655f7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:13.077862 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db498e04-e6f1-47a4-a32b-be68382655f7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1214 microversion: 2.1 time: 0.360751 Jul 19 20:24:13.078464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2898/5898] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:12 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:13.546751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:13.581213 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0be6195-2d43-42f2-8c5d-ab32fb7f5146 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 1.092460 Jul 19 20:24:13.583079 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3001/5899] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:12 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:14.097009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:14.099135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:14.126482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.128600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.135244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.142946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.434049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:14.450385 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ba9ee23-40d4-4c9d-89f3-d78d25a553b1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1218 microversion: 2.1 time: 0.351073 Jul 19 20:24:14.451106 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2899/5900] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:14 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:14.603312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:14.605352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:14.625188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.631245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.637211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.638842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.964459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:15.471335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:15.472490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:15.490172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:15.490172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:15.490172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:15.492740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:15.695957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:15.710235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35242e16-1eb1-420b-b05f-30f32409733f tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1284 microversion: 2.1 time: 0.247079 Jul 19 20:24:15.711341 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2900/5901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:15 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:15.773546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:15.792298 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac12989d-729b-47a4-ba4c-76eca7585070 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 1.196406 Jul 19 20:24:15.796100 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3002/5902] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:14 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:16.732348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:16.734573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:16.753101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.753751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:16.754691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.757129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:16.815614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:16.816499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:16.845397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.853136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:16.859286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.862204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:17.210362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:17.220140 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dda60150-6fb8-41d8-b9a1-1e1c9e2071dc tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1272 microversion: 2.1 time: 0.494352 Jul 19 20:24:17.235041 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2901/5903] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:16 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:17.743341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:17.751715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c7291da0-b20a-4b4c-a1d3-63925e92e679 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 0.942348 Jul 19 20:24:17.762008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3003/5904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:16 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:18.247122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:18.248311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:18.280772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.281257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.289547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.290081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.504032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8bb9a357-4078-4b35-9bb8-7ee0da5d6755 req-cd520446-1eea-4fdd-8cdc-645c4c6da7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38527d5-feea-499a-bd4a-457cef2e6c86", "name": "network-vif-plugged", "status": "completed", "tag": "d766f851-0d1b-4ef0-b69d-b437ed1cc955"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:18.530917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8bb9a357-4078-4b35-9bb8-7ee0da5d6755 req-cd520446-1eea-4fdd-8cdc-645c4c6da7cc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.533091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8bb9a357-4078-4b35-9bb8-7ee0da5d6755 req-cd520446-1eea-4fdd-8cdc-645c4c6da7cc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.567961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8bb9a357-4078-4b35-9bb8-7ee0da5d6755 req-cd520446-1eea-4fdd-8cdc-645c4c6da7cc service nova] Creating event network-vif-plugged:d766f851-0d1b-4ef0-b69d-b437ed1cc955 for instance c38527d5-feea-499a-bd4a-457cef2e6c86 on n-h1-843861-3 Jul 19 20:24:18.586433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8bb9a357-4078-4b35-9bb8-7ee0da5d6755 req-cd520446-1eea-4fdd-8cdc-645c4c6da7cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088075 Jul 19 20:24:18.588026 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3004/5905] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:18.771922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:18.772664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:18.782680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.783354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.791377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.792118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:19.308074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:19.324735 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa393d79-df4a-402b-a3b5-858e7dc70174 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 1.085410 Jul 19 20:24:19.325483 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2902/5906] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:18 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:19.456373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:19.466452 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6596bf00-039f-4d27-ad71-9d69ef0ada0a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1313 microversion: 2.1 time: 0.699640 Jul 19 20:24:19.475320 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3005/5907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:18 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:20.347332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:20.349150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:20.381368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.381801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.384271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.388504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.505026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:20.507342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:20.529911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.531110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.535172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.536027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.081205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:21.096392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00d02f6c-8f3b-497b-bfa5-e59d4784c0e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1501 microversion: 2.1 time: 0.597420 Jul 19 20:24:21.098395 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3006/5908] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:20 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1501 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:21.114012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:21.115252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:21.124086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.125103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.126210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.127024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.198687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:21.208947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0156574-6f97-45e7-b46b-90ad9237636d tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.869674 Jul 19 20:24:21.211155 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2903/5909] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:20 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:21.673065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:21.682039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-55571e3a-5bdd-4494-8fb6-91b11341ee95 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1501 microversion: 2.1 time: 0.571795 Jul 19 20:24:21.687055 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3007/5910] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:21 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1501 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:21.703218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:21.705112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:21.715660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.720200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.721332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.722145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.756064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lazy-loading 'flavor' on Instance uuid c38527d5-feea-499a-bd4a-457cef2e6c86 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:24:21.914603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c15a6f2-6d00-4e81-af44-f52b8e21f4d9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action" status: 202 len: 0 microversion: 2.1 time: 0.212815 Jul 19 20:24:21.915455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2904/5911] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:24:21 2022] POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:24:21.925537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:21.926510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:21.932882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.941479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.944358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:21.946467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:21.982611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-366cfc9b-4377-47b0-b957-c3dda722e8c7 req-0aaaf49d-6dab-4a31-b669-7920702018f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc461f5-02fa-45be-b4ec-3ccad6882e6e", "tag": "4f083531-6f16-4dd2-906a-3af248864bfe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:21.999133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-366cfc9b-4377-47b0-b957-c3dda722e8c7 req-0aaaf49d-6dab-4a31-b669-7920702018f9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:22.003403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-366cfc9b-4377-47b0-b957-c3dda722e8c7 req-0aaaf49d-6dab-4a31-b669-7920702018f9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:22.033343 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-366cfc9b-4377-47b0-b957-c3dda722e8c7 req-0aaaf49d-6dab-4a31-b669-7920702018f9 service nova] Creating event network-changed:4f083531-6f16-4dd2-906a-3af248864bfe for instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e on n-h2-843861-3 Jul 19 20:24:22.045387 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-366cfc9b-4377-47b0-b957-c3dda722e8c7 req-0aaaf49d-6dab-4a31-b669-7920702018f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067380 Jul 19 20:24:22.049042 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2905/5912] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:24:22.237237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:22.237973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:22.253183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:22.256258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:22.259423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:22.261651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:22.464238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:23.074216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:23.118213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:23.132473 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2912cbe5-7460-44e3-99c7-8d57abfd0fe1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1509 microversion: 2.1 time: 1.209365 Jul 19 20:24:23.134523 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3008/5913] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:21 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1509 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:23.174778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:23.188203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ab3e397-7f48-429d-8738-f730cb1883cb tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.952345 Jul 19 20:24:23.189649 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2906/5914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:22 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:24.149270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:24.150235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:24.171199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.171697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.172523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.172963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.207006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:24.207653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:24.217809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.226821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.229541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.230470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.583856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:24.613474 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e38a5da-792d-4515-bdc1-1892f818fa06 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1492 microversion: 2.1 time: 0.464951 Jul 19 20:24:24.616816 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3009/5915] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:24 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1492 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:24.636685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:24.638547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:24.664386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.664855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.665654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.666097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.933815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:24.934003 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6612498c-3139-49b6-aecb-778361759cf2 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action" status: 202 len: 0 microversion: 2.1 time: 0.305382 Jul 19 20:24:24.935618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3010/5916] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:24:24 2022] POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:24:24.949107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fad76851-ac9d-4204-aa60-c553c95be07a tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.746093 Jul 19 20:24:24.953682 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2907/5917] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:24 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:24.954095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:24.955303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:24.963394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.964276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:24.966695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:24.967506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:25.758753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:25.774374 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6a22d1e-cb68-4684-8b1a-900501874573 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1498 microversion: 2.1 time: 0.832694 Jul 19 20:24:25.777173 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3011/5918] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:24 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1498 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:25.979682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:25.983599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:26.011834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:26.025310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:26.027087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:26.028126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:26.646733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:26.659903 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73055bd8-9d2d-4799-be38-96592a6594a7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.688156 Jul 19 20:24:26.665631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2908/5919] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:25 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:26.802762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:26.807194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:26.839098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:26.843205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:26.847258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:26.848537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:27.555550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:27.565559 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-625ec24c-3749-4372-bb9f-29d2f65dc5c6 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1498 microversion: 2.1 time: 0.771153 Jul 19 20:24:27.571860 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3012/5920] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:26 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1498 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:27.686674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:27.688186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:27.710809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:27.713265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:27.715029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:27.718092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:27.862947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:28.590428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:28.592726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:28.608347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:28.609457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:28.615126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:28.616577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:28.734220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:28.749971 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57c8bb4c-f6e5-4fcc-9c44-be538c72707b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 1.070457 Jul 19 20:24:28.753174 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2909/5921] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:27 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:28.893291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:28.903793 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-06a53cc7-a214-4df3-a276-7d0d26698a22 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1501 microversion: 2.1 time: 0.318273 Jul 19 20:24:28.905241 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3013/5922] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:28 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:28.927377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:28.928374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:28.946523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:28.948523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:28.950373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:28.952441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.025817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lazy-loading 'flavor' on Instance uuid c38527d5-feea-499a-bd4a-457cef2e6c86 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:24:29.183262 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4acced6c-c222-4923-baab-b19a0a72fea9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action" status: 202 len: 0 microversion: 2.1 time: 0.262587 Jul 19 20:24:29.184546 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2910/5923] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:24:28 2022] POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:24:29.193994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:29.193994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:29.208028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:29.208961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.236205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:29.236856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.519307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:29.525176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:29.537155 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-04b012ef-6687-4365-a0df-0ac98e64853a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1509 microversion: 2.1 time: 0.347596 Jul 19 20:24:29.538411 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3014/5924] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:29 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:29.719987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e6761a20-e4c3-46ce-8564-97e5f9dc7257 req-1ee47980-371a-4649-9265-c910d56f7f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc461f5-02fa-45be-b4ec-3ccad6882e6e", "name": "network-vif-plugged", "status": "completed", "tag": "4f083531-6f16-4dd2-906a-3af248864bfe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:29.750503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e6761a20-e4c3-46ce-8564-97e5f9dc7257 req-1ee47980-371a-4649-9265-c910d56f7f95 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:29.759759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e6761a20-e4c3-46ce-8564-97e5f9dc7257 req-1ee47980-371a-4649-9265-c910d56f7f95 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.772930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:29.777204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:29.796662 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e6761a20-e4c3-46ce-8564-97e5f9dc7257 req-1ee47980-371a-4649-9265-c910d56f7f95 service nova] Creating event network-vif-plugged:4f083531-6f16-4dd2-906a-3af248864bfe for instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e on n-h2-843861-3 Jul 19 20:24:29.802473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:29.803886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.805525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:29.806813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:29.808421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e6761a20-e4c3-46ce-8564-97e5f9dc7257 req-1ee47980-371a-4649-9265-c910d56f7f95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094768 Jul 19 20:24:29.813981 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2911/5925] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:24:30.270173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:30.312374 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-448c4a08-15c3-414b-9c68-745a8e071fd7 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.520397 Jul 19 20:24:30.324751 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3015/5926] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:29 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:30.562651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:30.563836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:30.587737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:30.588778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:30.590222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:30.593485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:30.965577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:30.985606 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebfdf918-3b82-4de7-997c-9885f503f3fb tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1492 microversion: 2.1 time: 0.429794 Jul 19 20:24:30.986988 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2912/5927] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:30 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1492 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:31.005225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:31.006135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:31.046803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.047837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.049575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.051593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.238553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ecb9fe7-122f-41c9-a369-d4a808d8d9e1 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action" status: 202 len: 0 microversion: 2.1 time: 0.239049 Jul 19 20:24:31.242763 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3016/5928] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:24:30 2022] POST /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:24:31.252711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:31.253587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:31.267395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.268670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.272439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.274045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.333985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:31.336174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:31.347429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.348619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.350698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:31.351325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:31.905217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:31.915951 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-16ab2b1e-4d65-4cb4-97ee-069a27f1fb68 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1314 microversion: 2.1 time: 0.588314 Jul 19 20:24:31.917214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3017/5929] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:31 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:31.970787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:31.983447 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58927076-b572-4a06-a107-63e2002e4bad tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1498 microversion: 2.1 time: 0.738852 Jul 19 20:24:31.997746 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2913/5930] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:31 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1498 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:32.933723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:32.935716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:32.948975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:32.949438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:32.950912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:32.951451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:33.005118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:33.006608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:33.029196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:33.029196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:33.029196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:33.029196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:33.520954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:33.539764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-46c1c4f4-67aa-46ee-91d0-d9eb68bfa6e3 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1498 microversion: 2.1 time: 0.610325 Jul 19 20:24:33.557160 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3018/5931] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:32 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1498 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:33.609370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:33.619440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f2303a4-a540-452d-87ca-5835227a0ec5 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1498 microversion: 2.1 time: 0.620383 Jul 19 20:24:33.620099 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2914/5932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:32 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1498 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:34.441790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:34.444719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:34.452845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.453503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:34.454304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.455447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:34.502668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:24:34.638991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:34.639852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:34.653261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.654846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:34.657627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.658168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:34.713744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6c3871a-4f90-4c9e-8180-519a025b6afd tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 204 len: 0 microversion: 2.1 time: 0.276418 Jul 19 20:24:34.714782 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3019/5933] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:34 2022] DELETE /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:24:34.731660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:34.732731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:34.750784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.751897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:34.753265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:34.754327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:35.114272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:35.132341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c076b67d-9ba0-4124-a81c-93f15042736b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1504 microversion: 2.1 time: 0.412113 Jul 19 20:24:35.144853 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3020/5934] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:34 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:35.240721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:35.270145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa8a66ab-2079-4944-9d05-43ba60575810 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1501 microversion: 2.1 time: 0.635879 Jul 19 20:24:35.270674 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2915/5935] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:34 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1501 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:35.299993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:35.300742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:35.318723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:35.319248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:35.322731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:35.323246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:35.381246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:24:35.542273 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-617cacdf-fef8-4342-9495-e31932eaa7e0 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 204 len: 0 microversion: 2.1 time: 0.246381 Jul 19 20:24:35.542922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3021/5936] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:35 2022] DELETE /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:24:35.553965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:35.555413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:35.565329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:35.566542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:35.567629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:35.568780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:35.890912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:35.901069 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4ac408f9-eb9b-4eb7-bf88-baabb793b4ba tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1507 microversion: 2.1 time: 0.351187 Jul 19 20:24:35.901666 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2916/5937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:35 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:36.163956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:36.164962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:36.173108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:36.176337 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:36.177401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:36.177971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:36.770166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:36.797893 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffa07e35-1a2a-45ed-851c-87b2a4e6cab1 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1504 microversion: 2.1 time: 0.640574 Jul 19 20:24:36.802892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3022/5938] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:36 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:36.919897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:36.920598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:36.939624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:36.941656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:36.943001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:36.943465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:37.820914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:37.821543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:37.833221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:37.837457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:37.841924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:37.842638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:37.892672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:37.900623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d3c2b97-c696-451f-be4c-e85c02e46d9a tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1507 microversion: 2.1 time: 0.985509 Jul 19 20:24:37.908428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2917/5939] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:36 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1507 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:38.039404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c585c1eafe4ae384e4e38e5352204d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd76c505754106aa4367d3d53bcccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:38.050599 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87154cc4-971d-46bb-a119-7573a7882931 tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 200 len: 1462 microversion: 2.1 time: 0.233961 Jul 19 20:24:38.061416 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3023/5940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:37 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 1462 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:38.174884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0524c2a2-cb6c-40ed-8c6e-1c3f0d9a005f req-90b66fae-e521-47db-8b57-54c4b38aec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc461f5-02fa-45be-b4ec-3ccad6882e6e", "name": "network-vif-deleted", "tag": "4f083531-6f16-4dd2-906a-3af248864bfe"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:38.196276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0524c2a2-cb6c-40ed-8c6e-1c3f0d9a005f req-90b66fae-e521-47db-8b57-54c4b38aec4f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:38.197051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0524c2a2-cb6c-40ed-8c6e-1c3f0d9a005f req-90b66fae-e521-47db-8b57-54c4b38aec4f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:38.230505 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0524c2a2-cb6c-40ed-8c6e-1c3f0d9a005f req-90b66fae-e521-47db-8b57-54c4b38aec4f service nova] Creating event network-vif-deleted:4f083531-6f16-4dd2-906a-3af248864bfe for instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e on n-h2-843861-3 Jul 19 20:24:38.246082 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0524c2a2-cb6c-40ed-8c6e-1c3f0d9a005f req-90b66fae-e521-47db-8b57-54c4b38aec4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075370 Jul 19 20:24:38.247100 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2918/5941] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:38.926644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:38.928242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:38.956039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:38.957721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:38.960380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:38.968671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:39.073449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:39.075344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] [instance: ccc461f5-02fa-45be-b4ec-3ccad6882e6e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:39.092157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:39.093267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:39.096290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:39.097769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:39.121132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] HTTP exception thrown: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Request method failure captured: Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e HTTP/1.1 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xLFG1whsuqCkxsdMLwk2s7PSVewUK5Y1dLnxJtatn6VMJFU7qQlDpQEeRgeFHcTCQE9djWMR0zFdHIxtCtJcV82jNowptBe92M4P7ieCBMN9vsgy94_be7hGDdtng-P1MeGXhotVhpzJQRhgOW6TIdIomg8TmbsyBYP7lh8YvIDx5k Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a7fd76c505754106aa4367d3d53bcccc Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7fd76c505754106aa4367d3d53bcccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a7fd76c505754106aa4367d3d53bcccc Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-VolumesActionsTest-2130501928 Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-VolumesActionsTest-2130501928-project Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 67c585c1eafe4ae384e4e38e5352204d Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-VolumesActionsTest-2130501928-project Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ccc461f5-02fa-45be-b4ec-3ccad6882e6e'} Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:39.126025 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. Jul 19 20:24:39.129579 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:39.144316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] Returning 404 to user: Instance ccc461f5-02fa-45be-b4ec-3ccad6882e6e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:39.147104 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-464eae9c-9a37-4099-baae-5ef5646d947b tempest-VolumesActionsTest-2130501928 tempest-VolumesActionsTest-2130501928-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e" status: 404 len: 111 microversion: 2.1 time: 0.078762 Jul 19 20:24:39.149019 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2919/5942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:39 2022] GET /compute/v2.1/servers/ccc461f5-02fa-45be-b4ec-3ccad6882e6e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:24:39.742084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:39.751844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0f60e74-0d57-4fe2-bf12-3a9d3890bd88 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1507 microversion: 2.1 time: 0.830106 Jul 19 20:24:39.752453 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3024/5943] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:38 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1507 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:40.292853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-cc63124f-4b42-4a31-bdc5-4e39222c4b54 req-c71640c4-e8ee-453e-b9eb-602aa19ffafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38527d5-feea-499a-bd4a-457cef2e6c86", "name": "network-vif-deleted", "tag": "d766f851-0d1b-4ef0-b69d-b437ed1cc955"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:40.327122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cc63124f-4b42-4a31-bdc5-4e39222c4b54 req-c71640c4-e8ee-453e-b9eb-602aa19ffafe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:40.328295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-cc63124f-4b42-4a31-bdc5-4e39222c4b54 req-c71640c4-e8ee-453e-b9eb-602aa19ffafe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:40.384397 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-cc63124f-4b42-4a31-bdc5-4e39222c4b54 req-c71640c4-e8ee-453e-b9eb-602aa19ffafe service nova] Creating event network-vif-deleted:d766f851-0d1b-4ef0-b69d-b437ed1cc955 for instance c38527d5-feea-499a-bd4a-457cef2e6c86 on n-h1-843861-3 Jul 19 20:24:40.405733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-cc63124f-4b42-4a31-bdc5-4e39222c4b54 req-c71640c4-e8ee-453e-b9eb-602aa19ffafe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119625 Jul 19 20:24:40.408190 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2920/5944] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:40.774812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:40.780125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:40.793242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:40.811216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:40.813051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:40.815102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:40.828649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:40.954195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:40.955622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:40.956713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lazy-loading 'fault' on Instance uuid c38527d5-feea-499a-bd4a-457cef2e6c86 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:24:41.032172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea271f7053d64fefa4d25753cf71b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19ed2b1da7c4210ad242a5eff14ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:41.046981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-31c29b75-66ea-4cd0-ae5b-e01cf8528fa7 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 200 len: 1303 microversion: 2.1 time: 0.280392 Jul 19 20:24:41.048444 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3025/5945] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:40 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:42.076724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:42.078419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] [instance: c38527d5-feea-499a-bd4a-457cef2e6c86] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:42.108150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:42.109036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:42.112069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:42.112702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:42.157484 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] HTTP exception thrown: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Request method failure captured: Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 HTTP/1.1 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xLamk0V9VaG65S6gULLw62h3HqAdAK47jgpug-V3Aw1GW1cdUAvYsHE-mmRLJ7RHP3-vT26jGNWAJaw2McSDhp2xnzz2yKSu2OlT-vGc2--zD88gsbQ5hQF_-9zkup5_fpMkHHfGC7mE9_DJrPWuNGFL12raRd0rDu9JZ72csj4p4E Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: a19ed2b1da7c4210ad242a5eff14ef65 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestServerAdvancedOps-1483950113 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a19ed2b1da7c4210ad242a5eff14ef65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a19ed2b1da7c4210ad242a5eff14ef65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a19ed2b1da7c4210ad242a5eff14ef65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a19ed2b1da7c4210ad242a5eff14ef65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestServerAdvancedOps-1483950113 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: a19ed2b1da7c4210ad242a5eff14ef65 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestServerAdvancedOps-1483950113 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestServerAdvancedOps-1483950113-project Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea271f7053d64fefa4d25753cf71b0e3 Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestServerAdvancedOps-1483950113-project Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c38527d5-feea-499a-bd4a-457cef2e6c86'} Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:42.166492 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] Returning 404 to user: Instance c38527d5-feea-499a-bd4a-457cef2e6c86 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fa230c7-2b84-4252-ae90-ba287a0866a9 tempest-TestServerAdvancedOps-1483950113 tempest-TestServerAdvancedOps-1483950113-project] 10.222.0.33 "GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86" status: 404 len: 111 microversion: 2.1 time: 0.099976 Jul 19 20:24:42.170156 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2921/5946] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:42 2022] GET /compute/v2.1/servers/c38527d5-feea-499a-bd4a-457cef2e6c86 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:24:47.814149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1219642347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-405241929", "security_groups": [{"name": "tempest-secgroup-smoke-89582101"}], "block_device_mapping_v2": [{"uuid": "395530d5-f694-414c-802a-df579eaa2d1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:48.252868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:24:50.336584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:24:50.337573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:24:50.337573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:24:50.337855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:24:50.338686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:24:50.368574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:50.369539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:50.371000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:50.372200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:50.443557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:24:50.462753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:24:50.631108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:24:50.633632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='395530d5-f694-414c-802a-df579eaa2d1d',volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:24:51.015233 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-941849bd-10f3-4e80-800b-af46a4e0c45b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.205587 Jul 19 20:24:51.022204 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3026/5947] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:24:47 2022] POST /compute/v2.1/servers => generated 404 bytes in 3214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:24:51.030335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f225ae67-857f-456d-ad60-97f29e66caee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:51.031336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f225ae67-857f-456d-ad60-97f29e66caee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:51.041506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:51.495778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f225ae67-857f-456d-ad60-97f29e66caee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:51.513975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f225ae67-857f-456d-ad60-97f29e66caee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1094 microversion: 2.1 time: 0.490490 Jul 19 20:24:51.515730 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2922/5948] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:51 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1094 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:52.534162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:52.536163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:52.550137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:52.550930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:52.555417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:52.556011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:52.599756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:52.712816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:52.725884 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-473c3a6b-5d68-449b-be04-62e87a4e37f7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1144 microversion: 2.1 time: 0.196222 Jul 19 20:24:52.726634 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3027/5949] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:52 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1144 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:53.747735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:53.748880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:53.790083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:53.792596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:53.796557 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:53.801920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:53.805294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:54.013267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:54.030607 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9e1637e-34c8-4bf8-8ced-c79456a97450 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1210 microversion: 2.1 time: 0.286215 Jul 19 20:24:54.032302 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2923/5950] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:53 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:55.062413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:55.063195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:55.084458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:55.084922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:55.085738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:55.086185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:55.512620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:55.523538 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3494fddc-8801-4748-bf3f-0d49264377c8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1210 microversion: 2.1 time: 0.465581 Jul 19 20:24:55.536056 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3028/5951] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:55 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1210 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:56.557315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:56.558626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:56.573524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:56.575078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:56.576790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:56.578166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:57.855916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:57.869052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9c7531d-2d35-4c96-ae8c-9c0c5af48f3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1276 microversion: 2.1 time: 1.331069 Jul 19 20:24:57.872767 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2924/5952] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:56 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1276 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:58.891279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:58.892573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:58.912609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:58.913340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:58.922067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:58.922990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:59.698937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:59.717118 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05632113-b0e7-449d-a7a4-a7829aa9e2a6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1276 microversion: 2.1 time: 0.831320 Jul 19 20:24:59.725930 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3029/5953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:58 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1276 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:00.768014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:00.768683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:00.821367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:00.821970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:00.829102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:00.850404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:01.514523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:02.137848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f9fc1828-53ff-4145-987f-5be28e699021 req-d9063c8b-4dfd-43a3-8d1a-ff9455519ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f78aa1-79f0-4fc4-afc7-19f14efbff03", "tag": "d89cd63b-5b41-47ff-b972-429fbc181dfd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:02.157538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:02.169007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:02.181043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f9fc1828-53ff-4145-987f-5be28e699021 req-d9063c8b-4dfd-43a3-8d1a-ff9455519ab0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:02.192233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f9fc1828-53ff-4145-987f-5be28e699021 req-d9063c8b-4dfd-43a3-8d1a-ff9455519ab0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:02.238641 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f9fc1828-53ff-4145-987f-5be28e699021 req-d9063c8b-4dfd-43a3-8d1a-ff9455519ab0 service nova] Creating event network-changed:d89cd63b-5b41-47ff-b972-429fbc181dfd for instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 on n-h1-843861-3 Jul 19 20:25:02.258328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f9fc1828-53ff-4145-987f-5be28e699021 req-d9063c8b-4dfd-43a3-8d1a-ff9455519ab0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131290 Jul 19 20:25:02.258966 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3030/5954] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:25:02.534752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:02.557392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20fb14c6-6d21-44d6-90ec-382070d39103 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1276 microversion: 2.1 time: 1.817700 Jul 19 20:25:02.559588 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2925/5955] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:00 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1276 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:03.580274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:03.581909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:03.621705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:03.624760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:03.627868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:03.630067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:06.514053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:06.560466 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-468ae6cb-3b9a-43bf-a651-075ff1612436 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1276 microversion: 2.1 time: 2.969011 Jul 19 20:25:06.572364 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3031/5956] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:03 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1276 bytes in 3000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:07.580527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:07.581171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:07.602129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:07.604625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:07.605744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:07.615211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:08.497854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:08.520084 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-654d8271-e9e7-4292-acd1-0054e8b88f29 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1276 microversion: 2.1 time: 0.943232 Jul 19 20:25:08.529062 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2926/5957] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:07 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1276 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:09.551623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:09.559799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:09.640993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:09.641816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:09.643056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:09.643614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:10.146622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:10.156586 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1887bc9-3b6d-46a5-b8af-e62785b5c720 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.613548 Jul 19 20:25:10.161559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3032/5958] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:09 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:11.187319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:11.192306 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:11.227999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:11.242496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:11.245524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:11.260032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:12.014698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:12.031591 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c70923df-b844-4b79-8986-79b791fd1a73 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.854104 Jul 19 20:25:12.041449 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2927/5959] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:11 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:13.071668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:13.073601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:13.089511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:13.097779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:13.100777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:13.110384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:13.115231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:13.578367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:13.595757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4993efb1-7485-46a9-b97f-8a354718b11e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.543154 Jul 19 20:25:13.598888 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3033/5960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:13 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:14.618367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:14.619747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:14.637208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:14.638069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:14.639181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:14.639923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:14.999042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:15.008657 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2410851-7a7e-443f-808a-33f8616f9f47 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.394630 Jul 19 20:25:15.016152 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2928/5961] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:14 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:16.031778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:16.034062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:16.046459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:16.047309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:16.051762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:16.061098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:16.719182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:16.729846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97dca4f6-5914-48c1-9c22-10bd70c37201 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.700899 Jul 19 20:25:16.746189 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3034/5962] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:16 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:17.751009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:17.752577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:17.765837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:17.766578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:17.767563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:17.768219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:18.043514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:18.060027 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb1cc0ee-c20e-4c4a-9c85-d7d05b2823b6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.312481 Jul 19 20:25:18.073602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2929/5963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:17 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:18.703714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9b3dd1a7-82ca-46bd-bbb0-0a67877769f1 req-2c4d0f2e-6c78-4a05-a481-238baa7722fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f78aa1-79f0-4fc4-afc7-19f14efbff03", "name": "network-vif-plugged", "status": "completed", "tag": "d89cd63b-5b41-47ff-b972-429fbc181dfd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:18.734205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9b3dd1a7-82ca-46bd-bbb0-0a67877769f1 req-2c4d0f2e-6c78-4a05-a481-238baa7722fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:18.735047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9b3dd1a7-82ca-46bd-bbb0-0a67877769f1 req-2c4d0f2e-6c78-4a05-a481-238baa7722fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:18.774738 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9b3dd1a7-82ca-46bd-bbb0-0a67877769f1 req-2c4d0f2e-6c78-4a05-a481-238baa7722fb service nova] Creating event network-vif-plugged:d89cd63b-5b41-47ff-b972-429fbc181dfd for instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 on n-h1-843861-3 Jul 19 20:25:18.794386 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9b3dd1a7-82ca-46bd-bbb0-0a67877769f1 req-2c4d0f2e-6c78-4a05-a481-238baa7722fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093627 Jul 19 20:25:18.804150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3035/5964] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:25:19.081054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:19.082270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:19.116839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:19.117312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:19.133129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:19.138108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:19.507845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:19.528223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf056c8e-3e24-4ef5-a1e0-e585ceaf11a0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1264 microversion: 2.1 time: 0.453332 Jul 19 20:25:19.536604 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2930/5965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:19 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1264 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:20.554776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:20.556334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:20.581219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:20.581677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:20.588942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:20.592261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:21.745685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:21.829950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b15aae6-63cf-4355-b87e-eaf07d52514b tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1450 microversion: 2.1 time: 1.280351 Jul 19 20:25:21.834146 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3036/5966] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:20 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1450 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:21.857330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:21.859659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:21.875109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=20 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:21.879107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:21.882827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:21.884382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:21.885193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:22.358126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:22.368337 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc7eea7b-fb60-4ebd-8e41-5d78a44adebd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1450 microversion: 2.1 time: 0.516644 Jul 19 20:25:22.368940 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2931/5967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:21 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1450 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:27.550328 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:25:27.551389 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:25:27.768790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-61db7313-035a-47c2-b1ed-943f921ce209 req-8d7fbf55-30d1-40de-816a-9039dc5c6fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f78aa1-79f0-4fc4-afc7-19f14efbff03", "tag": "d89cd63b-5b41-47ff-b972-429fbc181dfd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:27.791656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61db7313-035a-47c2-b1ed-943f921ce209 req-8d7fbf55-30d1-40de-816a-9039dc5c6fff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:27.792157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61db7313-035a-47c2-b1ed-943f921ce209 req-8d7fbf55-30d1-40de-816a-9039dc5c6fff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:27.849016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=49 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:27.852838 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-61db7313-035a-47c2-b1ed-943f921ce209 req-8d7fbf55-30d1-40de-816a-9039dc5c6fff service nova] Creating event network-changed:d89cd63b-5b41-47ff-b972-429fbc181dfd for instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 on n-h1-843861-3 Jul 19 20:25:27.866773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-61db7313-035a-47c2-b1ed-943f921ce209 req-8d7fbf55-30d1-40de-816a-9039dc5c6fff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102371 Jul 19 20:25:27.885537 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3037/5968] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:07.611688 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:27:07.612444 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:27:18.402328 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:27:18.403128 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:27:22.967500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:22.975230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=54 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:23.409249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:23.409944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:23.418846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:23.419992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:23.421579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:23.422384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:23.478934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:27:23.569411 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [dcf7bfa8-84ae-439b-8021-8b40c3995389] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:27:24.579610 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [dcf7bfa8-84ae-439b-8021-8b40c3995389] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51796. Jul 19 20:27:24.624077 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6cb3dae5-d66a-44ef-9608-190adc83067e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 204 len: 0 microversion: 2.1 time: 1.661252 Jul 19 20:27:24.624077 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2932/5969] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:27:22 2022] DELETE /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 0 bytes in 1664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:27:24.629435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=9 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:24.630732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:24.635606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:24.642601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:24.662287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:24.663070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:24.664088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:24.665038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:25.473039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:25.487607 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-068bc576-fdd0-49c7-b883-21467e62b7a3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1575 microversion: 2.1 time: 0.855584 Jul 19 20:27:25.488582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3038/5970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:24 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1575 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:26.508298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:26.509229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:26.529378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:26.531616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:26.533872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:26.534312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:27.296171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:27.311618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2ad20da6-f703-482f-acd3-96e737fc80ee tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1575 microversion: 2.1 time: 0.805096 Jul 19 20:27:27.312535 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2933/5971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:26 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1575 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:28.335543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:28.336258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:28.373520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.373986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.374785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.375294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.702959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:28.720090 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd7bdf82-9934-427e-aae6-ad8786dd50ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.394144 Jul 19 20:27:28.741501 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2934/5972] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:28 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:28.785902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b085820f-0b9a-4c51-9819-7e3da1994639 req-b99ce8d4-3e66-4caa-a943-65ebafeda6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f78aa1-79f0-4fc4-afc7-19f14efbff03", "name": "network-vif-deleted", "tag": "d89cd63b-5b41-47ff-b972-429fbc181dfd"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:28.819395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b085820f-0b9a-4c51-9819-7e3da1994639 req-b99ce8d4-3e66-4caa-a943-65ebafeda6b4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.821376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b085820f-0b9a-4c51-9819-7e3da1994639 req-b99ce8d4-3e66-4caa-a943-65ebafeda6b4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.880159 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b085820f-0b9a-4c51-9819-7e3da1994639 req-b99ce8d4-3e66-4caa-a943-65ebafeda6b4 service nova] Creating event network-vif-deleted:d89cd63b-5b41-47ff-b972-429fbc181dfd for instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 on n-h1-843861-3 Jul 19 20:27:28.901975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b085820f-0b9a-4c51-9819-7e3da1994639 req-b99ce8d4-3e66-4caa-a943-65ebafeda6b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.606604 Jul 19 20:27:28.903117 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3039/5973] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:29.753022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:29.754068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:29.781656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:29.784786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:29.792462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:29.801046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:29.991234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:29.999960 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c69ad7a-244e-4da2-9ea4-5d82cd1f3ab9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.253805 Jul 19 20:27:30.013844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2935/5974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:29 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:31.020966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:31.021799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:31.048658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:31.049315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:31.055579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:31.056636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:31.263129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:31.277328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2a196a8-4495-472a-a4eb-42702a4ccf00 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.264124 Jul 19 20:27:31.277939 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3040/5975] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:31 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:32.307688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:32.311604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:32.335472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:32.338270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:32.370219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:32.374767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:32.655540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:32.665182 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6aad55a3-8227-42c5-9e0f-a24711e19323 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.366019 Jul 19 20:27:32.665781 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2936/5976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:32 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:33.684140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:33.684903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:33.700563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:33.701073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:33.701958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:33.711567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:33.833562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:33.847999 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5346e9c4-2b10-459e-9f0b-2bae1b6461bf tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.168854 Jul 19 20:27:33.849155 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3041/5977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:33 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:34.868362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:34.869455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:34.906005 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:34.906864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:34.908270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:34.908969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:35.108747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:35.131031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e09e920b-662c-442f-a221-1adc628871d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.269832 Jul 19 20:27:35.136691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2937/5978] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:34 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:36.152995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:36.156453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:36.181435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:36.182244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:36.197657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:36.198431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:36.386554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:36.406685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e56854b8-c197-4a6b-b20e-e4bc8a140515 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.261157 Jul 19 20:27:36.408684 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3042/5979] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:36 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:37.429589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:37.430409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:37.438317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:37.439159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:37.440485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:37.441300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:37.588745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:37.598141 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f460e5f1-91cc-42df-9229-6e512b72bdfd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 200 len: 1225 microversion: 2.1 time: 0.173357 Jul 19 20:27:37.615152 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2938/5980] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:37 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:38.623550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:38.625276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:38.635443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:38.636687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:38.637730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:38.639383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:38.657444 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 HTTP/1.1 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e0f78aa1-79f0-4fc4-afc7-19f14efbff03'} Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:38.659154 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:27:38.663024 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:27:38.666798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:38.668858 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a84c0b77-c083-4140-8998-e80a4532159e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 404 len: 111 microversion: 2.1 time: 0.051707 Jul 19 20:27:38.671844 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3043/5981] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:38 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:27:38.813554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2052216684", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-405241929", "security_groups": [{"name": "tempest-secgroup-smoke-89582101"}], "block_device_mapping_v2": [{"uuid": "395530d5-f694-414c-802a-df579eaa2d1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:38.984293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:27:39.632708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:27:39.633203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:27:39.633690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:27:39.634227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:27:39.634658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:27:39.649502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:39.650209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:39.651201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:39.652423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:39.678153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:27:39.685706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:27:39.766183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:27:39.768333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='395530d5-f694-414c-802a-df579eaa2d1d',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:27:39.987587 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73cb147f-d5ba-478b-9119-814fb2db4a8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.179054 Jul 19 20:27:39.989220 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2939/5982] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:27:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:27:40.003253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-84999099-569d-4180-8db0-933776762c2e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:40.004747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-84999099-569d-4180-8db0-933776762c2e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:40.129210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-84999099-569d-4180-8db0-933776762c2e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:40.140872 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-84999099-569d-4180-8db0-933776762c2e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1094 microversion: 2.1 time: 0.145059 Jul 19 20:27:40.144028 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3044/5983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:39 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1094 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:41.160842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:41.162675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:41.184428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:41.185233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:41.186364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:41.187012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:41.269251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:41.293728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c300093a-d1b4-4d58-8aeb-2357d31715f9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1192 microversion: 2.1 time: 0.136430 Jul 19 20:27:41.303030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2940/5984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:41 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:42.311000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:42.311617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:42.322874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:42.323326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:42.336932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:42.336932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:42.609628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:42.622462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19f092fe-d87e-4ba8-a4fd-89c0f1f5d76a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1210 microversion: 2.1 time: 0.315669 Jul 19 20:27:42.625235 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3045/5985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:42 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1210 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:43.645967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:43.646749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:43.664509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:43.664966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:43.676274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:43.678513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:44.497571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:44.533988 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad2f469a-a8d3-4501-a7a8-c2cf81e71edd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.895632 Jul 19 20:27:44.538724 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2941/5986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:43 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:44.700466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-93fcdf56-ca6a-4956-8659-11c905c87e85 req-8838f2dd-7e44-4971-8621-7f638edd1443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637efbbd-5022-4cae-926e-4bdf025d24d0", "tag": "c9bb9a19-5905-4224-b6b8-1ee7a214cbdc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:44.719014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-93fcdf56-ca6a-4956-8659-11c905c87e85 req-8838f2dd-7e44-4971-8621-7f638edd1443 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:44.719924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-93fcdf56-ca6a-4956-8659-11c905c87e85 req-8838f2dd-7e44-4971-8621-7f638edd1443 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:44.739438 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-93fcdf56-ca6a-4956-8659-11c905c87e85 req-8838f2dd-7e44-4971-8621-7f638edd1443 service nova] Creating event network-changed:c9bb9a19-5905-4224-b6b8-1ee7a214cbdc for instance 637efbbd-5022-4cae-926e-4bdf025d24d0 on n-h2-843861-3 Jul 19 20:27:44.748667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-93fcdf56-ca6a-4956-8659-11c905c87e85 req-8838f2dd-7e44-4971-8621-7f638edd1443 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052650 Jul 19 20:27:44.753357 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3046/5987] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:45.554741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:45.555362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:45.591448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:45.592066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:45.592907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:45.593360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:46.045304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:46.053915 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-112de495-a923-4caf-84f9-b91628c70cd0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.503086 Jul 19 20:27:46.070122 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2942/5988] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:45 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:47.071442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:47.073037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:47.093446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:47.094131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:47.095082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:47.095668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:47.358786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:47.372841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2273997b-414f-4b1b-a856-8fa301b5e3f4 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.300396 Jul 19 20:27:47.373527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3047/5989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:47 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:48.394115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:48.395961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:48.403769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:48.404265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:48.405049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:48.405494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:48.619073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:48.628987 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-403c8a5f-cbfa-4754-a995-ef1bbdd4ce14 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.242918 Jul 19 20:27:48.638974 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2943/5990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:48 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:49.648274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:49.649074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:49.668264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:49.669190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:49.670161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:49.670601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:49.980176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:49.990720 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c0511b2-f5e1-46d7-a2e1-deffa0e2939e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.347962 Jul 19 20:27:49.991322 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3048/5991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:49 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:50.725589 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:27:50.726806 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:27:51.008942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:51.010159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:51.044537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:51.045998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:51.050094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:51.050789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:51.053194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:51.056278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:51.268564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:51.280867 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ef7ea2a4-3eb6-4235-97f0-516c789d1b75 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1276 microversion: 2.1 time: 0.276725 Jul 19 20:27:51.282292 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2944/5992] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:51 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:52.300367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:52.301769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:52.314308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:52.324116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:52.328434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:52.329677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:52.330346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:52.529659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:52.538850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2625aa1-b3bf-45f8-891f-82ade3ae75c3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.243629 Jul 19 20:27:52.540351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3049/5993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:52 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:53.559918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:53.561078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:53.564202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:53.571739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:53.572250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:53.573234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:53.573711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:53.577898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:53.748664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:53.763415 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-27f02516-d65c-4f86-a7e6-1e0783050ebc tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.208626 Jul 19 20:27:53.764068 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2945/5994] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:53 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:54.781979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:54.782757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:54.785811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:54.800651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:54.801451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:54.802374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:54.807039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:54.819752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=55 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:55.055192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:55.063426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d45df1b1-0f7a-4439-ae29-826e888a239a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.285591 Jul 19 20:27:55.064408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3050/5995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:54 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:56.080587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:56.081215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:56.092334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:56.092814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:56.098166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:56.098725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:56.476019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:56.488283 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c2233813-6380-42ff-be9b-fd3f3415b149 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.410303 Jul 19 20:27:56.489036 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2946/5996] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:56 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:57.510678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:57.516997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:57.531001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:57.532081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:57.533471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:57.534191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:57.763658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:57.771846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19cd47e4-8bfa-458d-9e85-d5b96aec9ff8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.269682 Jul 19 20:27:57.772448 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3051/5997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:57 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:58.791741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:58.793583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:58.809203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.811364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:58.812672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.816072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:59.191261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:59.211380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d9289db-f052-4a8e-8559-c73b60c94b23 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.424487 Jul 19 20:27:59.222854 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2947/5998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:58 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:00.233672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:00.234623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:00.268503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:00.269245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:00.270659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:00.272685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:00.599992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:00.618829 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6659bd37-f9b8-4ff9-b544-1d15260abbc7 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.392897 Jul 19 20:28:00.621814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3052/5999] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:00 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:01.638965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:01.640318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:01.655271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:01.655759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:01.659423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:01.659905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:02.064071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:02.102181 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-27a7ffe4-bc7c-48ee-8f1b-19361adc6812 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.468490 Jul 19 20:28:02.102783 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2948/6000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:01 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:02.575506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-009d7ce0-926d-4c60-bf89-a060febac943 req-b54c293f-2139-4e0a-be1b-bf2debfcf9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637efbbd-5022-4cae-926e-4bdf025d24d0", "name": "network-vif-plugged", "status": "completed", "tag": "c9bb9a19-5905-4224-b6b8-1ee7a214cbdc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:02.587057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-009d7ce0-926d-4c60-bf89-a060febac943 req-b54c293f-2139-4e0a-be1b-bf2debfcf9d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:02.587057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-009d7ce0-926d-4c60-bf89-a060febac943 req-b54c293f-2139-4e0a-be1b-bf2debfcf9d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:02.613352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-009d7ce0-926d-4c60-bf89-a060febac943 req-b54c293f-2139-4e0a-be1b-bf2debfcf9d3 service nova] Creating event network-vif-plugged:c9bb9a19-5905-4224-b6b8-1ee7a214cbdc for instance 637efbbd-5022-4cae-926e-4bdf025d24d0 on n-h2-843861-3 Jul 19 20:28:02.621428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-009d7ce0-926d-4c60-bf89-a060febac943 req-b54c293f-2139-4e0a-be1b-bf2debfcf9d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336577 Jul 19 20:28:02.626374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3053/6001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:03.143519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:03.144528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:03.152436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:03.153199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:03.154200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:03.154814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:03.499328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:03.511542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9fe84c90-c7a1-4ce8-9d61-80618b1aab7e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1264 microversion: 2.1 time: 0.372187 Jul 19 20:28:03.512489 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2949/6002] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:03 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1264 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:04.532927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:04.533642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:04.550094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.550757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:04.551755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.552231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:04.834420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:04.845880 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6fb4e29-c387-45a4-8296-f1168d4a2885 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1451 microversion: 2.1 time: 0.318991 Jul 19 20:28:04.851397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3054/6003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:04 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1451 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:04.874698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:04.875343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:04.888022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.888500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:04.889304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.889746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:05.132452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:05.149020 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-115c1cd5-cd74-49af-a7e7-61ec84003e43 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1451 microversion: 2.1 time: 0.281176 Jul 19 20:28:05.156515 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2950/6004] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:04 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1451 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:08.713387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1b6fbdda-6b3f-4627-a87d-0da2c872bd04 req-7e73e573-f905-4489-bd07-1bbfec293298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637efbbd-5022-4cae-926e-4bdf025d24d0", "tag": "c9bb9a19-5905-4224-b6b8-1ee7a214cbdc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:08.738539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b6fbdda-6b3f-4627-a87d-0da2c872bd04 req-7e73e573-f905-4489-bd07-1bbfec293298 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:08.740187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b6fbdda-6b3f-4627-a87d-0da2c872bd04 req-7e73e573-f905-4489-bd07-1bbfec293298 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:08.800671 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1b6fbdda-6b3f-4627-a87d-0da2c872bd04 req-7e73e573-f905-4489-bd07-1bbfec293298 service nova] Creating event network-changed:c9bb9a19-5905-4224-b6b8-1ee7a214cbdc for instance 637efbbd-5022-4cae-926e-4bdf025d24d0 on n-h2-843861-3 Jul 19 20:28:08.816157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1b6fbdda-6b3f-4627-a87d-0da2c872bd04 req-7e73e573-f905-4489-bd07-1bbfec293298 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106601 Jul 19 20:28:08.823225 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3055/6005] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:16.646992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-82918238", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:16.657281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=11 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:16.658052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=35 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:16.764822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:28:17.358604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:28:17.359049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:28:17.359552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:28:17.360018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:28:17.360467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:28:17.386558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:17.387133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:17.388045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:17.388578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:17.416162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Getting quotas for project ed73caebdd524f1caef5a8340b1414d9. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:17.423325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Getting quotas for user f97cfd5046ef46609f918ee1939eadf6 and project ed73caebdd524f1caef5a8340b1414d9. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:17.437997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:28:17.440264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:28:17.493274 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fcfe18c3-92d2-43d9-a9fe-219e49342080 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850039 Jul 19 20:28:17.499635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2951/6006] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:28:17.508459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adfefe4d-7fce-4c39-abdc-85c587ecfe53 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:17.510339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-adfefe4d-7fce-4c39-abdc-85c587ecfe53 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:17.594644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-adfefe4d-7fce-4c39-abdc-85c587ecfe53 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:17.604505 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-adfefe4d-7fce-4c39-abdc-85c587ecfe53 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1213 microversion: 2.1 time: 0.102522 Jul 19 20:28:17.614286 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3056/6007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:17 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:18.622867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:18.623568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:18.633150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:18.633894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:18.634883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:18.636400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:18.769740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:18.786484 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa1f5d58-a266-4e6a-8f87-9d1b4215aecf tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1265 microversion: 2.1 time: 0.168371 Jul 19 20:28:18.800873 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2952/6008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:18 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:19.804712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=27 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:19.809691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:19.810322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:19.844903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:19.845436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:19.846316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:19.853389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:20.000993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:20.010644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-decf4d2e-128b-4c9b-a0f6-3a7c46d1893c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1271 microversion: 2.1 time: 0.207676 Jul 19 20:28:20.011866 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3057/6009] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:19 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:21.038743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:21.039546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:21.066099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:21.069004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:21.069878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:21.070338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:21.345848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-affc9f24-582a-43ee-a951-32777648ca10 req-ecac35a3-3f14-4c17-8d62-49c3bfbb15b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511cdd54-1972-477e-9c7f-40d8c6fddcf4", "tag": "803c23c0-5aeb-410b-9315-6a55ec610c71"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:21.366977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-affc9f24-582a-43ee-a951-32777648ca10 req-ecac35a3-3f14-4c17-8d62-49c3bfbb15b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:21.368753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-affc9f24-582a-43ee-a951-32777648ca10 req-ecac35a3-3f14-4c17-8d62-49c3bfbb15b9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:21.438413 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-affc9f24-582a-43ee-a951-32777648ca10 req-ecac35a3-3f14-4c17-8d62-49c3bfbb15b9 service nova] Creating event network-changed:803c23c0-5aeb-410b-9315-6a55ec610c71 for instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 on n-h1-843861-3 Jul 19 20:28:21.451384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-affc9f24-582a-43ee-a951-32777648ca10 req-ecac35a3-3f14-4c17-8d62-49c3bfbb15b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106860 Jul 19 20:28:21.453104 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3058/6010] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:28:22.058668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:22.070374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0cd7c85b-a5d6-4e2a-aac0-d046ce320c61 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 1.045469 Jul 19 20:28:22.071169 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2953/6011] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:21 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:23.090959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:23.092665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:23.109684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:23.110251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:23.111327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:23.111600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:23.338770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:23.349117 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e78cb50a-23db-4637-9e00-1670972ce6e7 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 0.264112 Jul 19 20:28:23.349830 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3059/6012] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:23 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:24.371566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:24.372043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:24.379171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:24.379680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:24.380515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:24.380970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:24.561551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:24.571661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9007bd43-ed7a-4cfc-a6af-e51720452616 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 0.205925 Jul 19 20:28:24.572188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2954/6013] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:24 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:25.590522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:25.591177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:25.601125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=22 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:25.603601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:25.604432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:25.605430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:25.606416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:25.777395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:25.787164 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d4fa68ba-6244-47ca-bbdc-11e72100bc54 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 0.201962 Jul 19 20:28:25.788569 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3060/6014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:25 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:26.806878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:26.807529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:26.815135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:26.815597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:26.816838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:26.817488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:26.985478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:26.995690 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3be870e8-1954-4fa2-8af4-ce0660bbc095 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 0.192824 Jul 19 20:28:26.996721 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2955/6015] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:26 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:27.141721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e48c945c-70c8-4a10-8baa-f9f51b52f929 req-12d83c3d-c7bb-4dd1-ba7a-fffe622955fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511cdd54-1972-477e-9c7f-40d8c6fddcf4", "name": "network-vif-plugged", "status": "completed", "tag": "803c23c0-5aeb-410b-9315-6a55ec610c71"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:27.152370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e48c945c-70c8-4a10-8baa-f9f51b52f929 req-12d83c3d-c7bb-4dd1-ba7a-fffe622955fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:27.153019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e48c945c-70c8-4a10-8baa-f9f51b52f929 req-12d83c3d-c7bb-4dd1-ba7a-fffe622955fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:27.166653 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e48c945c-70c8-4a10-8baa-f9f51b52f929 req-12d83c3d-c7bb-4dd1-ba7a-fffe622955fc service nova] Creating event network-vif-plugged:803c23c0-5aeb-410b-9315-6a55ec610c71 for instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 on n-h1-843861-3 Jul 19 20:28:27.174638 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e48c945c-70c8-4a10-8baa-f9f51b52f929 req-12d83c3d-c7bb-4dd1-ba7a-fffe622955fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036640 Jul 19 20:28:27.175849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3061/6016] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:28.017572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:28.018589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:28.023700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:28.025096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:28.036576 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:28.037334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:28.038419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:28.039153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:28.207137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:28.223490 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2329e214-2d37-48c9-ac8f-cd1ede0e8a89 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1313 microversion: 2.1 time: 0.212603 Jul 19 20:28:28.224532 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2956/6017] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:28 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:29.242543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:29.244144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:29.250771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:29.253961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.254552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.255355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.255871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.453109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:29.462757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0730093a-8874-442f-b6ac-b20d66fb47d9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1462 microversion: 2.1 time: 0.223972 Jul 19 20:28:29.463429 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3062/6018] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:29 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1462 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:29.511343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:29.511726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:29.520434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.521010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.522105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.522649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.556764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:28:29.684546 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-953dfad9-33e8-4a36-ab7e-b773a0f48de8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "DELETE /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 204 len: 0 microversion: 2.1 time: 0.178481 Jul 19 20:28:29.685551 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2957/6019] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:28:29 2022] DELETE /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:28:29.698050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:29.699170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:29.708966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.709752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.710720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.711617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.932639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:29.941862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c140853-8385-4d30-8bff-76c4b43251e9 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1468 microversion: 2.1 time: 0.251146 Jul 19 20:28:29.943847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3063/6020] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:29 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:30.967583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:30.969951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:30.989496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:30.990112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:30.991282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:30.991920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:31.280498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:31.291177 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-63bb73dd-1fbd-4021-924b-9b40e3848d69 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1468 microversion: 2.1 time: 0.332874 Jul 19 20:28:31.304619 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2958/6021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:30 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:31.872513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1cb79aca-4b27-44c8-a389-7ba5df48f45e req-3bf9ce3e-317c-46b3-bc3c-466213237242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511cdd54-1972-477e-9c7f-40d8c6fddcf4", "name": "network-vif-deleted", "tag": "803c23c0-5aeb-410b-9315-6a55ec610c71"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:31.889962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1cb79aca-4b27-44c8-a389-7ba5df48f45e req-3bf9ce3e-317c-46b3-bc3c-466213237242 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:31.890570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1cb79aca-4b27-44c8-a389-7ba5df48f45e req-3bf9ce3e-317c-46b3-bc3c-466213237242 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:31.905503 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1cb79aca-4b27-44c8-a389-7ba5df48f45e req-3bf9ce3e-317c-46b3-bc3c-466213237242 service nova] Creating event network-vif-deleted:803c23c0-5aeb-410b-9315-6a55ec610c71 for instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 on n-h1-843861-3 Jul 19 20:28:31.915572 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1cb79aca-4b27-44c8-a389-7ba5df48f45e req-3bf9ce3e-317c-46b3-bc3c-466213237242 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047570 Jul 19 20:28:31.923653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3064/6022] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:32.324242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:32.324875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:32.342357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:32.347076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:32.348247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:32.348865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:32.428394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:32.428771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:32.429426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lazy-loading 'fault' on Instance uuid 511cdd54-1972-477e-9c7f-40d8c6fddcf4 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:28:32.556598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cfd5046ef46609f918ee1939eadf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed73caebdd524f1caef5a8340b1414d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:32.566565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17b60968-e626-4fad-b9e0-71ca4134440c tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 200 len: 1303 microversion: 2.1 time: 0.247540 Jul 19 20:28:32.567430 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2959/6023] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:32 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:33.585275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:33.586077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] [instance: 511cdd54-1972-477e-9c7f-40d8c6fddcf4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:33.593864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:33.594443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:33.595334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:33.595984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:33.613192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] HTTP exception thrown: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Request method failure captured: Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 HTTP/1.1 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xPdtDSmaG_b3WJ5KBBYUMUXYPA6gHhI10ioZlKsEsdlJCiRLvDKIlSSVzNrqY0SQwVT9OOZVdzmh3c_uOr-GTBcd16bnm30W39xyBFPVIBZcnaAP1PYwbc2byl8elQ7RIGeDL-tJRsMd-uz7r3fB2bShXZPvA5gLYPfU2HMcwRCIow Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: ed73caebdd524f1caef5a8340b1414d9 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesNegativeTest-1699979171 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed73caebdd524f1caef5a8340b1414d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed73caebdd524f1caef5a8340b1414d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed73caebdd524f1caef5a8340b1414d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed73caebdd524f1caef5a8340b1414d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesNegativeTest-1699979171 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: ed73caebdd524f1caef5a8340b1414d9 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesNegativeTest-1699979171 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesNegativeTest-1699979171-project Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f97cfd5046ef46609f918ee1939eadf6 Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesNegativeTest-1699979171-project Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '511cdd54-1972-477e-9c7f-40d8c6fddcf4'} Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:33.615254 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. Jul 19 20:28:33.619159 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:28:33.622052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] Returning 404 to user: Instance 511cdd54-1972-477e-9c7f-40d8c6fddcf4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:28:33.623132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-87cdf1d5-7844-40ff-af13-de3d0f98a4c8 tempest-VolumesNegativeTest-1699979171 tempest-VolumesNegativeTest-1699979171-project] 10.222.0.33 "GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4" status: 404 len: 111 microversion: 2.1 time: 0.042408 Jul 19 20:28:33.624017 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3065/6024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:33 2022] GET /compute/v2.1/servers/511cdd54-1972-477e-9c7f-40d8c6fddcf4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:28:47.565294 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:28:47.565896 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:28:54.946444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:54.948301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:55.317633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6323eba7-add3-4385-8a99-da31282974ea tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Action: 'create', calling method: .version_select at 0x7fb88d444160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-959891076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPG35J0nxET/fwOV2NlF9nzYmz6l0i8lkjOH/huEvQ7rqf7OyZ8TDn17n8BXc0HpXhbHbE/QcgblLCRXRo4D2tDMbB5c6OptReMsFTkK0+eIhiBWPEADSO1XRwH5TQTQvA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:55.349342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6323eba7-add3-4385-8a99-da31282974ea tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for project 98281089717642988e019eff386eb797. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:55.356832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6323eba7-add3-4385-8a99-da31282974ea tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for user fe004dd50462446db546bc49e9a4230d and project 98281089717642988e019eff386eb797. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:55.408825 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6323eba7-add3-4385-8a99-da31282974ea tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.470187 Jul 19 20:28:55.409948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2960/6025] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:28:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:28:56.910538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=11 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:56.913520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:56.917267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1106303214", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-959891076", "security_groups": [{"name": "tempest-secgroup-smoke-129777267"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "51f29e41-78f0-4795-9668-7785b93153f5"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:57.037263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] validate_networks() for [('51f29e41-78f0-4795-9668-7785b93153f5', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:28:57.822693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for project 98281089717642988e019eff386eb797. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:57.854606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for user fe004dd50462446db546bc49e9a4230d and project 98281089717642988e019eff386eb797. Resources: dict_keys(['metadata_items']) {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:57.882520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:28:57.883616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:28:57.884827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:28:57.885765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:28:57.886635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:28:57.913806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.916389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.917987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.919407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.960512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for project 98281089717642988e019eff386eb797. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:57.972781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Getting quotas for user fe004dd50462446db546bc49e9a4230d and project 98281089717642988e019eff386eb797. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:58.031910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:28:58.036282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:28:58.208895 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ea745b1-403f-4f26-999e-07c50b8e95c8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.299096 Jul 19 20:28:58.220323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3066/6026] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:28:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:28:58.233776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-508787ff-3f79-4f7d-a92e-aee28508e93e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:58.237000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-508787ff-3f79-4f7d-a92e-aee28508e93e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:58.418847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-508787ff-3f79-4f7d-a92e-aee28508e93e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:58.443440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-508787ff-3f79-4f7d-a92e-aee28508e93e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1302 microversion: 2.1 time: 0.213957 Jul 19 20:28:58.447536 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2961/6027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:58 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1302 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:59.469751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:59.475365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:59.494157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:59.494938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:59.497527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:59.498057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:59.630251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:59.651414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3101af67-7257-488a-aa30-585e01dfb49c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1298 microversion: 2.1 time: 0.184896 Jul 19 20:28:59.653687 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3067/6028] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:59 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:00.673904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:00.675799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:00.703384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.704313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.705396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.706025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.869555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:00.888569 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e90b185-a3b8-4a2b-8189-dd98a456653c tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1360 microversion: 2.1 time: 0.220265 Jul 19 20:29:00.889400 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2962/6029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:00 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:01.907764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:01.908499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:01.916057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.916752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:01.917785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.918382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.240163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:02.270260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7ede8e0-e50c-45e8-b2c5-c53b302bd7a8 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.366743 Jul 19 20:29:02.282712 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3068/6030] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:01 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:02.647119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-36cae3c8-2491-4406-a744-ffe9d6afd82e req-66e85224-da3d-415a-88c7-c4321ffa3333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8", "tag": "936f5c9a-a78b-4ef9-8f52-b796a74fb268"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:02.661720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-36cae3c8-2491-4406-a744-ffe9d6afd82e req-66e85224-da3d-415a-88c7-c4321ffa3333 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:02.662856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-36cae3c8-2491-4406-a744-ffe9d6afd82e req-66e85224-da3d-415a-88c7-c4321ffa3333 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.682632 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-36cae3c8-2491-4406-a744-ffe9d6afd82e req-66e85224-da3d-415a-88c7-c4321ffa3333 service nova] Creating event network-changed:936f5c9a-a78b-4ef9-8f52-b796a74fb268 for instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 on n-h1-843861-3 Jul 19 20:29:02.690752 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-36cae3c8-2491-4406-a744-ffe9d6afd82e req-66e85224-da3d-415a-88c7-c4321ffa3333 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057465 Jul 19 20:29:02.692223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2963/6031] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:03.298501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:03.299652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:03.311841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.312923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:03.314603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.315358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:03.506796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:03.518985 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e42eef0-bc16-4037-8d59-0e12af78d503 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.228621 Jul 19 20:29:03.519578 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3069/6032] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:03 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:04.544509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:04.545801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:04.552810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.553280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.554277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.554736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.887280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:04.901523 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-906c93fb-c60c-475d-a62b-929e6a300a06 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.362266 Jul 19 20:29:04.902436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2964/6033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:04 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:05.929982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:05.930452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:05.942993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:05.943772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:05.944752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:05.945188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:06.137479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:06.148066 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2c0515b7-d343-4ba1-8adc-fb4c4ad95f98 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.222553 Jul 19 20:29:06.148918 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3070/6034] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:05 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:07.169746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:07.170939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:07.184716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.185910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.187570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.188716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.377610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-508b51ab-cd9f-45e0-a14d-d3700c64b5ea req-33673938-6bde-4cdd-9216-b7353dd4642b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8", "name": "network-vif-plugged", "status": "completed", "tag": "936f5c9a-a78b-4ef9-8f52-b796a74fb268"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:07.386823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:07.398320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-508b51ab-cd9f-45e0-a14d-d3700c64b5ea req-33673938-6bde-4cdd-9216-b7353dd4642b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.398738 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4d3ddc34-d739-4c44-8750-fce9ce049499 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.234886 Jul 19 20:29:07.399260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-508b51ab-cd9f-45e0-a14d-d3700c64b5ea req-33673938-6bde-4cdd-9216-b7353dd4642b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.412138 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2965/6035] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:07 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:07.415528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-508b51ab-cd9f-45e0-a14d-d3700c64b5ea req-33673938-6bde-4cdd-9216-b7353dd4642b service nova] Creating event network-vif-plugged:936f5c9a-a78b-4ef9-8f52-b796a74fb268 for instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 on n-h1-843861-3 Jul 19 20:29:07.422143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-508b51ab-cd9f-45e0-a14d-d3700c64b5ea req-33673938-6bde-4cdd-9216-b7353dd4642b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048678 Jul 19 20:29:07.423132 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3071/6036] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:29:08.420696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:08.422075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:08.429765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.430436 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.431701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.432253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.451449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:08.622720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:08.632545 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b7e1ac7b-8836-4cc5-81b7-e7dde312c585 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1427 microversion: 2.1 time: 0.217700 Jul 19 20:29:08.633735 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2966/6037] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:08 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:09.654963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:09.656517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:09.666440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:09.672861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:09.677740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:09.680144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:09.680994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:09.681517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:09.891143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:09.904554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01ba062b-5093-422b-b9f3-9cc368ddd930 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1607 microversion: 2.1 time: 0.257192 Jul 19 20:29:09.905727 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3072/6038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:09 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1607 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:09.922551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:09.924207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:09.931359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:09.932105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:09.933225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:09.933853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:10.098841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:10.108540 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0a647c6-ad61-49ee-80ae-5280a0fef7d9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1607 microversion: 2.1 time: 0.189485 Jul 19 20:29:10.109278 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2967/6039] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:09 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1607 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:29:10.125611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:10.126378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:10.135474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:10.136318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:10.137650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:10.138470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:10.318649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:10.327963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9bd44e6-6bd4-4995-8b84-924c36e6be5e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1607 microversion: 2.1 time: 0.206349 Jul 19 20:29:10.328717 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3073/6040] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:10 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1607 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:13.503970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-798fb4f1-4961-4d60-8a4c-016c175c7fee req-8072f88c-05ff-46f3-9d1c-d5cb0c722405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8", "tag": "936f5c9a-a78b-4ef9-8f52-b796a74fb268"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:13.523858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-798fb4f1-4961-4d60-8a4c-016c175c7fee req-8072f88c-05ff-46f3-9d1c-d5cb0c722405 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:13.524729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-798fb4f1-4961-4d60-8a4c-016c175c7fee req-8072f88c-05ff-46f3-9d1c-d5cb0c722405 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:13.547039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-798fb4f1-4961-4d60-8a4c-016c175c7fee req-8072f88c-05ff-46f3-9d1c-d5cb0c722405 service nova] Creating event network-changed:936f5c9a-a78b-4ef9-8f52-b796a74fb268 for instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 on n-h1-843861-3 Jul 19 20:29:13.592732 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-798fb4f1-4961-4d60-8a4c-016c175c7fee req-8072f88c-05ff-46f3-9d1c-d5cb0c722405 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317514 Jul 19 20:29:13.593944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2968/6041] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:49.471096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:49.471096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:49.471096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:49.471096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=40 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:49.484895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:49.485647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:49.486664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:49.487335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:49.532692 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e988e519-8e15-4f3a-a697-14627d8bb094 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.069590 Jul 19 20:29:49.533720 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3074/6042] 10.222.0.33 () {58 vars in 1292 bytes} [Tue Jul 19 20:29:49 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8/os-server-password => generated 116 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:59.144190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:59.145021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:59.149454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-868867227", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-405241929", "security_groups": [{"name": "tempest-secgroup-smoke-89582101"}], "block_device_mapping_v2": [{"uuid": "57923b43-0e18-4eed-9aba-580dd2d54b3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90e243b8-68d4-46dd-830a-72ebad7979e0"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:59.319219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] validate_networks() for [('90e243b8-68d4-46dd-830a-72ebad7979e0', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:30:00.491255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:30:00.492707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:30:00.493550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:30:00.494466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:30:00.495148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:30:00.512743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:00.513554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:00.516192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:00.516998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:00.546200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:30:00.552334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Getting quotas for user aed9bc1a8174428196b98f4679e659f4 and project fcf2fd626c654fcf817e438760bcd2f3. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:30:00.640172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:30:00.643148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57923b43-0e18-4eed-9aba-580dd2d54b3a',volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:30:00.816855 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae6fb66a-a3d3-4897-9037-04cf25553a55 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.674945 Jul 19 20:30:00.819263 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2969/6043] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:29:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:30:00.834865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e367d6b0-6ad7-462c-8b96-2ad804459fc2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:00.837096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e367d6b0-6ad7-462c-8b96-2ad804459fc2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:00.849802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:00.850597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:00.924202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e367d6b0-6ad7-462c-8b96-2ad804459fc2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:00.935978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e367d6b0-6ad7-462c-8b96-2ad804459fc2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1093 microversion: 2.1 time: 0.108736 Jul 19 20:30:00.937471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3075/6044] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:00 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1093 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:01.966864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:01.969548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:01.982840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:01.983217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:01.984446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:01.985156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:02.087333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:02.102009 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0f91898-8122-4803-b744-0ff01f62e2fd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1191 microversion: 2.1 time: 0.144255 Jul 19 20:30:02.108337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2970/6045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:01 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:03.126310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:03.128118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:03.149601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:03.150404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:03.151468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:03.152279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:03.561735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:03.575378 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61f9d81f-3397-4954-8543-3ca937913584 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1275 microversion: 2.1 time: 0.455370 Jul 19 20:30:03.576619 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3076/6046] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:03 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1275 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:04.601431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:04.602179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:04.621803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:04.622499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:04.624216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:04.629703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:04.890060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-564e34f1-04e3-45a0-a5db-54f552ee370d req-2247ad1d-0a49-426d-aeb7-071e3916a39a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c58682-a743-46d2-b990-ebc5526fc5c0", "tag": "4a03b1e1-f6a9-471a-a25f-a9b910096113"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:04.956685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-564e34f1-04e3-45a0-a5db-54f552ee370d req-2247ad1d-0a49-426d-aeb7-071e3916a39a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:04.959022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-564e34f1-04e3-45a0-a5db-54f552ee370d req-2247ad1d-0a49-426d-aeb7-071e3916a39a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:04.984250 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-564e34f1-04e3-45a0-a5db-54f552ee370d req-2247ad1d-0a49-426d-aeb7-071e3916a39a service nova] Creating event network-changed:4a03b1e1-f6a9-471a-a25f-a9b910096113 for instance a6c58682-a743-46d2-b990-ebc5526fc5c0 on n-h1-843861-3 Jul 19 20:30:04.996275 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-564e34f1-04e3-45a0-a5db-54f552ee370d req-2247ad1d-0a49-426d-aeb7-071e3916a39a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110902 Jul 19 20:30:04.997786 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3077/6047] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:30:05.356411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:05.391070 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4422ad7a-17ad-4b4d-83d0-2d2485714dcd tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1275 microversion: 2.1 time: 0.797893 Jul 19 20:30:05.403838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2971/6048] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:04 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1275 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:06.419165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:06.420900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:06.433143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:06.433588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:06.434371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:06.434804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:06.975127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:06.999745 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24b6067b-06bd-4ec5-9451-0f5db05a9dd2 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1275 microversion: 2.1 time: 0.584577 Jul 19 20:30:07.006016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3078/6049] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:06 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1275 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:08.018394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:08.019021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:08.028629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:08.029347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:08.030205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:08.031082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:08.232781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:08.242684 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b52a1ea-ddea-4a93-8048-930bfa31d0fb tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1275 microversion: 2.1 time: 0.229189 Jul 19 20:30:08.243403 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2972/6050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:08 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:09.265662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:09.266931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:09.287906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:09.288727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:09.289712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:09.290208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:09.566628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:09.580019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-917b982e-20c0-42c2-9906-2e6a23e205d6 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1275 microversion: 2.1 time: 0.318641 Jul 19 20:30:09.581935 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3079/6051] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:09 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:10.599992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:10.600633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:10.603452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:10.604185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:10.610950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:10.611430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:10.612276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:10.612722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:10.816738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:10.832006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f5bdd548-a2d6-4fee-9319-8d3c9205bb62 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.236211 Jul 19 20:30:10.832960 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2973/6052] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:10 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:11.857950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:11.858903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:11.881237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:11.887571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:11.888884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:11.890269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:11.894778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:12.195829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:12.216337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b49a1306-a3a7-4e39-a37d-4f60c7a874ad tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.364936 Jul 19 20:30:12.218070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3080/6053] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:11 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:13.240200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:13.240200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:13.251927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:13.253066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:13.254623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:13.255604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:13.576147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:13.587941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80939d20-033b-4812-840d-e19427fca538 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.354449 Jul 19 20:30:13.588884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2974/6054] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:13 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:14.615620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:14.616859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:14.625577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:14.626397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:14.627364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:14.628149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:14.822934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:14.841389 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3b2ebfc7-dda9-46df-873f-7e2ac25e5d3c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.233319 Jul 19 20:30:14.842669 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3081/6055] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:14 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:15.866444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:15.866444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:15.877885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:15.878344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:15.879137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:15.880826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:16.098514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:16.110988 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cba0ab4d-f3a7-402b-8296-f7a2a92648de tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.250989 Jul 19 20:30:16.111850 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2975/6056] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:15 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:17.129411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:17.130031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:17.139076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:17.139687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:17.141197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:17.141918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:17.327346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:17.355416 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-debe05c1-dbbf-40fc-bd1a-c810f801bf85 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.230203 Jul 19 20:30:17.363553 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3082/6057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:17 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:18.380151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:18.382007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:18.390160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:18.390979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:18.392236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:18.393143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:18.627561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:18.650138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4497a527-21f8-4213-b71e-0b0d9794b47d tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.273450 Jul 19 20:30:18.651865 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2976/6058] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:18 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:30:19.676208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:19.677489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:19.692937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:19.693657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:19.694820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:19.695263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:19.785630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-59ecce79-39e3-42b4-9cea-e222ebd87cb4 req-c3c15f22-bba5-4ae7-b90a-a26b96390769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c58682-a743-46d2-b990-ebc5526fc5c0", "name": "network-vif-plugged", "status": "completed", "tag": "4a03b1e1-f6a9-471a-a25f-a9b910096113"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:19.808783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-59ecce79-39e3-42b4-9cea-e222ebd87cb4 req-c3c15f22-bba5-4ae7-b90a-a26b96390769 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:19.809792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-59ecce79-39e3-42b4-9cea-e222ebd87cb4 req-c3c15f22-bba5-4ae7-b90a-a26b96390769 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:19.827722 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-59ecce79-39e3-42b4-9cea-e222ebd87cb4 req-c3c15f22-bba5-4ae7-b90a-a26b96390769 service nova] Creating event network-vif-plugged:4a03b1e1-f6a9-471a-a25f-a9b910096113 for instance a6c58682-a743-46d2-b990-ebc5526fc5c0 on n-h1-843861-3 Jul 19 20:30:19.835558 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-59ecce79-39e3-42b4-9cea-e222ebd87cb4 req-c3c15f22-bba5-4ae7-b90a-a26b96390769 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057566 Jul 19 20:30:19.836621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2977/6059] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:30:19.934594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:19.946689 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c9c6d33-8ebf-4d3c-a69b-d6aed0e323a9 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.275443 Jul 19 20:30:19.954303 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3083/6060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:19 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:30:20.976006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:20.977569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:20.986668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:20.987404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:20.988341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:20.988994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:21.254423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:21.263129 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b67570e-960c-4141-9fb8-b0e7bc17b1ca tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1263 microversion: 2.1 time: 0.298906 Jul 19 20:30:21.263879 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2978/6061] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:20 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:22.288607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:22.289364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:22.298164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:22.299014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:22.299387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:22.299841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:22.486400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:22.495099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f650544-b874-442f-bf98-a1c043745114 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1450 microversion: 2.1 time: 0.210339 Jul 19 20:30:22.500708 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3084/6062] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:22 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:30:22.511723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:22.513014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:22.521551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:22.521940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:22.522723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:22.523171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:22.702693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:22.711677 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-baf65873-eb6b-4a1d-8475-84d1df08539a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1450 microversion: 2.1 time: 0.204008 Jul 19 20:30:22.715893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2979/6063] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:22 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:25.702116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-68969ea6-f23f-4931-87c9-03d6df0831d5 req-348c8fdb-2741-4e11-b32c-576e32a65f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c58682-a743-46d2-b990-ebc5526fc5c0", "tag": "4a03b1e1-f6a9-471a-a25f-a9b910096113"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:25.724682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-68969ea6-f23f-4931-87c9-03d6df0831d5 req-348c8fdb-2741-4e11-b32c-576e32a65f8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:25.724682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-68969ea6-f23f-4931-87c9-03d6df0831d5 req-348c8fdb-2741-4e11-b32c-576e32a65f8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:25.760800 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-68969ea6-f23f-4931-87c9-03d6df0831d5 req-348c8fdb-2741-4e11-b32c-576e32a65f8a service nova] Creating event network-changed:4a03b1e1-f6a9-471a-a25f-a9b910096113 for instance a6c58682-a743-46d2-b990-ebc5526fc5c0 on n-h1-843861-3 Jul 19 20:30:25.768170 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-68969ea6-f23f-4931-87c9-03d6df0831d5 req-348c8fdb-2741-4e11-b32c-576e32a65f8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076537 Jul 19 20:30:25.773683 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3085/6064] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:30:28.750672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1436415289", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "cd1e74d2-ff09-4295-932a-da5a96128422"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:28.818198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] validate_networks() for [('cd1e74d2-ff09-4295-932a-da5a96128422', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:30:29.296195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:30:29.296859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:30:29.297494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:30:29.298268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:30:29.298521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:30:29.300708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:29.314192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:29.314654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:29.316728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:29.317217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:29.325735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=59 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:29.337629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Getting quotas for project c17607df6e3542b69df933370901ba66. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:30:29.344186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Getting quotas for user c5deb03c3edd4c199a7c5a1d969673e8 and project c17607df6e3542b69df933370901ba66. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:30:29.374684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:30:29.374684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:30:29.425103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c111f0d9-1970-4519-aedb-9fe20c525e76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678108 Jul 19 20:30:29.426375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2980/6065] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:30:29.438009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de844fcc-ad6a-484a-8a21-864253b05808 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:29.439989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de844fcc-ad6a-484a-8a21-864253b05808 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:29.505488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de844fcc-ad6a-484a-8a21-864253b05808 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:29.515641 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de844fcc-ad6a-484a-8a21-864253b05808 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1219 microversion: 2.1 time: 0.083294 Jul 19 20:30:29.516602 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3086/6066] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:29 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:30.534552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:30.535397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:30.545783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:30.546312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:30.547103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:30.547545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:30.639839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:30.656229 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f40c27e2-38bd-4369-ab68-866a428e16f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1271 microversion: 2.1 time: 0.125079 Jul 19 20:30:30.670478 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2981/6067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:30 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:31.680154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:31.680725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:31.689596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=29 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:31.691676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:31.692385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:31.693329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:31.693745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:31.699637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=53 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:32.001929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:32.016184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c59c076-cf33-42a4-a28d-669b033030b5 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.340472 Jul 19 20:30:32.034352 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3087/6068] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:31 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:32.800239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e079c3a9-9b34-465d-8fdf-5285a86de012 req-691c4128-3229-4cd8-a264-8385e05d927f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce1cdad-ba15-498a-b613-480f89cf370a", "tag": "6c79212a-7966-4e93-b3ad-a1cbe65d2078"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:32.811145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e079c3a9-9b34-465d-8fdf-5285a86de012 req-691c4128-3229-4cd8-a264-8385e05d927f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:32.811608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e079c3a9-9b34-465d-8fdf-5285a86de012 req-691c4128-3229-4cd8-a264-8385e05d927f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:32.824929 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e079c3a9-9b34-465d-8fdf-5285a86de012 req-691c4128-3229-4cd8-a264-8385e05d927f service nova] Creating event network-changed:6c79212a-7966-4e93-b3ad-a1cbe65d2078 for instance 3ce1cdad-ba15-498a-b613-480f89cf370a on n-h2-843861-3 Jul 19 20:30:32.830034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e079c3a9-9b34-465d-8fdf-5285a86de012 req-691c4128-3229-4cd8-a264-8385e05d927f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033724 Jul 19 20:30:32.830649 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2982/6069] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:30:33.041251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:33.042384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:33.050247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:33.050698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:33.051464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:33.052129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:33.266284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:33.275083 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d47f28e-aad8-4f68-9f22-436dd95a7c07 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.237654 Jul 19 20:30:33.275673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3088/6070] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:33 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:34.295363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:34.296101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:34.302863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:34.303345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:34.304430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:34.304890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:34.462367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:34.471198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09f8b79e-8bc1-49ce-91b8-d308992988f9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.181072 Jul 19 20:30:34.472075 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2983/6071] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:34 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:30:35.493715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:35.495257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:35.506197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:35.506782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:35.507678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:35.508566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:35.801287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:35.811447 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d19979f7-3655-43b8-8add-31e854fc07ea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.324487 Jul 19 20:30:35.812285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3089/6072] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:35 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:36.829599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:36.830245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:36.837529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:36.838000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:36.839388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:36.839874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:36.997275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:37.012037 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fcce39e9-5cba-4317-9577-65ece3f96172 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.186407 Jul 19 20:30:37.012669 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2984/6073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:36 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:38.029862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:38.030562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:38.039228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:38.039870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:38.040769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:38.041226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:38.193482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:38.203507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18471f14-8e7d-45c2-8101-3c9cc29d5c3e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.178613 Jul 19 20:30:38.204154 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3090/6074] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:38 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:38.414593 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:30:38.414945 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:30:38.649680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1806f57a-d47a-4264-8ed4-0067ece90f5e req-8cfde232-e7d3-4de1-8849-6780233900b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce1cdad-ba15-498a-b613-480f89cf370a", "name": "network-vif-plugged", "status": "completed", "tag": "6c79212a-7966-4e93-b3ad-a1cbe65d2078"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:38.659706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1806f57a-d47a-4264-8ed4-0067ece90f5e req-8cfde232-e7d3-4de1-8849-6780233900b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:38.660585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1806f57a-d47a-4264-8ed4-0067ece90f5e req-8cfde232-e7d3-4de1-8849-6780233900b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:38.678103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1806f57a-d47a-4264-8ed4-0067ece90f5e req-8cfde232-e7d3-4de1-8849-6780233900b6 service nova] Creating event network-vif-plugged:6c79212a-7966-4e93-b3ad-a1cbe65d2078 for instance 3ce1cdad-ba15-498a-b613-480f89cf370a on n-h2-843861-3 Jul 19 20:30:38.686210 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1806f57a-d47a-4264-8ed4-0067ece90f5e req-8cfde232-e7d3-4de1-8849-6780233900b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040097 Jul 19 20:30:38.686859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2985/6075] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:30:39.225654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:39.226962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:39.235065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:39.235521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:39.236320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:39.236754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:39.413754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:39.422917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5d2d01ea-a714-45fe-b2ed-c03b54fc401d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.204168 Jul 19 20:30:39.423502 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3091/6076] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:39 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:40.439962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:40.442122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:40.450742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:40.451622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:40.460751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:40.461974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:40.463127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:40.463583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:40.645260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:40.655147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1768b750-50cb-4578-b8c4-da3d0edf841d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1319 microversion: 2.1 time: 0.216929 Jul 19 20:30:40.667188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2986/6077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:40 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:41.682896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:41.683467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:41.685241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:41.691467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:41.691935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:41.692703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:41.693126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:41.857851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:41.865696 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-15304355-5f01-4980-a7d1-5b6d6564f5d0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1509 microversion: 2.1 time: 0.189602 Jul 19 20:30:41.866283 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3092/6078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:41 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:30:56.556283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:56.558630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=29 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:56.727475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-62feabf7-80c6-4e6c-9960-99a77465735b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Action: 'create', calling method: .version_select at 0x7fb88de940d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-793379855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB6RrraALLqq8Ay0/VK0R6i+PBV/ul8akyL4cuAcIKUJjws0p3F+xPd5Zv1nImK/J3M5KT+gYrVuROj2MsEuHvz0I8EuSWvm4JQM4goDXj0CfhP3qpRYr7WLNMg6UFaXg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:56.742234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-62feabf7-80c6-4e6c-9960-99a77465735b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:30:56.747957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-62feabf7-80c6-4e6c-9960-99a77465735b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for user 6c27ed3447824dd794da4c806cbe256b and project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:30:56.773400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-62feabf7-80c6-4e6c-9960-99a77465735b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.222896 Jul 19 20:30:56.774019 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2987/6079] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:30:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:30:59.529014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6cf7b96-741b-4edc-983b-9bc24d04129d", "device": "/dev/sdb"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:59.532686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:59.541514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=11 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:59.543033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=35 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:59.545159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:59.545915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:59.546976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:59.547565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:59.909134 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc27b2c2-3df6-4f1d-a8b9-887db1d51927 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "POST /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385937 Jul 19 20:30:59.909841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3093/6080] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:30:59 2022] POST /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:03.331297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-708915348-access_point-508828503", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "effeb4fd-54de-4ac2-9a9a-34d870868850"}], "key_name": "tempest-TestSecurityGroupsBasicOps-793379855", "security_groups": [{"name": "tempest-secgroup_access--241633945"}, {"name": "tempest-secgroup_general--1738648959"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:03.511011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] validate_networks() for [('effeb4fd-54de-4ac2-9a9a-34d870868850', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:31:03.948566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:31:03.949018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:31:03.949654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:31:03.950253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:31:03.950746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:31:03.962338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:03.963077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:03.964086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:03.964902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:03.986011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:31:03.991882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for user 6c27ed3447824dd794da4c806cbe256b and project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:31:04.007500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:31:04.012171 n-d-843861-3 devstack@n-api.service[126007]: WARNING nova.utils [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-708915348-access_point-508828503 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-708915348-acc Jul 19 20:31:04.013240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:31:04.069547 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ab19e1d7-fce7-43a0-923f-975a1a5dc093 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.743917 Jul 19 20:31:04.071132 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2988/6081] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:31:03 2022] POST /compute/v2.1/servers => generated 457 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:31:04.084507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6c965da5-1ff0-4647-98c3-124e596b5253 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:04.085366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6c965da5-1ff0-4647-98c3-124e596b5253 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:04.181991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6c965da5-1ff0-4647-98c3-124e596b5253 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:04.191053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6c965da5-1ff0-4647-98c3-124e596b5253 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1292 microversion: 2.1 time: 0.112904 Jul 19 20:31:04.193869 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3094/6082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:04 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1292 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:05.212032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:05.212687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:05.223796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:05.224657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:05.226200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:05.227346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:05.355644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:05.369441 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bbc54f83-2059-452b-a76d-10c819922000 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1344 microversion: 2.1 time: 0.161530 Jul 19 20:31:05.395053 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2989/6083] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:05 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:06.400288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:06.401172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:06.413436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:06.414775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:06.416634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:06.420651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:06.821915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:06.831113 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2afd15cd-044c-4337-b19f-8348e9948531 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.435328 Jul 19 20:31:06.831920 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3095/6084] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:06 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:07.243094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5d806879-0f83-44e6-981f-2b40e7277637 req-cf78b17a-03d4-42a9-b49e-d56d6d42bbca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542a147-1844-46a7-990e-8ddc922bb0fd", "tag": "dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:07.263297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d806879-0f83-44e6-981f-2b40e7277637 req-cf78b17a-03d4-42a9-b49e-d56d6d42bbca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:07.264218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d806879-0f83-44e6-981f-2b40e7277637 req-cf78b17a-03d4-42a9-b49e-d56d6d42bbca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:07.285526 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5d806879-0f83-44e6-981f-2b40e7277637 req-cf78b17a-03d4-42a9-b49e-d56d6d42bbca service nova] Creating event network-changed:dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e for instance c542a147-1844-46a7-990e-8ddc922bb0fd on n-h1-843861-3 Jul 19 20:31:07.292125 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5d806879-0f83-44e6-981f-2b40e7277637 req-cf78b17a-03d4-42a9-b49e-d56d6d42bbca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054286 Jul 19 20:31:07.292949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2990/6085] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:07.852259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:07.852880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:07.861184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:07.861631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:07.862401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:07.862832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:08.005151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:08.013160 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3b277e9a-c8be-4b3b-9937-c160b6877a0c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.167554 Jul 19 20:31:08.013739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3096/6086] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:07 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:09.032011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:09.033073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:09.041838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:09.042414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:09.043390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:09.044141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:09.279019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:09.287747 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c26271d-d577-426a-b735-a630caa98202 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.260521 Jul 19 20:31:09.288408 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2991/6087] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:09 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:31:10.305425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:10.306035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:10.314235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.314683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.315449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.315910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.461312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:10.469041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-56515baf-faaa-457c-88e7-d6e11a3f6124 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.167534 Jul 19 20:31:10.469612 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3097/6088] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:10 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:11.486795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:11.487341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:11.495866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:11.496402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:11.497601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:11.498186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:11.667390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:11.677157 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7fe184f7-ebea-4d77-b43a-169920d424dc tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.194743 Jul 19 20:31:11.677758 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2992/6089] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:11 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:12.151859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-242b22e0-e3e6-4650-b2a0-b972d13b2e4e req-ac7b70ba-a54d-4493-ac91-b232421fc1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c542a147-1844-46a7-990e-8ddc922bb0fd", "name": "network-vif-plugged", "status": "completed", "tag": "dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:12.163200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-242b22e0-e3e6-4650-b2a0-b972d13b2e4e req-ac7b70ba-a54d-4493-ac91-b232421fc1c1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:12.164460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-242b22e0-e3e6-4650-b2a0-b972d13b2e4e req-ac7b70ba-a54d-4493-ac91-b232421fc1c1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:12.187831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-242b22e0-e3e6-4650-b2a0-b972d13b2e4e req-ac7b70ba-a54d-4493-ac91-b232421fc1c1 service nova] Creating event network-vif-plugged:dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e for instance c542a147-1844-46a7-990e-8ddc922bb0fd on n-h1-843861-3 Jul 19 20:31:12.193905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-242b22e0-e3e6-4650-b2a0-b972d13b2e4e req-ac7b70ba-a54d-4493-ac91-b232421fc1c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047870 Jul 19 20:31:12.195592 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3098/6090] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:31:12.695167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:12.696904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:12.703777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:12.704269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:12.705051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:12.705495 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:12.881007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:12.890887 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eebc6e77-fa5a-4dc1-8f4d-adb7b69ea276 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1469 microversion: 2.1 time: 0.200256 Jul 19 20:31:12.891793 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2993/6091] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:12 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:13.916438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:13.917148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:13.924077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:13.924535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:13.925302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:13.925739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:14.078499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:14.086899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fac71d78-72e2-4a0a-b749-279958ba1385 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1641 microversion: 2.1 time: 0.175746 Jul 19 20:31:14.087610 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3099/6092] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:13 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1641 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:14.104561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:14.105216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:14.108210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:14.108922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:14.115360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:14.115860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:14.117295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:14.117752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:14.271865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:14.279701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d92271e9-fbbb-432e-ab2e-9ca2249d8e5f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1641 microversion: 2.1 time: 0.179530 Jul 19 20:31:14.280642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2994/6093] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:14 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1641 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:14.296216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:14.297050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:14.299043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:14.305461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:14.305909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:14.306675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:14.307109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:14.586153 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a9d4d69-34af-4e78-b069-aae4f1c0bb47 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1792 microversion: 2.1 time: 0.291640 Jul 19 20:31:14.586153 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3100/6094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:14 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1792 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:16.790531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ef504228-9b3b-4360-8b5a-b14811682f9d req-8f04e2f1-c624-448c-b4e0-2c1000f30cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542a147-1844-46a7-990e-8ddc922bb0fd", "tag": "dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:16.824471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef504228-9b3b-4360-8b5a-b14811682f9d req-8f04e2f1-c624-448c-b4e0-2c1000f30cb5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:16.825249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef504228-9b3b-4360-8b5a-b14811682f9d req-8f04e2f1-c624-448c-b4e0-2c1000f30cb5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:16.856881 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ef504228-9b3b-4360-8b5a-b14811682f9d req-8f04e2f1-c624-448c-b4e0-2c1000f30cb5 service nova] Creating event network-changed:dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e for instance c542a147-1844-46a7-990e-8ddc922bb0fd on n-h1-843861-3 Jul 19 20:31:16.864539 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ef504228-9b3b-4360-8b5a-b14811682f9d req-8f04e2f1-c624-448c-b4e0-2c1000f30cb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078191 Jul 19 20:31:16.866016 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2995/6095] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:25.325097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:25.325688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:25.328303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=18 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:25.329039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:25.335129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:25.335570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:25.336434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:25.336868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:25.422706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lazy-loading 'services' on Instance uuid 3ce1cdad-ba15-498a-b613-480f89cf370a {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:31:25.493251 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc02734e-41f8-43a2-afbe-2d4db6d378ad tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a/os-volume_attachments/e6cf7b96-741b-4edc-983b-9bc24d04129d" status: 202 len: 0 microversion: 2.1 time: 0.172635 Jul 19 20:31:25.493853 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3101/6096] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:31:25 2022] DELETE /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a/os-volume_attachments/e6cf7b96-741b-4edc-983b-9bc24d04129d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:31:30.869365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:30.869955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:30.872763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:30.873424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:30.880994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:30.881444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:30.882229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:30.882670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:30.916673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:31:31.008301 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bf81f595-89d1-4cfb-b550-0edf5dfae196 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 204 len: 0 microversion: 2.1 time: 0.143134 Jul 19 20:31:31.009001 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2996/6097] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:31:30 2022] DELETE /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:31:31.018663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:31.019362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:31.025815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:31.026256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:31.027019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:31.027451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:31.166049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:31.173571 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fac9921a-f668-4b53-8099-4a100e6e8370 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1515 microversion: 2.1 time: 0.159978 Jul 19 20:31:31.174146 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3102/6098] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:31 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:32.191905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:32.193573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:32.200681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:32.201151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:32.201943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:32.202392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:32.346042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:32.353893 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4facb0aa-0bc0-440d-a343-5507507b0a65 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1515 microversion: 2.1 time: 0.166413 Jul 19 20:31:32.354521 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2997/6099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:32 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:33.274485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1a30821a-6eb8-43b8-b693-f691cc994e8f req-edbd717e-ab7f-488f-91d1-75ab00457f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce1cdad-ba15-498a-b613-480f89cf370a", "name": "network-vif-deleted", "tag": "6c79212a-7966-4e93-b3ad-a1cbe65d2078"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:33.285488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1a30821a-6eb8-43b8-b693-f691cc994e8f req-edbd717e-ab7f-488f-91d1-75ab00457f57 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:33.285932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1a30821a-6eb8-43b8-b693-f691cc994e8f req-edbd717e-ab7f-488f-91d1-75ab00457f57 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:33.298706 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1a30821a-6eb8-43b8-b693-f691cc994e8f req-edbd717e-ab7f-488f-91d1-75ab00457f57 service nova] Creating event network-vif-deleted:6c79212a-7966-4e93-b3ad-a1cbe65d2078 for instance 3ce1cdad-ba15-498a-b613-480f89cf370a on n-h2-843861-3 Jul 19 20:31:33.304763 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1a30821a-6eb8-43b8-b693-f691cc994e8f req-edbd717e-ab7f-488f-91d1-75ab00457f57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034526 Jul 19 20:31:33.305375 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3103/6100] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:33.370928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:33.371832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:33.381699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:33.382158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:33.383394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:33.383976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:33.423567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:33.424061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:33.424530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lazy-loading 'fault' on Instance uuid 3ce1cdad-ba15-498a-b613-480f89cf370a {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:31:33.467033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:33.475229 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58c528b9-e815-40f5-8f74-7ee37cfbf20d tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 200 len: 1309 microversion: 2.1 time: 0.108446 Jul 19 20:31:33.475915 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2998/6101] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:33 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:34.494093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:34.494692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: 3ce1cdad-ba15-498a-b613-480f89cf370a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:34.501181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:34.501634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:34.502409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:34.502851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:34.517371 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] HTTP exception thrown: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Request method failure captured: Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a HTTP/1.1 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xQfR3dE4cbqtQu03l-YZ_V1yL6y2L4mK7AppWZOhMkoFlcsMZtA5NP5LrgxlDua-m9zdhV7p1GDN-AIJ_0BUV4q5LkKtXBSUbToj8hkuVkak_B3AnbC3gcRYd1pSKTvjU3I_xp3raNtZgY7fTqh8I05FbNLzrmehwYZwup1aQXAO6k Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c17607df6e3542b69df933370901ba66 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17607df6e3542b69df933370901ba66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c17607df6e3542b69df933370901ba66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17607df6e3542b69df933370901ba66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c17607df6e3542b69df933370901ba66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c17607df6e3542b69df933370901ba66 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesSnapshotTestJSON-1799733497-project Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: c5deb03c3edd4c199a7c5a1d969673e8 Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799733497-project Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3ce1cdad-ba15-498a-b613-480f89cf370a'} Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:31:34.519039 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Returning 404 to user: Instance 3ce1cdad-ba15-498a-b613-480f89cf370a could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-64d7064d-3c1c-4dd4-8c96-66d6344469f6 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a" status: 404 len: 111 microversion: 2.1 time: 0.031584 Jul 19 20:31:34.525016 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3104/6102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:34 2022] GET /compute/v2.1/servers/3ce1cdad-ba15-498a-b613-480f89cf370a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:31:41.407189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-523255995", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "cd1e74d2-ff09-4295-932a-da5a96128422"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:41.472258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] validate_networks() for [('cd1e74d2-ff09-4295-932a-da5a96128422', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:31:41.860157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:31:41.860752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:31:41.861255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:31:41.861690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:31:41.862118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:31:41.872244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:41.872700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:41.873505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:41.873949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:41.892000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Getting quotas for project c17607df6e3542b69df933370901ba66. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:31:41.898141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Getting quotas for user c5deb03c3edd4c199a7c5a1d969673e8 and project c17607df6e3542b69df933370901ba66. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:31:41.910971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:31:41.913324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:31:41.960309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca5d7e5a-1586-48fe-b366-4f20aa352db0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558624 Jul 19 20:31:41.966441 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 2999/6103] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:31:41.971685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee33d08a-c766-48b2-b0b6-3becbb97ca04 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:41.972425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee33d08a-c766-48b2-b0b6-3becbb97ca04 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:42.029460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee33d08a-c766-48b2-b0b6-3becbb97ca04 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:42.037993 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee33d08a-c766-48b2-b0b6-3becbb97ca04 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1218 microversion: 2.1 time: 0.070141 Jul 19 20:31:42.039038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3105/6104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:41 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:43.056742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:43.057366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:43.064788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:43.065285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:43.066071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:43.067113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:43.159246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:43.168043 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-11907bee-ead8-495e-93e1-2a47ab352fc1 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1276 microversion: 2.1 time: 0.116134 Jul 19 20:31:43.168635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3000/6105] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:43 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:44.187309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:44.188022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:44.198285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.198796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.199669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.200130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.437536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:44.446119 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-763bd183-ea27-4697-884d-e7185f930229 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.263529 Jul 19 20:31:44.446717 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3106/6106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:44 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:44.554611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e8e43dce-296e-4ed7-bef9-406905d0b154 req-d098f5d8-181f-4fd7-a4fe-4be3deadb205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4509422-ec49-40ac-a7c9-aa10566a70ed", "tag": "ed69a66b-b57d-4f36-937a-d0e8f3f258d8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:44.565967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e8e43dce-296e-4ed7-bef9-406905d0b154 req-d098f5d8-181f-4fd7-a4fe-4be3deadb205 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.567093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e8e43dce-296e-4ed7-bef9-406905d0b154 req-d098f5d8-181f-4fd7-a4fe-4be3deadb205 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.582390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e8e43dce-296e-4ed7-bef9-406905d0b154 req-d098f5d8-181f-4fd7-a4fe-4be3deadb205 service nova] Creating event network-changed:ed69a66b-b57d-4f36-937a-d0e8f3f258d8 for instance b4509422-ec49-40ac-a7c9-aa10566a70ed on n-h2-843861-3 Jul 19 20:31:44.588414 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e8e43dce-296e-4ed7-bef9-406905d0b154 req-d098f5d8-181f-4fd7-a4fe-4be3deadb205 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039543 Jul 19 20:31:44.589619 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3001/6107] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:45.463685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:45.464419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:45.472273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:45.472784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:45.473545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:45.473978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:45.619336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:45.629315 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2e7f1e1d-04a3-43af-b3af-7f46e1b950d9 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.169763 Jul 19 20:31:45.630063 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3107/6108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:45 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:46.647459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:46.648666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:46.657010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:46.657534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:46.658314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:46.658763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:46.813546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:46.821430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32eb8f83-655e-45dc-b0e9-f55b6614b1df tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.178474 Jul 19 20:31:46.822037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3002/6109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:46 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:47.838948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:47.839790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:47.846677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:47.847165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:47.848611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:47.849265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:47.983602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:47.991352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54e366fa-ce0c-4159-bf71-f8b898c18ddb tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.156275 Jul 19 20:31:47.991961 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3108/6110] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:47 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:49.009493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:49.010378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:49.017471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:49.017928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:49.018763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:49.019837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:49.169970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:49.178426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89adc56c-0944-422e-8cde-29fe6c84f836 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.173505 Jul 19 20:31:49.179022 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3003/6111] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:49 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:50.196365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:50.197025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:50.204239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:50.204687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:50.205457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:50.205887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:50.347940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:50.359262 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bec230ab-4e30-4abc-94eb-440d33505bcf tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.166783 Jul 19 20:31:50.359868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3109/6112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:50 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:51.062901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-95a0fcfc-3fdf-4ffd-8ff5-556f81f46073 req-c8a387f6-ec24-4493-8f9f-896002f1e767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4509422-ec49-40ac-a7c9-aa10566a70ed", "name": "network-vif-plugged", "status": "completed", "tag": "ed69a66b-b57d-4f36-937a-d0e8f3f258d8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:51.072489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-95a0fcfc-3fdf-4ffd-8ff5-556f81f46073 req-c8a387f6-ec24-4493-8f9f-896002f1e767 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:51.072956 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-95a0fcfc-3fdf-4ffd-8ff5-556f81f46073 req-c8a387f6-ec24-4493-8f9f-896002f1e767 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:51.085479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-95a0fcfc-3fdf-4ffd-8ff5-556f81f46073 req-c8a387f6-ec24-4493-8f9f-896002f1e767 service nova] Creating event network-vif-plugged:ed69a66b-b57d-4f36-937a-d0e8f3f258d8 for instance b4509422-ec49-40ac-a7c9-aa10566a70ed on n-h2-843861-3 Jul 19 20:31:51.091047 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-95a0fcfc-3fdf-4ffd-8ff5-556f81f46073 req-c8a387f6-ec24-4493-8f9f-896002f1e767 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Jul 19 20:31:51.091668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3004/6113] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:51.376294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:51.376939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:51.383940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:51.384390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:51.385250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:51.385677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:51.527489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:51.536327 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-684c602a-9b1e-4d93-9077-5c6f0bfeca06 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.163812 Jul 19 20:31:51.536915 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3110/6114] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:51 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:52.551589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:52.552433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:52.558580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:52.559298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:52.566256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:52.566719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:52.567559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:52.568053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:52.713967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:52.722728 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-89e6733c-f2bf-4df5-ab03-2b98af81762a tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1318 microversion: 2.1 time: 0.171943 Jul 19 20:31:52.725809 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3005/6115] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:52 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:53.741824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:53.741824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:53.744364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:53.750454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:53.750898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:53.751668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:53.752137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:53.972686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:53.982544 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51a76417-01a3-45bb-8d20-eb12174e3fe3 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1507 microversion: 2.1 time: 0.245126 Jul 19 20:31:53.983319 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3111/6116] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:53 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:53.999800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deccfbeb-7fdf-4c5c-a75d-fa029c09cadc", "device": "/dev/sdb"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:54.001088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:54.009633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:54.010189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:54.011087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:54.011612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:54.307945 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed016396-e17d-4f1b-9332-ef2442d59b8e tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "POST /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312048 Jul 19 20:31:54.308599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3006/6117] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:31:53 2022] POST /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:59.365660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:59.366153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:59.371823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=25 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:59.373815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-32a0fbcf-a1e2-4eb3-aeef-582ffc026ce1 req-8a56eb2e-3d5a-4bdc-ab28-39f42a1bff94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c58682-a743-46d2-b990-ebc5526fc5c0", "tag": "4a03b1e1-f6a9-471a-a25f-a9b910096113"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:59.376948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:59.377691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:59.378657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:59.379249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:59.403647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:59.409751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32a0fbcf-a1e2-4eb3-aeef-582ffc026ce1 req-8a56eb2e-3d5a-4bdc-ab28-39f42a1bff94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:59.410722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32a0fbcf-a1e2-4eb3-aeef-582ffc026ce1 req-8a56eb2e-3d5a-4bdc-ab28-39f42a1bff94 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:59.450645 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-32a0fbcf-a1e2-4eb3-aeef-582ffc026ce1 req-8a56eb2e-3d5a-4bdc-ab28-39f42a1bff94 service nova] Creating event network-changed:4a03b1e1-f6a9-471a-a25f-a9b910096113 for instance a6c58682-a743-46d2-b990-ebc5526fc5c0 on n-h1-843861-3 Jul 19 20:31:59.464698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-32a0fbcf-a1e2-4eb3-aeef-582ffc026ce1 req-8a56eb2e-3d5a-4bdc-ab28-39f42a1bff94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094618 Jul 19 20:31:59.469184 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3007/6118] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:59.490031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:31:59.538554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-722606292", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "11877e04-0340-4192-b360-3163867d40e9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-793379855", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c542a147-1844-46a7-990e-8ddc922bb0fd"]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:59.644507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] validate_networks() for [('11877e04-0340-4192-b360-3163867d40e9', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:31:59.652343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09297e25-314d-4f03-b7a9-a51f13d745d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 204 len: 0 microversion: 2.1 time: 0.286570 Jul 19 20:31:59.655780 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3112/6119] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:31:59 2022] DELETE /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:31:59.666007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:59.666865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:59.688733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:59.689675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:59.690785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:59.691690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.345478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:00.357696 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ced8c01e-1aa3-4a45-94d5-927e481585d8 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1575 microversion: 2.1 time: 0.697017 Jul 19 20:32:00.358580 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3113/6120] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:59 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1575 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:00.528133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:32:00.528882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:32:00.529276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:32:00.529802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:32:00.530570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:32:00.544349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.545330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.546420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.547534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.576304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:32:00.583531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Getting quotas for user 6c27ed3447824dd794da4c806cbe256b and project 173e211434dc4e5da6fb0e7856a2676c. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:32:00.602071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:32:00.604738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:32:00.703918 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a0c2ff1-6081-456f-b0c3-a50d6168a8f4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.173886 Jul 19 20:32:00.705160 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3008/6121] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:31:59 2022] POST /compute/v2.1/servers => generated 361 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:32:00.717182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4bfd6938-c8f0-4a35-9fe1-5d61178dc60b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:00.718275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4bfd6938-c8f0-4a35-9fe1-5d61178dc60b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:00.812522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4bfd6938-c8f0-4a35-9fe1-5d61178dc60b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:00.820451 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4bfd6938-c8f0-4a35-9fe1-5d61178dc60b tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1240 microversion: 2.1 time: 0.107605 Jul 19 20:32:00.823735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3114/6122] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:00 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:01.377625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:01.378265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:01.386478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:01.393772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.394344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.395344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.395835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.482143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:01.805352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:01.835848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84e8df0d-55b7-4162-bf79-3c5d77ce6708 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1575 microversion: 2.1 time: 0.461602 Jul 19 20:32:01.838903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3009/6123] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:01 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1575 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:01.852174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:01.852808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:01.870181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.871064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.872879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.874340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.957936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:01.973777 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c0d7041-741f-438d-8e96-6a9b450e1513 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1292 microversion: 2.1 time: 0.136664 Jul 19 20:32:01.984850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3115/6124] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:01 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1292 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:02.235935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c1e2bfba-924e-4fe8-9950-2a76ccb0a9f6 req-5ce34a5f-3a92-4ba1-a270-3d4c36b33aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c58682-a743-46d2-b990-ebc5526fc5c0", "name": "network-vif-deleted", "tag": "4a03b1e1-f6a9-471a-a25f-a9b910096113"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:02.246168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c1e2bfba-924e-4fe8-9950-2a76ccb0a9f6 req-5ce34a5f-3a92-4ba1-a270-3d4c36b33aae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:02.246846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c1e2bfba-924e-4fe8-9950-2a76ccb0a9f6 req-5ce34a5f-3a92-4ba1-a270-3d4c36b33aae service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:02.265438 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c1e2bfba-924e-4fe8-9950-2a76ccb0a9f6 req-5ce34a5f-3a92-4ba1-a270-3d4c36b33aae service nova] Creating event network-vif-deleted:4a03b1e1-f6a9-471a-a25f-a9b910096113 for instance a6c58682-a743-46d2-b990-ebc5526fc5c0 on n-h1-843861-3 Jul 19 20:32:02.271658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c1e2bfba-924e-4fe8-9950-2a76ccb0a9f6 req-5ce34a5f-3a92-4ba1-a270-3d4c36b33aae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039937 Jul 19 20:32:02.272387 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3010/6125] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:02.854957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:02.856267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:02.863107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:02.863851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:02.864995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:02.865603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:02.967735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:02.980735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a1e4d2d-94e4-4014-afab-64ee630c6459 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1224 microversion: 2.1 time: 0.129069 Jul 19 20:32:02.982869 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3116/6126] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:02 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:02.995038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:02.997195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:03.006271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.006980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:03.008028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.008873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:03.094627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:03.105309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-971f4e07-e327-4b77-ba0b-e9013c6247e4 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.115686 Jul 19 20:32:03.107855 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3011/6127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:02 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:04.000459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:04.001695 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:04.013874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.015068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.015257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.015604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.108364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:04.121337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8afd2a37-24fc-49cc-a477-5907d95b5b8a tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1224 microversion: 2.1 time: 0.124727 Jul 19 20:32:04.122721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:04.123359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:04.125746 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3117/6128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:03 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:04.131564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.132356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.133433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.134214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.277093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:04.290867 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-312f5dbc-ae83-408c-ba29-e35a46aeb58c tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.171983 Jul 19 20:32:04.301598 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3012/6129] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:04 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:04.357531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5be8ad66-2b1d-4c4c-b6f4-1d69c7e5c38f req-794de771-97e9-4113-80d4-9a9bb2283d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d413da4d-3f31-43b0-8c1e-0d1878e0df55", "tag": "3de0e2a6-0579-446a-926e-418352169182"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:04.393315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5be8ad66-2b1d-4c4c-b6f4-1d69c7e5c38f req-794de771-97e9-4113-80d4-9a9bb2283d5b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.394088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5be8ad66-2b1d-4c4c-b6f4-1d69c7e5c38f req-794de771-97e9-4113-80d4-9a9bb2283d5b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.414404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5be8ad66-2b1d-4c4c-b6f4-1d69c7e5c38f req-794de771-97e9-4113-80d4-9a9bb2283d5b service nova] Creating event network-changed:3de0e2a6-0579-446a-926e-418352169182 for instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 on n-h2-843861-3 Jul 19 20:32:04.422887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5be8ad66-2b1d-4c4c-b6f4-1d69c7e5c38f req-794de771-97e9-4113-80d4-9a9bb2283d5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069573 Jul 19 20:32:04.424668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3118/6130] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:05.140747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:05.141377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:05.149281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.149755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.150550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.151265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.228744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:05.236993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-22e3ef41-a1aa-468a-9cb0-720ffd9369ef tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1224 microversion: 2.1 time: 0.100290 Jul 19 20:32:05.237591 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3013/6131] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:05 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:05.310365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:05.311237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:05.318462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.318919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.319676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.320139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.407240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:05.414981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af96e31a-60a4-4577-90c2-26b42c2740e5 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.110130 Jul 19 20:32:05.415559 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3119/6132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:05 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:06.254101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:06.254727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:06.262467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.263001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.263900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.264325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.340902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:06.350227 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-95644835-2ccc-4808-8bde-d5cd9c01ded1 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 200 len: 1224 microversion: 2.1 time: 0.100742 Jul 19 20:32:06.351285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3014/6133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:06 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:06.432923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:06.434501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:06.442190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.442638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.443402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.443977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.529584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:06.539469 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e95bfc0-61e4-48ba-ad32-47086c01fd3e tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.110682 Jul 19 20:32:06.540151 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3120/6134] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:06 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:07.368666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:07.369846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: a6c58682-a743-46d2-b990-ebc5526fc5c0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:07.381065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.381936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.383261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.384041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.408754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 HTTP/1.1 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a6c58682-a743-46d2-b990-ebc5526fc5c0'} Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:07.411600 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance a6c58682-a743-46d2-b990-ebc5526fc5c0 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7b20b03-a108-497c-93ae-e0b81df54957 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0" status: 404 len: 111 microversion: 2.1 time: 0.051130 Jul 19 20:32:07.416736 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3015/6135] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:07 2022] GET /compute/v2.1/servers/a6c58682-a743-46d2-b990-ebc5526fc5c0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:07.559324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:07.561289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:07.570322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.571085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.572064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.572654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.729001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:07.737667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7963e3e2-346f-4835-a857-65ea4be4b728 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.184347 Jul 19 20:32:07.747987 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3121/6136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:07 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:08.754738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:08.755276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:08.767571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.768305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.769103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.769552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.862597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:08.870776 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87f59f15-0f95-46b2-8018-4da9d4c8472d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.120032 Jul 19 20:32:08.871937 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3016/6137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:08 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:09.171870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-239397e3-7489-4ca1-85c0-24ae5d77d91c req-6f249001-d0af-4f3c-bc40-60a4c785170e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d413da4d-3f31-43b0-8c1e-0d1878e0df55", "name": "network-vif-plugged", "status": "completed", "tag": "3de0e2a6-0579-446a-926e-418352169182"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:09.206150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-239397e3-7489-4ca1-85c0-24ae5d77d91c req-6f249001-d0af-4f3c-bc40-60a4c785170e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:09.207756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-239397e3-7489-4ca1-85c0-24ae5d77d91c req-6f249001-d0af-4f3c-bc40-60a4c785170e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:09.229676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-239397e3-7489-4ca1-85c0-24ae5d77d91c req-6f249001-d0af-4f3c-bc40-60a4c785170e service nova] Creating event network-vif-plugged:3de0e2a6-0579-446a-926e-418352169182 for instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 on n-h2-843861-3 Jul 19 20:32:09.244998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-239397e3-7489-4ca1-85c0-24ae5d77d91c req-6f249001-d0af-4f3c-bc40-60a4c785170e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086632 Jul 19 20:32:09.245976 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3122/6138] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:09.889795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:09.891001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:09.899794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:09.900311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:09.901376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:09.901895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.040283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:10.053199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b679ed1a-aef7-4578-929a-0f2918f6f885 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1298 microversion: 2.1 time: 0.167336 Jul 19 20:32:10.059464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3017/6139] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:09 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.085081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.085781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.088832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:11.096820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.097733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.098940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.099634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.202826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:11.213179 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50d91ba5-c97c-4df6-86df-189d95826e54 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1471 microversion: 2.1 time: 0.133635 Jul 19 20:32:11.228230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3123/6140] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.231698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.232596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.234681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:11.237803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:11.247678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.248410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.249478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.250298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.408105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:11.415835 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a820340e-4325-4a09-badb-2f3bf43087c1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1471 microversion: 2.1 time: 0.188915 Jul 19 20:32:11.416657 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3018/6141] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.432832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.433682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.440988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.441442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.442218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.442647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.549769 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b1f42b2-ad17-4108-96dd-90786599db31 tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1622 microversion: 2.1 time: 0.120899 Jul 19 20:32:11.560592 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3124/6142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1622 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.567463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.568463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.576709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.577175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.577964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.578636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.754128 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a009035-a7d1-4260-a87a-7cde8714990f tempest-TestSecurityGroupsBasicOps-1248969535 tempest-TestSecurityGroupsBasicOps-1248969535-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1910 microversion: 2.1 time: 0.190957 Jul 19 20:32:11.767724 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3019/6143] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1910 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.832002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.832479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.842666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.843126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.843948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.844387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.885604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:32:12.008505 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d53473f9-b588-4ec2-9eab-0fa5b878a48d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 204 len: 0 microversion: 2.1 time: 0.179894 Jul 19 20:32:12.011859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3125/6144] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:11 2022] DELETE /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:32:12.023550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:12.026192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:12.049813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:12.051248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:12.054057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:12.055937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:12.183423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:12.194051 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa9538e4-31fe-44c4-a875-267c4bc188cd tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1477 microversion: 2.1 time: 0.180260 Jul 19 20:32:12.194921 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3020/6145] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:12 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:13.220739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:13.222034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:13.235265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.235265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.236056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.236546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.339331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:13.349515 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6e891a8-4c4f-4f04-8a79-aaff52aac3f6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1477 microversion: 2.1 time: 0.135024 Jul 19 20:32:13.364424 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3126/6146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:13 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:13.931083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:13.936720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5123e84d-70ac-457d-a499-20362190e319 req-1b746ccd-1b8a-49d4-bdff-00b4a05e0aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637efbbd-5022-4cae-926e-4bdf025d24d0", "tag": "c9bb9a19-5905-4224-b6b8-1ee7a214cbdc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:13.941618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:13.950288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.950746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.951533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.952009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.959717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5123e84d-70ac-457d-a499-20362190e319 req-1b746ccd-1b8a-49d4-bdff-00b4a05e0aaa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.960188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5123e84d-70ac-457d-a499-20362190e319 req-1b746ccd-1b8a-49d4-bdff-00b4a05e0aaa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.979380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5123e84d-70ac-457d-a499-20362190e319 req-1b746ccd-1b8a-49d4-bdff-00b4a05e0aaa service nova] Creating event network-changed:c9bb9a19-5905-4224-b6b8-1ee7a214cbdc for instance 637efbbd-5022-4cae-926e-4bdf025d24d0 on n-h2-843861-3 Jul 19 20:32:13.984611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5123e84d-70ac-457d-a499-20362190e319 req-1b746ccd-1b8a-49d4-bdff-00b4a05e0aaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051300 Jul 19 20:32:13.985412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3127/6147] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:32:14.019074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:32:14.192616 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc877c4c-5e3f-4e6c-aef0-c42a7457a70c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 204 len: 0 microversion: 2.1 time: 0.265952 Jul 19 20:32:14.193803 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3021/6148] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:13 2022] DELETE /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:32:14.203093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:14.204275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:14.221179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.223475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.225928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.229305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.266369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:14.370794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:14.371686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:14.379041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.379604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.380626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.381381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.539544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:14.548370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a9c7f7d-e839-4c77-a2d6-9c74931cf728 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1576 microversion: 2.1 time: 0.348752 Jul 19 20:32:14.549351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3128/6149] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:14 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1576 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:14.571245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:14.580202 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9ef633e-0a80-437d-b7fe-388098f9a6b6 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1477 microversion: 2.1 time: 0.213482 Jul 19 20:32:14.580904 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3022/6150] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:14 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:14.906815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e653e8ba-d2dc-4c93-bfda-85f502bc1b3c req-edf67c36-618d-4c1a-9646-62481aa366ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d413da4d-3f31-43b0-8c1e-0d1878e0df55", "name": "network-vif-deleted", "tag": "3de0e2a6-0579-446a-926e-418352169182"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:14.917538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e653e8ba-d2dc-4c93-bfda-85f502bc1b3c req-edf67c36-618d-4c1a-9646-62481aa366ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.918281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e653e8ba-d2dc-4c93-bfda-85f502bc1b3c req-edf67c36-618d-4c1a-9646-62481aa366ef service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.936414 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e653e8ba-d2dc-4c93-bfda-85f502bc1b3c req-edf67c36-618d-4c1a-9646-62481aa366ef service nova] Creating event network-vif-deleted:3de0e2a6-0579-446a-926e-418352169182 for instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 on n-h2-843861-3 Jul 19 20:32:14.944256 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e653e8ba-d2dc-4c93-bfda-85f502bc1b3c req-edf67c36-618d-4c1a-9646-62481aa366ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042564 Jul 19 20:32:14.945323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3129/6151] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:15.567324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:15.568153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:15.576013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.576478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.577290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.577749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.599851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:15.600987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:15.609651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.610281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.611221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.612109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.691871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:15.701715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e13da55-5365-4334-81cd-bc2b5a35f2b1 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 200 len: 1325 microversion: 2.1 time: 0.107213 Jul 19 20:32:15.702455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3130/6152] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:15 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 1325 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:15.765672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:15.775138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-530811e2-7dc3-46ff-86d1-1972c6f604d5 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1576 microversion: 2.1 time: 0.212388 Jul 19 20:32:15.776529 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3023/6153] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:15 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:16.726185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:16.727031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: d413da4d-3f31-43b0-8c1e-0d1878e0df55] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:16.735633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.736317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:16.737272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.737867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:16.753871 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] HTTP exception thrown: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Request method failure captured: Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 HTTP/1.1 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xR_k5MCM_JQ-7UvwSzKzytwivUa-uBLvtht4iTmPqnX-yTG_ueCjMzr9R2hEfr4y9dPNKP9ENBQ30IxM13h5BzcE1RT_i_UJrvbFQv4IEb6tPvsst-aq_qCwTeEfzETuB4V9sDh_zp9h2ZAZ8AaLt2_9NLxclLtDjZZMLB_NoazY8c Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 173e211434dc4e5da6fb0e7856a2676c Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 173e211434dc4e5da6fb0e7856a2676c Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestSecurityGroupsBasicOps-708915348-project Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 6c27ed3447824dd794da4c806cbe256b Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestSecurityGroupsBasicOps-708915348-project Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd413da4d-3f31-43b0-8c1e-0d1878e0df55'} Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:16.755516 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Returning 404 to user: Instance d413da4d-3f31-43b0-8c1e-0d1878e0df55 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70e10be3-8d50-4e8e-9f87-9687ab65a737 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55" status: 404 len: 111 microversion: 2.1 time: 0.038510 Jul 19 20:32:16.762310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3131/6154] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:16 2022] GET /compute/v2.1/servers/d413da4d-3f31-43b0-8c1e-0d1878e0df55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:16.795926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:16.796794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:16.806852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.806852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:16.806852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.808422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:17.147282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-94bfa409-87fd-493b-93ea-a94ac55978d0 req-abe80640-d2ed-4618-9837-2ec8e9b2b832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637efbbd-5022-4cae-926e-4bdf025d24d0", "name": "network-vif-deleted", "tag": "c9bb9a19-5905-4224-b6b8-1ee7a214cbdc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:17.149491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:17.157927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-94bfa409-87fd-493b-93ea-a94ac55978d0 req-abe80640-d2ed-4618-9837-2ec8e9b2b832 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:17.158621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-94bfa409-87fd-493b-93ea-a94ac55978d0 req-abe80640-d2ed-4618-9837-2ec8e9b2b832 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:17.160955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-34b94d29-1c75-4f37-b079-55f8fe575e35 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1457 microversion: 2.1 time: 0.369919 Jul 19 20:32:17.161802 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3024/6155] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:16 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1457 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:17.173173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-94bfa409-87fd-493b-93ea-a94ac55978d0 req-abe80640-d2ed-4618-9837-2ec8e9b2b832 service nova] Creating event network-vif-deleted:c9bb9a19-5905-4224-b6b8-1ee7a214cbdc for instance 637efbbd-5022-4cae-926e-4bdf025d24d0 on n-h2-843861-3 Jul 19 20:32:17.183922 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-94bfa409-87fd-493b-93ea-a94ac55978d0 req-abe80640-d2ed-4618-9837-2ec8e9b2b832 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044732 Jul 19 20:32:17.184668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3132/6156] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:18.188183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:18.189585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:18.197670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:18.198493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:18.199666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:18.200366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:18.219861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:18.322807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:18.334799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9492eddc-42a5-4bf8-a3cc-2bb3cc8e2c9e tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1225 microversion: 2.1 time: 0.150603 Jul 19 20:32:18.336695 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3025/6157] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:18 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:19.354944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:19.356334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:19.369083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.369888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.371055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.371868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.468030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:19.478055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-429d15f8-4cf6-40cf-9c23-c2816be6991c tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1225 microversion: 2.1 time: 0.128067 Jul 19 20:32:19.479719 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3133/6158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:19 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:19.691240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:19.692028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:19.713989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.714916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.716148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.716861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.866472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lazy-loading 'services' on Instance uuid b4509422-ec49-40ac-a7c9-aa10566a70ed {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:32:19.996886 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23ea3fcd-77b6-4efb-b726-79b9d11c3eea tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed/os-volume_attachments/deccfbeb-7fdf-4c5c-a75d-fa029c09cadc" status: 202 len: 0 microversion: 2.1 time: 0.311087 Jul 19 20:32:20.002459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3026/6159] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:32:19 2022] DELETE /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed/os-volume_attachments/deccfbeb-7fdf-4c5c-a75d-fa029c09cadc => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:32:20.495548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:20.496466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:20.517953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:20.520480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:20.523994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:20.524631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:20.624381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:20.646617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c3fe2fa4-2bf4-4d14-be17-9892b32cfea3 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1225 microversion: 2.1 time: 0.154901 Jul 19 20:32:20.656292 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3134/6160] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:20 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:21.664982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:21.667339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:21.675536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:21.676180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:21.677073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:21.677620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:21.786431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:21.799205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aaf6cd82-c5cd-4fec-b265-420e82efd513 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1225 microversion: 2.1 time: 0.139156 Jul 19 20:32:21.800796 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3027/6161] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:21 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:22.333962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-76b67c82-5781-4a3c-bfe3-09a0f99e8d16 req-0d663aa9-54d4-496f-a1a8-d03d836931d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542a147-1844-46a7-990e-8ddc922bb0fd", "tag": "dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:22.340620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:22.341817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:22.352035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-76b67c82-5781-4a3c-bfe3-09a0f99e8d16 req-0d663aa9-54d4-496f-a1a8-d03d836931d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.352504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-76b67c82-5781-4a3c-bfe3-09a0f99e8d16 req-0d663aa9-54d4-496f-a1a8-d03d836931d1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.357623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.358056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.358865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.359300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.386830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-76b67c82-5781-4a3c-bfe3-09a0f99e8d16 req-0d663aa9-54d4-496f-a1a8-d03d836931d1 service nova] Creating event network-changed:dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e for instance c542a147-1844-46a7-990e-8ddc922bb0fd on n-h1-843861-3 Jul 19 20:32:22.395308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-76b67c82-5781-4a3c-bfe3-09a0f99e8d16 req-0d663aa9-54d4-496f-a1a8-d03d836931d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064980 Jul 19 20:32:22.396287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3028/6162] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:22.413769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:32:22.553562 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8dbec7f-5eff-4e07-bfc2-8861c2003bb2 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 204 len: 0 microversion: 2.1 time: 0.227808 Jul 19 20:32:22.555390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3135/6163] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:22 2022] DELETE /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:32:22.567982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:22.568484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:22.579243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.580386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.581564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.582260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.834130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:22.845997 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5868c93-a9ee-47df-ad02-c93632cd454f tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1765 microversion: 2.1 time: 0.285394 Jul 19 20:32:22.846827 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3029/6164] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:22 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1765 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:23.013935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:23.014941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:23.024477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:23.025197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:23.026136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:23.027022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:23.074970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:23.075676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:23.076428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lazy-loading 'fault' on Instance uuid 637efbbd-5022-4cae-926e-4bdf025d24d0 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:32:23.131209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed9bc1a8174428196b98f4679e659f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf2fd626c654fcf817e438760bcd2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:23.144870 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8c62a48-c87e-46ab-9b16-c5881e6316df tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 200 len: 1184 microversion: 2.1 time: 0.325509 Jul 19 20:32:23.148787 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3136/6165] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:22 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 1184 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:23.864325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:23.865226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:23.881561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:23.882327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:23.883413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:23.884091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.165308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:24.166387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: 637efbbd-5022-4cae-926e-4bdf025d24d0] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:24.179617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:24.180786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.183944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:24.185070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.213752 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 HTTP/1.1 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '637efbbd-5022-4cae-926e-4bdf025d24d0'} Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:24.217061 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. Jul 19 20:32:24.224505 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:24.228239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance 637efbbd-5022-4cae-926e-4bdf025d24d0 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:24.229950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3709b419-ec5e-4f43-ab27-7c572b39d711 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0" status: 404 len: 111 microversion: 2.1 time: 0.073575 Jul 19 20:32:24.237357 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3137/6166] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:24 2022] GET /compute/v2.1/servers/637efbbd-5022-4cae-926e-4bdf025d24d0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:24.350310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c27ed3447824dd794da4c806cbe256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e211434dc4e5da6fb0e7856a2676c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:24.364475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e5956ffd-8ae9-4803-b2e4-11f0e3b730d9 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 200 len: 1765 microversion: 2.1 time: 0.503339 Jul 19 20:32:24.374064 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3030/6167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:23 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 1765 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:24.764254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-56eeee56-4293-4f7a-b319-09d511d70376 req-20246042-cb7b-4558-914d-ff1fdc7efa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c542a147-1844-46a7-990e-8ddc922bb0fd", "name": "network-vif-deleted", "tag": "dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:24.810255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-56eeee56-4293-4f7a-b319-09d511d70376 req-20246042-cb7b-4558-914d-ff1fdc7efa58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:24.810920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-56eeee56-4293-4f7a-b319-09d511d70376 req-20246042-cb7b-4558-914d-ff1fdc7efa58 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.838503 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-56eeee56-4293-4f7a-b319-09d511d70376 req-20246042-cb7b-4558-914d-ff1fdc7efa58 service nova] Creating event network-vif-deleted:dfb53328-3ef2-4fd3-b2f7-5d018aa44e5e for instance c542a147-1844-46a7-990e-8ddc922bb0fd on n-h1-843861-3 Jul 19 20:32:24.845239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-56eeee56-4293-4f7a-b319-09d511d70376 req-20246042-cb7b-4558-914d-ff1fdc7efa58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087454 Jul 19 20:32:24.846171 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3138/6168] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:32:25.053327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:25.053960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:25.064427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.065180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.066307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.066857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.091342 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 HTTP/1.1 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'e0f78aa1-79f0-4fc4-afc7-19f14efbff03'} Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:25.094929 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:25.099064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc43be8e-be6c-41a7-a519-a3bc3ed21a59 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 404 len: 111 microversion: 2.1 time: 0.052346 Jul 19 20:32:25.099919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3031/6169] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:25 2022] DELETE /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:25.109080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:25.109887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] [instance: e0f78aa1-79f0-4fc4-afc7-19f14efbff03] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:25.116966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.117412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.118519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.118633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.133697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] HTTP exception thrown: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Request method failure captured: Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 HTTP/1.1 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xEX6S12WzXxhBtaCCOHySrk17e9mvo4UMl6AfLuc3lvglKX90JgGrflu2XWOSMVVpSJxmV3VfxiEf4WpWpgfl4mS2UhptK2Lq4p-i_NtMLmSCogF8yZn7dGwxdBzRfBMuDAQI0OXwBVBggsJTCBbAoNU_XK4GStd3ZLT4KBPn3NG48 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcf2fd626c654fcf817e438760bcd2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fcf2fd626c654fcf817e438760bcd2f3 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestVolumeBootPattern-877963720 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: aed9bc1a8174428196b98f4679e659f4 Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestVolumeBootPattern-877963720-project Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e0f78aa1-79f0-4fc4-afc7-19f14efbff03'} Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.135662 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. Jul 19 20:32:25.140970 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.143140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Returning 404 to user: Instance e0f78aa1-79f0-4fc4-afc7-19f14efbff03 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:25.143404 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e19fabfd-baf6-4b5c-92e8-c69198b8b360 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03" status: 404 len: 111 microversion: 2.1 time: 0.039255 Jul 19 20:32:25.144053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3139/6170] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:25 2022] GET /compute/v2.1/servers/e0f78aa1-79f0-4fc4-afc7-19f14efbff03 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:25.382478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:25.383167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] [instance: c542a147-1844-46a7-990e-8ddc922bb0fd] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:25.391990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.392459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.393249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.393696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.408836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] HTTP exception thrown: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Request method failure captured: Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd HTTP/1.1 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xR_k5MCM_JQ-7UvwSzKzytwivUa-uBLvtht4iTmPqnX-yTG_ueCjMzr9R2hEfr4y9dPNKP9ENBQ30IxM13h5BzcE1RT_i_UJrvbFQv4IEb6tPvsst-aq_qCwTeEfzETuB4V9sDh_zp9h2ZAZ8AaLt2_9NLxclLtDjZZMLB_NoazY8c Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 173e211434dc4e5da6fb0e7856a2676c Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_173e211434dc4e5da6fb0e7856a2676c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 173e211434dc4e5da6fb0e7856a2676c Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-708915348 Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestSecurityGroupsBasicOps-708915348-project Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 6c27ed3447824dd794da4c806cbe256b Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestSecurityGroupsBasicOps-708915348-project Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c542a147-1844-46a7-990e-8ddc922bb0fd'} Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:25.410395 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Returning 404 to user: Instance c542a147-1844-46a7-990e-8ddc922bb0fd could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8dddacca-3017-4329-b6aa-390ca29b086d tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd" status: 404 len: 111 microversion: 2.1 time: 0.033684 Jul 19 20:32:25.416820 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3032/6171] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:25 2022] GET /compute/v2.1/servers/c542a147-1844-46a7-990e-8ddc922bb0fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:27.754468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:27.755188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:27.763735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.764831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:27.768569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.769385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:27.804940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:32:27.942432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c75a42b-b14e-48be-a39e-cbb6ec0640b0 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 204 len: 0 microversion: 2.1 time: 0.194355 Jul 19 20:32:27.945102 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3140/6172] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:27 2022] DELETE /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:32:27.962238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:27.964847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:27.979784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.981224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:27.983031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.985397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:28.325612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:28.338165 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebf11686-bf6a-4844-88be-4989ec13f100 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1513 microversion: 2.1 time: 0.385554 Jul 19 20:32:28.356955 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3033/6173] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:27 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1513 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:29.366367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:29.367169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:29.374523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:29.374938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:29.375673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:29.376126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:29.738524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d28e5cee-00e3-45ad-9671-be7ef111d3b0 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] Calling method '.version_select at 0x7fb88de5faf0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:29.755019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:29.764670 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1d88858e-9111-4b80-86f4-ccac29106d76 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1513 microversion: 2.1 time: 0.402399 Jul 19 20:32:29.765492 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3141/6174] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:29 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:29.788226 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d28e5cee-00e3-45ad-9671-be7ef111d3b0 tempest-TestSecurityGroupsBasicOps-708915348 tempest-TestSecurityGroupsBasicOps-708915348-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-793379855" status: 202 len: 0 microversion: 2.1 time: 0.054931 Jul 19 20:32:29.792675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3034/6175] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-793379855 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:32:30.784438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:30.785046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:30.788111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:30.803251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:30.803891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:30.805022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:30.808266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:30.940128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5deb03c3edd4c199a7c5a1d969673e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17607df6e3542b69df933370901ba66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:30.950931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-737f1467-43af-4199-ba9e-7fa666652d94 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 200 len: 1471 microversion: 2.1 time: 0.171780 Jul 19 20:32:30.953305 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3142/6176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:30 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:31.038418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-daa3b4ea-ee08-4fa0-8903-eea3730a88d0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] Calling method '.version_select at 0x7fb88ca494c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:31.108016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-daa3b4ea-ee08-4fa0-8903-eea3730a88d0 tempest-TestVolumeBootPattern-877963720 tempest-TestVolumeBootPattern-877963720-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-405241929" status: 202 len: 0 microversion: 2.1 time: 0.078863 Jul 19 20:32:31.109484 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3143/6177] 10.222.0.33 () {58 vars in 1259 bytes} [Tue Jul 19 20:32:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-405241929 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:32:31.296476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0299139b-f2b3-453c-92af-2a3db24909ba req-17ecbf82-08c1-45a2-b454-352640f8719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4509422-ec49-40ac-a7c9-aa10566a70ed", "name": "network-vif-deleted", "tag": "ed69a66b-b57d-4f36-937a-d0e8f3f258d8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:31.306892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0299139b-f2b3-453c-92af-2a3db24909ba req-17ecbf82-08c1-45a2-b454-352640f8719f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:31.307442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0299139b-f2b3-453c-92af-2a3db24909ba req-17ecbf82-08c1-45a2-b454-352640f8719f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.318605 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0299139b-f2b3-453c-92af-2a3db24909ba req-17ecbf82-08c1-45a2-b454-352640f8719f service nova] Creating event network-vif-deleted:ed69a66b-b57d-4f36-937a-d0e8f3f258d8 for instance b4509422-ec49-40ac-a7c9-aa10566a70ed on n-h2-843861-3 Jul 19 20:32:31.334885 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0299139b-f2b3-453c-92af-2a3db24909ba req-17ecbf82-08c1-45a2-b454-352640f8719f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401428 Jul 19 20:32:31.336916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3035/6178] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:31.970082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:31.971277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] [instance: b4509422-ec49-40ac-a7c9-aa10566a70ed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:31.978046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:31.978490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.979453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:31.980080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.994844 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] HTTP exception thrown: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Request method failure captured: Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed HTTP/1.1 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xQfR3dE4cbqtQu03l-YZ_V1yL6y2L4mK7AppWZOhMkoFlcsMZtA5NP5LrgxlDua-m9zdhV7p1GDN-AIJ_0BUV4q5LkKtXBSUbToj8hkuVkak_B3AnbC3gcRYd1pSKTvjU3I_xp3raNtZgY7fTqh8I05FbNLzrmehwYZwup1aQXAO6k Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c17607df6e3542b69df933370901ba66 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17607df6e3542b69df933370901ba66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c17607df6e3542b69df933370901ba66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17607df6e3542b69df933370901ba66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c17607df6e3542b69df933370901ba66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c17607df6e3542b69df933370901ba66 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799733497 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-VolumesSnapshotTestJSON-1799733497-project Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: c5deb03c3edd4c199a7c5a1d969673e8 Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799733497-project Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'b4509422-ec49-40ac-a7c9-aa10566a70ed'} Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:31.996522 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] Returning 404 to user: Instance b4509422-ec49-40ac-a7c9-aa10566a70ed could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:32.002319 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b764bd2f-7f70-4c42-a0d5-0dae7d4cf4e4 tempest-VolumesSnapshotTestJSON-1799733497 tempest-VolumesSnapshotTestJSON-1799733497-project] 10.222.0.33 "GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed" status: 404 len: 111 microversion: 2.1 time: 0.032570 Jul 19 20:32:32.007244 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3144/6179] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:31 2022] GET /compute/v2.1/servers/b4509422-ec49-40ac-a7c9-aa10566a70ed => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:33:20.295253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:20.298889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:20.482880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-46c43381-a84e-4443-b540-aecf367f0f65 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: .version_select at 0x7fb88deb6af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-986841135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABGXKl7ERUJYlx9ZAQVBxmIQEJN/hF4jG0iJh46Cvtk3dZwCDr8JPvglRLG2vowS859NReDp6iHbEOEmx+KwWiT2bkksa627wC18+H7kYeHpJf1GA/mZMG1bbM1QboOVg=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:20.500359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-46c43381-a84e-4443-b540-aecf367f0f65 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:33:20.505703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-46c43381-a84e-4443-b540-aecf367f0f65 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:33:20.533544 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-46c43381-a84e-4443-b540-aecf367f0f65 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.242965 Jul 19 20:33:20.534199 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3036/6180] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:33:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:33:27.130644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-783612869", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "1f5b2bbb-6f91-408d-b1d5-0105e0affb45"}], "key_name": "tempest-TestNetworkAdvancedServerOps-986841135", "security_groups": [{"name": "tempest-secgroup-smoke-45590497"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:27.138561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:27.139176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:27.284985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] validate_networks() for [('1f5b2bbb-6f91-408d-b1d5-0105e0affb45', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:33:27.780296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:33:27.780648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:33:27.781152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:33:27.781716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:33:27.782222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:33:27.796117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:27.797022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:27.797161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:27.797586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:27.818923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:33:27.827269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:33:27.850521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:33:27.853072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:33:27.910821 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8128c82-bb80-4309-900f-c422fb16d855 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.784333 Jul 19 20:33:27.917705 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3145/6181] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:33:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:33:27.923676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee125203-37b6-463d-9a8c-0b36b29731ee tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:27.924750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee125203-37b6-463d-9a8c-0b36b29731ee tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:28.009932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee125203-37b6-463d-9a8c-0b36b29731ee tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:28.022911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee125203-37b6-463d-9a8c-0b36b29731ee tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1265 microversion: 2.1 time: 0.103563 Jul 19 20:33:28.024801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3037/6182] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:27 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:29.049014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:29.050513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:29.061957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:29.062776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:29.064144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:29.064757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:29.151641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:29.175744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a92ae48-21e0-4b83-ac3f-d6583943eab1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1317 microversion: 2.1 time: 0.133299 Jul 19 20:33:29.187972 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3146/6183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:29 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:30.196965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:30.197984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:30.211317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:30.212022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:30.218074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:30.218729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:30.496987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:30.508431 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e3577e72-2f09-4c66-bec2-6b544f446efb tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.317415 Jul 19 20:33:30.510568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3038/6184] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:30 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:31.259089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-af9d7a75-f38c-4736-a059-6a13dba9a310 req-9093c969-4fca-4662-b1c5-f8a7f4830bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:31.278909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-af9d7a75-f38c-4736-a059-6a13dba9a310 req-9093c969-4fca-4662-b1c5-f8a7f4830bcd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:31.279595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-af9d7a75-f38c-4736-a059-6a13dba9a310 req-9093c969-4fca-4662-b1c5-f8a7f4830bcd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:31.299190 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-af9d7a75-f38c-4736-a059-6a13dba9a310 req-9093c969-4fca-4662-b1c5-f8a7f4830bcd service nova] Creating event network-changed:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h2-843861-3 Jul 19 20:33:31.306713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-af9d7a75-f38c-4736-a059-6a13dba9a310 req-9093c969-4fca-4662-b1c5-f8a7f4830bcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051359 Jul 19 20:33:31.307936 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3147/6185] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:31.529424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:31.530742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:31.543262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:31.544175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:31.545819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:31.546760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:31.838553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:31.851225 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10f52a2e-4b08-4799-a97b-c0d482ede67a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.326951 Jul 19 20:33:31.852495 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3039/6186] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:31 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:32.871588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:32.872270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:32.878768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:32.879252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:32.880084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:32.880499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:33.021907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:33.040183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b56427d-15fa-45e0-a4b2-000cdb0b9f3c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.173541 Jul 19 20:33:33.041607 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3148/6187] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:32 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:34.061475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:34.062581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:34.070671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:34.071140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:34.071964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:34.072427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:34.624348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:34.633593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cf992bd-daf0-480a-9db4-496d540354dc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.576296 Jul 19 20:33:34.634823 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3040/6188] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:34 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:35.652012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:35.652626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:35.660589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:35.661080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:35.662030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:35.662470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:35.833558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:35.842554 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-516d5f07-bc73-4755-b17e-554dbf801bd6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.194553 Jul 19 20:33:35.843245 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3149/6189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:35 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:36.860921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:36.861542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:36.868589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:36.869093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:36.869872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:36.870312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:37.012514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:37.021059 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c43daea-8a50-4825-afc1-3f35b67a1b37 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.163804 Jul 19 20:33:37.021672 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3041/6190] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:36 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:38.038521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:38.039131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:38.042179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:38.042845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:38.049985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:38.050432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:38.051207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:38.051653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:38.195978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:38.204101 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11c1e834-9fd4-40e7-b389-06d94856ec14 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.169273 Jul 19 20:33:38.204930 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3150/6191] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:38 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:39.221900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:39.222732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:39.225460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:39.232100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:39.232624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:39.233546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:39.234064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:39.375608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:39.383950 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc58edd8-967c-4000-a0c9-966bd739deef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.165893 Jul 19 20:33:39.385158 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3042/6192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:39 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:39.590699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ba6bb777-3a8c-4c70-9778-d225ca2bfdc1 req-0d6b5f41-b48f-4e31-808c-06336e4e811e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "name": "network-vif-plugged", "status": "completed", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:39.599910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ba6bb777-3a8c-4c70-9778-d225ca2bfdc1 req-0d6b5f41-b48f-4e31-808c-06336e4e811e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:39.600521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ba6bb777-3a8c-4c70-9778-d225ca2bfdc1 req-0d6b5f41-b48f-4e31-808c-06336e4e811e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:39.617420 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ba6bb777-3a8c-4c70-9778-d225ca2bfdc1 req-0d6b5f41-b48f-4e31-808c-06336e4e811e service nova] Creating event network-vif-plugged:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h2-843861-3 Jul 19 20:33:39.623341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ba6bb777-3a8c-4c70-9778-d225ca2bfdc1 req-0d6b5f41-b48f-4e31-808c-06336e4e811e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121043 Jul 19 20:33:39.623993 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3151/6193] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:40.403340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:40.403994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:40.412040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:40.412503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:40.413604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:40.414115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:40.561439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:40.569433 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-27fc990d-5a3a-470a-abf0-b06ad2cd91e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1389 microversion: 2.1 time: 0.170520 Jul 19 20:33:40.570023 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3043/6194] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:40 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:41.587384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:41.588099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:41.595629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:41.596097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:41.596870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:41.597297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:41.736922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:41.745043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f6ea8e2-118f-4298-b907-47a63096c7aa tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1561 microversion: 2.1 time: 0.161866 Jul 19 20:33:41.745620 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3152/6195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:41 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:41.761885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:41.762515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:41.769991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:41.770722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:41.771505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:41.771989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:41.906791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:41.914427 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8dc8963e-552b-4b0d-b06b-07cfe423659a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1561 microversion: 2.1 time: 0.157073 Jul 19 20:33:41.915681 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3044/6196] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:41 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:43.648974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-84f7bbd0-b9e8-4aca-810b-768b765b856b req-3a4b30e6-d0f7-4a24-b104-d3fe8a8ff87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:43.658647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:43.659896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:43.660152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-84f7bbd0-b9e8-4aca-810b-768b765b856b req-3a4b30e6-d0f7-4a24-b104-d3fe8a8ff87b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:43.660876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-84f7bbd0-b9e8-4aca-810b-768b765b856b req-3a4b30e6-d0f7-4a24-b104-d3fe8a8ff87b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:43.667351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:43.668137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:43.668928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:43.669370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:43.681009 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-84f7bbd0-b9e8-4aca-810b-768b765b856b req-3a4b30e6-d0f7-4a24-b104-d3fe8a8ff87b service nova] Creating event network-changed:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h2-843861-3 Jul 19 20:33:43.687958 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-84f7bbd0-b9e8-4aca-810b-768b765b856b req-3a4b30e6-d0f7-4a24-b104-d3fe8a8ff87b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043949 Jul 19 20:33:43.689064 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3045/6197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:33:43.961804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:43.972266 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dda68d06-1deb-4d04-b4ce-8a3ad4522a63 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1561 microversion: 2.1 time: 0.330442 Jul 19 20:33:43.987440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3153/6198] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:43 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1561 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:52.975633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:52.976324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:52.978325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:52.984682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:52.985141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:52.986304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:52.986750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:52.990201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=45 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:53.015406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:33:53.098893 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f06ec8f9-f3b7-42ec-a8ea-4ae8095202ac tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 204 len: 0 microversion: 2.1 time: 0.128107 Jul 19 20:33:53.100332 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3046/6199] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:33:52 2022] DELETE /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:53.112176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:53.113116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:53.123300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:53.123998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:53.125173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:53.125888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:53.281870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:53.289568 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0a2f756-2149-4b4c-bdfe-d6fb03e80f36 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1731 microversion: 2.1 time: 0.183713 Jul 19 20:33:53.290158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3154/6200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:53 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:54.307957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:54.308671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:54.315657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.316157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.316934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.317379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.494331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:54.503026 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-beae4303-d87f-4eb6-ba87-5ed69286cea9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1731 microversion: 2.1 time: 0.199519 Jul 19 20:33:54.503620 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3047/6201] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:54 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:55.426295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-79da1c44-061a-4f2f-bcba-07211b1d9999 req-4475ef6c-08c2-4217-8270-8255351732d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8", "name": "network-vif-deleted", "tag": "936f5c9a-a78b-4ef9-8f52-b796a74fb268"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:55.444449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-79da1c44-061a-4f2f-bcba-07211b1d9999 req-4475ef6c-08c2-4217-8270-8255351732d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.445224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-79da1c44-061a-4f2f-bcba-07211b1d9999 req-4475ef6c-08c2-4217-8270-8255351732d3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.464015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-79da1c44-061a-4f2f-bcba-07211b1d9999 req-4475ef6c-08c2-4217-8270-8255351732d3 service nova] Creating event network-vif-deleted:936f5c9a-a78b-4ef9-8f52-b796a74fb268 for instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 on n-h1-843861-3 Jul 19 20:33:55.470877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-79da1c44-061a-4f2f-bcba-07211b1d9999 req-4475ef6c-08c2-4217-8270-8255351732d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Jul 19 20:33:55.472756 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3155/6202] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:55.712789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:55.713429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:55.719700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.720346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.721299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.721768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.756605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.757243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.758401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lazy-loading 'fault' on Instance uuid bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:33:56.105483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe004dd50462446db546bc49e9a4230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98281089717642988e019eff386eb797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:56.115871 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-96d48dd7-a4ec-4369-99c8-57d6e900501e tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 200 len: 1388 microversion: 2.1 time: 0.597253 Jul 19 20:33:56.116903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3048/6203] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:55 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 1388 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:57.137240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:57.137945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:57.145419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.145861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.146629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.147062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.160569 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] HTTP exception thrown: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Request method failure captured: Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 HTTP/1.1 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xP9khPMc-mbNrnoi8GVKvVPEoLuKJex9taZcB34KnhBZP9132AtDDaJCdRQ_0NHUMcunKpfsvIzK-zU6J5kwPtrNIwk6a2R62B0m94yc7xWv9gb9LIPXq3v7S_CE4DjGRv1Fevzg5LudPtVfs__2eKAsELUxSnV_y6W4uuApXeGHwY Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98281089717642988e019eff386eb797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98281089717642988e019eff386eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fe004dd50462446db546bc49e9a4230d Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8'} Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.162199 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Returning 404 to user: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-988ea5ad-4963-460d-b8b2-b4f29f551fc9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 404 len: 111 microversion: 2.1 time: 0.032302 Jul 19 20:33:57.167307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3156/6204] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:57 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:33:57.641389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:57.642053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:57.649420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.649814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.650598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.651050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.666321 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] HTTP exception thrown: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Request method failure captured: Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 HTTP/1.1 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xP9khPMc-mbNrnoi8GVKvVPEoLuKJex9taZcB34KnhBZP9132AtDDaJCdRQ_0NHUMcunKpfsvIzK-zU6J5kwPtrNIwk6a2R62B0m94yc7xWv9gb9LIPXq3v7S_CE4DjGRv1Fevzg5LudPtVfs__2eKAsELUxSnV_y6W4uuApXeGHwY Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98281089717642988e019eff386eb797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98281089717642988e019eff386eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: fe004dd50462446db546bc49e9a4230d Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8'} Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:33:57.668090 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Returning 404 to user: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4e2c223-35c4-4b65-804a-961a511d6db1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 404 len: 111 microversion: 2.1 time: 0.032264 Jul 19 20:33:57.673451 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3049/6205] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:33:57 2022] DELETE /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:33:57.680207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:57.680822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] [instance: bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:57.682789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.688351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.688830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.689594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:57.690022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:57.694798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=53 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.706657 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] HTTP exception thrown: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Request method failure captured: Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 HTTP/1.1 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xP9khPMc-mbNrnoi8GVKvVPEoLuKJex9taZcB34KnhBZP9132AtDDaJCdRQ_0NHUMcunKpfsvIzK-zU6J5kwPtrNIwk6a2R62B0m94yc7xWv9gb9LIPXq3v7S_CE4DjGRv1Fevzg5LudPtVfs__2eKAsELUxSnV_y6W4uuApXeGHwY Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98281089717642988e019eff386eb797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98281089717642988e019eff386eb797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98281089717642988e019eff386eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 98281089717642988e019eff386eb797 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestServerBasicOps-1871660676 Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: fe004dd50462446db546bc49e9a4230d Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestServerBasicOps-1871660676-project Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8'} Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:33:57.708359 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Returning 404 to user: Instance bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c99bc52-d445-4704-815a-5b1ad539dde1 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8" status: 404 len: 111 microversion: 2.1 time: 0.033988 Jul 19 20:33:57.717221 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3157/6206] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:57 2022] GET /compute/v2.1/servers/bedbf8a6-9aa6-43f4-bf93-c0cc6484f0c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:33:57.887037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14cae13c-f195-4a1a-9893-fd1b85f256b9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] Calling method '.version_select at 0x7fb88dad5040>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:57.915315 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14cae13c-f195-4a1a-9893-fd1b85f256b9 tempest-TestServerBasicOps-1871660676 tempest-TestServerBasicOps-1871660676-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959891076" status: 202 len: 0 microversion: 2.1 time: 0.037638 Jul 19 20:33:57.916025 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3050/6207] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 19 20:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959891076 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:34:17.338006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:17.339101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:17.342282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:17.343031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:17.353696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:17.354148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:17.354946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:17.355380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:17.417051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-122e3b54-43f0-49fd-971d-85bbb1359bca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action" status: 200 len: 24572 microversion: 2.1 time: 0.084029 Jul 19 20:34:17.417703 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3158/6208] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:34:17 2022] POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action => generated 24572 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:34:56.178967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.179739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.184054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:56.184683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:56.194608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.195079 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.195891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.196348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.452323 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0d0fa5c-a623-4fc9-a396-f93336c123e4 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1831 microversion: 2.1 time: 0.275472 Jul 19 20:34:56.458854 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3051/6209] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:56 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1831 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:56.470869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:56.471579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:56.474436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.475139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.482376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.482842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.483636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.484097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.627903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:56.636029 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-13e2f855-dc38-4e23-9016-4ee334655555 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1680 microversion: 2.1 time: 0.170017 Jul 19 20:34:56.637254 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3159/6210] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:56 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:56.736532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:56.737699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:56.744256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.744732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.745520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.745981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.811631 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c3ee816-27d6-497c-8455-32dad317e386 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action" status: 200 len: 32647 microversion: 2.1 time: 0.078868 Jul 19 20:34:56.812340 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3052/6211] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:34:56 2022] POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action => generated 32647 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:34:56.964917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:56.965417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:56.976521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.976983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.977767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:56.978208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.087420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '345bd02c36df479ba7961200a9fe116f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931927cbf871451c976ad8f59d56a1f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:57.088390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] flavor_id is None. Assuming migration. {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 20:34:57.088632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:34:57.332188 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2ade317-db6c-4df7-b06d-c6a7b1ca2e64 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action" status: 202 len: 0 microversion: 2.1 time: 0.370890 Jul 19 20:34:57.332814 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3160/6212] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:34:56 2022] POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:34:57.341648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:57.342381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:57.349767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.350073 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.350861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.351309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.545605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:57.560085 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4f350f89-b0eb-4896-a6cc-f6ee032ee14c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1689 microversion: 2.1 time: 0.222191 Jul 19 20:34:57.561132 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3053/6213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:57 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:58.579666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:58.580438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:58.588332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:58.588796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:58.589581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:58.590044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:58.745153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:58.755792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01bec127-6ecd-4e39-bdfe-317b9126cf3f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1689 microversion: 2.1 time: 0.179384 Jul 19 20:34:58.756593 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3161/6214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:58 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:59.773826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:59.774479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:59.782287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:59.782861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:59.783858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:59.784443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:59.928623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:59.936281 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a36c891-131a-4ea8-ad63-4820886a5948 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.166461 Jul 19 20:34:59.937109 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3054/6215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:59 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:00.954284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:00.954934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:00.962490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:00.962943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:00.963801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:00.964267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:01.102570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:01.110398 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-083cc7f6-9f1c-419e-a677-8d8ba81dcc16 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.160011 Jul 19 20:35:01.110974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3162/6216] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:00 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:02.128399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:02.129018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:02.137214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:02.137753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:02.138811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:02.139442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:02.279730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:02.288113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3088ce3-10c3-4792-bc2a-1d6108e44a9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.163897 Jul 19 20:35:02.288701 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3055/6217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:02 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:03.306106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:03.306753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:03.313936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:03.314393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:03.315170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:03.315611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:03.457051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:03.465724 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c6e4b37-b3bc-4b4c-9fda-d3051ea67e52 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.164243 Jul 19 20:35:03.466390 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3163/6218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:03 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:04.484544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:04.485104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:04.492732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.493207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.494033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.494488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.632124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:04.639975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb6d3a22-2cae-427d-831d-729b198da125 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.159750 Jul 19 20:35:04.640568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3056/6219] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:04 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:05.657617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:05.658220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:05.666074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:05.666535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:05.667309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:05.667752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:05.804921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:05.812652 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60eab0be-434a-4efa-8f28-859b6e097813 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.158971 Jul 19 20:35:05.813221 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3164/6220] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:05 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:06.829988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:06.830595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:06.838253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:06.838253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:06.838933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:06.839374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:06.978774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:06.986738 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-282149a7-7c18-4338-9002-b036d940964a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.160612 Jul 19 20:35:06.987344 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3057/6221] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:06 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:08.005305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:08.005910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:08.014312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:08.014756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:08.015522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:08.015993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:08.158209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:08.168798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b43ee5f5-739e-4381-a1f0-4e5e7dc8ad39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.167364 Jul 19 20:35:08.169398 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3165/6222] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:08 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:09.185940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:09.188114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:09.194260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:09.194728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:09.195515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:09.196078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:09.331868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:09.340001 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b77bed2-9ad3-4d19-b9a5-ffb8e5ef16cc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.158047 Jul 19 20:35:09.340584 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3058/6223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:09 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:10.359094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:10.359715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:10.366926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:10.367377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:10.368191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:10.368645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:10.512150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:10.520726 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-955ca617-a8fc-4bce-9e71-7db6d48db330 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.164918 Jul 19 20:35:10.521314 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3166/6224] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:10 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:11.537546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:11.538136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:11.545369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:11.546354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:11.546624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:11.547075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:11.685133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:11.695709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-21204aa2-adbc-4bca-9b07-f06e670c526e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1694 microversion: 2.1 time: 0.160387 Jul 19 20:35:11.695709 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3059/6225] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:11 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:12.388949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "name": "network-vif-unplugged", "status": "completed", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:12.399308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:12.399822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:12.415528 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] Creating event network-vif-unplugged:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h1-843861-3 Jul 19 20:35:12.422072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:35:12.433640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c3d5fa0b-b187-42fb-a45a-560a45a102e2 req-09e24386-05db-4369-b0d7-b0dc31c7b356 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048286 Jul 19 20:35:12.434581 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3167/6226] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:12.712407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:12.713337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:12.720550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:12.721142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:12.722044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:12.722606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:12.961968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:12.977716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bab1823-b40c-49bf-98f7-d1cbfd541439 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1693 microversion: 2.1 time: 0.269672 Jul 19 20:35:12.997120 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3060/6227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:12 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1693 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:14.008108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:14.008840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:14.015192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:14.015612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:14.016685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:14.017119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:14.152078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:14.159943 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e5a4fcd3-0449-4215-8ee4-dba9499b189c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1691 microversion: 2.1 time: 0.157012 Jul 19 20:35:14.161091 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3168/6228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:14 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:14.449628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:14.459153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:14.459602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:14.470940 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] Creating event network-changed:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h1-843861-3 Jul 19 20:35:14.476266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:35:14.487235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-744b20c3-ee8b-41ab-a025-6e0a7d92bbfe req-5b1a7da9-4eb1-4f63-a0b0-1ee509395d87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041253 Jul 19 20:35:14.487870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3061/6229] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:15.178044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:15.178649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:15.185920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.186367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:15.187142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.187569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:15.598457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:15.606099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4ea4c69-fcae-4993-ab21-744aa3bb38d5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1688 microversion: 2.1 time: 0.432070 Jul 19 20:35:15.606687 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3169/6230] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:15 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1688 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:15.624492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:15.625799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:15.632662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.633127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:15.634024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.634474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:15.696777 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3947f183-a613-416f-a249-a66e74114f51 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action" status: 204 len: 0 microversion: 2.1 time: 0.077245 Jul 19 20:35:15.697426 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3062/6231] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:35:15 2022] POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:35:15.705623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:15.706244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:15.713429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.713889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:15.714875 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:15.715205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:16.057443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:16.066150 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e893b30-db30-4290-99c6-06444b39d80e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1688 microversion: 2.1 time: 0.364381 Jul 19 20:35:16.066795 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3170/6232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:15 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1688 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:17.085398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:17.086164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:17.093241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:17.093767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:17.095055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:17.095750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:17.242411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:17.250370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5373bc1c-eb79-404c-841f-39030b77202e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1688 microversion: 2.1 time: 0.170187 Jul 19 20:35:17.250952 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3063/6233] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:17 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:18.268741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:18.269353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:18.277128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:18.277577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:18.278338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:18.278774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:18.414484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:18.422099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4216c55b-5752-45dd-b7d0-af35db460757 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1680 microversion: 2.1 time: 0.157524 Jul 19 20:35:18.422676 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3171/6234] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:18 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:19.058974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3230fd3c-c0ea-4b44-bee5-9a33ad5728c4 req-a2bd090c-eb4d-404e-8475-1fab5568ca7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "name": "network-vif-plugged", "status": "completed", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:19.070704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3230fd3c-c0ea-4b44-bee5-9a33ad5728c4 req-a2bd090c-eb4d-404e-8475-1fab5568ca7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:19.071179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3230fd3c-c0ea-4b44-bee5-9a33ad5728c4 req-a2bd090c-eb4d-404e-8475-1fab5568ca7e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:19.084820 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3230fd3c-c0ea-4b44-bee5-9a33ad5728c4 req-a2bd090c-eb4d-404e-8475-1fab5568ca7e service nova] Creating event network-vif-plugged:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h1-843861-3 Jul 19 20:35:19.091569 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3230fd3c-c0ea-4b44-bee5-9a33ad5728c4 req-a2bd090c-eb4d-404e-8475-1fab5568ca7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036870 Jul 19 20:35:19.092914 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3064/6235] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:38.425723 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:35:38.426322 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:35:40.608027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:40.609256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:40.611488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=28 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:40.612248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:40.618715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:40.619223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:40.620082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:40.620532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:40.683581 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a01b2cb6-f4fe-44d3-bd63-4d370a9cff33 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action" status: 200 len: 24567 microversion: 2.1 time: 0.078709 Jul 19 20:35:40.684745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3172/6236] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:35:40 2022] POST /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4/action => generated 24567 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:46.905325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=28 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.906082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.911413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:46.912155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:46.920508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:46.920963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:46.921736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:46.922181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:47.058202 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3cbdffe-716b-4750-81e4-b4206c2ba6d8 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1831 microversion: 2.1 time: 0.155147 Jul 19 20:35:47.058776 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3065/6237] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:46 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1831 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:48.195536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:48.196433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:48.204537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:48.205351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:48.206160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:48.206598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:48.240659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:35:48.274936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-54f0b6e9-4ed2-4eb5-b757-f202f4bd826c req-a568fe2c-46bd-40af-835d-4f54376db01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:48.286739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-54f0b6e9-4ed2-4eb5-b757-f202f4bd826c req-a568fe2c-46bd-40af-835d-4f54376db01f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:48.287184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-54f0b6e9-4ed2-4eb5-b757-f202f4bd826c req-a568fe2c-46bd-40af-835d-4f54376db01f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:48.303199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-54f0b6e9-4ed2-4eb5-b757-f202f4bd826c req-a568fe2c-46bd-40af-835d-4f54376db01f service nova] Creating event network-changed:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h1-843861-3 Jul 19 20:35:48.308834 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-54f0b6e9-4ed2-4eb5-b757-f202f4bd826c req-a568fe2c-46bd-40af-835d-4f54376db01f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116703 Jul 19 20:35:48.310745 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3066/6238] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:48.327985 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9580250-afc8-4ff6-ad63-ceca08bfe7cf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 204 len: 0 microversion: 2.1 time: 0.136832 Jul 19 20:35:48.328673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3173/6239] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:35:48 2022] DELETE /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:35:48.339762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:48.340515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:48.347731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:48.348243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:48.349036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:48.349490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:48.496525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:48.504428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4186b791-a92e-437b-b362-bbd85ab296a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1686 microversion: 2.1 time: 0.169842 Jul 19 20:35:48.505019 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3067/6240] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:48 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:49.523407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:49.524041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:49.534003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:49.534920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:49.535785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:49.536283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:49.792197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:49.801487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2463874-0acd-4da0-a9f8-8a3c6f927004 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 200 len: 1686 microversion: 2.1 time: 0.282345 Jul 19 20:35:49.802446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3174/6241] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:49 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 1686 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:50.324010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ef58fecc-b36c-43fe-9440-b06844989fcc req-750f1cb3-26c5-45dd-9e87-c18ac44039fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ffeb2-eaf0-4c06-aace-47da51f369b4", "name": "network-vif-deleted", "tag": "5dc42290-7744-493f-9fbd-6f4bbda29594"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:50.333305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef58fecc-b36c-43fe-9440-b06844989fcc req-750f1cb3-26c5-45dd-9e87-c18ac44039fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:50.333763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ef58fecc-b36c-43fe-9440-b06844989fcc req-750f1cb3-26c5-45dd-9e87-c18ac44039fb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:50.345777 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ef58fecc-b36c-43fe-9440-b06844989fcc req-750f1cb3-26c5-45dd-9e87-c18ac44039fb service nova] Creating event network-vif-deleted:5dc42290-7744-493f-9fbd-6f4bbda29594 for instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 on n-h1-843861-3 Jul 19 20:35:50.350717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ef58fecc-b36c-43fe-9440-b06844989fcc req-750f1cb3-26c5-45dd-9e87-c18ac44039fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Jul 19 20:35:50.351330 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3068/6242] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:35:50.818610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:50.819212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: 349ffeb2-eaf0-4c06-aace-47da51f369b4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:50.826916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:50.827362 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:50.828161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:50.828596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:50.843842 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] HTTP exception thrown: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Request method failure captured: Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 HTTP/1.1 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xUPF9VugDOMICMbcpWUi6fR5ao9pGWs64EPPb2vhvKmy4os-JsL3llUrAe8COE7cO7QsXvoW0Mxn1KqaQ1izC1xFqGqI-q_wLiq3uo0VWOJ5FHzeJG2_Nirdri6KxwdL-57TY9hUM3ltWAugk2EaXudEwS0Sdqzu8s18AUWHS_30cY Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 88a98608e91c4399a6c5bbccf00a7165 Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '349ffeb2-eaf0-4c06-aace-47da51f369b4'} Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:35:50.846301 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Returning 404 to user: Instance 349ffeb2-eaf0-4c06-aace-47da51f369b4 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2558afa2-7c9d-418d-ba10-57d83ed9b2ad tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4" status: 404 len: 111 microversion: 2.1 time: 0.032995 Jul 19 20:35:50.851482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3175/6243] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:50 2022] GET /compute/v2.1/servers/349ffeb2-eaf0-4c06-aace-47da51f369b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:35:54.358724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12eb4883-bfa3-450e-874d-a54bb8641f39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '.version_select at 0x7fb8930f6d30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:54.381783 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12eb4883-bfa3-450e-874d-a54bb8641f39 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-986841135" status: 202 len: 0 microversion: 2.1 time: 0.028246 Jul 19 20:35:54.382701 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3069/6244] 10.222.0.33 () {58 vars in 1280 bytes} [Tue Jul 19 20:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-986841135 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:35:54.415133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25480e8f-db3e-407d-a651-2e3aa42a5a97 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: .version_select at 0x7fb88d152b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-620925188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTD5rsC6kzS66e+o9pua/fQ2Zr5MGwcjp18p/Sv7M1yqYqIlD1hTdWl0AalBJa4Wzuoiy1PnWVYsCMxNBy8L4a6uehsUG9ZHu1eBV00I5WK6UioF3pC3krxHCDPhLZKjw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:54.430101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-25480e8f-db3e-407d-a651-2e3aa42a5a97 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:35:54.436146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-25480e8f-db3e-407d-a651-2e3aa42a5a97 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:35:54.464963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25480e8f-db3e-407d-a651-2e3aa42a5a97 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053853 Jul 19 20:35:54.465561 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3176/6245] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:35:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:00.448868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-436569358", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "c5e1a48c-9a07-40fc-a32a-9a754d8cbef1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-620925188", "security_groups": [{"name": "tempest-secgroup-smoke-448182874"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:00.460504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:00.578702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] validate_networks() for [('c5e1a48c-9a07-40fc-a32a-9a754d8cbef1', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:36:01.165451 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:36:01.165898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:36:01.166424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:36:01.166859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:36:01.167300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:36:01.178186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:01.178657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:01.179491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:01.180015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:01.198543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:36:01.204290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:36:01.220030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:36:01.223148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:36:01.280979 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7954ff17-cc52-46e4-953e-a0a0b6542566 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.836616 Jul 19 20:36:01.282328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3070/6246] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:36:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:36:01.290341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:01.294340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-339a508a-3c78-412f-8f31-1cce2098d78a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:01.294961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-339a508a-3c78-412f-8f31-1cce2098d78a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:01.356833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-339a508a-3c78-412f-8f31-1cce2098d78a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:01.364066 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-339a508a-3c78-412f-8f31-1cce2098d78a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1265 microversion: 2.1 time: 0.075611 Jul 19 20:36:01.364752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3177/6247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:01 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:02.385820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a6f7503-dbda-4cee-a054-dc8d3bb2f3b1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:02.386462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a6f7503-dbda-4cee-a054-dc8d3bb2f3b1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:02.447918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a6f7503-dbda-4cee-a054-dc8d3bb2f3b1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:02.456743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a6f7503-dbda-4cee-a054-dc8d3bb2f3b1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1265 microversion: 2.1 time: 0.079182 Jul 19 20:36:02.457343 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3071/6248] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:02 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:03.475486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:03.476209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:03.485972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:03.486422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:03.487189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:03.487636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:03.548664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:03.556300 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bca38321-1ed9-42a9-bcff-f86e794994dd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1269 microversion: 2.1 time: 0.084823 Jul 19 20:36:03.556892 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3178/6249] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:03 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:04.573782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:04.574405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:04.581561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:04.582026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:04.582805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:04.583255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:04.651439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:04.662351 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca873a16-ee99-4677-a167-45e2d53a89ef tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1323 microversion: 2.1 time: 0.092176 Jul 19 20:36:04.663223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3072/6250] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:04 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1323 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:05.686687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:05.687286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:05.698897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:05.699348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:05.700166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:05.700599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:05.852645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:05.862818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c91a67b-a17c-4040-9749-7884e1e80f23 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.186404 Jul 19 20:36:05.863503 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3179/6251] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:05 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:06.167785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-75147f08-d5df-42bd-80da-f40994b0b338 req-a5143bd4-bdcd-4602-8268-69a4c24ea47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:06.181534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75147f08-d5df-42bd-80da-f40994b0b338 req-a5143bd4-bdcd-4602-8268-69a4c24ea47f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:06.182095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75147f08-d5df-42bd-80da-f40994b0b338 req-a5143bd4-bdcd-4602-8268-69a4c24ea47f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:06.203492 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-75147f08-d5df-42bd-80da-f40994b0b338 req-a5143bd4-bdcd-4602-8268-69a4c24ea47f service nova] Creating event network-changed:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:36:06.209701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-75147f08-d5df-42bd-80da-f40994b0b338 req-a5143bd4-bdcd-4602-8268-69a4c24ea47f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046064 Jul 19 20:36:06.210574 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3073/6252] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:06.880163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:06.880769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:06.887696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:06.888172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:06.889201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:06.889630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.026678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:07.034812 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f69008d-a06c-4895-b481-041019533d98 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.158515 Jul 19 20:36:07.035386 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3180/6253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:06 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:08.054155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:08.054867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:08.061847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:08.062308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:08.063081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:08.063587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:08.197502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:08.206110 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-edb32373-1593-4f30-83de-d6bcdd0206ac tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.156241 Jul 19 20:36:08.206740 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3074/6254] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:08 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:09.226174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:09.226565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:09.233720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:09.234176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:09.234941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:09.235370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:09.393429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:09.401024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23f9ca46-0394-41df-aafd-b919967a2f88 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.179149 Jul 19 20:36:09.401627 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3181/6255] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:09 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:10.418868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:10.419500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:10.427159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:10.427626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:10.428432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:10.428881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:10.564114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:10.571721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4eb28887-2641-4622-814e-12bc42715bfd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.156792 Jul 19 20:36:10.572343 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3075/6256] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:10 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:11.301049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-79b9b150-361a-40ad-bcfe-6c5ebb570185 req-906d9f20-a550-47ee-ac93-9f1fa14a04ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-plugged", "status": "completed", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:11.305717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:11.311847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-79b9b150-361a-40ad-bcfe-6c5ebb570185 req-906d9f20-a550-47ee-ac93-9f1fa14a04ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.312305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-79b9b150-361a-40ad-bcfe-6c5ebb570185 req-906d9f20-a550-47ee-ac93-9f1fa14a04ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.333857 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-79b9b150-361a-40ad-bcfe-6c5ebb570185 req-906d9f20-a550-47ee-ac93-9f1fa14a04ad service nova] Creating event network-vif-plugged:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:36:11.342559 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-79b9b150-361a-40ad-bcfe-6c5ebb570185 req-906d9f20-a550-47ee-ac93-9f1fa14a04ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045148 Jul 19 20:36:11.343295 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3182/6257] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:11.589003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:11.589619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:11.591612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:11.599312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.599552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.600377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.600829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.739982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:11.749390 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-86bf92b9-ec92-4839-9a39-7b7496579f2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1390 microversion: 2.1 time: 0.164306 Jul 19 20:36:11.749989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3076/6258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:11 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:12.764364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:12.770739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:12.771476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:12.779449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.779889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:12.780668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.781100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:12.919349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:12.929363 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-630a1f73-dfa0-448f-aa37-68aac6dc02d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1562 microversion: 2.1 time: 0.166164 Jul 19 20:36:12.930267 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3183/6259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:12 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:12.946984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:12.947612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:12.949547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:12.956177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.956642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:12.957437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.957959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:13.096131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:13.103658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ccb19b51-6f17-4eb9-9e2e-ceb14034815c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1562 microversion: 2.1 time: 0.160629 Jul 19 20:36:13.104272 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3077/6260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:12 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:14.805410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-65f614bc-7514-48be-974f-391b1ee7ecb3 req-4dc5998b-13bf-4578-80de-e3f9641f3d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:14.810700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:14.811312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:14.817953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:14.821487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:14.822273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:14.822709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:14.831161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-65f614bc-7514-48be-974f-391b1ee7ecb3 req-4dc5998b-13bf-4578-80de-e3f9641f3d37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:14.831615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-65f614bc-7514-48be-974f-391b1ee7ecb3 req-4dc5998b-13bf-4578-80de-e3f9641f3d37 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:14.843660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-65f614bc-7514-48be-974f-391b1ee7ecb3 req-4dc5998b-13bf-4578-80de-e3f9641f3d37 service nova] Creating event network-changed:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:36:14.850102 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-65f614bc-7514-48be-974f-391b1ee7ecb3 req-4dc5998b-13bf-4578-80de-e3f9641f3d37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048284 Jul 19 20:36:14.851244 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3078/6261] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:14.981169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:14.989623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-62399a0e-be7b-410a-9b75-381d01ac145c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1562 microversion: 2.1 time: 0.191349 Jul 19 20:36:14.991849 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3184/6262] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:14 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:40.257562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:40.258582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:40.260823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:40.261573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:40.269605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:40.270067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:40.270846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:40.271292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:40.325219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-36cc3ec9-ac9f-4c62-b22e-717d72726708 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action" status: 200 len: 24569 microversion: 2.1 time: 0.072162 Jul 19 20:36:40.326264 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3079/6263] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:40 2022] POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action => generated 24569 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:51.403886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:51.404484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:51.406552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:51.407388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:51.413439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.413897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.414678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.415116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.821143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2104cc0-0342-4a9a-9d9d-1bace6d42bde tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1832 microversion: 2.1 time: 0.421347 Jul 19 20:36:51.821717 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3185/6264] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:51 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1832 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:51.838463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:51.839193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:51.842218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:51.843015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:51.850799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.851274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.852612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.852612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.990832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:51.998476 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f4a4afed-cb64-4922-80eb-0864c0a785e5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1681 microversion: 2.1 time: 0.164543 Jul 19 20:36:51.999059 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3080/6265] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:51 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:52.091678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:52.092646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:52.099409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.099899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.100673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.101113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.150316 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f470908e-8d6f-41c2-96bc-9e567365e503 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action" status: 200 len: 32645 microversion: 2.1 time: 0.062549 Jul 19 20:36:52.150939 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3186/6266] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:52 2022] POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:52.263969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:52.264489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:52.271840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.272319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.273108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.273564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.312989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '345bd02c36df479ba7961200a9fe116f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931927cbf871451c976ad8f59d56a1f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:52.313639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] flavor_id is None. Assuming migration. {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 20:36:52.314605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:36:52.591552 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed3aeebe-c2d1-41e7-9447-1e7f6b7dbef7 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action" status: 202 len: 0 microversion: 2.1 time: 0.331546 Jul 19 20:36:52.592399 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3081/6267] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:52 2022] POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:36:52.601277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:52.601990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:52.609421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.609877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.610703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.611149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.776423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:52.784204 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-988094fa-2c7c-409c-956f-692182d6fc3b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1690 microversion: 2.1 time: 0.187180 Jul 19 20:36:52.784716 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3187/6268] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:52 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:53.803731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:53.804428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:53.811988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.812281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:53.813058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.813519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:53.965965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:53.974538 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8a06bf69-c4b2-4de6-9d45-16b4d1c07ce6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1690 microversion: 2.1 time: 0.176429 Jul 19 20:36:53.975544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3082/6269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:53 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:54.992750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:54.993325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:55.000939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:55.001980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:55.002780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:55.003213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:55.144583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:55.152392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3679efb8-d75f-4f97-bcbf-b8e09f49255b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.163413 Jul 19 20:36:55.152719 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3188/6270] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:54 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:56.171143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:56.171724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:56.179567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.180080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.180903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.181350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.331531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:56.339270 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f0d16b4-ef4b-4b2b-b227-a7f83fa28111 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.172725 Jul 19 20:36:56.339864 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3083/6271] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:56 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:57.356105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:57.356705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:57.363696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:57.364352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:57.365137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:57.365657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:57.510838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:57.520277 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c66771c6-e43a-4a81-b862-c3e3f252dd5d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.168143 Jul 19 20:36:57.520840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3189/6272] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:57 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:58.538191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:58.538839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:58.546115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:58.546589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:58.547375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:58.548425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:58.696084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:58.703883 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba517fef-f0f3-4e1d-be40-0e5f949fb2cd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.169711 Jul 19 20:36:58.704992 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3084/6273] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:58 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:59.721526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:59.722140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:59.729201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.729654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.730431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.730873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.875797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:59.883609 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e46195e0-bf11-422e-9f97-ad4a283d60ff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.165943 Jul 19 20:36:59.884225 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3190/6274] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:59 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:00.903758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:00.904645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:00.913704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:00.914175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:00.914970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:00.915426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:01.061013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:01.069561 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cec2e96f-80e3-40a7-9f06-cc9e24e170d8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.171621 Jul 19 20:37:01.070162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3085/6275] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:00 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:02.087268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:02.088021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:02.095305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:02.095757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:02.096564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:02.096998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:02.232317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:02.240141 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b124611-3fd6-476d-917d-6e7b9ff107f4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.156849 Jul 19 20:37:02.240716 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3191/6276] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:02 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:03.258175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:03.258778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:03.266910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:03.267369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:03.268270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:03.268718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:03.415017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:03.423103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03e1f223-91a6-4d24-b75d-85487d24873d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.168342 Jul 19 20:37:03.423681 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3086/6277] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:03 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:37:04.440649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:04.441463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:04.448937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:04.449385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:04.450162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:04.450598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:04.586129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:04.593784 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3637762d-cc8a-488c-99cc-47df8393c77d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.157167 Jul 19 20:37:04.594879 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3192/6278] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:04 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:05.612856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:05.613469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:05.620702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:05.621195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:05.621988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:05.622437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:05.768861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:05.776698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc5e7c5a-a515-4eab-8304-92516d12142e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.168499 Jul 19 20:37:05.777295 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3087/6279] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:05 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:06.794832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:06.795455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:06.803259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:06.803703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:06.804505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:06.804941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:06.946784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:06.954484 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a17925a-e3a9-452f-83dd-298e17850f76 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.163805 Jul 19 20:37:06.955068 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3193/6280] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:06 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:07.972549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:07.973110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:07.979986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:07.980452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:07.981239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:07.981691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:08.123067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:08.131467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7bc7724f-9105-46b4-a833-ac275317e2c6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.163589 Jul 19 20:37:08.132094 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3088/6281] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:07 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:09.150653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:09.151394 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:09.158920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:09.159510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:09.160308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:09.160749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:09.309996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:09.318746 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-67c46ed2-ea81-4a6a-ab61-eaaa811be4c0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.171913 Jul 19 20:37:09.319354 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3194/6282] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:09 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:10.336146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:10.336777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:10.344969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.345598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.346779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.347239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.491688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:10.500195 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ecaa0287-5eb6-43f6-af15-b0e68d6849e8 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.167974 Jul 19 20:37:10.500782 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3089/6283] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:10 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:11.518555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:11.519118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:11.526333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:11.526785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:11.527556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:11.528023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:11.671508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:11.680020 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b938cefb-927d-4137-8570-cbdceaf71698 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1695 microversion: 2.1 time: 0.165497 Jul 19 20:37:11.684473 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3195/6284] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:11 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:12.432562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-unplugged", "status": "completed", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:12.442548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:12.443345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:12.458914 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] Creating event network-vif-unplugged:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h2-843861-3 Jul 19 20:37:12.466772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:37:12.482577 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-398f7417-e3ed-4556-84ff-3846e2029085 req-b93af7bb-ed00-4754-9ebe-0a5deef95b0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053920 Jul 19 20:37:12.483580 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3090/6285] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:12.715624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:12.717264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:12.726299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:12.727335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:12.728656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:12.729368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:13.232660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:13.241132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-789b555f-65ac-4042-aa53-5ddda144c22a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1694 microversion: 2.1 time: 0.542526 Jul 19 20:37:13.252676 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3196/6286] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:12 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1694 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:14.262439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:14.263142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:14.270481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:14.270945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:14.271742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:14.272222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:14.417822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:14.426154 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0be16cf5-37bb-472e-89d6-546a96bf183c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1692 microversion: 2.1 time: 0.169440 Jul 19 20:37:14.426754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3091/6287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:14 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:14.503399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:14.512926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:14.513377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:14.525787 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] Creating event network-changed:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h2-843861-3 Jul 19 20:37:14.531595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:37:14.542462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5970f7cc-2eab-43df-b290-1b3aacec8e9f req-7a86497e-ab3f-45bc-b7eb-26ac5ee529e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043389 Jul 19 20:37:14.543089 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3197/6288] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:15.444220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:15.444881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:15.452341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:15.452803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:15.454251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:15.454828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:15.615573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:15.629542 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a7d7828-ea39-429f-9343-9e50b10f0f43 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1692 microversion: 2.1 time: 0.189026 Jul 19 20:37:15.630530 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3092/6289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:15 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:16.656992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:16.657712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:16.664340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:16.664796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:16.665583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:16.666024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:16.806864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:16.815196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9f93160-55f0-4712-80c2-ef18af1cee68 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1692 microversion: 2.1 time: 0.163738 Jul 19 20:37:16.815842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3198/6290] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:16 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:17.832420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:17.833039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:17.840024 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:17.840485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:17.841266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:17.841807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:17.989352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:17.998418 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bb23bd2-37e1-4fe2-9221-dad2a8b8edfc tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1689 microversion: 2.1 time: 0.169866 Jul 19 20:37:17.999186 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3093/6291] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:17 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:18.016857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:18.017501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:18.024859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:18.025319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:18.026108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:18.026553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:18.155354 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-737ccda2-532f-412a-b434-13ba3e1687e7 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action" status: 202 len: 0 microversion: 2.1 time: 0.142286 Jul 19 20:37:18.159070 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3199/6292] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:37:18 2022] POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:37:18.165004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:18.165737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:18.172966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:18.173434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:18.174431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:18.175053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:18.401500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:18.410411 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-820f8de5-4eb3-4ffe-a1fb-00b705d58cff tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.249331 Jul 19 20:37:18.411024 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3094/6293] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:18 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:19.432711 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:19.433634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:19.441836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:19.442384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:19.443252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:19.443718 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:19.461161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:19.603173 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:19.611683 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61eac4bc-5394-45a7-8720-7d84b43f84a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.185816 Jul 19 20:37:19.612339 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3200/6294] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:19 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:20.460596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-plugged", "status": "completed", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:20.471414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:20.471903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:20.476148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:20.485816 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] Creating event network-vif-plugged:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h2-843861-3 Jul 19 20:37:20.492915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:37:20.504170 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-be81ebb1-59dc-4775-9a15-e8284ffaf95f req-ffb215f5-6eda-406c-8567-8268b8306ae3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047155 Jul 19 20:37:20.504696 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3095/6295] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:20.631326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:20.631974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:20.639377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:20.639857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:20.641445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:20.641748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:20.779929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:20.788246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-79411925-30c8-43a2-93c7-a87d696a0d3d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.162907 Jul 19 20:37:20.788829 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3201/6296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:20 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:21.808115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:21.808842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:21.815373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.815889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.816792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.817285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.833390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-unplugged", "status": "completed", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:21.850645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=39 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:21.860314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.863719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.885265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] Creating event network-vif-unplugged:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:37:21.894549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:37:21.910117 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0df95d70-f215-43ac-9756-c40e984d7247 req-da4b8113-b437-4dfc-9100-878240b735df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081492 Jul 19 20:37:21.911367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3202/6297] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:21.987364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:21.995995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b212089b-6d7f-463c-902c-ae54f2e0415b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.193251 Jul 19 20:37:21.996533 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3096/6298] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:21 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:23.014304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:23.015570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:23.023381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:23.023868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:23.024661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:23.025099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:23.167301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:23.174959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ab7a348-6cd7-4092-92de-bf005a72b4df tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.165311 Jul 19 20:37:23.175560 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3203/6299] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:23 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:23.968840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:23.973409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=37 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:23.979339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:23.979798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:23.994736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] Creating event network-changed:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:37:24.001083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:37:24.012525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ec0f66e1-663c-42f3-a92c-e32cf1d7722f req-b365bde2-0c5a-40f9-a026-f3960685209d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047833 Jul 19 20:37:24.013146 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3097/6300] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:24.196955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:24.197572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:24.206457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:24.206948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:24.207742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:24.208210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:24.429034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:24.437662 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60d16c44-c221-4af7-a7fd-8f45da3b8530 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1688 microversion: 2.1 time: 0.244635 Jul 19 20:37:24.438417 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3204/6301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:24 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:25.458936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:25.459655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:25.466165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:25.466636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:25.467459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:25.468452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:25.619645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:25.630735 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-297d1dc7-37e6-4abf-99f0-25b17e964642 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1681 microversion: 2.1 time: 0.177009 Jul 19 20:37:25.631345 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3098/6302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:25 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:27.728256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b4d0e73e-4aea-4629-bf92-988fb1dbb089 req-dea6f535-02ab-4521-9c95-2c9aa251d4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-plugged", "status": "completed", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:27.744330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b4d0e73e-4aea-4629-bf92-988fb1dbb089 req-dea6f535-02ab-4521-9c95-2c9aa251d4fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:27.744766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b4d0e73e-4aea-4629-bf92-988fb1dbb089 req-dea6f535-02ab-4521-9c95-2c9aa251d4fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:27.758240 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b4d0e73e-4aea-4629-bf92-988fb1dbb089 req-dea6f535-02ab-4521-9c95-2c9aa251d4fa service nova] Creating event network-vif-plugged:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:37:27.763937 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b4d0e73e-4aea-4629-bf92-988fb1dbb089 req-dea6f535-02ab-4521-9c95-2c9aa251d4fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040416 Jul 19 20:37:27.765513 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3205/6303] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:50.745207 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:37:50.745931 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:37:51.847625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:51.849605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:51.856856 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:51.857929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=18 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:51.860002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:51.860945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:51.862231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:51.862964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:51.925122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d9dfa684-6ea7-4572-807b-16de770e423a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action" status: 200 len: 63184 microversion: 2.1 time: 0.083189 Jul 19 20:37:51.925874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3099/6304] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:37:51 2022] POST /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9/action => generated 63184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:37:58.198479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:58.199185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:58.202363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.203051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=27 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.209401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:58.209855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:58.210633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:58.211074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:58.422954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0f35b3b1-383b-4ddc-a7df-66987766211e tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1832 microversion: 2.1 time: 0.228980 Jul 19 20:37:58.423533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3206/6305] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:58 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1832 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:59.382208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:59.382940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:59.392143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:59.392731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:59.393593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:59.394010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:59.429000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:37:59.469890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7fd2505b-4d6a-4f06-95da-6945ae186d6d req-d8db70a3-5276-4bfa-87f2-c5c1ea2cc739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:59.479938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fd2505b-4d6a-4f06-95da-6945ae186d6d req-d8db70a3-5276-4bfa-87f2-c5c1ea2cc739 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:59.479938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fd2505b-4d6a-4f06-95da-6945ae186d6d req-d8db70a3-5276-4bfa-87f2-c5c1ea2cc739 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:59.491234 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7fd2505b-4d6a-4f06-95da-6945ae186d6d req-d8db70a3-5276-4bfa-87f2-c5c1ea2cc739 service nova] Creating event network-changed:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:37:59.498587 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7fd2505b-4d6a-4f06-95da-6945ae186d6d req-d8db70a3-5276-4bfa-87f2-c5c1ea2cc739 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117281 Jul 19 20:37:59.499285 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3207/6306] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:59.529936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d2fac0a-6a87-4731-8162-ac6af74a24e6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 204 len: 0 microversion: 2.1 time: 0.150681 Jul 19 20:37:59.534254 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3100/6307] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:37:59 2022] DELETE /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:37:59.541948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:59.542517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:59.549955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:59.550406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:59.551463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:59.552028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:59.715966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:59.728664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8676fea4-b790-4d85-85df-abeb0e99413a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1687 microversion: 2.1 time: 0.192477 Jul 19 20:37:59.729273 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3208/6308] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:59 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:00.751129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:00.752096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:00.760729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:00.761203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:00.761996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:00.762448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:00.973240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:00.982831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dfcd6d46-8c71-42dc-9f31-51bf09134746 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1687 microversion: 2.1 time: 0.238304 Jul 19 20:38:00.983525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3101/6309] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:00 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:02.001187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:02.001941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:02.009610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:02.010067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:02.011126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:02.011563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:02.120157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6dcbb128-ce12-499a-aacd-6befcdec9b1e req-abf7be84-5810-4fdf-9d98-01a0ba34120b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4270-2e14-43f8-a98c-5a3b76a377e9", "name": "network-vif-deleted", "tag": "20c222de-1c1c-42a2-a4e0-83af308c5944"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:02.121415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:02.130832 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-06936d54-a0f6-4d5e-ba0b-4f7b28d3379a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 200 len: 1501 microversion: 2.1 time: 0.133799 Jul 19 20:38:02.131339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6dcbb128-ce12-499a-aacd-6befcdec9b1e req-abf7be84-5810-4fdf-9d98-01a0ba34120b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:02.141382 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3209/6310] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:01 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 1501 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:02.141657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6dcbb128-ce12-499a-aacd-6befcdec9b1e req-abf7be84-5810-4fdf-9d98-01a0ba34120b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:02.148615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6dcbb128-ce12-499a-aacd-6befcdec9b1e req-abf7be84-5810-4fdf-9d98-01a0ba34120b service nova] Creating event network-vif-deleted:20c222de-1c1c-42a2-a4e0-83af308c5944 for instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 on n-h1-843861-3 Jul 19 20:38:02.154152 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6dcbb128-ce12-499a-aacd-6befcdec9b1e req-abf7be84-5810-4fdf-9d98-01a0ba34120b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037816 Jul 19 20:38:02.154971 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3102/6311] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:38:03.149627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:03.150328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: ad8d4270-2e14-43f8-a98c-5a3b76a377e9] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:03.158037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:03.158491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:03.159279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:03.159721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:03.179242 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] HTTP exception thrown: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Request method failure captured: Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 HTTP/1.1 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xUPF9VugDOMICMbcpWUi6fR5ao9pGWs64EPPb2vhvKmy4os-JsL3llUrAe8COE7cO7QsXvoW0Mxn1KqaQ1izC1xFqGqI-q_wLiq3uo0VWOJ5FHzeJG2_Nirdri6KxwdL-57TY9hUM3ltWAugk2EaXudEwS0Sdqzu8s18AUWHS_30cY Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 88a98608e91c4399a6c5bbccf00a7165 Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ad8d4270-2e14-43f8-a98c-5a3b76a377e9'} Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:38:03.180952 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Returning 404 to user: Instance ad8d4270-2e14-43f8-a98c-5a3b76a377e9 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93e8d337-1961-4f5d-8c99-9bfac1b492b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9" status: 404 len: 111 microversion: 2.1 time: 0.037051 Jul 19 20:38:03.186327 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3210/6312] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:03 2022] GET /compute/v2.1/servers/ad8d4270-2e14-43f8-a98c-5a3b76a377e9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:38:07.013220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-494a9ea7-6514-451c-993e-a0f96a5828be tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '.version_select at 0x7fb8930f6280>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:07.042838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-494a9ea7-6514-451c-993e-a0f96a5828be tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-620925188" status: 202 len: 0 microversion: 2.1 time: 0.035231 Jul 19 20:38:07.043528 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3103/6313] 10.222.0.33 () {58 vars in 1280 bytes} [Tue Jul 19 20:38:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-620925188 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:38:07.092721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc282d13-c9dc-48de-89df-5d66a98d72d9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: .version_select at 0x7fb88c9e0280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-841972110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY1lwwA9XD5/nfukMS5AS2ak5UxmCSTehv+xwAeBGFxs5IAtLKkluK3dCNqQzSCTpW6GiAu29m2I+p3aGNwn9nn8jbvkeAM97SRcaKweDdccbQ6MhIw9Tn3GGiliM9Dbw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:07.109226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bc282d13-c9dc-48de-89df-5d66a98d72d9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:38:07.116613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-bc282d13-c9dc-48de-89df-5d66a98d72d9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:38:07.149462 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bc282d13-c9dc-48de-89df-5d66a98d72d9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062681 Jul 19 20:38:07.150278 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3211/6314] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:38:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:14.414741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:14.422257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-762612781", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "073e7de5-3fa3-4b0e-9e5c-889d6a7f6075"}], "key_name": "tempest-TestNetworkAdvancedServerOps-841972110", "security_groups": [{"name": "tempest-secgroup-smoke-61178310"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:14.609352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] validate_networks() for [('073e7de5-3fa3-4b0e-9e5c-889d6a7f6075', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:38:15.112055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:38:15.112528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:38:15.113021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:38:15.113510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:38:15.113947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:38:15.123636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:15.124135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:15.124959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:15.125405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:15.143222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:38:15.149039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:38:15.164959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:38:15.167378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:38:15.219874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1cb7b98d-733b-44fc-8c2d-3d48e336dc82 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.806899 Jul 19 20:38:15.221194 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3104/6315] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:38:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:38:15.229262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=22 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:15.234165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1eb7565c-605c-4c48-9909-7e629dfa372c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:15.235651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1eb7565c-605c-4c48-9909-7e629dfa372c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:15.307088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1eb7565c-605c-4c48-9909-7e629dfa372c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:15.314753 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1eb7565c-605c-4c48-9909-7e629dfa372c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1265 microversion: 2.1 time: 0.087280 Jul 19 20:38:15.324505 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3212/6316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:15 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:16.338496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf4eb43a-307e-4af6-aabc-3b0bfa3373f0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:16.339686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf4eb43a-307e-4af6-aabc-3b0bfa3373f0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:16.444434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf4eb43a-307e-4af6-aabc-3b0bfa3373f0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:16.457517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf4eb43a-307e-4af6-aabc-3b0bfa3373f0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1265 microversion: 2.1 time: 0.127815 Jul 19 20:38:16.458581 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3105/6317] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:16 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:38:17.487784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9da3de6a-ffb6-4509-9f95-21e67388ca62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:17.488639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9da3de6a-ffb6-4509-9f95-21e67388ca62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:17.570066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9da3de6a-ffb6-4509-9f95-21e67388ca62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:17.580660 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9da3de6a-ffb6-4509-9f95-21e67388ca62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1265 microversion: 2.1 time: 0.099475 Jul 19 20:38:17.581033 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3213/6318] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:17 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:18.598762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:18.599549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:18.609519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:18.611158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:18.612049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:18.612689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:18.693426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:18.702245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-82f60a8e-e0c5-495c-91fc-e60847be992d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1323 microversion: 2.1 time: 0.108294 Jul 19 20:38:18.703250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3106/6319] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:18 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1323 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:19.724638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:19.725553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:19.733444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:19.733904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:19.734685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:19.735343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:19.917251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0c6563e6-8bf0-491b-975b-23a34c6a5cc7 req-9f5df923-ee97-4f93-9f3a-e8f5c9b9269f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:19.930446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0c6563e6-8bf0-491b-975b-23a34c6a5cc7 req-9f5df923-ee97-4f93-9f3a-e8f5c9b9269f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:19.931337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0c6563e6-8bf0-491b-975b-23a34c6a5cc7 req-9f5df923-ee97-4f93-9f3a-e8f5c9b9269f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:19.945704 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0c6563e6-8bf0-491b-975b-23a34c6a5cc7 req-9f5df923-ee97-4f93-9f3a-e8f5c9b9269f service nova] Creating event network-changed:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:38:19.952107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0c6563e6-8bf0-491b-975b-23a34c6a5cc7 req-9f5df923-ee97-4f93-9f3a-e8f5c9b9269f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039136 Jul 19 20:38:19.953570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3107/6320] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:19.969532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:19.978057 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3ab0c66f-6f90-44b5-abb2-6d6f1a6166a5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.257738 Jul 19 20:38:19.978662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3214/6321] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:19 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:21.056039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:21.056765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:21.063086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:21.063554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:21.064375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:21.064826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:21.208266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:21.216475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2e2a182c-b42d-4a77-81fa-ee68a9d94eab tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.224411 Jul 19 20:38:21.217029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3108/6322] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:20 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:22.234235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:22.235091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:22.243165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:22.243610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:22.244408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:22.244842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:22.384448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:22.393448 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-81a208c7-cfe5-4069-a601-a47e23297aa6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.164631 Jul 19 20:38:22.394043 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3215/6323] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:22 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:23.411185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:23.411734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:23.414593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:23.420926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:23.421398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:23.422192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:23.422646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:23.564556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:23.572952 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d4faafae-da2d-400a-a741-7bee8cb91cbf tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.165799 Jul 19 20:38:23.573541 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3109/6324] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:23 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:24.589952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:24.590650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:24.597868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:24.598266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:24.599044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:24.599486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:24.743391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:24.752384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a66a896-9980-4fd1-9d47-846136cf7906 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.166316 Jul 19 20:38:24.752956 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3216/6325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:24 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:38:25.769575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:25.770199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:25.772640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:25.778744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:25.779729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:25.780690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:25.781135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:25.931437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:25.940156 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-383d2859-e37b-496d-8266-9b35176e1f21 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.174435 Jul 19 20:38:25.940899 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3110/6326] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:25 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:38:26.033543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-175eaa4d-2615-434c-9f2d-3e33e7c44b78 req-543b03e3-6fed-435d-9867-f024dc957295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "name": "network-vif-plugged", "status": "completed", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:26.047022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-175eaa4d-2615-434c-9f2d-3e33e7c44b78 req-543b03e3-6fed-435d-9867-f024dc957295 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:26.047634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-175eaa4d-2615-434c-9f2d-3e33e7c44b78 req-543b03e3-6fed-435d-9867-f024dc957295 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:26.060100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-175eaa4d-2615-434c-9f2d-3e33e7c44b78 req-543b03e3-6fed-435d-9867-f024dc957295 service nova] Creating event network-vif-plugged:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:38:26.070735 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-175eaa4d-2615-434c-9f2d-3e33e7c44b78 req-543b03e3-6fed-435d-9867-f024dc957295 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043240 Jul 19 20:38:26.071359 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3217/6327] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:26.958903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:26.959837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:26.962223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:26.971015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:26.971674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:26.972668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:26.973311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:27.109089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:27.116593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b648bbbc-3dbe-4172-824f-7553a93d6eb5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1389 microversion: 2.1 time: 0.161977 Jul 19 20:38:27.117165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3111/6328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:26 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:28.132349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:28.137524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:28.138311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:28.145977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:28.146430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:28.147218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:28.147653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:28.301282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:28.309204 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2b49e3c-4c7b-4feb-bbe8-0a4fd5660882 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1562 microversion: 2.1 time: 0.179313 Jul 19 20:38:28.309774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3218/6329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:28 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:28.327511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:28.328325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:28.335638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:28.336132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:28.336901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:28.337345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:28.486107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:28.494174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-64cc8533-121e-4025-b1ad-bbb5c0e32098 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1562 microversion: 2.1 time: 0.171899 Jul 19 20:38:28.494776 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3112/6330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:28 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:30.661032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:30.662308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:30.666004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-47237fb8-182e-48f8-b8b5-3e53c1f934f7 req-83664986-d2bc-4c6c-ba8b-c14328d62407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:30.666752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:30.671834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:30.672316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:30.673104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:30.673547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:30.678735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-47237fb8-182e-48f8-b8b5-3e53c1f934f7 req-83664986-d2bc-4c6c-ba8b-c14328d62407 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:30.679569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-47237fb8-182e-48f8-b8b5-3e53c1f934f7 req-83664986-d2bc-4c6c-ba8b-c14328d62407 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:30.694936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-47237fb8-182e-48f8-b8b5-3e53c1f934f7 req-83664986-d2bc-4c6c-ba8b-c14328d62407 service nova] Creating event network-changed:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:38:30.701479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-47237fb8-182e-48f8-b8b5-3e53c1f934f7 req-83664986-d2bc-4c6c-ba8b-c14328d62407 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040960 Jul 19 20:38:30.702103 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3113/6331] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:38:30.915996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:30.925773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29f81862-c404-4d78-aa09-a16b660f7816 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1562 microversion: 2.1 time: 0.268788 Jul 19 20:38:30.926396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3219/6332] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:30 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:54.237731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:54.238499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=42 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:54.243583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:54.244676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:54.253313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.254236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.254545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.255343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.317624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-344cfdd5-ee33-41be-94e9-e7cf1ff03291 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action" status: 200 len: 24574 microversion: 2.1 time: 0.081336 Jul 19 20:38:54.318702 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3114/6333] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:38:54 2022] POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action => generated 24574 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:39:05.053281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:05.053877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:05.056213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:05.056879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=32 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:05.063166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.063614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.064422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.064861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.212582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:05.224964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f898baf6-43e1-4c74-abf9-616d5e5500a6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1681 microversion: 2.1 time: 0.175496 Jul 19 20:39:05.225637 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3220/6334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:05 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:05.323401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:05.324507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:05.327510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:05.328213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:05.338588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.339058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.339872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.340329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.393144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8493c5ce-bed1-472c-84b0-2c02461c768f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action" status: 200 len: 32640 microversion: 2.1 time: 0.073880 Jul 19 20:39:05.393824 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3115/6335] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:39:05 2022] POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action => generated 32640 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:39:05.553150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:05.553758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:05.560189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.560634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.561397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.561830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.704156 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-727cd8cf-3aed-4ba9-a8b8-9c3db081458c tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1832 microversion: 2.1 time: 0.154698 Jul 19 20:39:05.704742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3221/6336] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:05 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1832 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:05.730163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:05.731376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:05.738366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.738825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.739594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:05.740137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:05.768147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lazy-loading 'flavor' on Instance uuid d54212e1-31a4-41c4-ac05-e184f7ae575e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:39:05.781190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Going to try to live migrate instance to another host {{(pid=126007) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 20:39:07.165928 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5cae78ce-0bd8-4265-a015-ca9e1c9370f3 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action" status: 202 len: 0 microversion: 2.1 time: 1.440022 Jul 19 20:39:07.167222 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3116/6337] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:39:05 2022] POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:39:07.179363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:07.180239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:07.187732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:07.188352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:07.189257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:07.189828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:07.345082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:07.354424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6666400-9085-430b-baaf-0c3f155b4942 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.179836 Jul 19 20:39:07.355171 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3222/6338] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:07 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:08.372552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:08.373195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:08.381460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:08.382050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:08.383109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:08.384006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:08.413896 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-16671813-430d-4cb5-a575-35a5bb131a42 req-1cd58626-d2aa-4efc-b4e6-74fc22db5738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "name": "network-vif-unplugged", "status": "completed", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:08.423456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-16671813-430d-4cb5-a575-35a5bb131a42 req-1cd58626-d2aa-4efc-b4e6-74fc22db5738 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:08.424025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-16671813-430d-4cb5-a575-35a5bb131a42 req-1cd58626-d2aa-4efc-b4e6-74fc22db5738 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:08.437157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-16671813-430d-4cb5-a575-35a5bb131a42 req-1cd58626-d2aa-4efc-b4e6-74fc22db5738 service nova] Creating event network-vif-unplugged:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:39:08.444276 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-16671813-430d-4cb5-a575-35a5bb131a42 req-1cd58626-d2aa-4efc-b4e6-74fc22db5738 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035239 Jul 19 20:39:08.445028 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3223/6339] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:08.655000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:08.662826 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c21b7456-29cc-4e8f-8bac-a8caae267f17 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.294261 Jul 19 20:39:08.671847 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3117/6340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:08 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:09.682529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:09.683261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:09.690537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:09.690990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:09.691758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:09.692223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:09.827753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:09.835561 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34099be2-5b23-4c75-96dd-7d8221354f41 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.158181 Jul 19 20:39:09.836164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3224/6341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:09 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:10.470180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-462326aa-ffe3-4033-acf2-28ae574593c5 req-d1313078-9f54-4c61-9b33-38740891683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:10.480843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-462326aa-ffe3-4033-acf2-28ae574593c5 req-d1313078-9f54-4c61-9b33-38740891683e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:10.481204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-462326aa-ffe3-4033-acf2-28ae574593c5 req-d1313078-9f54-4c61-9b33-38740891683e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:10.492560 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-462326aa-ffe3-4033-acf2-28ae574593c5 req-d1313078-9f54-4c61-9b33-38740891683e service nova] Creating event network-changed:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:39:10.497841 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-462326aa-ffe3-4033-acf2-28ae574593c5 req-d1313078-9f54-4c61-9b33-38740891683e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 Jul 19 20:39:10.498565 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3118/6342] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:39:10.853965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:10.854622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:10.862227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:10.862688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:10.863476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:10.863946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:11.089692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:11.097918 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b356a458-1faa-4d4c-a2e7-d10d4e60e84c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.247869 Jul 19 20:39:11.098633 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3225/6343] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:10 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:12.117995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:12.118707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:12.127574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:12.127954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:12.128700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:12.129150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:12.276228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:12.284311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-195df9c2-59ba-4f44-a1c0-bed52556206c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.171870 Jul 19 20:39:12.284984 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3119/6344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:12 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:13.302138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:13.302824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:13.310675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:13.311159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:13.311963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:13.312403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:13.453647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:13.462452 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-721f8833-49ed-4b0d-a8df-c8650977443d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.164277 Jul 19 20:39:13.463044 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3226/6345] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:13 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:14.482196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:14.483353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:14.492199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:14.492758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:14.493680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:14.494169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:14.634052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:14.642207 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d8bd9a6-3a1c-41b3-8cd4-5b518b55a95c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.164586 Jul 19 20:39:14.642519 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3120/6346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:14 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:15.659068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:15.659731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:15.667970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:15.668479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:15.669298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:15.670336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:15.809061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:15.817513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f720227-a2ab-409b-a16e-57799212f82a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.162738 Jul 19 20:39:15.818103 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3227/6347] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:15 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:16.834443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:16.835066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:16.842304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:16.842763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:16.843530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:16.844041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:16.987504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:16.995238 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39e25c4b-c179-4bec-85b6-05dad53032ca tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.164642 Jul 19 20:39:16.995833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3121/6348] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:16 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:17.687429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-da0bd75c-3f74-470e-8ae0-4fb80516e3e5 req-66129dad-b5da-4248-bdbe-f84f54a89041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "name": "network-vif-unplugged", "status": "completed", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:17.696498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-da0bd75c-3f74-470e-8ae0-4fb80516e3e5 req-66129dad-b5da-4248-bdbe-f84f54a89041 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:17.697001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-da0bd75c-3f74-470e-8ae0-4fb80516e3e5 req-66129dad-b5da-4248-bdbe-f84f54a89041 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:17.709701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-da0bd75c-3f74-470e-8ae0-4fb80516e3e5 req-66129dad-b5da-4248-bdbe-f84f54a89041 service nova] Creating event network-vif-unplugged:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h1-843861-3 Jul 19 20:39:17.714975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-da0bd75c-3f74-470e-8ae0-4fb80516e3e5 req-66129dad-b5da-4248-bdbe-f84f54a89041 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031435 Jul 19 20:39:17.715834 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3228/6349] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:18.014232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:18.015416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:18.022949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:18.023424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:18.024270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:18.024734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:18.198104 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:18.210792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f379ef50-8769-4adb-80cf-1aa1ab0ba68f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1691 microversion: 2.1 time: 0.201165 Jul 19 20:39:18.211392 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3122/6350] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:18 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:19.229747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:19.230468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.237041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.237496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.238284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.238720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.408232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:19.416115 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5281be1e-0055-4bc0-a5f0-a0d2a4415b94 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1681 microversion: 2.1 time: 0.191566 Jul 19 20:39:19.416840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3229/6351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:19 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:19.442034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:19.442766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.449979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.450448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.451895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.452352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.609153 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7a9bcb30-a238-48ab-a614-13993fc0f308 tempest-TestNetworkAdvancedServerOps-1674164841 tempest-TestNetworkAdvancedServerOps-1674164841-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1832 microversion: 2.1 time: 0.170722 Jul 19 20:39:19.609942 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3123/6352] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:19 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1832 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:19.628538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:19.629248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.637212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.637881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.639321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.640060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.806387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:19.819529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad7be281-1cc8-416b-b64f-8232270aee62 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1681 microversion: 2.1 time: 0.195684 Jul 19 20:39:19.820187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3230/6353] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:19 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:19.921932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:19.922868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.929225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.929686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.930472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.930918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.997221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c1f0d96-4f24-4116-a8ee-39d65c539931 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action" status: 200 len: 38605 microversion: 2.1 time: 0.078895 Jul 19 20:39:20.003908 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3124/6354] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:39:19 2022] POST /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e/action => generated 38605 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:39:21.154244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:21.155156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:21.158577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a2a2f84a-027b-47f7-a448-c7d1ae1f8d1c req-fac33e18-5ab2-455f-b2a5-8cb43175d024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:21.163988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.164692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.165215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.165834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.177507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a2a2f84a-027b-47f7-a448-c7d1ae1f8d1c req-fac33e18-5ab2-455f-b2a5-8cb43175d024 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.178433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a2a2f84a-027b-47f7-a448-c7d1ae1f8d1c req-fac33e18-5ab2-455f-b2a5-8cb43175d024 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.198681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:39:21.208478 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a2a2f84a-027b-47f7-a448-c7d1ae1f8d1c req-fac33e18-5ab2-455f-b2a5-8cb43175d024 service nova] Creating event network-changed:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h2-843861-3 Jul 19 20:39:21.214698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a2a2f84a-027b-47f7-a448-c7d1ae1f8d1c req-fac33e18-5ab2-455f-b2a5-8cb43175d024 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064339 Jul 19 20:39:21.218944 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3125/6355] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:39:21.340890 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a51ba99-7098-425e-bb45-14bb24e1b2b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 204 len: 0 microversion: 2.1 time: 0.194172 Jul 19 20:39:21.343924 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3231/6356] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:39:21 2022] DELETE /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:39:21.354553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:21.355449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:21.363990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.364755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.365553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.366214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.569931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:21.578710 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eaa9a72a-b882-42dd-9991-293d67ed1553 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1687 microversion: 2.1 time: 0.230496 Jul 19 20:39:21.579398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3126/6357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:21 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:22.598499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:22.599920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:22.606666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:22.607724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:22.608645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:22.609021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:22.700169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:22.708215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a08eeeee-6284-4a18-9b03-b04890fb0246 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 200 len: 1502 microversion: 2.1 time: 0.114355 Jul 19 20:39:22.708802 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3232/6358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:22 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 1502 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:23.234564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-32ff338b-93b6-4334-aefe-43851f755388 req-85900a19-8041-4510-92d9-9b04e6205bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54212e1-31a4-41c4-ac05-e184f7ae575e", "name": "network-vif-deleted", "tag": "9afde5af-aed6-4cf1-9d75-f16e6a477f32"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:23.243433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32ff338b-93b6-4334-aefe-43851f755388 req-85900a19-8041-4510-92d9-9b04e6205bda service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:23.243951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32ff338b-93b6-4334-aefe-43851f755388 req-85900a19-8041-4510-92d9-9b04e6205bda service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:23.255640 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-32ff338b-93b6-4334-aefe-43851f755388 req-85900a19-8041-4510-92d9-9b04e6205bda service nova] Creating event network-vif-deleted:9afde5af-aed6-4cf1-9d75-f16e6a477f32 for instance d54212e1-31a4-41c4-ac05-e184f7ae575e on n-h2-843861-3 Jul 19 20:39:23.261486 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-32ff338b-93b6-4334-aefe-43851f755388 req-85900a19-8041-4510-92d9-9b04e6205bda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Jul 19 20:39:23.262113 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3127/6359] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:23.726359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:23.726961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: d54212e1-31a4-41c4-ac05-e184f7ae575e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:23.734864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:23.735373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:23.736222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:23.736701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:23.751673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] HTTP exception thrown: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Request method failure captured: Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e HTTP/1.1 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xUPF9VugDOMICMbcpWUi6fR5ao9pGWs64EPPb2vhvKmy4os-JsL3llUrAe8COE7cO7QsXvoW0Mxn1KqaQ1izC1xFqGqI-q_wLiq3uo0VWOJ5FHzeJG2_Nirdri6KxwdL-57TY9hUM3ltWAugk2EaXudEwS0Sdqzu8s18AUWHS_30cY Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 88a98608e91c4399a6c5bbccf00a7165 Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd54212e1-31a4-41c4-ac05-e184f7ae575e'} Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:39:23.753352 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Returning 404 to user: Instance d54212e1-31a4-41c4-ac05-e184f7ae575e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5695911f-dad1-436f-8da6-750d94a7d0ce tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e" status: 404 len: 111 microversion: 2.1 time: 0.032373 Jul 19 20:39:23.759468 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3233/6360] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:23 2022] GET /compute/v2.1/servers/d54212e1-31a4-41c4-ac05-e184f7ae575e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:39:27.426993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5847b6b3-a196-4ae8-86fd-e6cac252455a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '.version_select at 0x7fb88de3e3a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:27.454847 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5847b6b3-a196-4ae8-86fd-e6cac252455a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-841972110" status: 202 len: 0 microversion: 2.1 time: 0.031791 Jul 19 20:39:27.456054 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3128/6361] 10.222.0.33 () {58 vars in 1280 bytes} [Tue Jul 19 20:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-841972110 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:39:27.492431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e4c759c-2b68-4ec9-b1c3-9bcf9f7f4846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: .version_select at 0x7fb88ccf4310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1229215772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP/w4SGNQoyqb0t5fXqEssiRdzfcKy9WBJIUeQJPh6SX2/5UQYKrG8txt67Phu/s/eYGAioHEgvv1Jqv57LYCeJSm1V8y+VSuWgPZ7SCFJOaVgIdjctVYnpAVYeFn2iWg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:27.508648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4e4c759c-2b68-4ec9-b1c3-9bcf9f7f4846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:39:27.514667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4e4c759c-2b68-4ec9-b1c3-9bcf9f7f4846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:39:27.540213 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e4c759c-2b68-4ec9-b1c3-9bcf9f7f4846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052040 Jul 19 20:39:27.540741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3234/6362] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:39:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:33.728123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:33.733916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-278180988", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "8105aa0b-44d4-4f39-9e7f-1ddc1dc5b16e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1229215772", "security_groups": [{"name": "tempest-secgroup-smoke-1269328108"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:33.878780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] validate_networks() for [('8105aa0b-44d4-4f39-9e7f-1ddc1dc5b16e', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:39:34.418220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:39:34.419456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:39:34.420474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:39:34.421170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:39:34.421801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:39:34.435673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:34.436396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:34.437612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:34.438263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:34.462794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:39:34.471231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Getting quotas for user 88a98608e91c4399a6c5bbccf00a7165 and project b73af8c1835d4a50accba0b30c86cb5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:39:34.488366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:39:34.491582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:39:34.545380 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3dda0cd9-17ae-45d0-b321-f976e2d2e857 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818720 Jul 19 20:39:34.546388 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3129/6363] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:39:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:39:34.556645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d29c651-317e-470c-be35-5d60fa284221 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:34.557322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d29c651-317e-470c-be35-5d60fa284221 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:34.561821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:34.653781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d29c651-317e-470c-be35-5d60fa284221 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:34.673779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d29c651-317e-470c-be35-5d60fa284221 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1266 microversion: 2.1 time: 0.121064 Jul 19 20:39:34.674576 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3235/6364] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:34 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:35.694930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:35.697803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:35.701357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:35.708418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:35.709865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:35.710690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:35.711372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:35.782624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:35.803284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31293fc7-c8d6-4431-bb07-afd08d9ab580 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1318 microversion: 2.1 time: 0.114961 Jul 19 20:39:35.805089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3130/6365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:35 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:36.823383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:36.824259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:36.827100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:36.834787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:36.835708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:36.837984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:36.838889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:37.167169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:37.181911 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd073e21-dbd6-4e90-a144-9f032203b37a tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.362575 Jul 19 20:39:37.194145 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3236/6366] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:36 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:38.025634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4014df06-a7dd-4a73-8ebd-20fce38c220d req-6ea22323-50e4-4901-bccf-1a684e841d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:38.061161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4014df06-a7dd-4a73-8ebd-20fce38c220d req-6ea22323-50e4-4901-bccf-1a684e841d8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:38.061875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4014df06-a7dd-4a73-8ebd-20fce38c220d req-6ea22323-50e4-4901-bccf-1a684e841d8a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:38.092031 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4014df06-a7dd-4a73-8ebd-20fce38c220d req-6ea22323-50e4-4901-bccf-1a684e841d8a service nova] Creating event network-changed:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:39:38.100243 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4014df06-a7dd-4a73-8ebd-20fce38c220d req-6ea22323-50e4-4901-bccf-1a684e841d8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082454 Jul 19 20:39:38.101711 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3131/6367] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:38.209064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:38.210210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:38.225235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:38.226378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:38.227464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:38.228080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:38.477571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:38.487166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a54ac9a-5fac-4b54-b9b9-8e5f22c6d023 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.284386 Jul 19 20:39:38.487762 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3237/6368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:38 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:39.505574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:39.506893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:39.515652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:39.516424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:39.517397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:39.517991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:39.672549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:39.680479 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7473178e-3234-4e75-a82e-7ee0b279034d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.180241 Jul 19 20:39:39.681128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3132/6369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:39 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:40.698156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:40.698926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:40.706585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:40.707035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:40.707821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:40.708276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:40.851281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:40.859042 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0abfa006-8c90-4a6e-a37b-237e0b13b846 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.165020 Jul 19 20:39:40.859618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3238/6370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:40 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:41.877580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:41.878305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:41.885526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:41.885995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:41.886820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:41.887780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:42.042143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:42.049866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd89d506-fa16-49c4-9510-cc08c7d2f6b5 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.176375 Jul 19 20:39:42.050449 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3133/6371] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:41 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:43.067568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:43.068208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:43.075893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:43.076347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:43.077124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:43.077557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:43.242446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:43.250903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7cb1a05d-47f9-4559-80fd-1a30b8171cb6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.187216 Jul 19 20:39:43.251527 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3239/6372] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:43 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:44.272687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:44.273351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:44.284754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:44.285450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:44.286675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:44.287271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:44.447909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:44.450925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:44.458615 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5e07679-2b0d-44bd-b947-416e91d0a24f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.192465 Jul 19 20:39:44.468910 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3134/6373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:44 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:44.541299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ce552031-28af-4dc6-8d9c-f63bba82ec1a req-367b20ba-11c9-49da-b8b5-09c1ef563b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "name": "network-vif-plugged", "status": "completed", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:44.549699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ce552031-28af-4dc6-8d9c-f63bba82ec1a req-367b20ba-11c9-49da-b8b5-09c1ef563b74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:44.550153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ce552031-28af-4dc6-8d9c-f63bba82ec1a req-367b20ba-11c9-49da-b8b5-09c1ef563b74 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:44.562295 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ce552031-28af-4dc6-8d9c-f63bba82ec1a req-367b20ba-11c9-49da-b8b5-09c1ef563b74 service nova] Creating event network-vif-plugged:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:39:44.567599 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ce552031-28af-4dc6-8d9c-f63bba82ec1a req-367b20ba-11c9-49da-b8b5-09c1ef563b74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118125 Jul 19 20:39:44.568325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3240/6374] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:39:45.476889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:45.477637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:45.479504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:45.486198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:45.486656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:45.487445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:45.487926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:45.628722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:45.636536 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c0ce802d-18dc-4756-8904-b84ddb53d8db tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1392 microversion: 2.1 time: 0.163671 Jul 19 20:39:45.637662 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3135/6375] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:45 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:46.652918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:46.661485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:46.661485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:46.668758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.670079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.670844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.671619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.817034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:46.825237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-410c6c40-21b0-4979-8780-bd1e77988988 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1565 microversion: 2.1 time: 0.173902 Jul 19 20:39:46.825832 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3241/6376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:46 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:46.843040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:46.843711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:46.851214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.851681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.852552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.853001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.996931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:47.004840 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9e87344d-1fb7-48e1-a289-68be36042d4b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1565 microversion: 2.1 time: 0.166689 Jul 19 20:39:47.005459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3136/6377] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:46 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:49.196131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1d898f48-39a2-4de6-b3dc-155566fc4f16 req-fc18fe00-b501-4ccb-a723-dcd21424f8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:49.197152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:49.197795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:49.207764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:49.208409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:49.209064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1d898f48-39a2-4de6-b3dc-155566fc4f16 req-fc18fe00-b501-4ccb-a723-dcd21424f8fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:49.209513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:49.209907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1d898f48-39a2-4de6-b3dc-155566fc4f16 req-fc18fe00-b501-4ccb-a723-dcd21424f8fa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:49.210290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:49.231240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1d898f48-39a2-4de6-b3dc-155566fc4f16 req-fc18fe00-b501-4ccb-a723-dcd21424f8fa service nova] Creating event network-changed:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:39:49.238540 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1d898f48-39a2-4de6-b3dc-155566fc4f16 req-fc18fe00-b501-4ccb-a723-dcd21424f8fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045066 Jul 19 20:39:49.238540 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3137/6378] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:49.490077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:49.499694 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-846e41de-a880-49ba-97ea-618327b04215 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1565 microversion: 2.1 time: 0.310012 Jul 19 20:39:49.500371 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3242/6379] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:49 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1565 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:16.789458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:16.790494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:16.792991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=15 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:16.793723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=42 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:16.799966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:16.800440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:16.801239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:16.801697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:16.856941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d251562-47cc-4eca-9564-a8f6f69c638b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action" status: 200 len: 24570 microversion: 2.1 time: 0.072493 Jul 19 20:40:16.857631 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3138/6380] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:40:16 2022] POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:40:27.964920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:27.966436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:27.968770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=13 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:27.969433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:27.975109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:27.975562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:27.976374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:27.976814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:28.066097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:40:28.066581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:40:28.067106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:40:28.067574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:40:28.068087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:40:28.137034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:28.144184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:28.144645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:28.145473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:28.145917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:28.178337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b97af31-b59a-44bf-a2b8-6ebdfaadb61e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action" status: 202 len: 1138 microversion: 2.1 time: 0.217597 Jul 19 20:40:28.179002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3243/6381] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:40:27 2022] POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action => generated 1138 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 20:40:28.197246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:28.198122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:28.201868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:28.202534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:28.209118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:28.209586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:28.210391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:28.210873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:28.378075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:28.386477 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e4f949a7-600b-4ac5-8348-7875a4c4c7c1 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.193643 Jul 19 20:40:28.387065 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3139/6382] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:28 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:29.404654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:29.405222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:29.412683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:29.413138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:29.413977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:29.414415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:29.560841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:29.571996 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3dcd1589-5655-4e64-8efe-7b6e160d0c5f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.171916 Jul 19 20:40:29.572595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3244/6383] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:29 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:30.590749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:30.591355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:30.598392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:30.598853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:30.599633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:30.600107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:30.749253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:30.757327 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a9cf9c8a-69ef-461d-893d-b66c5f1a68a3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.170417 Jul 19 20:40:30.757931 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3140/6384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:30 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:31.774758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:31.775417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:31.782638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:31.783100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:31.783917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:31.784366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:31.927067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:31.935441 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34b0eb52-5d9d-4ec2-8734-f1f8b275e05b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.164654 Jul 19 20:40:31.936053 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3245/6385] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:31 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:32.954341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:32.954928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:32.962428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:32.962911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:32.963749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:32.964313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:33.110785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:33.122496 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-759c237c-f97d-4dc2-995c-e59dbdb0ca29 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.172125 Jul 19 20:40:33.123081 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3141/6386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:32 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:34.144916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:34.145539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:34.152754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:34.153216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:34.154000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:34.154438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:34.314992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:34.324567 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-616bb1fd-95ac-4857-9c18-8470fcd8a47f tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.181992 Jul 19 20:40:34.324567 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3246/6387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:34 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:35.342062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:35.342784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:35.349732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:35.350185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:35.350957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:35.351399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:35.491459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:35.499128 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8aac7f0d-2fe0-42be-8887-21ae6fb85b9e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.160936 Jul 19 20:40:35.499704 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3142/6388] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:35 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:36.516792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:36.517353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:36.524596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:36.524798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:36.525604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:36.526205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:36.660069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:36.667600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52fe04f1-6f23-4219-986c-0b0752eed2d6 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.154917 Jul 19 20:40:36.668701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3247/6389] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:36 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:37.690222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:37.690874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:37.698147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:37.698610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:37.699996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:37.700709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:37.859824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:37.868144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-85bc5cbb-60d2-463d-9c5a-8be508fb22d0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.181752 Jul 19 20:40:37.868733 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3143/6390] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:37 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:38.887839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:38.888629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:38.895821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:38.896295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:38.897068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:38.897502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:39.045634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:39.053684 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c31fdc9-599e-4764-b364-9df19c17ba2b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.170599 Jul 19 20:40:39.054264 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3248/6391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:38 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:40.070625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:40.071240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:40.078623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:40.079081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:40.079894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:40.080341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:40.230751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:40.241193 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-276b8bb1-2392-4ebf-8534-05255b9c0b00 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.173745 Jul 19 20:40:40.241193 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3144/6392] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:40 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:41.260889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:41.261497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:41.269055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:41.269520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:41.270311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:41.270757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:41.412129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:41.420700 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2ac4de8e-25a8-43be-9881-a07a510c16fd tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.164017 Jul 19 20:40:41.421291 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3249/6393] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:41 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:42.439421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:42.440105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:42.447181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:42.447643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:42.448453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:42.448905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:42.597181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:42.605148 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5bbbb297-107d-4786-afd1-738d6e8196fe tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.169590 Jul 19 20:40:42.606403 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3145/6394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:42 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:43.624615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:43.626603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:43.635314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:43.635757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:43.636581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:43.637753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:43.786760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:43.795230 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd93f0e5-03d0-4b24-b918-da9bdc9d7a9d tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.176182 Jul 19 20:40:43.795848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3250/6395] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:43 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:44.813351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:44.813986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:44.821157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:44.821626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:44.822410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:44.822859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:44.977017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:44.985204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e00c7166-5109-4142-8530-fc13259ee754 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.176279 Jul 19 20:40:44.985786 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3146/6396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:44 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:46.002973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:46.003593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:46.011061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:46.011507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:46.012304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:46.012739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:46.156513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:46.164886 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd31b487-1b9e-4fd3-8865-dc75e4125922 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.165730 Jul 19 20:40:46.165494 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3251/6397] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:45 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:47.185318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:47.185947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:47.193198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:47.193780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:47.194586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:47.195078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:47.347841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:47.353197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5acb8c1-37d6-4e0c-a56f-4c6cfec646e2 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.172323 Jul 19 20:40:47.353808 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3147/6398] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:47 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:48.374181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:48.374809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:48.382619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:48.383135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:48.383958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:48.384392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:48.545710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:48.553485 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c161b36a-24f6-49f3-8001-faa293ff47b3 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.183894 Jul 19 20:40:48.554078 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3252/6399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:48 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:49.571890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:49.572769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:49.580786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:49.581259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:49.582072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:49.582591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:49.734881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:49.743725 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e024056-1fe7-4410-abd2-debf52028d09 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1693 microversion: 2.1 time: 0.175922 Jul 19 20:40:49.744513 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3148/6400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:49 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:50.762963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:50.763571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:50.771184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:50.771617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:50.772423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:50.772866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:50.914466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:50.922742 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50547e56-3800-4642-92a5-2b8fc79c15a9 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1699 microversion: 2.1 time: 0.163795 Jul 19 20:40:50.923562 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3253/6401] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:50 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:51.940386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:51.941047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:51.948594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:51.949143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:51.950574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:51.951062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:52.107126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:52.114832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fe8dab7e-c959-411b-bb1c-9243bc69879e tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1699 microversion: 2.1 time: 0.178418 Jul 19 20:40:52.115363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3149/6402] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:51 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1699 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:53.133342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:53.133904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:53.141305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:53.141791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:53.142578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:53.143013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:53.305808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:53.314632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-547de710-789c-41f5-89fa-92fb977607b4 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1684 microversion: 2.1 time: 0.185714 Jul 19 20:40:53.315301 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3254/6403] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:53 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:54.834128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1df29e23-c628-45f3-b8d9-24ba235609d2 req-efe654ea-efe8-4eb3-991d-a6445d12dc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "name": "network-vif-plugged", "status": "completed", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:54.843700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1df29e23-c628-45f3-b8d9-24ba235609d2 req-efe654ea-efe8-4eb3-991d-a6445d12dc1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:54.844195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1df29e23-c628-45f3-b8d9-24ba235609d2 req-efe654ea-efe8-4eb3-991d-a6445d12dc1f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:54.856509 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1df29e23-c628-45f3-b8d9-24ba235609d2 req-efe654ea-efe8-4eb3-991d-a6445d12dc1f service nova] Creating event network-vif-plugged:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:40:54.861785 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1df29e23-c628-45f3-b8d9-24ba235609d2 req-efe654ea-efe8-4eb3-991d-a6445d12dc1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 Jul 19 20:40:54.862645 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3150/6404] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:23.543043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:23.544083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:23.546380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=28 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:23.547052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:23.553358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:23.553807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:23.554582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:23.555018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:23.617954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a8d70d1-b653-4a56-9021-cd1294df2039 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action" status: 200 len: 24564 microversion: 2.1 time: 0.079517 Jul 19 20:41:23.618630 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3255/6405] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:41:23 2022] POST /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6/action => generated 24564 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:36.038650 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=24 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.040081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=68 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.045235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.045905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:36.046515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.046643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:36.054755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.055228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.056055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.056709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.093533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:41:36.118429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-fb8d292f-52d2-4d43-87a1-a76e88df6e2f req-37d5dd32-b335-44aa-816d-51e1fd19febe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:36.129311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb8d292f-52d2-4d43-87a1-a76e88df6e2f req-37d5dd32-b335-44aa-816d-51e1fd19febe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.129758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-fb8d292f-52d2-4d43-87a1-a76e88df6e2f req-37d5dd32-b335-44aa-816d-51e1fd19febe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.141184 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-fb8d292f-52d2-4d43-87a1-a76e88df6e2f req-37d5dd32-b335-44aa-816d-51e1fd19febe service nova] Creating event network-changed:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:41:36.147079 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-fb8d292f-52d2-4d43-87a1-a76e88df6e2f req-37d5dd32-b335-44aa-816d-51e1fd19febe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108447 Jul 19 20:41:36.148136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3256/6406] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:36.201263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb45c254-7b31-43d0-a0b9-275f78f2bab0 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 204 len: 0 microversion: 2.1 time: 0.163792 Jul 19 20:41:36.205934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3151/6407] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:41:36 2022] DELETE /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:41:36.214736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:36.215604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:36.227027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.227722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.229150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.230501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.399467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:36.408428 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-049fd48d-8ff1-43ce-8066-840751a8cc32 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1690 microversion: 2.1 time: 0.200229 Jul 19 20:41:36.409036 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3257/6408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:36 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:37.428371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:37.429008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:37.436422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:37.436885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:37.437719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:37.438197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:37.585724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:37.594183 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ba81bfd-1594-473a-81cf-de48981bc49c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1690 microversion: 2.1 time: 0.170325 Jul 19 20:41:37.594819 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3152/6409] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:37 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:38.401031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-44b462b6-8d0f-4992-b596-3b2623d2ea5b req-4c6df330-7ffb-49a8-85ac-61bc84104f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae6dd8-f303-412a-88ed-ca8ffacad9d6", "name": "network-vif-deleted", "tag": "4044dbc4-969e-447d-84ae-a5508d9dc7ca"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:38.415576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-44b462b6-8d0f-4992-b596-3b2623d2ea5b req-4c6df330-7ffb-49a8-85ac-61bc84104f14 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:38.416275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-44b462b6-8d0f-4992-b596-3b2623d2ea5b req-4c6df330-7ffb-49a8-85ac-61bc84104f14 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:38.430438 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-44b462b6-8d0f-4992-b596-3b2623d2ea5b req-4c6df330-7ffb-49a8-85ac-61bc84104f14 service nova] Creating event network-vif-deleted:4044dbc4-969e-447d-84ae-a5508d9dc7ca for instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 on n-h1-843861-3 Jul 19 20:41:38.435553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-44b462b6-8d0f-4992-b596-3b2623d2ea5b req-4c6df330-7ffb-49a8-85ac-61bc84104f14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Jul 19 20:41:38.436228 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3258/6410] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:38.611472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:38.612192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:38.619922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:38.620393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:38.621234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:38.621649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:38.658480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:38.658951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:38.659455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lazy-loading 'fault' on Instance uuid b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:41:38.709289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a98608e91c4399a6c5bbccf00a7165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73af8c1835d4a50accba0b30c86cb5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:38.720276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d2c70c97-51be-462e-a504-5d085501b676 tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 200 len: 1356 microversion: 2.1 time: 0.112983 Jul 19 20:41:38.721098 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3153/6411] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:38 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:39.740297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:39.741020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] [instance: b9ae6dd8-f303-412a-88ed-ca8ffacad9d6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:39.747534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:39.748037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:39.748826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:39.749302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:39.764079 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] HTTP exception thrown: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Request method failure captured: Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 HTTP/1.1 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xUPF9VugDOMICMbcpWUi6fR5ao9pGWs64EPPb2vhvKmy4os-JsL3llUrAe8COE7cO7QsXvoW0Mxn1KqaQ1izC1xFqGqI-q_wLiq3uo0VWOJ5FHzeJG2_Nirdri6KxwdL-57TY9hUM3ltWAugk2EaXudEwS0Sdqzu8s18AUWHS_30cY Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b73af8c1835d4a50accba0b30c86cb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: b73af8c1835d4a50accba0b30c86cb5f Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1551035329 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 88a98608e91c4399a6c5bbccf00a7165 Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1551035329-project Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'b9ae6dd8-f303-412a-88ed-ca8ffacad9d6'} Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:41:39.765759 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Returning 404 to user: Instance b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6454c1e2-fd1f-4303-8dd9-6459d781a10c tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6" status: 404 len: 111 microversion: 2.1 time: 0.032275 Jul 19 20:41:39.773041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3259/6412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:39 2022] GET /compute/v2.1/servers/b9ae6dd8-f303-412a-88ed-ca8ffacad9d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:41:43.319697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7469d23c-ffe1-4dee-aa6f-b3db6865319b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] Calling method '.version_select at 0x7fb88dc67820>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:43.349094 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7469d23c-ffe1-4dee-aa6f-b3db6865319b tempest-TestNetworkAdvancedServerOps-1551035329 tempest-TestNetworkAdvancedServerOps-1551035329-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1229215772" status: 202 len: 0 microversion: 2.1 time: 0.037916 Jul 19 20:41:43.350250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3154/6413] 10.222.0.33 () {58 vars in 1283 bytes} [Tue Jul 19 20:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1229215772 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:41:51.942871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: .version_select at 0x7fb88c9c1b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-883792373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjenOdt2L808twbx+dVpckcwL2EXv7xBeVXPN4Ryic5ZQ0t58Ii5sHXM5dKlvR121G+VsUvnzxvlNd36YwnwQiDuoPukSU4chA5i1jGGlhp7YYqpQudPulLJ/bISl01tg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:51.948182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:51.949354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:51.967428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:41:51.972937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:41:51.988510 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:41:53.003258 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59192. Jul 19 20:41:53.030039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3e7f6b2a-f8d4-4479-8d3a-d47cb77087d8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.091233 Jul 19 20:41:53.031529 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3260/6414] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:41:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:54.156765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:54.157569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:54.161924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-651802386", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "50b8132b-be3c-4c37-9e0d-b2def149ac0f"}], "key_name": "tempest-TestNetworkBasicOps-883792373", "security_groups": [{"name": "tempest-secgroup-smoke-1540766124"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:54.279749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] validate_networks() for [('50b8132b-be3c-4c37-9e0d-b2def149ac0f', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:41:54.755065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:41:54.755578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:41:54.756289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:41:54.756719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:41:54.757151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:41:54.767039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:54.767707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:54.768737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:54.769449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:54.798929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:41:54.805027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:41:54.827153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:41:54.829794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:41:54.881483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-534d35d1-1a36-4153-9845-b01e2641fbf6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726216 Jul 19 20:41:54.882292 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3155/6415] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:41:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:41:54.892755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60857328-385e-4957-9e84-eebc943b0d26 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:54.894776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60857328-385e-4957-9e84-eebc943b0d26 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:54.966350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60857328-385e-4957-9e84-eebc943b0d26 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:54.976458 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60857328-385e-4957-9e84-eebc943b0d26 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1247 microversion: 2.1 time: 0.087497 Jul 19 20:41:54.982469 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3261/6416] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:54 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:55.994551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:55.995154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:56.002155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.002632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.003433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.003918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.095718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:56.104311 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d6d24c4-0c3f-40bc-9912-85df09190cbd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1307 microversion: 2.1 time: 0.114614 Jul 19 20:41:56.114097 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3156/6417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:55 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:57.122223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:57.122839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:57.131647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:57.132257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:57.133114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:57.133548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:57.353518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:57.361628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-adcc5489-0ea9-4892-b1c8-ffc66071099e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.243737 Jul 19 20:41:57.362693 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3262/6418] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:57 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:57.667123 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c7c26777-c2c6-43da-91b7-cfed881c33f7 req-d69ec692-fd62-4398-8689-fb908f29c33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98242e3b-2fcd-4c2b-80f3-92b04eaba95a", "tag": "acc132ed-0db5-4213-a653-eed574c76770"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:57.680522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c7c26777-c2c6-43da-91b7-cfed881c33f7 req-d69ec692-fd62-4398-8689-fb908f29c33f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:57.681181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c7c26777-c2c6-43da-91b7-cfed881c33f7 req-d69ec692-fd62-4398-8689-fb908f29c33f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:57.701927 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c7c26777-c2c6-43da-91b7-cfed881c33f7 req-d69ec692-fd62-4398-8689-fb908f29c33f service nova] Creating event network-changed:acc132ed-0db5-4213-a653-eed574c76770 for instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a on n-h2-843861-3 Jul 19 20:41:57.707578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c7c26777-c2c6-43da-91b7-cfed881c33f7 req-d69ec692-fd62-4398-8689-fb908f29c33f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044973 Jul 19 20:41:57.708503 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3157/6419] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:58.380442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:58.381317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:58.388462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:58.388911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:58.389676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:58.390124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:58.523296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:58.530779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da9f77ca-133f-4f3f-835e-180821ae5391 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.154232 Jul 19 20:41:58.531350 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3263/6420] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:58 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:59.549807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:59.550453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:59.557507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.557976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.558807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.559260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.708036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:59.716514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39e99f8c-8ff3-4c0b-9f5d-e08fe321bef4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.172029 Jul 19 20:41:59.717092 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3158/6421] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:59 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:00.733746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:00.734348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:00.741846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.742138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.742954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.743398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:01.020188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:01.028565 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43994bec-2c97-4ff4-92f3-481bf0aa9631 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.298982 Jul 19 20:42:01.029583 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3264/6422] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:00 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:02.050018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:02.051197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:02.062993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:02.063857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:02.065259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:02.066057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:02.233534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:02.241273 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d47b5339-7a76-4090-8564-3f6fd6679cdb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.198931 Jul 19 20:42:02.241857 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3159/6423] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:02 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:03.258135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:03.258751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:03.265932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.266384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.267160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.267598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.407351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:03.415255 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a122e118-a3f4-4971-9518-89420b84ed51 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.161286 Jul 19 20:42:03.416558 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3265/6424] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:03 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:03.829850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8d19d553-25cb-42e4-9f79-942a360dda6f req-c42e519b-6e41-4f76-bb85-874be6444f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98242e3b-2fcd-4c2b-80f3-92b04eaba95a", "name": "network-vif-plugged", "status": "completed", "tag": "acc132ed-0db5-4213-a653-eed574c76770"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:03.839595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8d19d553-25cb-42e4-9f79-942a360dda6f req-c42e519b-6e41-4f76-bb85-874be6444f97 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.840078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8d19d553-25cb-42e4-9f79-942a360dda6f req-c42e519b-6e41-4f76-bb85-874be6444f97 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.852346 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8d19d553-25cb-42e4-9f79-942a360dda6f req-c42e519b-6e41-4f76-bb85-874be6444f97 service nova] Creating event network-vif-plugged:acc132ed-0db5-4213-a653-eed574c76770 for instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a on n-h2-843861-3 Jul 19 20:42:03.857510 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8d19d553-25cb-42e4-9f79-942a360dda6f req-c42e519b-6e41-4f76-bb85-874be6444f97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Jul 19 20:42:03.858277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3160/6425] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:04.433183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:04.433831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:04.440841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:04.441292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:04.442058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:04.442491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:04.581330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:04.589628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2df4c42-8bd4-4133-92d0-f8f7de02c3d0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1373 microversion: 2.1 time: 0.160887 Jul 19 20:42:04.590288 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3266/6426] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:04 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:05.603930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:05.604730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:05.609808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:05.610466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:05.617807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:05.618269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:05.619567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:05.620053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:05.765738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:05.773525 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4457ee0c-ace5-489a-89f7-e814ac214848 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1545 microversion: 2.1 time: 0.170567 Jul 19 20:42:05.774137 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3161/6427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:05 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:05.789582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:05.790205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:05.792673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:05.798999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:05.799446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:05.800263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:05.800705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:05.943342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:05.951014 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bffd1e74-ed08-4392-b706-a3815aeb5fcb tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1545 microversion: 2.1 time: 0.165282 Jul 19 20:42:05.951616 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3267/6428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:05 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1545 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:07.611494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6747b266-b4db-4b71-af13-eec6ca340e95 req-0fbd4eb9-05f5-4a0f-8fb5-dc29361b3352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98242e3b-2fcd-4c2b-80f3-92b04eaba95a", "tag": "acc132ed-0db5-4213-a653-eed574c76770"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:07.623118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6747b266-b4db-4b71-af13-eec6ca340e95 req-0fbd4eb9-05f5-4a0f-8fb5-dc29361b3352 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:07.623569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6747b266-b4db-4b71-af13-eec6ca340e95 req-0fbd4eb9-05f5-4a0f-8fb5-dc29361b3352 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:07.636220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6747b266-b4db-4b71-af13-eec6ca340e95 req-0fbd4eb9-05f5-4a0f-8fb5-dc29361b3352 service nova] Creating event network-changed:acc132ed-0db5-4213-a653-eed574c76770 for instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a on n-h2-843861-3 Jul 19 20:42:07.642211 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6747b266-b4db-4b71-af13-eec6ca340e95 req-0fbd4eb9-05f5-4a0f-8fb5-dc29361b3352 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Jul 19 20:42:07.643095 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3162/6429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:44.913742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:44.914725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:44.917077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:44.917785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=36 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:44.924750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:44.925228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:44.926021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:44.926449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:44.989116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23909d47-7705-4fed-aa5e-892ace520d5f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a/action" status: 200 len: 24570 microversion: 2.1 time: 0.079406 Jul 19 20:42:44.989753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3268/6430] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:42:44 2022] POST /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:42:50.756231 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:42:50.756929 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:42:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:43:28.687754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:28.688600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=32 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:28.694524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-839c94fc-614e-4651-8362-697ef18852d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: .version_select at 0x7fb88cc7ad30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1100239674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu5DNl52kDL0D93OuXgSWCSBTMXCjQjT1rN2zfGTX9rejLxeAV8jajPU7TmSla6KVJtgENHv15f5KhuLAQjpsLM8d7v94JZ8veUmNjWrG2avzcdyZM5Ys6dUTpjyGak4g=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:28.712065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-839c94fc-614e-4651-8362-697ef18852d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:43:28.718476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-839c94fc-614e-4651-8362-697ef18852d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:43:28.749680 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-839c94fc-614e-4651-8362-697ef18852d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.064762 Jul 19 20:43:28.750299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3163/6431] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:43:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:29.967003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-470754278", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "cea74d44-ff19-4648-9842-7494c870ecbb"}], "key_name": "tempest-TestNetworkBasicOps-1100239674", "security_groups": [{"name": "tempest-secgroup-smoke-886981969"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:29.974407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:29.975657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:30.459045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] validate_networks() for [('cea74d44-ff19-4648-9842-7494c870ecbb', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:43:31.370458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:43:31.371105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:43:31.371366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:43:31.371776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:43:31.372209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:43:31.381841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:31.382292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:31.383189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:31.383613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:31.401507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:43:31.407934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:43:31.421267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:43:31.423635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:43:31.472697 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-638b034f-1062-4844-89c5-9bfd95a57968 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.510042 Jul 19 20:43:31.473587 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3269/6432] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:43:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:43:31.488522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d8fc98e0-f7b7-42e3-8a58-11e69fd3dbc2 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:31.489411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d8fc98e0-f7b7-42e3-8a58-11e69fd3dbc2 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:31.715315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d8fc98e0-f7b7-42e3-8a58-11e69fd3dbc2 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:31.725104 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d8fc98e0-f7b7-42e3-8a58-11e69fd3dbc2 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1248 microversion: 2.1 time: 0.243157 Jul 19 20:43:31.725705 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3164/6433] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:31 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1248 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:32.746740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:32.747762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:32.760239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:32.760924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:32.761906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:32.762495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:32.855670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:32.869292 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-682edec3-3c33-48c8-a4fa-c353a3eecafa tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1306 microversion: 2.1 time: 0.129558 Jul 19 20:43:32.870071 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3270/6434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:32 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:43:33.891885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:33.893233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:33.908233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.909130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:33.910150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.910613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:34.123558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:34.132937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd357fcd-7f55-4659-95b5-e46b5ac466d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.246918 Jul 19 20:43:34.133980 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3165/6435] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:33 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:34.744878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-390a7a07-b24f-4826-a96e-28e9da0dc61a req-9f025a61-438a-4d48-a099-487650ded72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7314bdd1-c43d-46b8-b270-d4e3cbfb7eed", "tag": "8d1c5892-1111-486b-80d6-dec5d3232e69"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:34.759242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-390a7a07-b24f-4826-a96e-28e9da0dc61a req-9f025a61-438a-4d48-a099-487650ded72c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:34.759650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-390a7a07-b24f-4826-a96e-28e9da0dc61a req-9f025a61-438a-4d48-a099-487650ded72c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:34.778580 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-390a7a07-b24f-4826-a96e-28e9da0dc61a req-9f025a61-438a-4d48-a099-487650ded72c service nova] Creating event network-changed:8d1c5892-1111-486b-80d6-dec5d3232e69 for instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed on n-h1-843861-3 Jul 19 20:43:34.785956 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-390a7a07-b24f-4826-a96e-28e9da0dc61a req-9f025a61-438a-4d48-a099-487650ded72c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044870 Jul 19 20:43:34.787758 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3271/6436] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:35.154525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:35.155152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:35.163389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:35.163389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:35.164098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:35.164550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:35.311595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:35.321169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-57415c76-5649-4352-8595-9547028f0ae6 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.170499 Jul 19 20:43:35.321934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3166/6437] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:35 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:43:36.350440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:36.351412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:36.358460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:36.358939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:36.359704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:36.360175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:36.584373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:36.592623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e0c3f42-63ea-4db2-8a10-0b0d710d379f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.246967 Jul 19 20:43:36.593322 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3272/6438] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:36 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:37.611428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:37.612712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:37.620124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:37.620653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:37.621490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:37.621935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:37.762970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:37.771563 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0068401-a8e5-4876-a16c-7ffdbe054b93 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.164319 Jul 19 20:43:37.775635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3167/6439] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:37 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:38.790250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:38.790892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:38.804761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:38.805211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:38.805981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:38.806413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:39.038475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:39.046225 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d0f7a263-0b02-4df5-a7d3-b5aa76499ca8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.260073 Jul 19 20:43:39.046824 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3273/6440] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:38 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:39.595417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-47e1d4ee-e3f6-4567-99c2-d5708ba96606 req-b8949677-5151-4298-a68c-983d986702fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7314bdd1-c43d-46b8-b270-d4e3cbfb7eed", "name": "network-vif-plugged", "status": "completed", "tag": "8d1c5892-1111-486b-80d6-dec5d3232e69"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:39.605639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-47e1d4ee-e3f6-4567-99c2-d5708ba96606 req-b8949677-5151-4298-a68c-983d986702fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:39.606227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-47e1d4ee-e3f6-4567-99c2-d5708ba96606 req-b8949677-5151-4298-a68c-983d986702fe service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:39.618499 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-47e1d4ee-e3f6-4567-99c2-d5708ba96606 req-b8949677-5151-4298-a68c-983d986702fe service nova] Creating event network-vif-plugged:8d1c5892-1111-486b-80d6-dec5d3232e69 for instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed on n-h1-843861-3 Jul 19 20:43:39.624184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-47e1d4ee-e3f6-4567-99c2-d5708ba96606 req-b8949677-5151-4298-a68c-983d986702fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Jul 19 20:43:39.625386 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3168/6441] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:43:40.063906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:40.064551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:40.072434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:40.072887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:40.073665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:40.074105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:40.211657 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:40.219619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c887e94e-7890-4235-8ec8-f4db771ce6d7 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1373 microversion: 2.1 time: 0.159551 Jul 19 20:43:40.220251 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3274/6442] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:40 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:41.242293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:41.243790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:41.252229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.252805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:41.253473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.253923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:41.397503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:41.405231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e939ce2-79d9-4143-b752-a85a926c4693 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1546 microversion: 2.1 time: 0.168475 Jul 19 20:43:41.405830 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3169/6443] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:41 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:41.424316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:41.425364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:41.428959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:41.429672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:41.435990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.436453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:41.437246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.437688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:41.587149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:41.594952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7bbc283c-22ba-4995-8eab-ee4cd46b5787 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1546 microversion: 2.1 time: 0.176859 Jul 19 20:43:41.595542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3275/6444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:41 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:11.814453 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:11.814959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:11.821640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:11.822595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:11.823558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=26 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:11.826873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:11.827774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:11.828779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:11.829387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:11.858594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:44:11.953417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2192b34-c420-44fe-b667-9ba49b30ce52 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 204 len: 0 microversion: 2.1 time: 0.142818 Jul 19 20:44:11.955323 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3170/6445] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:44:11 2022] DELETE /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:44:11.963307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:11.964097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:11.966353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:11.967247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:11.974731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:11.975261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:11.976165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:11.976826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:12.129399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:12.138112 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9038ba51-aa9a-40c7-a97b-b13f3d91aa40 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1552 microversion: 2.1 time: 0.178975 Jul 19 20:44:12.138699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3276/6446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:11 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:44:13.155110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:13.155987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:13.166152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:13.167323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:13.168466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:13.168926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:13.315206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:13.323600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-44f54254-dd4c-41a7-8c35-8356816d80dd tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1552 microversion: 2.1 time: 0.172701 Jul 19 20:44:13.324953 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3171/6447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:13 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:13.920325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a43aad66-af24-45ba-a55f-c4b02d6d2c7d req-da6447c8-d372-441a-9e9d-3469bf0cdd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7314bdd1-c43d-46b8-b270-d4e3cbfb7eed", "name": "network-vif-deleted", "tag": "8d1c5892-1111-486b-80d6-dec5d3232e69"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:13.935127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a43aad66-af24-45ba-a55f-c4b02d6d2c7d req-da6447c8-d372-441a-9e9d-3469bf0cdd30 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:13.935576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a43aad66-af24-45ba-a55f-c4b02d6d2c7d req-da6447c8-d372-441a-9e9d-3469bf0cdd30 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:13.948923 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a43aad66-af24-45ba-a55f-c4b02d6d2c7d req-da6447c8-d372-441a-9e9d-3469bf0cdd30 service nova] Creating event network-vif-deleted:8d1c5892-1111-486b-80d6-dec5d3232e69 for instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed on n-h1-843861-3 Jul 19 20:44:13.954676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a43aad66-af24-45ba-a55f-c4b02d6d2c7d req-da6447c8-d372-441a-9e9d-3469bf0cdd30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039165 Jul 19 20:44:13.955470 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3277/6448] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:14.342443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:14.343980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:14.351164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:14.351976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:14.352769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:14.353788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:14.389096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:14.389723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:14.390298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lazy-loading 'fault' on Instance uuid 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:44:14.436308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:14.443736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83c0cc5f-9a82-4b47-b145-d52a2e3bd19f tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 200 len: 1338 microversion: 2.1 time: 0.105405 Jul 19 20:44:14.444287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3172/6449] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:14 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:15.462514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:15.463223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:15.469567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:15.470014 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:15.470787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:15.471224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:15.485328 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] HTTP exception thrown: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Request method failure captured: Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed HTTP/1.1 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xcJvQQFISI597RSJuyFP1NthMzq71a8yoSqdd8nmxLRuVtAA_w6F-vEW55U-oItvZUfe42DT9eaUKoiADi8aJ1eb2EesE26b71tggV6I8vkF8xiwdwhMmIK5mIUVAUbz0qNanXMcMX_92z3Ub2-6IFdL7wSVOtPxpLCVOCb71KMRec Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fce552776c99429188c4748ba0d096b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e726730705b54d4985a7d4db46c2f4ff Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '7314bdd1-c43d-46b8-b270-d4e3cbfb7eed'} Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:15.486902 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Returning 404 to user: Instance 7314bdd1-c43d-46b8-b270-d4e3cbfb7eed could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78f0ddcc-505f-4b09-b56b-3b2f21174d85 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed" status: 404 len: 111 microversion: 2.1 time: 0.031606 Jul 19 20:44:15.492846 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3278/6450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:15 2022] GET /compute/v2.1/servers/7314bdd1-c43d-46b8-b270-d4e3cbfb7eed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:44:15.655011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ac84c573-1852-46de-bf57-ad70c759e941 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '.version_select at 0x7fb88d4bd3a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:15.675596 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ac84c573-1852-46de-bf57-ad70c759e941 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1100239674" status: 202 len: 0 microversion: 2.1 time: 0.025887 Jul 19 20:44:15.676494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3173/6451] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 20:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1100239674 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:44:17.412294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:17.412980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:17.420315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:17.420998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:17.421931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:17.422372 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:17.449313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:44:17.518488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4c7c7707-417a-481e-b72b-452cd386ebe0 req-e4809e40-a9aa-4cab-9149-445f824fb653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98242e3b-2fcd-4c2b-80f3-92b04eaba95a", "tag": "acc132ed-0db5-4213-a653-eed574c76770"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:17.528032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4c7c7707-417a-481e-b72b-452cd386ebe0 req-e4809e40-a9aa-4cab-9149-445f824fb653 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:17.528752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4c7c7707-417a-481e-b72b-452cd386ebe0 req-e4809e40-a9aa-4cab-9149-445f824fb653 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:17.540626 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4c7c7707-417a-481e-b72b-452cd386ebe0 req-e4809e40-a9aa-4cab-9149-445f824fb653 service nova] Creating event network-changed:acc132ed-0db5-4213-a653-eed574c76770 for instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a on n-h2-843861-3 Jul 19 20:44:17.541177 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ad179ddb-ee02-42ef-905a-ae42f27ed249 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 204 len: 0 microversion: 2.1 time: 0.133419 Jul 19 20:44:17.542142 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3279/6452] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:44:17 2022] DELETE /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:44:17.547699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4c7c7707-417a-481e-b72b-452cd386ebe0 req-e4809e40-a9aa-4cab-9149-445f824fb653 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091859 Jul 19 20:44:17.548895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3174/6453] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:44:17.557197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:17.558007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:17.564375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:17.564904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:17.565744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:17.566251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:17.717309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:17.726212 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7b411da2-eb48-493c-8378-669d8df80156 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1670 microversion: 2.1 time: 0.179083 Jul 19 20:44:17.727238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3280/6454] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:17 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:18.747009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:18.747762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:18.754731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:18.755776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:18.756640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:18.757094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:18.975539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:18.983846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a4147b0-f938-4f4e-8beb-e6cd8ab72c78 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1670 microversion: 2.1 time: 0.242175 Jul 19 20:44:18.984436 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3175/6455] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:18 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:19.942691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-cbe279e9-d2e9-403a-8499-ee8841f0b996 req-7f31b753-3ec6-48c2-8ed9-79f93ddef38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98242e3b-2fcd-4c2b-80f3-92b04eaba95a", "name": "network-vif-deleted", "tag": "acc132ed-0db5-4213-a653-eed574c76770"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:19.957029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cbe279e9-d2e9-403a-8499-ee8841f0b996 req-7f31b753-3ec6-48c2-8ed9-79f93ddef38f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:19.957029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-cbe279e9-d2e9-403a-8499-ee8841f0b996 req-7f31b753-3ec6-48c2-8ed9-79f93ddef38f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:19.971777 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-cbe279e9-d2e9-403a-8499-ee8841f0b996 req-7f31b753-3ec6-48c2-8ed9-79f93ddef38f service nova] Creating event network-vif-deleted:acc132ed-0db5-4213-a653-eed574c76770 for instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a on n-h2-843861-3 Jul 19 20:44:19.978102 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-cbe279e9-d2e9-403a-8499-ee8841f0b996 req-7f31b753-3ec6-48c2-8ed9-79f93ddef38f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040786 Jul 19 20:44:19.979071 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3281/6456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:20.007032 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:20.008191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:20.019904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:20.020287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:20.021957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:20.022408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:20.095578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:20.103565 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-db6c15f9-0c36-4ec6-962f-87f8cf7ede0e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 200 len: 1332 microversion: 2.1 time: 0.103903 Jul 19 20:44:20.104346 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3176/6457] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:19 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:21.123061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:21.123782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: 98242e3b-2fcd-4c2b-80f3-92b04eaba95a] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:21.131175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:21.131623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:21.132430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:21.132878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:21.150367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] HTTP exception thrown: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Request method failure captured: Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a HTTP/1.1 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xcJvQQFISI597RSJuyFP1NthMzq71a8yoSqdd8nmxLRuVtAA_w6F-vEW55U-oItvZUfe42DT9eaUKoiADi8aJ1eb2EesE26b71tggV6I8vkF8xiwdwhMmIK5mIUVAUbz0qNanXMcMX_92z3Ub2-6IFdL7wSVOtPxpLCVOCb71KMRec Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fce552776c99429188c4748ba0d096b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e726730705b54d4985a7d4db46c2f4ff Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '98242e3b-2fcd-4c2b-80f3-92b04eaba95a'} Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:21.152083 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Returning 404 to user: Instance 98242e3b-2fcd-4c2b-80f3-92b04eaba95a could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-23c62606-9ff8-4529-9461-02e667a3dbce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a" status: 404 len: 111 microversion: 2.1 time: 0.035690 Jul 19 20:44:21.157535 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3282/6458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:21 2022] GET /compute/v2.1/servers/98242e3b-2fcd-4c2b-80f3-92b04eaba95a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:44:21.334440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-335d4491-7d8c-4ee9-b57a-93162c0051c8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '.version_select at 0x7fb8930f6430>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:21.358888 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-335d4491-7d8c-4ee9-b57a-93162c0051c8 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-883792373" status: 202 len: 0 microversion: 2.1 time: 0.029041 Jul 19 20:44:21.359668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3177/6459] 10.222.0.33 () {58 vars in 1253 bytes} [Tue Jul 19 20:44:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-883792373 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:44:29.806540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e6eb0e9-f443-40aa-876b-0d8b00144184 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: .version_select at 0x7fb88ccf4dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2144657826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAgFF3Z7+CQDO4UB3yVntjz6cVH/SzcC2eXRLVBlt191cMohDU6hfFgiQPHATPdDZWqyqbn9pyXmldPiMg+taeo6V30oqg06DnzwriHapwN/nhQkbTbBycqDU+Cf9s0JQ=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:29.822601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0e6eb0e9-f443-40aa-876b-0d8b00144184 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:44:29.829934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0e6eb0e9-f443-40aa-876b-0d8b00144184 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:44:29.866831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e6eb0e9-f443-40aa-876b-0d8b00144184 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.064213 Jul 19 20:44:29.867793 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3283/6460] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:44:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:31.008318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-415414871", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "9927e120-9c7d-43a0-a1c5-c566f6f6ff0a"}], "key_name": "tempest-TestNetworkBasicOps-2144657826", "security_groups": [{"name": "tempest-secgroup-smoke-1015357436"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:31.022162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:31.138327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] validate_networks() for [('9927e120-9c7d-43a0-a1c5-c566f6f6ff0a', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:44:32.080364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:44:32.081039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:44:32.081521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:44:32.081954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:44:32.082459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:44:32.092280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:32.092734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:32.093564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:32.094019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:32.112852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:44:32.118984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Getting quotas for user e726730705b54d4985a7d4db46c2f4ff and project fce552776c99429188c4748ba0d096b2. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:44:32.133171 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:44:32.135507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:44:32.188685 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-47b69b03-966b-4139-9ae8-3f74ab00497d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.184940 Jul 19 20:44:32.195838 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3178/6461] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:44:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:44:32.199234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:32.203321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95fd51dc-239e-48aa-99c8-5e389b0bbf20 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:32.204294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95fd51dc-239e-48aa-99c8-5e389b0bbf20 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:32.279658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95fd51dc-239e-48aa-99c8-5e389b0bbf20 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:32.287864 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95fd51dc-239e-48aa-99c8-5e389b0bbf20 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1248 microversion: 2.1 time: 0.090278 Jul 19 20:44:32.288682 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3284/6462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:32 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:33.309279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:33.310037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:33.319273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:33.319737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:33.320570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:33.321015 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:33.397190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:33.405529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4e0e7c92-41ba-407b-9d81-99cef97f8d81 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1252 microversion: 2.1 time: 0.103806 Jul 19 20:44:33.406123 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3179/6463] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:33 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1252 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:34.423073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:34.424701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:34.437239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:34.437850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:34.438844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:34.439475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:34.522649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:34.531447 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c11d7eda-8011-40ee-91b2-92c9099abbf9 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1306 microversion: 2.1 time: 0.112500 Jul 19 20:44:34.532080 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3285/6464] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:34 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:35.550368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:35.551766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:35.559938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:35.560632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:35.561520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:35.562045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:35.734004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:35.745665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-716df37b-0895-4de8-aebb-fae33339dbf3 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.199200 Jul 19 20:44:35.746469 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3180/6465] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:35 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:35.785117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7fbd8fd4-c863-4430-862e-e036f2c78216 req-04a0dfbd-33d2-4397-ab0a-70eeb2e8e247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e224cc-806f-4b33-8546-123f2c72397e", "tag": "a1aaa495-73af-4f10-9a87-6eb15e2ea1af"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:35.798918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fbd8fd4-c863-4430-862e-e036f2c78216 req-04a0dfbd-33d2-4397-ab0a-70eeb2e8e247 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:35.799507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7fbd8fd4-c863-4430-862e-e036f2c78216 req-04a0dfbd-33d2-4397-ab0a-70eeb2e8e247 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:35.814143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7fbd8fd4-c863-4430-862e-e036f2c78216 req-04a0dfbd-33d2-4397-ab0a-70eeb2e8e247 service nova] Creating event network-changed:a1aaa495-73af-4f10-9a87-6eb15e2ea1af for instance b4e224cc-806f-4b33-8546-123f2c72397e on n-h1-843861-3 Jul 19 20:44:35.820090 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7fbd8fd4-c863-4430-862e-e036f2c78216 req-04a0dfbd-33d2-4397-ab0a-70eeb2e8e247 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040839 Jul 19 20:44:35.820960 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3286/6466] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:36.764161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:36.764929 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:36.774262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:36.774787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:36.775718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:36.776238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:36.938185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:36.949003 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9cc9368e-b9b3-4515-93fd-e0ed98bc3409 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.189407 Jul 19 20:44:36.949784 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3181/6467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:36 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:37.972131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:37.973448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:37.980217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:37.980671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:37.981449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:37.981880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:38.125923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:38.133917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6e6fb920-f300-45cc-bb5c-d547821f81f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.168026 Jul 19 20:44:38.134488 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3287/6468] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:37 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:39.151447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:39.152033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:39.158549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:39.159008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:39.159776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:39.160254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:39.296087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:39.303451 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4de0fa12-a973-4bd2-9e05-ad3517b5d1a0 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.156239 Jul 19 20:44:39.304049 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3182/6469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:39 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:44:40.320355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:40.320966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:40.331167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:40.332006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:40.332719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:40.333149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:40.469219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:40.477537 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4cdde260-0f50-4197-a3ca-a44d7b8b3653 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.161082 Jul 19 20:44:40.478049 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3288/6470] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:40 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:41.495360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:41.495953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:41.505762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:41.506225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:41.507016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:41.507465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:41.652100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:41.659873 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae79621d-a56a-4e72-9e49-8caf4c6c435d tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.168519 Jul 19 20:44:41.660461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3183/6471] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:41 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:42.082812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c5395a6c-50f9-4083-9bef-c52961f59013 req-3f42eb13-96f4-47da-8ed1-9d9c8954e09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e224cc-806f-4b33-8546-123f2c72397e", "name": "network-vif-plugged", "status": "completed", "tag": "a1aaa495-73af-4f10-9a87-6eb15e2ea1af"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:42.086451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:42.093366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c5395a6c-50f9-4083-9bef-c52961f59013 req-3f42eb13-96f4-47da-8ed1-9d9c8954e09e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:42.093814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c5395a6c-50f9-4083-9bef-c52961f59013 req-3f42eb13-96f4-47da-8ed1-9d9c8954e09e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:42.106133 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c5395a6c-50f9-4083-9bef-c52961f59013 req-3f42eb13-96f4-47da-8ed1-9d9c8954e09e service nova] Creating event network-vif-plugged:a1aaa495-73af-4f10-9a87-6eb15e2ea1af for instance b4e224cc-806f-4b33-8546-123f2c72397e on n-h1-843861-3 Jul 19 20:44:42.112313 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c5395a6c-50f9-4083-9bef-c52961f59013 req-3f42eb13-96f4-47da-8ed1-9d9c8954e09e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088727 Jul 19 20:44:42.112937 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3289/6472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:44:42.677372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:42.678007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:42.679919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:42.680706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:42.682430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:42.689754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:42.690219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:42.691001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:42.691458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:42.825217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:42.832891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1dfec86-28f5-4c63-a8dd-ae6d4439707b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1374 microversion: 2.1 time: 0.159422 Jul 19 20:44:42.833503 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3184/6473] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:42 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:43.848068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:43.853656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:43.854365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:43.861155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:43.861609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:43.862378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:43.862813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:43.996150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:44.003658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-913bfc9a-7f35-4892-a13e-17dc5538ce97 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1546 microversion: 2.1 time: 0.156587 Jul 19 20:44:44.004557 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3290/6474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:43 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:44.020548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:44.021174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:44.028440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:44.028902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:44.029677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:44.030115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:44.167691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:44.175279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e60d5041-0e72-4eb1-9926-52b45e2974f1 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1546 microversion: 2.1 time: 0.158551 Jul 19 20:44:44.175876 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3185/6475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:44 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:45.806040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c1f75bf8-77b9-4a84-99cc-2a8911427b04 req-c979f5c5-0bac-4261-a9ef-396031bb72f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e224cc-806f-4b33-8546-123f2c72397e", "tag": "a1aaa495-73af-4f10-9a87-6eb15e2ea1af"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:45.816039 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c1f75bf8-77b9-4a84-99cc-2a8911427b04 req-c979f5c5-0bac-4261-a9ef-396031bb72f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:45.816576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c1f75bf8-77b9-4a84-99cc-2a8911427b04 req-c979f5c5-0bac-4261-a9ef-396031bb72f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:45.831909 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c1f75bf8-77b9-4a84-99cc-2a8911427b04 req-c979f5c5-0bac-4261-a9ef-396031bb72f8 service nova] Creating event network-changed:a1aaa495-73af-4f10-9a87-6eb15e2ea1af for instance b4e224cc-806f-4b33-8546-123f2c72397e on n-h1-843861-3 Jul 19 20:44:45.838671 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c1f75bf8-77b9-4a84-99cc-2a8911427b04 req-c979f5c5-0bac-4261-a9ef-396031bb72f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036178 Jul 19 20:44:45.839607 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3291/6476] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:11.048613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:11.049657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:11.052467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:11.053156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=44 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:11.059291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:11.059754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:11.060577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:11.061021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:11.118629 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8dafba0-42af-402e-98d7-6b50b84cdf42 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e/action" status: 200 len: 24573 microversion: 2.1 time: 0.073956 Jul 19 20:45:11.119643 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3186/6477] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:45:11 2022] POST /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:45:22.436954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=5 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:22.437696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=30 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:22.441874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:22.443492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:22.450472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:22.450916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:22.451674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:22.452134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:22.502094 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc6959fe-1fe8-4e81-938d-94db93b064d4 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "POST /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e/action" status: 200 len: 32645 microversion: 2.1 time: 0.066991 Jul 19 20:45:22.502680 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3292/6478] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:45:22 2022] POST /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e/action => generated 32645 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:45:23.542805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:23.543410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:23.549249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-59232073-c2c6-469c-8f8a-aa18d4183307 req-4092c3a0-eff5-46a2-8034-5a126515341e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e224cc-806f-4b33-8546-123f2c72397e", "tag": "a1aaa495-73af-4f10-9a87-6eb15e2ea1af"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:23.558143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:23.558854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:23.559426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-59232073-c2c6-469c-8f8a-aa18d4183307 req-4092c3a0-eff5-46a2-8034-5a126515341e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:23.559971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-59232073-c2c6-469c-8f8a-aa18d4183307 req-4092c3a0-eff5-46a2-8034-5a126515341e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:23.560680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:23.561172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:23.562029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:23.562478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:23.573190 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-59232073-c2c6-469c-8f8a-aa18d4183307 req-4092c3a0-eff5-46a2-8034-5a126515341e service nova] Creating event network-changed:a1aaa495-73af-4f10-9a87-6eb15e2ea1af for instance b4e224cc-806f-4b33-8546-123f2c72397e on n-h1-843861-3 Jul 19 20:45:23.578221 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-59232073-c2c6-469c-8f8a-aa18d4183307 req-4092c3a0-eff5-46a2-8034-5a126515341e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032954 Jul 19 20:45:23.579033 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3293/6479] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:23.593962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:45:23.693517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-905655d8-dac0-41c6-a6f1-6ee0fecaf6ce tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 204 len: 0 microversion: 2.1 time: 0.154222 Jul 19 20:45:23.694492 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3187/6480] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:45:23 2022] DELETE /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:45:23.705054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:23.705934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:23.713253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:23.714119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:23.715094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:23.715876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:23.858618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:23.866878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d581a21f-19e4-4fa4-aa5e-49da3b65628b tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1671 microversion: 2.1 time: 0.166587 Jul 19 20:45:23.867426 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3294/6481] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:23 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:24.886048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:24.886710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:24.894521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:24.894979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:24.896390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:24.896833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:25.036076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:25.043618 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e035b6ee-a4d7-447d-ad82-fd94c2b35add tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1671 microversion: 2.1 time: 0.162002 Jul 19 20:45:25.044263 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3188/6482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:24 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:25.971196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-61ffa544-ebc5-4ca5-bcfa-bba3efadfd7c req-4f1f510e-e1c9-473e-8b90-fcfe4221ed21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e224cc-806f-4b33-8546-123f2c72397e", "name": "network-vif-deleted", "tag": "a1aaa495-73af-4f10-9a87-6eb15e2ea1af"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:25.982684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61ffa544-ebc5-4ca5-bcfa-bba3efadfd7c req-4f1f510e-e1c9-473e-8b90-fcfe4221ed21 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:25.983143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-61ffa544-ebc5-4ca5-bcfa-bba3efadfd7c req-4f1f510e-e1c9-473e-8b90-fcfe4221ed21 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:25.996373 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-61ffa544-ebc5-4ca5-bcfa-bba3efadfd7c req-4f1f510e-e1c9-473e-8b90-fcfe4221ed21 service nova] Creating event network-vif-deleted:a1aaa495-73af-4f10-9a87-6eb15e2ea1af for instance b4e224cc-806f-4b33-8546-123f2c72397e on n-h1-843861-3 Jul 19 20:45:26.001658 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-61ffa544-ebc5-4ca5-bcfa-bba3efadfd7c req-4f1f510e-e1c9-473e-8b90-fcfe4221ed21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Jul 19 20:45:26.002261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3295/6483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:26.061747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:26.062389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:26.069682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:26.070396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:26.071177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:26.071691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:26.106077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:26.106540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:26.106996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lazy-loading 'fault' on Instance uuid b4e224cc-806f-4b33-8546-123f2c72397e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:45:26.151710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e726730705b54d4985a7d4db46c2f4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce552776c99429188c4748ba0d096b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:26.159362 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84bc724f-0709-4cad-bb82-3d8e75d3872e tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 200 len: 1338 microversion: 2.1 time: 0.101797 Jul 19 20:45:26.159978 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3189/6484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:26 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:27.178874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:27.179493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] [instance: b4e224cc-806f-4b33-8546-123f2c72397e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:27.185881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:27.186332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:27.187098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:27.187536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:27.201529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] HTTP exception thrown: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Request method failure captured: Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e HTTP/1.1 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xcJvQQFISI597RSJuyFP1NthMzq71a8yoSqdd8nmxLRuVtAA_w6F-vEW55U-oItvZUfe42DT9eaUKoiADi8aJ1eb2EesE26b71tggV6I8vkF8xiwdwhMmIK5mIUVAUbz0qNanXMcMX_92z3Ub2-6IFdL7wSVOtPxpLCVOCb71KMRec Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fce552776c99429188c4748ba0d096b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fce552776c99429188c4748ba0d096b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fce552776c99429188c4748ba0d096b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkBasicOps-988202124 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: fce552776c99429188c4748ba0d096b2 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkBasicOps-988202124 Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: e726730705b54d4985a7d4db46c2f4ff Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkBasicOps-988202124-project Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'b4e224cc-806f-4b33-8546-123f2c72397e'} Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:45:27.203158 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Returning 404 to user: Instance b4e224cc-806f-4b33-8546-123f2c72397e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c2a9917-c093-4b34-8037-780292755896 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e" status: 404 len: 111 microversion: 2.1 time: 0.030943 Jul 19 20:45:27.209044 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3296/6485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:27 2022] GET /compute/v2.1/servers/b4e224cc-806f-4b33-8546-123f2c72397e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:45:27.365686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aad9ec13-2771-4f65-a1a3-1c043b52a9b5 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] Calling method '.version_select at 0x7fb892f943a0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:27.386218 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aad9ec13-2771-4f65-a1a3-1c043b52a9b5 tempest-TestNetworkBasicOps-988202124 tempest-TestNetworkBasicOps-988202124-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2144657826" status: 202 len: 0 microversion: 2.1 time: 0.024419 Jul 19 20:45:27.386820 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3190/6486] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 20:45:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2144657826 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:45:42.240644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.242197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=16 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.424013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:42.424876 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:45:42.424876 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:45:42.426583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.427038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.427880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.428323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.462442 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ba8f775-d4ba-485b-95ee-1689ff6eb629 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.228450 Jul 19 20:45:42.463604 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3297/6487] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Jul 19 20:45:42 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:42.576919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-371034031", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "availability_zone": "nova:n-h1-843861-3", "networks": [{"uuid": "8392bee8-8145-491f-af55-8a3bb53bc5a9"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:42.592398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.593286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.656152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] validate_networks() for [('8392bee8-8145-491f-af55-8a3bb53bc5a9', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:45:43.049115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:45:43.050310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:45:43.051500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:45:43.051890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:45:43.052319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:45:43.065748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:43.066245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:43.067131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:43.067583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:43.093901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Getting quotas for project 53d3336158a34c44a3fefb1d3ca2304f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:45:43.101479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Getting quotas for user 616a6b96324242159bbac4e694e0fd31 and project 53d3336158a34c44a3fefb1d3ca2304f. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:45:43.116029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:45:43.118374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:45:43.167400 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f686168f-fd00-49e3-85f2-522ccfed5af8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594148 Jul 19 20:45:43.168287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3191/6488] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:45:43.178436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-398b7cfc-498d-4b7b-8b84-0322a1d0d584 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:43.179227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-398b7cfc-498d-4b7b-8b84-0322a1d0d584 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:43.251576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-398b7cfc-498d-4b7b-8b84-0322a1d0d584 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1328 microversion: 2.1 time: 0.077000 Jul 19 20:45:43.252421 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3298/6489] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:43 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1328 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:44.269259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:44.270057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:44.278052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:44.278849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:44.279643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:44.280280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:44.417002 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-823b653a-42ef-4bb1-be8b-628a1512cff4 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1423 microversion: 2.1 time: 0.150388 Jul 19 20:45:44.419502 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3192/6490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:44 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:45.435979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:45.437391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:45.447510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:45.448415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:45.451442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:45.452210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:45.694590 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69f9738c-e24e-41e2-8dfd-07655f0006f0 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.262393 Jul 19 20:45:45.696714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3299/6491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:45 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:45.868415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c2f968e8-f796-4fe7-ac8e-deeae945e2d4 req-e8846e87-a12e-4d9d-9fec-d77a049aee24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40ee774-4c5a-411e-b1bc-72b75a9e15e2", "tag": "766be5bf-cb88-4270-b9dc-f1b4f99038a0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:45.883170 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2f968e8-f796-4fe7-ac8e-deeae945e2d4 req-e8846e87-a12e-4d9d-9fec-d77a049aee24 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:45.884055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2f968e8-f796-4fe7-ac8e-deeae945e2d4 req-e8846e87-a12e-4d9d-9fec-d77a049aee24 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:45.908547 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c2f968e8-f796-4fe7-ac8e-deeae945e2d4 req-e8846e87-a12e-4d9d-9fec-d77a049aee24 service nova] Creating event network-changed:766be5bf-cb88-4270-b9dc-f1b4f99038a0 for instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 on n-h1-843861-3 Jul 19 20:45:45.915424 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c2f968e8-f796-4fe7-ac8e-deeae945e2d4 req-e8846e87-a12e-4d9d-9fec-d77a049aee24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056015 Jul 19 20:45:45.916216 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3193/6492] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:46.720108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:46.720735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:46.728267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:46.728721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:46.729498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:46.729938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:46.863608 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-09fefadf-bb0e-4058-b263-de589281ef22 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.147195 Jul 19 20:45:46.864702 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3300/6493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:46 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:47.881363 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:47.882074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:47.889426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:47.889881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:47.890658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:47.891101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:48.059854 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-924af6dd-02df-4bcb-896d-920c22044285 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.182607 Jul 19 20:45:48.060461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3194/6494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:47 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:49.077786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:49.078384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:49.085420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:49.085870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:49.086637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:49.087073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:49.224633 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-156bc419-8fb4-4112-b130-3b233fa97982 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.150420 Jul 19 20:45:49.224988 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3301/6495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:49 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:50.241813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:50.242968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:50.250312 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:50.250869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:50.251710 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:50.252251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:50.294998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6ace17f6-4b1f-4078-a37a-a8168c4565ef req-180cafa7-1274-4d68-be0d-47b28c680b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40ee774-4c5a-411e-b1bc-72b75a9e15e2", "name": "network-vif-plugged", "status": "completed", "tag": "766be5bf-cb88-4270-b9dc-f1b4f99038a0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:50.305952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6ace17f6-4b1f-4078-a37a-a8168c4565ef req-180cafa7-1274-4d68-be0d-47b28c680b19 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:50.306522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6ace17f6-4b1f-4078-a37a-a8168c4565ef req-180cafa7-1274-4d68-be0d-47b28c680b19 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:50.319274 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6ace17f6-4b1f-4078-a37a-a8168c4565ef req-180cafa7-1274-4d68-be0d-47b28c680b19 service nova] Creating event network-vif-plugged:766be5bf-cb88-4270-b9dc-f1b4f99038a0 for instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 on n-h1-843861-3 Jul 19 20:45:50.325009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6ace17f6-4b1f-4078-a37a-a8168c4565ef req-180cafa7-1274-4d68-be0d-47b28c680b19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Jul 19 20:45:50.326279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3302/6496] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:50.401358 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1762351-a99a-4380-b39e-24f624a6d232 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.164403 Jul 19 20:45:50.401966 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3195/6497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:50 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:51.419774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:51.420510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:51.426944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:51.427385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:51.428169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:51.428600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:51.572105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7d2a7af-8755-42d7-ad77-c7818400ccdf tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1463 microversion: 2.1 time: 0.157186 Jul 19 20:45:51.572683 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3303/6498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:51 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:52.588892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:52.589529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:52.596478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.596977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.597761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.598217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.724354 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-84bec8d4-08db-4fbe-b785-cdde69ab910c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1649 microversion: 2.1 time: 0.139073 Jul 19 20:45:52.724928 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3196/6499] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:52 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1649 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:52.740101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:52.740715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:52.743294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:52.748846 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.749292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.750104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.750487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.878205 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a4f0f85-f97d-40e3-9c9f-5c3052733122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1649 microversion: 2.1 time: 0.141685 Jul 19 20:45:52.878785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3304/6500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:52 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:52.895002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:52.895625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:52.902706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.903168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.903964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.904407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:53.032815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0265cee6-a3a3-44f8-8c79-15bef293f496 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1649 microversion: 2.1 time: 0.142007 Jul 19 20:45:53.033392 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3197/6501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:52 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:53.088682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1694303245", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "availability_zone": "nova:n-h2-843861-3", "networks": [{"uuid": "8392bee8-8145-491f-af55-8a3bb53bc5a9"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:53.147943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] validate_networks() for [('8392bee8-8145-491f-af55-8a3bb53bc5a9', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:45:53.246802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:53.640823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:45:53.641286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:45:53.641766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:45:53.642180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:45:53.642598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:45:53.652961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:53.653576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:53.654392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:53.654835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:53.676262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Getting quotas for project 53d3336158a34c44a3fefb1d3ca2304f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:45:53.682349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Getting quotas for user 616a6b96324242159bbac4e694e0fd31 and project 53d3336158a34c44a3fefb1d3ca2304f. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:45:53.696683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:45:53.699016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:45:53.744324 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [25cda6fe-cf40-445c-a60d-09f4b672ed50] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:45:54.753897 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [25cda6fe-cf40-445c-a60d-09f4b672ed50] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59884. Jul 19 20:45:54.758971 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2b9ddc13-5936-4692-b450-260e25152ab8 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.674003 Jul 19 20:45:54.762326 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3305/6502] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:45:54.773413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eae948b2-857a-488a-a3ed-67905c134a86 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:54.774160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eae948b2-857a-488a-a3ed-67905c134a86 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:54.776250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:54.776962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:54.863909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eae948b2-857a-488a-a3ed-67905c134a86 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1329 microversion: 2.1 time: 0.096001 Jul 19 20:45:54.864916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3198/6503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:54 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:55.883004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:55.883676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:55.891474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:55.892634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:55.893663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:55.895251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:56.008072 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fb3ecf1-701e-4a20-99ab-4d5b2c16796a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1424 microversion: 2.1 time: 0.128866 Jul 19 20:45:56.008707 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3306/6504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:55 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:57.028144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:57.028732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:57.037490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:57.037986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:57.038772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:57.039425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:57.310221 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e1a4aa7e-82ae-426b-a514-880fab7c6c27 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.286067 Jul 19 20:45:57.310830 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3199/6505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:57 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:57.689526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-137a1ab0-aef9-4320-aaea-0edc90b0bfaa req-9a887c5b-b162-4e10-a3e0-f0a1153bb5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d059ea1-392d-4004-88f4-b380aeb88539", "tag": "5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:57.700649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-137a1ab0-aef9-4320-aaea-0edc90b0bfaa req-9a887c5b-b162-4e10-a3e0-f0a1153bb5b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:57.701237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-137a1ab0-aef9-4320-aaea-0edc90b0bfaa req-9a887c5b-b162-4e10-a3e0-f0a1153bb5b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:57.722976 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-137a1ab0-aef9-4320-aaea-0edc90b0bfaa req-9a887c5b-b162-4e10-a3e0-f0a1153bb5b8 service nova] Creating event network-changed:5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e for instance 3d059ea1-392d-4004-88f4-b380aeb88539 on n-h2-843861-3 Jul 19 20:45:57.728931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-137a1ab0-aef9-4320-aaea-0edc90b0bfaa req-9a887c5b-b162-4e10-a3e0-f0a1153bb5b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044295 Jul 19 20:45:57.729553 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3307/6506] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:58.327531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:58.328194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:58.337247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:58.337715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:58.338503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:58.339001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:58.475180 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7aee97dc-59be-4d1d-87fd-12be6156d54a tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.151252 Jul 19 20:45:58.475841 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3200/6507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:58 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:59.494663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:59.495427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:59.502778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:59.503268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:59.504345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:59.504787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:59.637975 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ce8aac7a-ff45-455e-8da4-4877a71d69f7 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.148657 Jul 19 20:45:59.638565 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3308/6508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:59 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:00.655372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:00.656078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:00.664217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:00.664675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:00.665467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:00.665907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:00.882748 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9b8486d5-a19c-450e-820f-a8c9b8e2636e tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.231054 Jul 19 20:46:00.883529 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3201/6509] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:00 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:01.900710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:01.901357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:01.908431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:01.908879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:01.910203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:01.910637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:02.045852 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a803600d-4b84-411c-a958-e8d8f48a4fca tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.147906 Jul 19 20:46:02.046466 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3309/6510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:01 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:02.986180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c5d38eb3-bcc0-4cfe-9fab-7d3ee97c8d07 req-20ea529f-0a3f-42ef-8d19-2e9dd0d26a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d059ea1-392d-4004-88f4-b380aeb88539", "name": "network-vif-plugged", "status": "completed", "tag": "5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:02.996285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c5d38eb3-bcc0-4cfe-9fab-7d3ee97c8d07 req-20ea529f-0a3f-42ef-8d19-2e9dd0d26a2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:02.996603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c5d38eb3-bcc0-4cfe-9fab-7d3ee97c8d07 req-20ea529f-0a3f-42ef-8d19-2e9dd0d26a2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:03.009935 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c5d38eb3-bcc0-4cfe-9fab-7d3ee97c8d07 req-20ea529f-0a3f-42ef-8d19-2e9dd0d26a2a service nova] Creating event network-vif-plugged:5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e for instance 3d059ea1-392d-4004-88f4-b380aeb88539 on n-h2-843861-3 Jul 19 20:46:03.015323 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c5d38eb3-bcc0-4cfe-9fab-7d3ee97c8d07 req-20ea529f-0a3f-42ef-8d19-2e9dd0d26a2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Jul 19 20:46:03.016335 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3202/6511] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:03.065162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:03.066332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:03.073739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:03.074229 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:03.075104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:03.075540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:03.277181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be704dda-74c4-43b9-8fc2-c48ecc4b2720 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.215991 Jul 19 20:46:03.277765 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3310/6512] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:03 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:04.294943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:04.295656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:04.302800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:04.303262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:04.304069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:04.304517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:04.435110 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5eb3d34f-d191-40f3-9eef-4bd6e8e9c565 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1464 microversion: 2.1 time: 0.144314 Jul 19 20:46:04.435679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3203/6513] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:04 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:05.458964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:05.459509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:05.461900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:05.462576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:05.469369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.469820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.470587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.471292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.599780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e21052c0-173f-487a-a1cb-cb9f38a3d122 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1649 microversion: 2.1 time: 0.145179 Jul 19 20:46:05.600378 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3311/6514] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:05 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1649 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:05.615909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:05.616548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:05.618760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:05.625069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.625533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.626315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.626764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.763575 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91fce84f-1a18-4b3c-a7aa-c558b21b52a5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1649 microversion: 2.1 time: 0.151372 Jul 19 20:46:05.764188 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3204/6515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:05 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1649 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:05.779350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:05.780035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:05.786306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.786762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.787541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.788020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.916252 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7a47eb86-91ad-4e80-8d30-a9f9a0f66e18 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1649 microversion: 2.1 time: 0.140553 Jul 19 20:46:05.916838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3312/6516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:05 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1649 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:05.932855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:05.933356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:05.939379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.939862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.941262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.941708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.965588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:46:06.041673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f85704a-47b1-4f45-90b7-946eb0770758 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 204 len: 0 microversion: 2.1 time: 0.112067 Jul 19 20:46:06.042372 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3205/6517] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:46:05 2022] DELETE /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:46:06.051420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:06.052060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:06.058298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.058742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.059506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.059965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.191194 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74e8fd89-9e21-49aa-9a29-08dc6cb39179 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1655 microversion: 2.1 time: 0.144151 Jul 19 20:46:06.191776 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3313/6518] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:06 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:07.208988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:07.209622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:07.216900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:07.217375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:07.218178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:07.218631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:07.347658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7371c88d-1a86-4f56-ba36-0bf94bce6baa tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1655 microversion: 2.1 time: 0.142837 Jul 19 20:46:07.348283 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3206/6519] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:07 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1655 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:08.102904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9219a09a-0435-41ef-8882-473dcaf8020d req-fbb08b28-1c6a-4659-880e-5ce67dab2953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d059ea1-392d-4004-88f4-b380aeb88539", "name": "network-vif-deleted", "tag": "5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:08.119827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9219a09a-0435-41ef-8882-473dcaf8020d req-fbb08b28-1c6a-4659-880e-5ce67dab2953 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:08.120380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9219a09a-0435-41ef-8882-473dcaf8020d req-fbb08b28-1c6a-4659-880e-5ce67dab2953 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:08.141150 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9219a09a-0435-41ef-8882-473dcaf8020d req-fbb08b28-1c6a-4659-880e-5ce67dab2953 service nova] Creating event network-vif-deleted:5fb3a15a-b8a4-42d3-9ddb-fb80fea60d9e for instance 3d059ea1-392d-4004-88f4-b380aeb88539 on n-h2-843861-3 Jul 19 20:46:08.149397 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9219a09a-0435-41ef-8882-473dcaf8020d req-fbb08b28-1c6a-4659-880e-5ce67dab2953 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053778 Jul 19 20:46:08.150662 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3314/6520] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:08.365261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:08.365923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:08.372938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:08.373406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:08.374231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:08.374686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:08.410148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:08.410630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:08.411078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lazy-loading 'fault' on Instance uuid 3d059ea1-392d-4004-88f4-b380aeb88539 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:46:08.459223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-614dac6c-7c2d-4eff-9d44-bf9f6240fcd5 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 200 len: 1454 microversion: 2.1 time: 0.098276 Jul 19 20:46:08.459825 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3207/6521] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:08 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:09.478243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:09.479058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: 3d059ea1-392d-4004-88f4-b380aeb88539] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:09.486519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.486975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.487764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.488233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.502924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] HTTP exception thrown: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Request method failure captured: Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 HTTP/1.1 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xf2UqJTc5TT3DKAc-WeWmSu7ft3inILThYCN0ZN8x81bmTwfsbsxi4RpPAtZfMo-ivt6caicOkO8VvrgCj5qYXIT2JkxmByQySgMu1IAoaYo-rG-vE0Bz5_4LnrWWD_JBnCSyxZGQu-AZjV7e_Ur2qTypql0LzXCh4zf7cS4t5f6N4 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 53d3336158a34c44a3fefb1d3ca2304f Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestServerMultinode-1179306285 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestServerMultinode-1179306285 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 53d3336158a34c44a3fefb1d3ca2304f Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestServerMultinode-1179306285 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestServerMultinode-1179306285-project-admin Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 616a6b96324242159bbac4e694e0fd31 Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestServerMultinode-1179306285-project-admin Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3d059ea1-392d-4004-88f4-b380aeb88539'} Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:09.504975 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Returning 404 to user: Instance 3d059ea1-392d-4004-88f4-b380aeb88539 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf05771c-1595-4f37-8a31-e8782176996d tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539" status: 404 len: 111 microversion: 2.1 time: 0.032542 Jul 19 20:46:09.512108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3315/6522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:09 2022] GET /compute/v2.1/servers/3d059ea1-392d-4004-88f4-b380aeb88539 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:46:09.515127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:09.515643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:09.523396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.523702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.524699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.525154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.544098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:09.553048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:46:09.661785 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1f3d92b3-b022-4074-a3b7-0714b216c61c tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 204 len: 0 microversion: 2.1 time: 0.149969 Jul 19 20:46:09.663312 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3208/6523] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:46:09 2022] DELETE /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:46:09.670577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:09.671472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:09.677766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.678861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.679696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.680195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.813652 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9c249de-77a9-4723-8915-f4bb518ecbe3 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1655 microversion: 2.1 time: 0.146754 Jul 19 20:46:09.814230 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3316/6524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:09 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:10.832635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:10.833354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:10.840317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:10.840776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:10.841548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:10.841999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:10.974679 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fb90d4b-63fc-4c52-b742-6346db689f48 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1655 microversion: 2.1 time: 0.146746 Jul 19 20:46:10.975271 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3209/6525] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:10 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:11.853280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-008afc59-6fe3-4d04-8604-8e0ab00deada req-4407ca58-fc86-439a-80d4-7b1db82290f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40ee774-4c5a-411e-b1bc-72b75a9e15e2", "name": "network-vif-deleted", "tag": "766be5bf-cb88-4270-b9dc-f1b4f99038a0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:11.869388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-008afc59-6fe3-4d04-8604-8e0ab00deada req-4407ca58-fc86-439a-80d4-7b1db82290f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:11.869933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-008afc59-6fe3-4d04-8604-8e0ab00deada req-4407ca58-fc86-439a-80d4-7b1db82290f4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:11.885786 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-008afc59-6fe3-4d04-8604-8e0ab00deada req-4407ca58-fc86-439a-80d4-7b1db82290f4 service nova] Creating event network-vif-deleted:766be5bf-cb88-4270-b9dc-f1b4f99038a0 for instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 on n-h1-843861-3 Jul 19 20:46:11.892260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-008afc59-6fe3-4d04-8604-8e0ab00deada req-4407ca58-fc86-439a-80d4-7b1db82290f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043766 Jul 19 20:46:11.893372 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3317/6526] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:11.993321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:11.994110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:12.001753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.002529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.004622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.006664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.049397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.050490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.050948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lazy-loading 'fault' on Instance uuid a40ee774-4c5a-411e-b1bc-72b75a9e15e2 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:46:12.101863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-286706de-adc5-4f0d-a816-702654c2f255 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 200 len: 1453 microversion: 2.1 time: 0.112778 Jul 19 20:46:12.102443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3210/6527] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:11 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:13.119534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:13.120201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] [instance: a40ee774-4c5a-411e-b1bc-72b75a9e15e2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:13.123167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:13.130496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:13.130962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:13.131751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:13.132336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:13.137264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=93 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:13.148281 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] HTTP exception thrown: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Request method failure captured: Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 HTTP/1.1 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xf2UqJTc5TT3DKAc-WeWmSu7ft3inILThYCN0ZN8x81bmTwfsbsxi4RpPAtZfMo-ivt6caicOkO8VvrgCj5qYXIT2JkxmByQySgMu1IAoaYo-rG-vE0Bz5_4LnrWWD_JBnCSyxZGQu-AZjV7e_Ur2qTypql0LzXCh4zf7cS4t5f6N4 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 53d3336158a34c44a3fefb1d3ca2304f Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestServerMultinode-1179306285 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d3336158a34c44a3fefb1d3ca2304f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestServerMultinode-1179306285 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 53d3336158a34c44a3fefb1d3ca2304f Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestServerMultinode-1179306285 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestServerMultinode-1179306285-project-admin Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 616a6b96324242159bbac4e694e0fd31 Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestServerMultinode-1179306285-project-admin Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a40ee774-4c5a-411e-b1bc-72b75a9e15e2'} Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:13.149878 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] Returning 404 to user: Instance a40ee774-4c5a-411e-b1bc-72b75a9e15e2 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b2ccad6-83c2-4b9a-b79b-c88b698ab994 tempest-TestServerMultinode-1179306285 tempest-TestServerMultinode-1179306285-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2" status: 404 len: 111 microversion: 2.1 time: 0.036374 Jul 19 20:46:13.153629 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3318/6528] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:13 2022] GET /compute/v2.1/servers/a40ee774-4c5a-411e-b1bc-72b75a9e15e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:46:31.611263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:31.612665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:31.728366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2053820414", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:31.778680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] validate_networks() for None {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:46:31.987297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:46:31.987731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:46:31.988246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:46:31.988696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:46:31.989124 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:46:31.999117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:31.999577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:32.000455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:32.000905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:32.019698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Getting quotas for project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:32.028076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Getting quotas for user 6564da8d3bfd4bcbabfcfddc9a6c8aca and project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:32.040834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:46:32.043120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:46:32.087859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-82416a7d-0a36-4617-93d9-bf36f2a312c6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482028 Jul 19 20:46:32.088435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3211/6529] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:46:32.100446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ede0a430-b27e-4354-a6d0-b37a746136fb tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:32.101162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ede0a430-b27e-4354-a6d0-b37a746136fb tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:32.103725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:32.104463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:32.162674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ede0a430-b27e-4354-a6d0-b37a746136fb tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:32.170506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ede0a430-b27e-4354-a6d0-b37a746136fb tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1222 microversion: 2.1 time: 0.075272 Jul 19 20:46:32.171533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3319/6530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:32 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:33.190141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:33.190777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:33.197979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:33.198693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:33.199657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:33.200278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:33.277196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:33.286425 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cecf232c-6172-433b-851f-2df4632dfd40 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1292 microversion: 2.1 time: 0.101970 Jul 19 20:46:33.287030 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3212/6531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:33 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:34.305351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:34.306153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:34.315778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:34.315778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:34.316374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:34.316809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:34.524988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:34.533083 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-399a01c8-cf8e-4534-b683-97667a17be00 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.232067 Jul 19 20:46:34.534197 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3320/6532] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:34 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:34.812806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7cf93bf9-6b81-41bd-8dca-6d4b98f861ec req-cc5d8a10-f54c-4fec-964b-909de12a484c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "610aaa31-a576-439f-b8b0-3f4ed548c6f5", "tag": "d594746f-42fa-440d-8d63-e98d85e5816b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:34.824927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7cf93bf9-6b81-41bd-8dca-6d4b98f861ec req-cc5d8a10-f54c-4fec-964b-909de12a484c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:34.825643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7cf93bf9-6b81-41bd-8dca-6d4b98f861ec req-cc5d8a10-f54c-4fec-964b-909de12a484c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:34.838133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7cf93bf9-6b81-41bd-8dca-6d4b98f861ec req-cc5d8a10-f54c-4fec-964b-909de12a484c service nova] Creating event network-changed:d594746f-42fa-440d-8d63-e98d85e5816b for instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 on n-h2-843861-3 Jul 19 20:46:34.843338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7cf93bf9-6b81-41bd-8dca-6d4b98f861ec req-cc5d8a10-f54c-4fec-964b-909de12a484c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037160 Jul 19 20:46:34.843980 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3213/6533] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:35.551314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:35.551874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:35.559057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:35.559512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:35.560323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:35.560767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:35.699273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:35.707379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a9330a70-8b56-4e7c-be5b-789c4349b930 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.160688 Jul 19 20:46:35.708002 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3321/6534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:35 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:36.726651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:36.727369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:36.733771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:36.734239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:36.735022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:36.735475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:36.876029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:36.884515 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5761e691-3c48-4678-9cbd-b504e33b9ce5 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.162945 Jul 19 20:46:36.885126 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3214/6535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:36 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:37.901373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:37.902024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:37.909334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:37.909792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:37.910576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:37.911019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:38.053931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:38.061510 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dae1bef6-7aa8-464d-9461-6ee5b7f33a17 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.164079 Jul 19 20:46:38.062021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3322/6536] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:37 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:39.078927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:39.079569 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:39.087223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:39.087777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:39.088596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:39.089054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:39.229754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:39.237507 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ec09327-8b64-4692-9401-306e7b3d4bcc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.162719 Jul 19 20:46:39.238092 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3215/6537] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:39 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:40.255369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:40.256015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:40.262951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:40.263398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:40.264185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:40.264618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:40.401479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:40.409113 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d52ac27a-0487-49a1-be73-63faa1c39488 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.158555 Jul 19 20:46:40.409699 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3323/6538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:40 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:41.100442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6897911f-83f2-44d4-88c9-465e0d5e8ba0 req-56ea079b-39f9-4e43-92b6-c23e240bb6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610aaa31-a576-439f-b8b0-3f4ed548c6f5", "name": "network-vif-plugged", "status": "completed", "tag": "d594746f-42fa-440d-8d63-e98d85e5816b"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:41.110203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6897911f-83f2-44d4-88c9-465e0d5e8ba0 req-56ea079b-39f9-4e43-92b6-c23e240bb6bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:41.110687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6897911f-83f2-44d4-88c9-465e0d5e8ba0 req-56ea079b-39f9-4e43-92b6-c23e240bb6bb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:41.122009 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6897911f-83f2-44d4-88c9-465e0d5e8ba0 req-56ea079b-39f9-4e43-92b6-c23e240bb6bb service nova] Creating event network-vif-plugged:d594746f-42fa-440d-8d63-e98d85e5816b for instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 on n-h2-843861-3 Jul 19 20:46:41.126961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6897911f-83f2-44d4-88c9-465e0d5e8ba0 req-56ea079b-39f9-4e43-92b6-c23e240bb6bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030924 Jul 19 20:46:41.127568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3216/6539] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:41.428272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:41.428796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:41.435922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:41.436376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:41.437144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:41.437581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:41.573048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:41.580748 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f5c1fd9-e0c5-44e1-9aeb-f00b203709d6 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.157104 Jul 19 20:46:41.581366 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3324/6540] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:41 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:42.594213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:42.595010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:42.599914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:42.600636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:42.607820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:42.608289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:42.609064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:42.609515 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:42.759163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:42.767934 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ac37c21-d4f4-4657-8015-e69c38386ddc tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1322 microversion: 2.1 time: 0.174487 Jul 19 20:46:42.768676 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3217/6541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:42 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:43.786834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:43.787723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:43.789749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:43.796909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:43.797367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:43.798156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:43.799200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:43.934927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:43.943337 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a330c963-ad36-4cd2-bbcb-cdc6b7bfd434 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1472 microversion: 2.1 time: 0.160905 Jul 19 20:46:43.943959 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3325/6542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:43 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:44.010945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b486197-96cf-4665-b86b-f1aadfffeedc tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '.version_select at 0x7fb88dc67a60>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.074897 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b486197-96cf-4665-b86b-f1aadfffeedc tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/73cee2bde81f48199f5b8e174eb90def" status: 200 len: 371 microversion: 2.1 time: 0.116312 Jul 19 20:46:44.075487 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3218/6543] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 20:46:43 2022] GET /compute/v2.1/os-quota-sets/73cee2bde81f48199f5b8e174eb90def => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:44.086077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a90d0583-17f6-471c-a72f-0977780b3c2b tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1129237155", "id": 942373548, "os-flavor-access:is_public": "True"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:44.087720 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:44.087720 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:46:44.102915 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a90d0583-17f6-471c-a72f-0977780b3c2b tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020624 Jul 19 20:46:44.103529 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3326/6544] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:46:44 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:44.114813 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "942373548"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:44.116009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:44.122484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.122939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.123712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.124199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.209533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5d6712e2f1cc44408a50f127e43c78bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cee2bde81f48199f5b8e174eb90def', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:44.216448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1129237155 {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:46:44.224045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.224197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.224998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.225437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.246632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Getting quotas for project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:44.252547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Getting quotas for user 6564da8d3bfd4bcbabfcfddc9a6c8aca and project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:44.266241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] ram quota exceeded for 73cee2bde81f48199f5b8e174eb90def, tried to resize instance. Jul 19 20:46:44.266783 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Request method failure captured: Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action HTTP/1.1 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 38 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xgnrP_TRarNw2a6fU57PwHmQk33AmJqvAEZvzsF_zKsUuvW34vuOhefOOu6jp6aODj2hAvg-jaX1CaXclSNqoyQ_fPKsMrWv-DH-E2SsZj9Ce2YT8eUuKwhhewZwSfZDtRekyMCivaQHusq8w9I5-zW4kajHhaoQYmAezERwI9ZzSE Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 73cee2bde81f48199f5b8e174eb90def Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member,admin Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member,admin Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 73cee2bde81f48199f5b8e174eb90def Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersAdminNegativeTestJSON-635581483-project-admin Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5d6712e2f1cc44408a50f127e43c78bd Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-635581483-project-admin Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: {"resize": {"flavorRef": "942373548"}} Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '610aaa31-a576-439f-b8b0-3f4ed548c6f5', 'body': {'resize': {'flavorRef': '942373548'}}} Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.268996 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2aa29d2c-09d9-4ecc-ad46-5e83e13f1863 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action" status: 403 len: 118 microversion: 2.1 time: 0.160043 Jul 19 20:46:44.273130 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3219/6545] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:46:44 2022] POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action => generated 118 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:46:44.281845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2299861d-7a3e-4759-9f0c-708ac4fa4bbb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.282605 n-d-843861-3 devstack@n-api.service[126008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:44.282605 n-d-843861-3 devstack@n-api.service[126008]: warnings.warn(msg) Jul 19 20:46:44.300056 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2299861d-7a3e-4759-9f0c-708ac4fa4bbb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/942373548" status: 202 len: 0 microversion: 2.1 time: 0.021957 Jul 19 20:46:44.300644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3327/6546] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 20:46:44 2022] DELETE /compute/v2.1/flavors/942373548 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:46:44.308614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa192121-dde4-4c2f-8c55-289469fd6fef tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.331965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa192121-dde4-4c2f-8c55-289469fd6fef tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026982 Jul 19 20:46:44.332549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3220/6547] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:46:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:44.349453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-85830d07-58b7-4922-ac26-4c6dfe70fafb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '.version_select at 0x7fb88cc8b820>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.422333 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-85830d07-58b7-4922-ac26-4c6dfe70fafb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/73cee2bde81f48199f5b8e174eb90def" status: 200 len: 371 microversion: 2.1 time: 0.076713 Jul 19 20:46:44.422929 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3328/6548] 10.222.0.33 () {58 vars in 1241 bytes} [Tue Jul 19 20:46:44 2022] GET /compute/v2.1/os-quota-sets/73cee2bde81f48199f5b8e174eb90def => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:44.433310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bcf3661-5e0f-44da-9b4a-0c1d4d0ab0ea tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-689786706", "id": 111231174, "os-flavor-access:is_public": "True"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:44.434987 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:44.434987 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:46:44.450733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bcf3661-5e0f-44da-9b4a-0c1d4d0ab0ea tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021206 Jul 19 20:46:44.451322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3221/6549] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:46:44 2022] POST /compute/v2.1/flavors => generated 433 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:44.463080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "111231174"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:44.464076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:44.470265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.470765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.471533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.472076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.556661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5d6712e2f1cc44408a50f127e43c78bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cee2bde81f48199f5b8e174eb90def', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:44.563244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-689786706 {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:46:44.570189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.570632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.571422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.571876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.596059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Getting quotas for project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:44.601101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Getting quotas for user 6564da8d3bfd4bcbabfcfddc9a6c8aca and project 410604e9836643e2b999f54b66fbc6fd. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:44.613146 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.compute.api [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] cores quota exceeded for 73cee2bde81f48199f5b8e174eb90def, tried to resize instance. Jul 19 20:46:44.613677 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Request method failure captured: Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action HTTP/1.1 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 38 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xgnrP_TRarNw2a6fU57PwHmQk33AmJqvAEZvzsF_zKsUuvW34vuOhefOOu6jp6aODj2hAvg-jaX1CaXclSNqoyQ_fPKsMrWv-DH-E2SsZj9Ce2YT8eUuKwhhewZwSfZDtRekyMCivaQHusq8w9I5-zW4kajHhaoQYmAezERwI9ZzSE Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 73cee2bde81f48199f5b8e174eb90def Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member,admin Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member,admin Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73cee2bde81f48199f5b8e174eb90def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 73cee2bde81f48199f5b8e174eb90def Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-635581483 Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminNegativeTestJSON-635581483-project-admin Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5d6712e2f1cc44408a50f127e43c78bd Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminNegativeTestJSON-635581483-project-admin Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: {"resize": {"flavorRef": "111231174"}} Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '610aaa31-a576-439f-b8b0-3f4ed548c6f5', 'body': {'resize': {'flavorRef': '111231174'}}} Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.615639 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c94e05c-1957-4e61-bfba-84f3995841bb tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action" status: 403 len: 113 microversion: 2.1 time: 0.157962 Jul 19 20:46:44.619486 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3329/6550] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:46:44 2022] POST /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:46:44.626586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1452108d-a9a5-4d5e-a1ff-9f6392330cf0 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.627882 n-d-843861-3 devstack@n-api.service[126007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:44.627882 n-d-843861-3 devstack@n-api.service[126007]: warnings.warn(msg) Jul 19 20:46:44.648113 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1452108d-a9a5-4d5e-a1ff-9f6392330cf0 tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/111231174" status: 202 len: 0 microversion: 2.1 time: 0.025093 Jul 19 20:46:44.648728 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3222/6551] 10.222.0.33 () {58 vars in 1157 bytes} [Tue Jul 19 20:46:44 2022] DELETE /compute/v2.1/flavors/111231174 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:46:44.656989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc09eef4-4ec1-4490-9d66-f894fb74048c tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.679695 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc09eef4-4ec1-4490-9d66-f894fb74048c tempest-ServersAdminNegativeTestJSON-635581483 tempest-ServersAdminNegativeTestJSON-635581483-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026297 Jul 19 20:46:44.680325 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3330/6552] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Jul 19 20:46:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:44.697602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.698107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:44.704235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.704698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.705466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.705913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.731027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:46:44.811245 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a1abb03-baa9-455a-a7ce-6439bce7b85a tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "DELETE /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 204 len: 0 microversion: 2.1 time: 0.117146 Jul 19 20:46:44.811821 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3223/6553] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:46:44 2022] DELETE /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:46:44.820142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:44.820752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:44.827863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.828326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.829083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:44.829511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:44.963399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:44.972043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-68c131b1-9a9c-4ca1-87f2-9a3fea34d81c tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1478 microversion: 2.1 time: 0.155859 Jul 19 20:46:44.972641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3331/6554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:44 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:45.990179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:45.991172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:45.998439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:45.998902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:45.999679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:46.000163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:46.139029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:46.147588 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1cfda324-1153-457c-aeff-1a0a3fd6d031 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1478 microversion: 2.1 time: 0.161739 Jul 19 20:46:46.148342 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3224/6555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:45 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:46.837274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-bff22427-77da-471b-95a8-dbec4b5e8e14 req-63152799-a2ef-4ee0-a483-49fd30dceeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610aaa31-a576-439f-b8b0-3f4ed548c6f5", "name": "network-vif-deleted", "tag": "d594746f-42fa-440d-8d63-e98d85e5816b"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:46.847449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bff22427-77da-471b-95a8-dbec4b5e8e14 req-63152799-a2ef-4ee0-a483-49fd30dceeb9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:46.848123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bff22427-77da-471b-95a8-dbec4b5e8e14 req-63152799-a2ef-4ee0-a483-49fd30dceeb9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:46.862379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-bff22427-77da-471b-95a8-dbec4b5e8e14 req-63152799-a2ef-4ee0-a483-49fd30dceeb9 service nova] Creating event network-vif-deleted:d594746f-42fa-440d-8d63-e98d85e5816b for instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 on n-h2-843861-3 Jul 19 20:46:46.874673 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-bff22427-77da-471b-95a8-dbec4b5e8e14 req-63152799-a2ef-4ee0-a483-49fd30dceeb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041415 Jul 19 20:46:46.875909 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3332/6556] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:47.165355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:47.165987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:47.173149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:47.173622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:47.174417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:47.174871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:47.206942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:47.207405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:47.207892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lazy-loading 'fault' on Instance uuid 610aaa31-a576-439f-b8b0-3f4ed548c6f5 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:46:47.249050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6564da8d3bfd4bcbabfcfddc9a6c8aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410604e9836643e2b999f54b66fbc6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:47.257590 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa4b4eb2-4d0b-4d4a-bf11-699200707318 tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 200 len: 1312 microversion: 2.1 time: 0.096186 Jul 19 20:46:47.258197 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3225/6557] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:47 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:48.276046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:48.276748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] [instance: 610aaa31-a576-439f-b8b0-3f4ed548c6f5] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:48.283647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:48.284123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:48.284895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:48.285329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:48.299519 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] HTTP exception thrown: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Request method failure captured: Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 HTTP/1.1 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xgmQkKxK9j5LukW5lEKA90a_sbMl82oSpkLc4bwqSS57tZq1C_dYTz2v0jymG0fhYTlHrXYvbk6b4SottPT1pX2HbBtDKGdg1J6YxoRAwk3VxE2MTLO1uczrG7aDx8dHSTmGoajI_ChPFqIFZyUzi2rT1lVzKO2AkNN6hSdAcRMLDw Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 410604e9836643e2b999f54b66fbc6fd Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1108633611 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/410604e9836643e2b999f54b66fbc6fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/410604e9836643e2b999f54b66fbc6fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/410604e9836643e2b999f54b66fbc6fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_410604e9836643e2b999f54b66fbc6fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1108633611 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 410604e9836643e2b999f54b66fbc6fd Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1108633611 Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersAdminNegativeTestJSON-1108633611-project Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 6564da8d3bfd4bcbabfcfddc9a6c8aca Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1108633611-project Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '610aaa31-a576-439f-b8b0-3f4ed548c6f5'} Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:48.301214 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] Returning 404 to user: Instance 610aaa31-a576-439f-b8b0-3f4ed548c6f5 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-350c0d62-4e77-4020-bf2c-59ed6e872dac tempest-ServersAdminNegativeTestJSON-1108633611 tempest-ServersAdminNegativeTestJSON-1108633611-project] 10.222.0.33 "GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5" status: 404 len: 111 microversion: 2.1 time: 0.031790 Jul 19 20:46:48.304752 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3333/6558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:48 2022] GET /compute/v2.1/servers/610aaa31-a576-439f-b8b0-3f4ed548c6f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:46:54.644602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:54.646585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:54.773304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1869992220", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "6e6927ee-999e-4a05-b17a-a66f263117e1"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:54.837106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] validate_networks() for [('6e6927ee-999e-4a05-b17a-a66f263117e1', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:46:55.242368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:46:55.242800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:46:55.243281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:46:55.243723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:46:55.244184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:46:55.254720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:55.255175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:55.256101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:55.256501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:55.275656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Getting quotas for project 44e79c8f14e147eb8bdfb68f0531e27d. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:55.282164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Getting quotas for user 8bbec20df8354e7286fc4c04c1d3dc5e and project 44e79c8f14e147eb8bdfb68f0531e27d. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:55.295415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:46:55.297758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:46:55.345386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb57cdb0-487d-4a9f-863f-b04f09705f22 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707699 Jul 19 20:46:55.346375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3226/6559] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:46:55.356243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c9b5257-632c-4dc2-9509-a419cc8a357c tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:55.357437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c9b5257-632c-4dc2-9509-a419cc8a357c tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:55.364899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:55.365701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:55.423620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c9b5257-632c-4dc2-9509-a419cc8a357c tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:55.430917 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c9b5257-632c-4dc2-9509-a419cc8a357c tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1215 microversion: 2.1 time: 0.078635 Jul 19 20:46:55.432088 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3334/6560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:55 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:56.449098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:56.450725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:56.458991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:56.459721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:56.460748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:56.461383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:56.558237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:56.574799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-13d5f8b3-34f5-4e67-9bca-efb76bf04ea8 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1267 microversion: 2.1 time: 0.128160 Jul 19 20:46:56.576728 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3227/6561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:56 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:57.597731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:57.598367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:57.611634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:57.612461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:57.613742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:57.614382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:57.853663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:57.863171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2455f95-7561-4c2c-8d93-0b6c548910dc tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.270993 Jul 19 20:46:57.863869 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3335/6562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:57 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:58.509581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-15cb7270-033e-4199-8c37-e6bd3047eb23 req-215ed963-e123-49bd-9ec2-02e59f993cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:58.527168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15cb7270-033e-4199-8c37-e6bd3047eb23 req-215ed963-e123-49bd-9ec2-02e59f993cb6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:58.527636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-15cb7270-033e-4199-8c37-e6bd3047eb23 req-215ed963-e123-49bd-9ec2-02e59f993cb6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:58.552461 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-15cb7270-033e-4199-8c37-e6bd3047eb23 req-215ed963-e123-49bd-9ec2-02e59f993cb6 service nova] Creating event network-changed:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h2-843861-3 Jul 19 20:46:58.566780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-15cb7270-033e-4199-8c37-e6bd3047eb23 req-215ed963-e123-49bd-9ec2-02e59f993cb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060915 Jul 19 20:46:58.567419 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3228/6563] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:58.881501 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:58.882121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:58.889690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:58.890564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:58.891568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:58.892680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:59.086350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:59.095192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8f0e46d1-e166-41f7-a4ba-dbd40c8de75d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.217784 Jul 19 20:46:59.095799 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3336/6564] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:58 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:00.116920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:00.117666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:00.124143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:00.124607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:00.125375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:00.125815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:00.273961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:00.281629 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8b39114a-2dcb-4416-9408-5a8b4354fc58 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.172624 Jul 19 20:47:00.285135 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3229/6565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:00 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:01.301357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:01.303721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:01.309650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:01.310117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:01.310911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:01.311355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:01.537537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:01.545394 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c24ab52-5b40-4b09-a605-e8b626a5c309 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.250404 Jul 19 20:47:01.545989 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3337/6566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:01 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:02.563977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:02.564637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:02.567408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:02.573180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:02.573652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:02.574448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:02.574896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:02.578590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:02.715197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:02.723676 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3a6e8ee-8418-4ce6-9acb-026781ebba79 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.163680 Jul 19 20:47:02.724306 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3230/6567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:02 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:03.243346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a06e1767-8357-4f55-a1e9-41e03f6852e0 req-4a38d053-3d84-483c-95bd-5d4d5220be03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "name": "network-vif-plugged", "status": "completed", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:03.247788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:03.255360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a06e1767-8357-4f55-a1e9-41e03f6852e0 req-4a38d053-3d84-483c-95bd-5d4d5220be03 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:03.255967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a06e1767-8357-4f55-a1e9-41e03f6852e0 req-4a38d053-3d84-483c-95bd-5d4d5220be03 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:03.261290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=78 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:03.270644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a06e1767-8357-4f55-a1e9-41e03f6852e0 req-4a38d053-3d84-483c-95bd-5d4d5220be03 service nova] Creating event network-vif-plugged:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h2-843861-3 Jul 19 20:47:03.276185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a06e1767-8357-4f55-a1e9-41e03f6852e0 req-4a38d053-3d84-483c-95bd-5d4d5220be03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 Jul 19 20:47:03.276806 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3338/6568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:03.741367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:03.741894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:03.749060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:03.749525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:03.750316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:03.750765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:03.889191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:03.897394 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-076bccde-1538-41d0-bc94-43809b6cb1b3 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1315 microversion: 2.1 time: 0.160121 Jul 19 20:47:03.897983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3231/6569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:03 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:04.917970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:04.918651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:04.925811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:04.926257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:04.927028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:04.927467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:05.068788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:05.076655 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4741a50c-1499-4607-80d7-ad25fa5fead4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1501 microversion: 2.1 time: 0.164428 Jul 19 20:47:05.077445 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3339/6570] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:04 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:05.093500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:05.094486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:05.101468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:05.101924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:05.102702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:05.103145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:05.132238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:05.138131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Old instance type m1.heat2, new instance type m1.heat {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:47:05.144396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:47:05.144832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:47:05.145313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:47:05.145729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:47:05.146349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:47:05.209366 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eb7936e5-5b58-4134-ab72-fc80b7f223dd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "POST /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8/action" status: 202 len: 0 microversion: 2.1 time: 0.119678 Jul 19 20:47:05.210240 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3232/6571] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:47:05 2022] POST /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:47:05.221784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:05.221784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:05.226091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:05.226601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:05.227403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:05.227907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:05.400232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:05.408831 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9f8ffca8-3018-468f-b6a1-ef7c1f61931a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1510 microversion: 2.1 time: 0.194097 Jul 19 20:47:05.409435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3340/6572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:05 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:06.427006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:06.427561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:06.429546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:06.430225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:06.437242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:06.437711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:06.438547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:06.439509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:06.575116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:06.582792 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a37f641-4a85-4c88-9279-0d8ef5ae4a47 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1510 microversion: 2.1 time: 0.160403 Jul 19 20:47:06.583373 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3233/6573] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:06 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:07.600746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:07.601365 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:07.603330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.609716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.610165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.611514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.611975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.748944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:07.756877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-37cd76a4-df5e-4b5f-8cde-010431095f76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.160328 Jul 19 20:47:07.757460 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3341/6574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:07 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:08.774946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:08.775571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:08.782275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:08.782735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:08.783540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:08.784126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:08.923783 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:08.931965 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a48f4d4b-f95c-43a8-8ac9-1b1391ce0f2f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.161133 Jul 19 20:47:08.932562 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3234/6575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:08 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:09.950276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:09.950823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:09.958357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:09.958804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:09.959587 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:09.960052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:10.094739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:10.102645 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bc13b751-a270-4406-a8f6-2503f4f81468 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.156444 Jul 19 20:47:10.103223 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3342/6576] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:09 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:11.119657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:11.120303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:11.127184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:11.127639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:11.128513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:11.129244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:11.259636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:11.267667 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e722667c-00ea-4572-8c90-06bb4b466d12 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.151824 Jul 19 20:47:11.268273 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3235/6577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:11 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:12.284326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:12.285789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:12.292084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:12.292567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:12.293333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:12.293796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:12.443674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:12.451982 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9e048e3-b6cc-4d09-a8f5-65e49c806a00 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.171475 Jul 19 20:47:12.452584 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3343/6578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:12 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:13.469324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:13.470978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:13.478173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:13.478586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:13.479370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:13.479841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:13.613067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:13.620763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf289b74-5f21-4baa-8018-5a04c4a6e773 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.155481 Jul 19 20:47:13.621324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3236/6579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:13 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:14.638630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:14.639283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:14.646812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:14.647269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:14.648086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:14.648532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:14.784339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:14.792715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be6fb9a1-00af-431e-8e2a-00eb2302e14b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.158058 Jul 19 20:47:14.793300 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3344/6580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:14 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:15.809833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:15.810459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:15.819255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:15.819726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:15.820544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:15.820994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:15.955379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:15.962975 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2c6a9e78-92e2-42fa-9572-0276f5c29642 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.157151 Jul 19 20:47:15.963567 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3237/6581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:15 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:16.980110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:16.980722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:16.988412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:16.988743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:16.989506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:16.989938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:17.136076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:17.143633 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd97fe21-ff8d-470e-920c-1efcadadaa60 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.167470 Jul 19 20:47:17.144276 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3345/6582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:16 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:18.161184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:18.161847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:18.168947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:18.169416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:18.170199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:18.170651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:18.306344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:18.314157 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9a91070-a097-4ba0-ae18-97c5aa6d2b76 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.157434 Jul 19 20:47:18.314741 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3238/6583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:18 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:18.443215 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:47:18.443749 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:47:19.331317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:19.332010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:19.339322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:19.339781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:19.340585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:19.341027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:19.473007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:19.480779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42bfb846-399e-4028-a979-3b856e9e0bb4 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.153862 Jul 19 20:47:19.481289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3346/6584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:19 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:20.497598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:20.498202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:20.506381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.506828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.507613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.508086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.652609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:20.661396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b415940-cd37-46c5-9be7-243a3c479b56 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.167819 Jul 19 20:47:20.662227 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3239/6585] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:20 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:21.678116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:21.678739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:21.685915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:21.686396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:21.687157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:21.687588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:21.818560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:21.826063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eeebae72-8e16-4c4b-aa46-6170358e601b tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.151905 Jul 19 20:47:21.826633 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3347/6586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:21 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:22.844751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:22.845427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:22.852864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:22.853342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:22.854133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:22.854583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:22.997505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:23.005583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ac94fa07-9d42-43c0-8a99-1af3654f244d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.165514 Jul 19 20:47:23.006176 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3240/6587] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:22 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:24.023504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.024150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:24.030775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:24.031250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:24.032641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:24.033083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:24.164647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:24.172237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-235ed0c4-f376-42e4-91f8-23abaa76686d tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.152902 Jul 19 20:47:24.172893 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3348/6588] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:24 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:25.190668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:25.191197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:25.198244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:25.198711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:25.199498 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:25.199981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:25.340800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:25.349075 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6d63a31-1502-4aa3-b2e0-e8d366f88b04 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.162951 Jul 19 20:47:25.349661 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3241/6589] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:25 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:26.366975 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.367585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:26.375062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:26.375518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:26.376484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:26.376969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:26.518091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:26.525651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-addf9958-12e5-4408-a46b-2ed732daf85e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.162757 Jul 19 20:47:26.526238 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3349/6590] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:26 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:27.543692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:27.544335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:27.552197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:27.552678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:27.553486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:27.553943 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:27.690373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:27.698285 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aa3e4c0c-7533-4d5b-8126-d61162df2f09 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.158567 Jul 19 20:47:27.698920 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3242/6591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:27 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:28.716569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:28.717260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:28.724982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:28.725439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:28.726237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:28.726653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:28.865781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:28.874305 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4487e149-e8a3-4a06-af99-b79f5b7bf7b0 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.161577 Jul 19 20:47:28.874906 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3350/6592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:28 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:29.893891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:29.894509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:29.901676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:29.902138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:29.902905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:29.903347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:30.045764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:30.054444 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f7c7502-d60b-45eb-8674-3ef639e2831f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.164507 Jul 19 20:47:30.055023 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3243/6593] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:29 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:31.070790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:31.071413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:31.079279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:31.079713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:31.080519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:31.080965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:31.217261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:31.225161 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-792684fa-b826-4988-954e-f8c82253ebad tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.158398 Jul 19 20:47:31.225741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3351/6594] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:31 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:32.242873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:32.243560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:32.250816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:32.251290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:32.252259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:32.252717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:32.389924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:32.398554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-81a678cd-9e16-459b-8473-da6d0c0928c2 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.159473 Jul 19 20:47:32.399161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3244/6595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:32 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:33.415764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:33.416395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:33.424043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:33.424494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:33.425252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:33.425686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:33.428328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=80 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:33.559685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:33.567898 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb2b031a-1bc1-4e37-a9c1-46cb69a0dbb5 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1515 microversion: 2.1 time: 0.155996 Jul 19 20:47:33.568483 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3352/6596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:33 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:34.585281 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:34.585907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:34.588906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:34.594855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:34.595293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:34.596116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:34.596562 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:34.599509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:34.830089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:34.837815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16b34364-583a-4866-9033-dcc24ad8db0a tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1514 microversion: 2.1 time: 0.256563 Jul 19 20:47:34.838409 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3245/6597] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:34 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:35.125553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "name": "network-vif-unplugged", "status": "completed", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:35.130326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=30 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:35.136847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:35.137063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:35.150025 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] Creating event network-vif-unplugged:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h1-843861-3 Jul 19 20:47:35.155715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:35.167908 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a7845087-45c2-4c90-b93b-199e960cb073 req-4de4bf5d-1926-465a-ac16-d6849831c006 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046003 Jul 19 20:47:35.168635 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3353/6598] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:35.855916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:35.856558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:35.864553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:35.865017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:35.865819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:35.866310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:36.053395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:36.062563 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10e7f542-0ee0-4786-a5ff-2d6c0072568e tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1514 microversion: 2.1 time: 0.210488 Jul 19 20:47:36.063473 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3246/6599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:35 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:37.083190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:37.086446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:37.090062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.090532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:37.091300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.091744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:37.183997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:37.194004 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.194543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:37.206750 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] Creating event network-changed:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h1-843861-3 Jul 19 20:47:37.212438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:37.224683 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c862e158-e2ac-4126-baa4-bc736a92479f req-e1453d73-9705-41a8-b84b-97a54f26542c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044174 Jul 19 20:47:37.225299 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3247/6600] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:47:37.228650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:37.236850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d8aef0b-1070-48f4-aad1-0ab510bd5b5f tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1512 microversion: 2.1 time: 0.160118 Jul 19 20:47:37.237434 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3354/6601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:37 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:38.256874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:38.257541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:38.264150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:38.264697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:38.265553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:38.266177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:38.515688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:38.523736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9cbad91-fb22-435b-bc22-85ae1d711834 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1512 microversion: 2.1 time: 0.272451 Jul 19 20:47:38.524465 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3248/6602] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:38 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:39.541784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:39.542366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:39.550637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:39.551097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:39.552052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:39.552517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.025800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:40.034268 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0a142e1b-fa1e-4899-84b6-888351c02840 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1509 microversion: 2.1 time: 0.496411 Jul 19 20:47:40.034902 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3355/6603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:39 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1509 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:40.052692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:40.053860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:40.061610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:40.062081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.062883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:40.063344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.092359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:47:40.151132 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Found an unconfirmed migration during delete, id: 16, status: finished Jul 19 20:47:40.709690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "name": "network-vif-plugged", "status": "completed", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:40.720165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:40.720609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.734128 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] Creating event network-vif-plugged:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h1-843861-3 Jul 19 20:47:40.740516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:40.754288 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-54359a01-5117-4412-a1e6-7638a02f6a30 req-313e27c4-f7d4-497f-a1a1-dd69e24fcce2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048125 Jul 19 20:47:40.755597 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3356/6604] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:41.826979 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67dce467-fa8c-4738-84e7-e35284f966ff tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 204 len: 0 microversion: 2.1 time: 1.778552 Jul 19 20:47:41.827769 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3249/6605] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:47:40 2022] DELETE /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 0 bytes in 1781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:47:41.838955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:41.839699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:41.846838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:41.847292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:41.848175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:41.848615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:41.984879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:41.992576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1311ce17-312e-416a-ab9a-18f5a5658655 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1501 microversion: 2.1 time: 0.159562 Jul 19 20:47:41.993161 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3357/6606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:41 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:43.010629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:43.011336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:43.018893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:43.019351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:43.020172 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:43.020622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:43.160890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:43.168585 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24f35998-9646-4f27-b2a9-65fe44f908bb tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1501 microversion: 2.1 time: 0.162203 Jul 19 20:47:43.169104 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3250/6607] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:43 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:43.992235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1509db04-a30c-477a-805e-5ce59d4a14dd req-aae4a3ca-a19b-4fd1-8f61-8294b29db012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694a7c3-7742-47bc-be15-e711e32b94a8", "name": "network-vif-deleted", "tag": "591375bf-1805-4de7-84df-73a55531174d"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:44.004342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1509db04-a30c-477a-805e-5ce59d4a14dd req-aae4a3ca-a19b-4fd1-8f61-8294b29db012 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.004796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1509db04-a30c-477a-805e-5ce59d4a14dd req-aae4a3ca-a19b-4fd1-8f61-8294b29db012 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.022765 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1509db04-a30c-477a-805e-5ce59d4a14dd req-aae4a3ca-a19b-4fd1-8f61-8294b29db012 service nova] Creating event network-vif-deleted:591375bf-1805-4de7-84df-73a55531174d for instance 4694a7c3-7742-47bc-be15-e711e32b94a8 on n-h1-843861-3 Jul 19 20:47:44.028427 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1509db04-a30c-477a-805e-5ce59d4a14dd req-aae4a3ca-a19b-4fd1-8f61-8294b29db012 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039808 Jul 19 20:47:44.029351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3358/6608] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:44.186439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:44.187077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:44.195653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.196152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.196990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.197450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.235491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.236062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.236474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lazy-loading 'fault' on Instance uuid 4694a7c3-7742-47bc-be15-e711e32b94a8 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:47:44.284657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbec20df8354e7286fc4c04c1d3dc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e79c8f14e147eb8bdfb68f0531e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:44.291709 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1886e221-aeab-426e-a5fd-6f8b404a57de tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 200 len: 1305 microversion: 2.1 time: 0.109181 Jul 19 20:47:44.292324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3251/6609] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:44 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:45.311080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:45.311827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:45.321061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.321517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.322296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.322733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.340308 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] HTTP exception thrown: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Request method failure captured: Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 HTTP/1.1 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xg-l9UFa6PDJwLwTwJSvJqlFtbZLXgr5beL7fjruoCjGjhnmzmDKaD1VykwG34i5ZGc9bYNXdPtr0TFvj1us5kKCUKLXMXmmr3KQaLmoaoaaPEw3C7F-jPrcYiEX8c1mOc_ZCg6aIHvaVKnDfx2Ql-b9LV-bHE97vlp4dAqTizQH9Y Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8bbec20df8354e7286fc4c04c1d3dc5e Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4694a7c3-7742-47bc-be15-e711e32b94a8'} Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.341963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Returning 404 to user: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-91b71bd5-d2a3-48e0-a8c5-74fde8046142 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 404 len: 111 microversion: 2.1 time: 0.037605 Jul 19 20:47:45.346854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3359/6610] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:45 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:47:45.360706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:45.361226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:45.368292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.368755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.369537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.369983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.387034 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] HTTP exception thrown: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Request method failure captured: Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 HTTP/1.1 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xg-l9UFa6PDJwLwTwJSvJqlFtbZLXgr5beL7fjruoCjGjhnmzmDKaD1VykwG34i5ZGc9bYNXdPtr0TFvj1us5kKCUKLXMXmmr3KQaLmoaoaaPEw3C7F-jPrcYiEX8c1mOc_ZCg6aIHvaVKnDfx2Ql-b9LV-bHE97vlp4dAqTizQH9Y Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 8bbec20df8354e7286fc4c04c1d3dc5e Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '4694a7c3-7742-47bc-be15-e711e32b94a8'} Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:47:45.388742 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Returning 404 to user: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ca46c85-22a2-4eaf-ae6e-ead4ad5142cd tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 404 len: 111 microversion: 2.1 time: 0.034081 Jul 19 20:47:45.393686 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3252/6611] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:47:45 2022] DELETE /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:47:45.399496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:45.400164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] [instance: 4694a7c3-7742-47bc-be15-e711e32b94a8] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:45.407042 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.407486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.408274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.408708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.422600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] HTTP exception thrown: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Request method failure captured: Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 HTTP/1.1 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xg-l9UFa6PDJwLwTwJSvJqlFtbZLXgr5beL7fjruoCjGjhnmzmDKaD1VykwG34i5ZGc9bYNXdPtr0TFvj1us5kKCUKLXMXmmr3KQaLmoaoaaPEw3C7F-jPrcYiEX8c1mOc_ZCg6aIHvaVKnDfx2Ql-b9LV-bHE97vlp4dAqTizQH9Y Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e79c8f14e147eb8bdfb68f0531e27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 44e79c8f14e147eb8bdfb68f0531e27d Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-DeleteServersTestJSON-163815608 Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 8bbec20df8354e7286fc4c04c1d3dc5e Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-DeleteServersTestJSON-163815608-project Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '4694a7c3-7742-47bc-be15-e711e32b94a8'} Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:45.424188 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] Returning 404 to user: Instance 4694a7c3-7742-47bc-be15-e711e32b94a8 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c7a898e4-1b31-436a-a69a-471664025392 tempest-DeleteServersTestJSON-163815608 tempest-DeleteServersTestJSON-163815608-project] 10.222.0.33 "GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8" status: 404 len: 111 microversion: 2.1 time: 0.029943 Jul 19 20:47:45.427862 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3360/6612] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:45 2022] GET /compute/v2.1/servers/4694a7c3-7742-47bc-be15-e711e32b94a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:47:54.026057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-43011012", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "46172cdf-70d2-44b7-a3fd-2bd51b08b972"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:54.082830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] validate_networks() for [('46172cdf-70d2-44b7-a3fd-2bd51b08b972', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:47:54.499737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:47:54.501103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:47:54.501737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:47:54.502359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:47:54.502819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:47:54.513503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:54.513959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:54.514763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:54.516029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:54.534288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:47:54.539881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for user 91da23b91c9b4be8b261a9b8caec8ce7 and project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:47:54.552593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:47:54.554918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:47:54.604564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2fc852b6-489d-4ded-bdad-7c19701d6f0b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712593 Jul 19 20:47:54.605398 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3253/6613] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:47:54.615639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fe97423-08ae-46f7-a85c-b0229b932eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:54.617375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fe97423-08ae-46f7-a85c-b0229b932eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:54.693090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fe97423-08ae-46f7-a85c-b0229b932eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:54.707284 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fe97423-08ae-46f7-a85c-b0229b932eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1216 microversion: 2.1 time: 0.095728 Jul 19 20:47:54.718742 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3361/6614] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:54 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:55.726266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:55.726896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:55.733462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:55.734508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:55.735410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:55.735976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:55.801053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:55.810291 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c7d5340-eb0f-4bca-8832-25ce48a67bc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1268 microversion: 2.1 time: 0.088732 Jul 19 20:47:55.811259 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3254/6615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:55 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:56.829116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:56.829735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:56.832522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=37 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:56.841962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:56.842416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:56.843249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:56.843689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:57.337127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:57.348035 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c45e801a-1c0f-4dc7-a841-197749ac31ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.522992 Jul 19 20:47:57.348913 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3362/6616] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:56 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:57.771059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-878f607f-be3d-4bee-954b-d496d7304e42 req-6d976d6b-b419-4047-98a0-7d83ec1e095a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:57.786447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-878f607f-be3d-4bee-954b-d496d7304e42 req-6d976d6b-b419-4047-98a0-7d83ec1e095a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:57.788784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-878f607f-be3d-4bee-954b-d496d7304e42 req-6d976d6b-b419-4047-98a0-7d83ec1e095a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:57.822799 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-878f607f-be3d-4bee-954b-d496d7304e42 req-6d976d6b-b419-4047-98a0-7d83ec1e095a service nova] Creating event network-changed:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h2-843861-3 Jul 19 20:47:57.835250 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-878f607f-be3d-4bee-954b-d496d7304e42 req-6d976d6b-b419-4047-98a0-7d83ec1e095a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068202 Jul 19 20:47:57.836316 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3255/6617] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:58.366628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:58.367520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:58.375459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:58.375940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:58.376725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:58.377166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:58.513700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:58.521358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1f58477-b910-419e-8b4e-1d5b6361fdda tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.158775 Jul 19 20:47:58.521949 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3363/6618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:58 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:59.539510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:59.540253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:59.547441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:59.547921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:59.548695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:59.549142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:59.690254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:59.698756 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ed3a4452-63dd-41c5-847d-7931f77068fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.163425 Jul 19 20:47:59.699350 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3256/6619] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:59 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:00.715761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:00.716651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:00.724105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:00.724547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:00.725322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:00.725756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:00.955709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:00.964543 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a172787-e29f-42d8-867e-7da903c51940 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.252688 Jul 19 20:48:00.965144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3364/6620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:00 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:01.981805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:01.982516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:01.989697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:01.990304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:01.991099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:01.991478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:02.130633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:02.138052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9cb06bb0-5478-4344-a2e8-405f6325f955 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.160278 Jul 19 20:48:02.138636 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3257/6621] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:01 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:03.156133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:03.156751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:03.163784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:03.164332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:03.165091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:03.165530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:03.298366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:03.305993 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fb0200f-779b-438d-92e2-b5a0e8ce9e31 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.154305 Jul 19 20:48:03.306577 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3365/6622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:03 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:03.463967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-04bb3661-f874-4e2a-baa5-0211105af281 req-8e5a7758-8f01-4f14-9093-ff9a2cc15791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "name": "network-vif-plugged", "status": "completed", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:03.474131 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-04bb3661-f874-4e2a-baa5-0211105af281 req-8e5a7758-8f01-4f14-9093-ff9a2cc15791 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:03.474594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-04bb3661-f874-4e2a-baa5-0211105af281 req-8e5a7758-8f01-4f14-9093-ff9a2cc15791 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:03.486291 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-04bb3661-f874-4e2a-baa5-0211105af281 req-8e5a7758-8f01-4f14-9093-ff9a2cc15791 service nova] Creating event network-vif-plugged:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h2-843861-3 Jul 19 20:48:03.491225 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-04bb3661-f874-4e2a-baa5-0211105af281 req-8e5a7758-8f01-4f14-9093-ff9a2cc15791 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030944 Jul 19 20:48:03.492038 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3258/6623] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:04.322538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:04.323162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:04.330734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:04.331192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:04.332159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:04.332619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:04.466724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:04.474862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-917b206f-7673-4599-b737-3ff2ca649a62 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1316 microversion: 2.1 time: 0.156315 Jul 19 20:48:04.475434 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3366/6624] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:04 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:05.490737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.491473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.496449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:05.497194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:05.501191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.510178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.510640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.511484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.512089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.516002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.651292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:05.659122 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-149fd005-43cb-4ad8-abce-5f03af1782d5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1506 microversion: 2.1 time: 0.170409 Jul 19 20:48:05.659697 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3259/6625] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:05 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:05.675921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:05.676540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:05.678474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.680018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=30 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:05.685745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.686197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.687575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.688037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.825316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:05.832959 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1b92ad52-358c-49af-9620-dd6c6b3de284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1506 microversion: 2.1 time: 0.160900 Jul 19 20:48:05.833546 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3367/6626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:05 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:05.848788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:05.849918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:05.855986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.856443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.857210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.857923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.924248 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0899b5b-48a1-41b8-acf8-56988b6ffda9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "PUT /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1078 microversion: 2.1 time: 0.079228 Jul 19 20:48:05.925390 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3260/6627] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 19 20:48:05 2022] PUT /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1078 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:05.939518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:05.940185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:05.946203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.946649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.947410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.947866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.078112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:06.085808 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25434330-f045-406b-914f-3f8006e2471e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1504 microversion: 2.1 time: 0.150828 Jul 19 20:48:06.086384 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3368/6628] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:05 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:06.102218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:06.102843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:06.109756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.110222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.110993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.111432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.241598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:06.249199 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39751b3b-176a-49b5-a929-acab95e83ac1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1504 microversion: 2.1 time: 0.150792 Jul 19 20:48:06.249782 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3261/6629] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:06 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:06.266496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:06.267527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:06.273750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.274198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.275024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.275407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.349788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:06.355611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:48:06.362404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:48:06.362890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:48:06.363363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:48:06.363771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:48:06.364205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:48:06.474509 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ac494de5-ed5e-4bff-8828-0308515a8e3c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b/action" status: 202 len: 0 microversion: 2.1 time: 0.211968 Jul 19 20:48:06.475134 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3369/6630] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:48:06 2022] POST /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:48:06.484426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:06.485062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:06.492811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.493394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.494064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.494688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.660849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:06.668793 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-de28297f-cf76-4545-b89d-f598ae1277fa tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1515 microversion: 2.1 time: 0.189189 Jul 19 20:48:06.669377 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3262/6631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:06 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:07.688203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:07.688760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:07.696082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:07.696534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:07.697307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:07.697740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:07.838305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:07.845977 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0a3ce25-f6dd-41b1-82b6-da5db614c63a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1515 microversion: 2.1 time: 0.163308 Jul 19 20:48:07.846567 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3370/6632] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:07 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:08.864154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:08.864778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:08.871926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:08.872394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:08.873175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:08.873625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:09.006692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:09.014185 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-28d037b7-4374-4002-adca-13f429058944 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.154051 Jul 19 20:48:09.015314 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3263/6633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:08 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:10.032841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:10.033487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:10.040464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:10.040917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:10.041685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:10.042123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:10.182731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:10.190964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a05ea708-0b8d-470d-a23f-d8a618f0daa7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.162080 Jul 19 20:48:10.191552 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3371/6634] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:10 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:11.209025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:11.209639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:11.217053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.217517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.219019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.219469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.353362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:11.361069 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-afb3506a-4056-46a8-9dac-7d999af706fe tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.155925 Jul 19 20:48:11.361654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3264/6635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:11 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:12.378561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:12.379675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:12.387320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:12.387761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:12.388555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:12.388980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:12.532276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:12.541432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d674899c-7686-49ba-88d5-b99688368cc6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.166896 Jul 19 20:48:12.542556 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3372/6636] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:12 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:13.558561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:13.559234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:13.566218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:13.566677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:13.567452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:13.567930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:13.706874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:13.714581 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5e633ca-2058-49f4-8e7f-393ee80978c4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.159844 Jul 19 20:48:13.715161 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3265/6637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:13 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:14.732389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:14.733021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:14.740717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:14.741170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:14.741965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:14.742393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:14.896347 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:14.903758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eb278c15-f286-47be-984c-5603417a5938 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.175339 Jul 19 20:48:14.904356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3373/6638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:14 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:15.921501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:15.922280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:15.929475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.929935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.930703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.931149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:16.071571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:16.079861 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b87e9725-a591-489c-b64e-b404d399ad09 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.162784 Jul 19 20:48:16.080439 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3266/6639] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:15 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:17.097254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:17.097867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:17.105000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:17.105453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:17.106217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:17.106648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:17.238473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:17.246068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bac6d0ea-5e0f-4f7b-b6ee-5dc3d9c0f0a2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.152624 Jul 19 20:48:17.246735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3374/6640] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:17 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:18.266357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:18.266357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:18.272910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:18.273369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:18.274139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:18.274580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:18.412090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:18.419642 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1eda2da0-ec7f-4891-9fdc-ce9ed7e8dbc5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158757 Jul 19 20:48:18.420254 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3267/6641] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:18 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:19.437541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:19.438148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:19.445072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:19.445518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:19.446271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:19.446699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:19.586314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:19.594228 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bf6695e8-bb25-4958-ab42-aa4b0ae43ab0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.160717 Jul 19 20:48:19.595133 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3375/6642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:19 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:20.611242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:20.611913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:20.618942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:20.619410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:20.620211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:20.620661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:20.755201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:20.762754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba33be1a-59cd-4589-95d4-d68a196beead tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.155349 Jul 19 20:48:20.763336 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3268/6643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:20 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:21.781117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:21.781653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:21.788808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:21.789265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:21.790036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:21.790476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:21.926971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:21.934826 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dd0891da-ae5a-4e15-b444-5119487298d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158372 Jul 19 20:48:21.935401 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3376/6644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:21 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:22.953046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:22.953712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:22.960751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:22.961214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:22.961986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:22.962434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:23.093432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:23.101267 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd1b0a29-21af-455d-a18a-52aa11a13c2d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.152676 Jul 19 20:48:23.101845 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3269/6645] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:22 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:24.119064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:24.119681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:24.126271 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:24.126719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:24.127484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:24.127999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:24.132238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:24.266093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:24.273892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b25e0c9d-9f54-446b-b402-dabceb8ad5e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158823 Jul 19 20:48:24.274481 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3377/6646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:24 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:25.291698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:25.292304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:25.299715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.300215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.301007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.301449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.436020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:25.444277 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03158783-d336-4448-9446-6afb3676eb18 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.156536 Jul 19 20:48:25.444928 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3270/6647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:25 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:26.461858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:26.462527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:26.469689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:26.470132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:26.470889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:26.471319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:26.605780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:26.615862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-289c0a73-c465-4304-9a33-426fd1f0b396 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158005 Jul 19 20:48:26.616450 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3378/6648] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:26 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:27.632745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:27.633374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:27.641080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:27.641541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:27.642320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:27.642765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:27.779075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:27.788749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4fbd1376-9e29-4eb8-9589-c6b89516fc3b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158819 Jul 19 20:48:27.788749 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3271/6649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:27 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:28.804615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.805228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.812331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.812777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.813542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.813970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.944392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:28.952450 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-042a0861-40d1-49b6-b9cb-4a2c7efc00fb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.151731 Jul 19 20:48:28.953038 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3379/6650] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:28 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:29.970489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:29.971114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:29.978472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:29.978940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:29.980256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:29.981080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:30.125372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:30.133257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0661b84-aff2-4286-87b0-629baf965eea tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.167318 Jul 19 20:48:30.133839 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3272/6651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:29 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:31.151787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:31.152977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:31.160635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:31.161086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:31.161862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:31.162293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:31.298250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:31.306103 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-28a847ad-c8da-4b64-a971-967e295f7583 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.158200 Jul 19 20:48:31.306687 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3380/6652] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:31 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:32.322949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:32.323568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:32.330936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:32.331389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:32.332204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:32.332651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:32.537815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:32.546139 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-deaaddf9-ca3d-421a-b225-42f013bfcc7d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.226452 Jul 19 20:48:32.546719 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3273/6653] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:32 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:33.564169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.564803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:33.572725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:33.573180 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:33.573946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:33.574384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:33.722119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:33.729862 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5074a31b-92ea-4533-aae7-e3b093ec1304 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.170305 Jul 19 20:48:33.730440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3381/6654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:34.746731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:34.747352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:34.755563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:34.756063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:34.756845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:34.757296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:34.898412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:34.906954 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7c885b1-719d-46ad-953c-db3db3c8312a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1520 microversion: 2.1 time: 0.164217 Jul 19 20:48:34.907544 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3274/6655] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:34 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:35.925006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:35.925639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:35.928494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=34 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:35.935131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:35.935638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:35.936961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:35.937402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:36.058364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "name": "network-vif-unplugged", "status": "completed", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:36.063360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=32 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:36.070152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:36.070611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:36.074844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:36.083428 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] Creating event network-vif-unplugged:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h1-843861-3 Jul 19 20:48:36.090018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:48:36.102836 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2ec7d078-e4f2-4858-adf1-7d112813b33d req-c5b34c8b-094d-44aa-9bc2-d2d657bcc504 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049128 Jul 19 20:48:36.103801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3275/6656] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:36.204331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:36.214638 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-babaf668-2e1c-4b04-9430-2129c1a449d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1519 microversion: 2.1 time: 0.293164 Jul 19 20:48:36.215764 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3382/6657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:35 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:37.234338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:37.235077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:37.241598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:37.242061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:37.242891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:37.243342 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:37.389391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:37.398636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-648b051f-9262-43b0-b4b1-6d5d5f0a644b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1517 microversion: 2.1 time: 0.169304 Jul 19 20:48:37.399246 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3276/6658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:37 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:38.132725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:38.141594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:38.142028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:38.153939 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] Creating event network-changed:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h1-843861-3 Jul 19 20:48:38.159953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:48:38.172166 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f88b448-4549-4227-bb47-1fa293a7c043 req-5a195838-3fa9-422b-820f-6dbd80080179 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043290 Jul 19 20:48:38.172779 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3383/6659] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:38.418237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:38.418869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:38.426955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:38.427423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:38.428265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:38.428713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:38.772767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:38.783541 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5611a5e5-8572-434a-8710-9d19263f620f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1517 microversion: 2.1 time: 0.369245 Jul 19 20:48:38.784779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3277/6660] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:38 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:39.801809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:39.802509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:39.811405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:39.812222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:39.813383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:39.813952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.016404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:40.024178 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-aa8172ca-5299-46d8-bbc7-a92b97621baf tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1514 microversion: 2.1 time: 0.226638 Jul 19 20:48:40.024754 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3384/6661] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:39 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:40.040477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:40.041135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:40.048062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:40.048568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.049406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:40.049949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.112801 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c3d6a2e-e43c-4190-a030-6c96d40ca457 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b/action" status: 204 len: 0 microversion: 2.1 time: 0.075829 Jul 19 20:48:40.113671 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3278/6662] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:48:40 2022] POST /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:48:40.128368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:40.129607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:40.139586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:40.141100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.142380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:40.142816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.363595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:40.371145 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a6aadd8-9a49-40e1-a1a5-f256a7e68653 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1514 microversion: 2.1 time: 0.251420 Jul 19 20:48:40.371739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3385/6663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:40 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:40.887590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "name": "network-vif-plugged", "status": "completed", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:40.899587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:40.900432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:40.916172 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] Creating event network-vif-plugged:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h1-843861-3 Jul 19 20:48:40.925081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:48:40.937857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6fce8e4f-1b1f-4967-8d5f-e71bfda4e2d7 req-ad87e1cf-b1bd-48ab-8c0e-34ad225cd357 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055314 Jul 19 20:48:40.938599 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3279/6664] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:41.390095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:41.390812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:41.398096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:41.398619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:41.399451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:41.400002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:41.548653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:41.557201 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a527b3e-b14c-4b17-8841-b4cdb40508b9 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1514 microversion: 2.1 time: 0.171566 Jul 19 20:48:41.561725 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3386/6665] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:41 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:42.577757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:42.578461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:42.584722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.585180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.585948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.586391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.724895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:42.732787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f144b516-c8a7-41a5-a535-3ef131c25fb2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1506 microversion: 2.1 time: 0.160741 Jul 19 20:48:42.733404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3280/6666] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:42 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:42.749526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:42.750179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:42.757577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.758018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.758778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.759204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.899930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:42.907876 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa239d92-ea6c-4c58-b9bc-a188208c0751 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1506 microversion: 2.1 time: 0.162685 Jul 19 20:48:42.908482 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3387/6667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:42 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:42.928148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7dfa4fe-7ca9-4476-99b2-c28af506ddf4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'create', calling method: .version_select at 0x7fb88c19ae50>, body: {"keypair": {"name": "tempest-keypair-441367966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXjjWv3OnWdCwzbc4O9HAtP6RctutlFklJLNvPuo8jAWhT7yv7litP0IAMn9ccvjYDOPen0hw0rukrwPOTIT9ePFqjB+TyNeWzwbgUoAVPSB9y4OWWFvLjEg9Zs5bUnvw=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:42.943080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f7dfa4fe-7ca9-4476-99b2-c28af506ddf4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:48:42.948400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-f7dfa4fe-7ca9-4476-99b2-c28af506ddf4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for user 91da23b91c9b4be8b261a9b8caec8ce7 and project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:48:42.974213 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7dfa4fe-7ca9-4476-99b2-c28af506ddf4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050063 Jul 19 20:48:42.974862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3281/6668] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:48:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:44.218279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:44.219533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:44.227400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:44.227894 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:44.228676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:44.229107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:44.364919 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:44.372600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd662a28-fb80-4484-aac8-5e2a390384b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 200 len: 1506 microversion: 2.1 time: 0.158971 Jul 19 20:48:44.373700 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3388/6669] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:44 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:44.391277 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:44.391832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:44.398500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:44.398961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:44.399737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:44.400240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:44.424816 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:48:44.502053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1f967d2-df0d-476d-9c28-83fefc0f459a tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "DELETE /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 204 len: 0 microversion: 2.1 time: 0.115912 Jul 19 20:48:44.502884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3282/6670] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:44 2022] DELETE /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:48:44.559893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2147034961", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "46172cdf-70d2-44b7-a3fd-2bd51b08b972"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:44.612006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] validate_networks() for [('46172cdf-70d2-44b7-a3fd-2bd51b08b972', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:48:45.000044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:48:45.000475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:48:45.000955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:48:45.001367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:48:45.001786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:48:45.011760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:45.012268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:45.013071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:45.013508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:45.031050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:48:45.036421 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Getting quotas for user 91da23b91c9b4be8b261a9b8caec8ce7 and project 1b397e41bdd74a419b57e1a9ce900bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:48:45.049984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:48:45.052253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:48:45.096666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9cb3ca4-ae07-4273-a1b5-441097c44c11 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540624 Jul 19 20:48:45.097323 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3389/6671] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:48:45.108646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7c20936b-ec5e-48f7-b6f0-355a46bebfc4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:45.109481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7c20936b-ec5e-48f7-b6f0-355a46bebfc4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:45.166074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7c20936b-ec5e-48f7-b6f0-355a46bebfc4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:45.173724 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7c20936b-ec5e-48f7-b6f0-355a46bebfc4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1218 microversion: 2.1 time: 0.070064 Jul 19 20:48:45.174326 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3283/6672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:45 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:46.191512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:46.192775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:46.200297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:46.200756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:46.201621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:46.202068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:46.304327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:46.312771 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6ad4bdde-373c-4528-ba42-25f18a17430c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1288 microversion: 2.1 time: 0.125304 Jul 19 20:48:46.313367 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3390/6673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:46 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:47.122684 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7307850b-c764-4481-a3ac-06d473d54afd req-6e8238bf-4def-400f-9a5c-79f64f8cc3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b", "name": "network-vif-deleted", "tag": "1aade5ed-7da7-4717-a51b-79549343f184"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:47.134860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7307850b-c764-4481-a3ac-06d473d54afd req-6e8238bf-4def-400f-9a5c-79f64f8cc3e9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.135482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7307850b-c764-4481-a3ac-06d473d54afd req-6e8238bf-4def-400f-9a5c-79f64f8cc3e9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.173906 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7307850b-c764-4481-a3ac-06d473d54afd req-6e8238bf-4def-400f-9a5c-79f64f8cc3e9 service nova] Creating event network-vif-deleted:1aade5ed-7da7-4717-a51b-79549343f184 for instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b on n-h1-843861-3 Jul 19 20:48:47.179589 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7307850b-c764-4481-a3ac-06d473d54afd req-6e8238bf-4def-400f-9a5c-79f64f8cc3e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061740 Jul 19 20:48:47.181392 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3284/6674] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:47.333732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:47.334368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:47.343563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.352826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.353710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.354158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.619856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:47.626463 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3e295b9-dba0-4b87-9eea-30f7121f089c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.300683 Jul 19 20:48:47.627066 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3391/6675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:47 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:48.645604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:48.646387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:48.652704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:48.653169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:48.653945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:48.654412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:48.793589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:48.801817 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a838b91e-6dd9-4d19-8a31-106ba64e0979 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.161366 Jul 19 20:48:48.802402 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3285/6676] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:48 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:49.195861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ed1c12a1-6b1d-4383-80fe-ab1dd6dd8574 req-c6909579-ab18-40fe-a5c0-0a957215db2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:49.205335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ed1c12a1-6b1d-4383-80fe-ab1dd6dd8574 req-c6909579-ab18-40fe-a5c0-0a957215db2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:49.205780 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ed1c12a1-6b1d-4383-80fe-ab1dd6dd8574 req-c6909579-ab18-40fe-a5c0-0a957215db2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:49.217378 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ed1c12a1-6b1d-4383-80fe-ab1dd6dd8574 req-c6909579-ab18-40fe-a5c0-0a957215db2a service nova] Creating event network-changed:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h2-843861-3 Jul 19 20:48:49.224483 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ed1c12a1-6b1d-4383-80fe-ab1dd6dd8574 req-c6909579-ab18-40fe-a5c0-0a957215db2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Jul 19 20:48:49.224977 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3392/6677] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:49.818993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:49.819598 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:49.827488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:49.827976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:49.828759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:49.829202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:49.961232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:49.968874 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b1c34a1b-a518-40e8-ac7b-623d95922284 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.153695 Jul 19 20:48:49.969463 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3286/6678] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:49 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:50.988193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:50.988912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:50.995268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:50.995723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:50.996516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:50.996958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:51.227590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:51.235311 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-507e4e87-9836-4fec-a6a5-4dbd535047e6 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.253125 Jul 19 20:48:51.236148 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3393/6679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:50 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:52.252575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:52.253221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:52.260775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:52.261233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:52.262002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:52.262547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:52.397540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:52.405128 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7986d28-2d88-44be-8084-7f072c5e76be tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.157061 Jul 19 20:48:52.405712 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3287/6680] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:52 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:53.423063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:53.423690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:53.430457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:53.430915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:53.431694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:53.432167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:53.566091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:53.574120 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6040e1e-3dc3-4de0-a586-029427159507 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.155015 Jul 19 20:48:53.574933 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3394/6681] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:53 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:54.592045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:54.592667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:54.599626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:54.600119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:54.600885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:54.601327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:54.737998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:54.746337 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6058094-5c86-4dd7-b5b1-30b53e96fb29 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.158145 Jul 19 20:48:54.746926 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3288/6682] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:54 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:55.672666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-caafb2ee-4881-4ef7-b58e-0701128e656b req-4fb1645d-a655-4794-9349-25eab7ed2fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "name": "network-vif-plugged", "status": "completed", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:55.677216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.677999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.684785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-caafb2ee-4881-4ef7-b58e-0701128e656b req-4fb1645d-a655-4794-9349-25eab7ed2fa3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:55.685953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-caafb2ee-4881-4ef7-b58e-0701128e656b req-4fb1645d-a655-4794-9349-25eab7ed2fa3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:55.690196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.702075 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-caafb2ee-4881-4ef7-b58e-0701128e656b req-4fb1645d-a655-4794-9349-25eab7ed2fa3 service nova] Creating event network-vif-plugged:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h2-843861-3 Jul 19 20:48:55.707497 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-caafb2ee-4881-4ef7-b58e-0701128e656b req-4fb1645d-a655-4794-9349-25eab7ed2fa3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038582 Jul 19 20:48:55.708345 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3395/6683] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:55.764975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:55.765605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:55.767615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.773467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:55.773926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:55.774699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:55.775146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:55.960591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:55.968195 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b690bb9a-ed4e-471d-a951-ed916eac9cdd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.207859 Jul 19 20:48:55.968768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3289/6684] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:55 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:56.986410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:56.987099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:56.993371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:56.993814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:56.994563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:56.994993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:57.127957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:57.135979 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-531fdd3c-0253-423c-9178-7b346d3ebedb tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1318 microversion: 2.1 time: 0.154899 Jul 19 20:48:57.136566 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3396/6685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:56 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:58.153552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:58.154341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:58.164300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.164769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.165568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.166021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.299940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:58.307475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c17fc7d-53d4-4f9a-a478-136dfa938a8b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1509 microversion: 2.1 time: 0.157872 Jul 19 20:48:58.308089 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3290/6686] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:58 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:58.324384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:58.324999 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:58.332537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.332997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.333764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.334202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.468863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:58.476393 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d5fc8913-8241-4fcf-a7d4-df28181af9ba tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1509 microversion: 2.1 time: 0.155876 Jul 19 20:48:58.476964 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3397/6687] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:58 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:58.493222 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:58.493872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:58.500397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.500864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.501683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.502135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.530719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:58.536790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=126007) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:48:58.543027 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:48:58.543452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:48:58.543966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:48:58.544388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:48:58.544807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:48:58.559658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:58.606063 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8953b61-c205-4f91-a992-2adcc9aee4c8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4/action" status: 202 len: 0 microversion: 2.1 time: 0.117204 Jul 19 20:48:58.606688 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3291/6688] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:48:58 2022] POST /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:48:58.615084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:58.615702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:58.621779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.622232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.623509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:58.623989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:59.191694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:59.199541 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d8d34c7-88fb-4617-acb3-9c7f4b8394b8 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1516 microversion: 2.1 time: 0.588357 Jul 19 20:48:59.200153 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3398/6689] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:58 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1516 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:00.218320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.219162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:00.225837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:00.226311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:00.227130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:00.227978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:00.438920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:00.449796 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2c7a87d-54d1-4593-b6bc-aa75e9a4e208 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1516 microversion: 2.1 time: 0.236185 Jul 19 20:49:00.450540 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3292/6690] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:01.470806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.472116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:01.479069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:01.479515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:01.480307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:01.480736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:01.618805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:01.626603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9cb6366-6829-4f77-b16f-bd0bad1ed5ec tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.159800 Jul 19 20:49:01.627155 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3399/6691] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:01 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:02.644723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:02.645379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:02.652565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:02.653026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:02.653805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:02.654248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:02.799428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:02.807198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e6022d0f-4b5c-4c34-b56f-0c5f55e2bde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.166734 Jul 19 20:49:02.807774 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3293/6692] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:02 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:03.825211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:03.825880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:03.832987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:03.833436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:03.834220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:03.834640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:03.971524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:03.979839 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ae7ce1d-b67f-4c1e-a386-cceea5528650 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.158530 Jul 19 20:49:03.980427 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3400/6693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:03 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:04.998043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:04.998663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:05.006398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:05.006990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:05.007758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:05.008226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:05.137932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:05.145822 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-01eec9f6-d8a4-49f5-9bbc-b2f8483c39d1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.151873 Jul 19 20:49:05.146410 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3294/6694] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:04 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:06.163300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:06.163939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:06.166864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.173623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.174069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.174842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.175264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.314609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:06.322215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e1b8511b-afa7-4446-901d-fb0d881b98fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.162808 Jul 19 20:49:06.322791 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3401/6695] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:06 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:07.340201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:07.340824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:07.343732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:07.350506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:07.350955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:07.351743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:07.352284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:07.486945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:07.494580 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2235491a-e1ea-4e72-bf5c-555d73db1f32 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.158298 Jul 19 20:49:07.495157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3295/6696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:07 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:08.512605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.513147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:08.520904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.521351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.522120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.522553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.655328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:08.662828 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1ff4e286-25bc-4e6a-bcd5-d066d1482cb0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.154276 Jul 19 20:49:08.663399 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3402/6697] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:08 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:09.680800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:09.681427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:09.688954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.689460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.690248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.690694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.827542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:09.835648 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-262fc3ca-8546-4a31-b69e-a2089950e026 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.158714 Jul 19 20:49:09.836285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3296/6698] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:09 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:10.852813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.853417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.860645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.861128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.861892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.862356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.991568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:10.999151 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0dcdc8f9-8f44-4c38-a9d7-6afa376656d4 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.150260 Jul 19 20:49:10.999728 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3403/6699] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:10 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:12.017383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.018051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.025485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.025951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.026784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.027371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.177466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:12.185135 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-048fe19b-79d4-4bed-b2f7-5458dca504ce tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.171993 Jul 19 20:49:12.185999 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3297/6700] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:12 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:13.202205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:13.202813 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:13.210305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:13.210747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:13.211500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:13.211964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:13.346579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:13.354183 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-35df19da-314a-47df-b334-6a85d717c140 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.155880 Jul 19 20:49:13.354760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3404/6701] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:13 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:14.371254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:14.371958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:14.379272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.379740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:14.380558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.381010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:14.515051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:14.522759 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b1b60b1-5576-4c7f-8e3e-87c5a061cde1 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.155390 Jul 19 20:49:14.523338 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3298/6702] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:14 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:15.541059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:15.541666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:15.549235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:15.549687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:15.550475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:15.550911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:15.694666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:15.702493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b0bf5c90-7b52-4eda-9e4b-313049d96b1c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.165866 Jul 19 20:49:15.703629 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3405/6703] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:15 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:16.720799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:16.721421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:16.728387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.728854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.729639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.730503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.869607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:16.877993 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2148c796-7097-477c-b6b7-a72f798dcdd5 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.161562 Jul 19 20:49:16.878593 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3299/6704] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:16 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:17.897586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:17.898247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:17.905831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:17.906281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:17.907057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:17.907499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:18.060756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:18.069099 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6384c27b-3a7f-42da-ab41-e70e99125a92 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.175344 Jul 19 20:49:18.069771 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3406/6705] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:17 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:19.086793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:19.087420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:19.094747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:19.095205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:19.096017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:19.096464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:19.239237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:19.246895 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf345172-d1fd-4d17-865e-be4ce0678890 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.163969 Jul 19 20:49:19.247479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3300/6706] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:19 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:20.264320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:20.264995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:20.272017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:20.272493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:20.273242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:20.273678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:20.425524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:20.433789 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5528873b-35bf-4e48-bec4-9fdb93df78a7 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.173346 Jul 19 20:49:20.434382 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3407/6707] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:20 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:21.451652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:21.452311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:21.460205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:21.460670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:21.461456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:21.461985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:21.599167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:21.607004 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a363bd84-7c39-4e35-80b4-b26b428ff547 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.159304 Jul 19 20:49:21.607587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3301/6708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:21 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:22.624121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:22.624723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:22.632000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:22.632447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:22.633212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:22.633643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:22.764370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:22.772101 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-657d3863-2ca0-4d06-b839-fab47c3a0f71 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.151996 Jul 19 20:49:22.772679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3408/6709] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:22 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:23.789580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:23.790205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:23.797361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:23.797805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:23.798909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:23.799509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:23.936782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:23.945052 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc24d2fc-9269-45d8-a970-77ed27e60358 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.159450 Jul 19 20:49:23.945644 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3302/6710] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:23 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:24.963282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:24.964234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:24.973710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:24.974163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:24.974946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:24.975382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:25.112095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:25.120025 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9c868e42-dca9-43cd-8d37-b602d0f93f1e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.161023 Jul 19 20:49:25.120611 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3409/6711] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:24 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:26.136899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:26.137445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:26.144798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:26.145265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:26.146058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:26.146505 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:26.290546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:26.299147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9289c767-c9c6-47f3-ad4c-947ac1c75050 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.166209 Jul 19 20:49:26.299745 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3303/6712] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:26 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:27.317756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:27.318379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:27.326096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:27.326541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:27.327332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:27.327757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:27.331648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=86 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:27.476224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:27.485357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-318aa601-759c-48c9-b4c5-6cac9097d13d tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1521 microversion: 2.1 time: 0.172513 Jul 19 20:49:27.486005 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3410/6713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:27 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:28.508043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:28.510613 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:28.525856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.526766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.528292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.529192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.594828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "name": "network-vif-unplugged", "status": "completed", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:28.610528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.613059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.621279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:28.644007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] Creating event network-vif-unplugged:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h1-843861-3 Jul 19 20:49:28.658993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:49:28.679749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1453a42f-c6c3-468e-bfc7-5ed299de06c3 req-ff550a81-aed9-4567-9335-e2e3982b14bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209610 Jul 19 20:49:28.681717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3304/6714] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:28.904413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:28.914458 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2629fe28-6565-4723-9cf9-0246fda6e01f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1520 microversion: 2.1 time: 0.415219 Jul 19 20:49:28.915407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3411/6715] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:28 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:29.949386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:29.950663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:29.961906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:29.962699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:29.964127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:29.964927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.199963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:30.213872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c3c8118-5e93-4310-96c1-4f3d579ee69b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1520 microversion: 2.1 time: 0.274716 Jul 19 20:49:30.214510 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3305/6716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:29 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:30.706838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:30.716621 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:30.717068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.732406 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] Creating event network-changed:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h1-843861-3 Jul 19 20:49:30.738783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:49:30.751977 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1f8d80c0-e1c8-41c3-9ee4-a7d9c24fa386 req-57148e4e-feb2-4e7f-b09f-9068f94ee746 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048971 Jul 19 20:49:30.752804 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3412/6717] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:31.243685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:31.245098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:31.254582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:31.254932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:31.256162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:31.256674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:31.622454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:31.641580 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23d95b54-86f1-45b2-bea4-b665c253455c tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1518 microversion: 2.1 time: 0.402219 Jul 19 20:49:31.642184 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3306/6718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:31 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1518 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:32.674216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:32.674925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:32.681369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.681809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.682576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.683001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.823291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:32.831073 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3d15f68-0c5c-4467-a4bc-e7c6677d6238 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1515 microversion: 2.1 time: 0.162485 Jul 19 20:49:32.831661 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3413/6719] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:32 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:32.847835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:32.848770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:32.856318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.856779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.857583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.858026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.918054 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-23f10214-b448-4f8b-88e4-f104d13010d2 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "POST /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4/action" status: 204 len: 0 microversion: 2.1 time: 0.074019 Jul 19 20:49:32.918764 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3307/6720] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:49:32 2022] POST /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:49:32.928446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:32.931161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:32.935773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.936441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.938194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:32.938707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:33.168832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:33.180599 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63c7b118-9673-490d-b50e-a549bfa8e7af tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1515 microversion: 2.1 time: 0.256164 Jul 19 20:49:33.181227 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3414/6721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:32 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:33.279629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "name": "network-vif-plugged", "status": "completed", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:33.297822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:33.298578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:33.321532 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] Creating event network-vif-plugged:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h1-843861-3 Jul 19 20:49:33.336112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:49:33.365432 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-89a3d34d-bd7c-4001-a50b-536674dd18dc req-548e1920-317a-47e1-a7d8-9fd36254649f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092974 Jul 19 20:49:33.366461 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3308/6722] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:34.203087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:34.203750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:34.210924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.211376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.212263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.212699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.372909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:34.384600 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b847d03-ae5c-44bb-ac2c-bf7c4e6a179e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1515 microversion: 2.1 time: 0.185789 Jul 19 20:49:34.385214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3415/6723] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:34 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:35.411862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.412482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.419486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.419995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.420800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.421257 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.576392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.585745 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55c29885-c34f-4d0a-9f38-186284d5147b tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1507 microversion: 2.1 time: 0.179298 Jul 19 20:49:35.586377 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3309/6724] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:35.602325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.602943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.610528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.610981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.611751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.612211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.748806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.757714 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-43599a4c-2667-4b34-8075-4c2cbc2e517e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1507 microversion: 2.1 time: 0.159220 Jul 19 20:49:35.758310 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3416/6725] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:35.774773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.775601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.782359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.783105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.784238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.784784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.938121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.946077 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f1a8bfbd-75fc-47c6-b508-8e8e528d416f tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1507 microversion: 2.1 time: 0.175495 Jul 19 20:49:35.946664 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3310/6726] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:35.963037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.963653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.970596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.971049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.971851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.972465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.998753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:49:36.086733 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ef33ee41-7164-452a-8932-1d6d884ab87e tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 204 len: 0 microversion: 2.1 time: 0.127097 Jul 19 20:49:36.090618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3417/6727] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:35 2022] DELETE /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:49:36.108208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:36.109567 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:36.116793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.117250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.118040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.118487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.148205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:49:36.197459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.compute.api [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Instance is already in deleting state, ignoring this request Jul 19 20:49:36.198220 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55787867-27ca-4a86-b07f-01c7690697d3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 204 len: 0 microversion: 2.1 time: 0.095185 Jul 19 20:49:36.198807 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3311/6728] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:36 2022] DELETE /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:49:36.208165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:36.208953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:36.211138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:36.217026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.217503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.219436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.220092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.360802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.368834 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d923385e-30df-40d5-9c1b-0dd406edde15 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1513 microversion: 2.1 time: 0.165517 Jul 19 20:49:36.369417 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3418/6729] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:36 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:37.386481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:37.387070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:37.390006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:37.396147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.396622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.397433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.397892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.545820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91da23b91c9b4be8b261a9b8caec8ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b397e41bdd74a419b57e1a9ce900bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.554890 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-300898ea-aa96-4c5e-8b66-736e865277fd tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 200 len: 1513 microversion: 2.1 time: 0.172779 Jul 19 20:49:37.555498 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3312/6730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:37 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:38.271996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-286e686f-071f-4b59-9c37-44d420c48c0e req-dfa08aca-f41b-4cce-8d2c-1c36c038cd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6da1f-966b-4fb5-b533-780bd3be28d4", "name": "network-vif-deleted", "tag": "e7b90a5a-5f15-47ee-be9b-50b0e7e36abc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:38.284006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-286e686f-071f-4b59-9c37-44d420c48c0e req-dfa08aca-f41b-4cce-8d2c-1c36c038cd6b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.284565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-286e686f-071f-4b59-9c37-44d420c48c0e req-dfa08aca-f41b-4cce-8d2c-1c36c038cd6b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.303795 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-286e686f-071f-4b59-9c37-44d420c48c0e req-dfa08aca-f41b-4cce-8d2c-1c36c038cd6b service nova] Creating event network-vif-deleted:e7b90a5a-5f15-47ee-be9b-50b0e7e36abc for instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 on n-h1-843861-3 Jul 19 20:49:38.309243 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-286e686f-071f-4b59-9c37-44d420c48c0e req-dfa08aca-f41b-4cce-8d2c-1c36c038cd6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041933 Jul 19 20:49:38.309973 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3419/6731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:38.572240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.573325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 05a6da1f-966b-4fb5-b533-780bd3be28d4] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:38.584575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.585304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.586217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.586796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.602081 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] HTTP exception thrown: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Request method failure captured: Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 HTTP/1.1 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xh5d_TM6NPb0QadDcGXptfAuzDdPgl3g6G9Eyo1svCgs0F8odZOwQE5XGt6NYcFPvopJLKQOllUXn1T1dKKY1OhIg_p7Es-FkkhI107uoA3QPjKRE9aq8wOYYzIU9U8zg2mp-lAu9IczowxBnDK0exqxBaNdn2SCClxZkc72eM-JXk Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 91da23b91c9b4be8b261a9b8caec8ce7 Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '05a6da1f-966b-4fb5-b533-780bd3be28d4'} Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:38.603736 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Returning 404 to user: Instance 05a6da1f-966b-4fb5-b533-780bd3be28d4 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f969d879-7035-45da-84e1-e755a61ec2c3 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4" status: 404 len: 111 microversion: 2.1 time: 0.037452 Jul 19 20:49:38.607849 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3313/6732] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:38 2022] GET /compute/v2.1/servers/05a6da1f-966b-4fb5-b533-780bd3be28d4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:38.616982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-662f7be7-e7b4-4589-bc17-1ada78a850e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '.version_select at 0x7fb893038160>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.641043 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-662f7be7-e7b4-4589-bc17-1ada78a850e0 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441367966" status: 202 len: 0 microversion: 2.1 time: 0.028820 Jul 19 20:49:38.641833 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3420/6733] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 19 20:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441367966 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:49:39.660844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:39.661397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:39.668206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.668736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.669520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.669957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.684603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] HTTP exception thrown: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Request method failure captured: Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b HTTP/1.1 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xh5d_TM6NPb0QadDcGXptfAuzDdPgl3g6G9Eyo1svCgs0F8odZOwQE5XGt6NYcFPvopJLKQOllUXn1T1dKKY1OhIg_p7Es-FkkhI107uoA3QPjKRE9aq8wOYYzIU9U8zg2mp-lAu9IczowxBnDK0exqxBaNdn2SCClxZkc72eM-JXk Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 91da23b91c9b4be8b261a9b8caec8ce7 Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b'} Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:39.686157 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Returning 404 to user: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0a21cd42-0d7c-409f-9d10-7f4ac325aa77 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "DELETE /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 404 len: 111 microversion: 2.1 time: 0.031032 Jul 19 20:49:39.690851 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3314/6734] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:39 2022] DELETE /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:39.699281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:39.700043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] [instance: 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:39.707073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.707520 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.708396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.708830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.723834 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] HTTP exception thrown: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Request method failure captured: Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b HTTP/1.1 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xh5d_TM6NPb0QadDcGXptfAuzDdPgl3g6G9Eyo1svCgs0F8odZOwQE5XGt6NYcFPvopJLKQOllUXn1T1dKKY1OhIg_p7Es-FkkhI107uoA3QPjKRE9aq8wOYYzIU9U8zg2mp-lAu9IczowxBnDK0exqxBaNdn2SCClxZkc72eM-JXk Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b397e41bdd74a419b57e1a9ce900bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 1b397e41bdd74a419b57e1a9ce900bb5 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-939650090 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 91da23b91c9b4be8b261a9b8caec8ce7 Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerDiskConfigTestJSON-939650090-project Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b'} Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:39.725515 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] Returning 404 to user: Instance 51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2aec80c0-0c72-4faf-959f-03265c339840 tempest-ServerDiskConfigTestJSON-939650090 tempest-ServerDiskConfigTestJSON-939650090-project] 10.222.0.33 "GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b" status: 404 len: 111 microversion: 2.1 time: 0.032448 Jul 19 20:49:39.732145 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3421/6735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:39 2022] GET /compute/v2.1/servers/51c0ab9c-61fa-4c13-a1ce-1efe3dfed28b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:48.795070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d6d5449f-8ccd-477b-b593-83a2dadf7a93 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: .version_select at 0x7fb88c172dc0>, body: {"keypair": {"name": "tempest-keypair-23138187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPu0GGmaJjmkDvvPkGNh6vE2rUW7stpnXVauhVk5RZyr5SRhduxLcL7tSYaiUHo6op8KPNTi1X9kLteYcS57GlYUYjCH23evbuR8gZj89MeZjkGxa1XSF9xrfXNhSEkMbA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:48.809842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d6d5449f-8ccd-477b-b593-83a2dadf7a93 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:48.816042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-d6d5449f-8ccd-477b-b593-83a2dadf7a93 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:48.840757 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d6d5449f-8ccd-477b-b593-83a2dadf7a93 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.170321 Jul 19 20:49:48.841363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3315/6736] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:49:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:50.565250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:50.568266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:50.576686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-610843634", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fee9b512-4898-41be-b489-8848070db704"}], "security_groups": [{"name": "tempest-securitygroup--671971149"}], "key_name": "tempest-keypair-23138187", "user_data": "}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:50.730464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] validate_networks() for [('fee9b512-4898-41be-b489-8848070db704', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:51.158438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:51.159107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:51.159790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:51.160342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:51.160921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:51.179257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.180381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.182053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.183006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.239469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:51.245716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:51.260223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:51.262545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:51.322513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c672745-c406-474b-9f57-ebe8603d314a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.763568 Jul 19 20:49:51.323715 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3422/6737] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:49:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:49:51.330859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:51.336150 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-51fc8932-4b4c-45ce-b653-34c8155586f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:51.336794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-51fc8932-4b4c-45ce-b653-34c8155586f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:51.423178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-51fc8932-4b4c-45ce-b653-34c8155586f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:51.431241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-51fc8932-4b4c-45ce-b653-34c8155586f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1236 microversion: 2.1 time: 0.101027 Jul 19 20:49:51.432275 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3316/6738] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:51 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1236 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:52.448531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:52.449160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:52.457024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.457487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.458279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.458892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.538193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.548728 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e04f34f9-9c59-4796-9bc0-1a1c35c3b277 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1296 microversion: 2.1 time: 0.103967 Jul 19 20:49:52.549412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3423/6739] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:52 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:53.567166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:53.567914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:53.575774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.576269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.577615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.578069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.787156 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.795653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3e1e09e9-349b-489f-92de-4fc556a664f2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.233091 Jul 19 20:49:53.796329 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3317/6740] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:53 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:54.088847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-3d18755a-dbd6-48e7-8b3a-cf862bbaf2aa req-15081ef5-8b98-4fa9-95c6-309ab12ed9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:54.100192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3d18755a-dbd6-48e7-8b3a-cf862bbaf2aa req-15081ef5-8b98-4fa9-95c6-309ab12ed9c9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.100679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-3d18755a-dbd6-48e7-8b3a-cf862bbaf2aa req-15081ef5-8b98-4fa9-95c6-309ab12ed9c9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.120304 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-3d18755a-dbd6-48e7-8b3a-cf862bbaf2aa req-15081ef5-8b98-4fa9-95c6-309ab12ed9c9 service nova] Creating event network-changed:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h2-843861-3 Jul 19 20:49:54.125955 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-3d18755a-dbd6-48e7-8b3a-cf862bbaf2aa req-15081ef5-8b98-4fa9-95c6-309ab12ed9c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040812 Jul 19 20:49:54.126594 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3424/6741] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:54.814622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:54.815662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:54.823432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.823933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.824729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.825282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.963795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:54.972121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-17770bed-5c89-46bd-a568-4120b573a287 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.162073 Jul 19 20:49:54.972710 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3318/6742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:54 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:55.990992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:55.991694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:55.998190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.998639 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.999490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.999957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:56.158663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:56.166296 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6afd9ef7-b1bc-40f7-bbca-653938f41f02 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.180462 Jul 19 20:49:56.166873 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3425/6743] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:55 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:57.182858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:57.183527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:57.191091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.191556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.192389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.192844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.447833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:57.456417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3a273e53-7052-4a19-8aa3-3fe6db4320ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.277488 Jul 19 20:49:57.457011 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3319/6744] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:57 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:58.474923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:58.475494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:58.482224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.482676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.484099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.484543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.625486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:58.633314 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-19c74cc0-bd67-4142-8efe-c433e5590443 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.162535 Jul 19 20:49:58.633893 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3426/6745] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:58 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:59.650906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:59.651520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:59.660528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.661288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.662411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.663157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.082987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.091837 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09548632-d9a6-4518-a5b9-92022c985652 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.444697 Jul 19 20:50:00.092443 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3320/6746] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:59 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:01.110024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:01.110620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:01.118155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.118611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.119669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.120144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.208739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:01.253643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:01.262462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:01.269963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bef35a87-3310-410d-a11d-c8b6eae1f604 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.164362 Jul 19 20:50:01.270542 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3427/6747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:01 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:02.131624 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.192235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b8fda406-df79-477a-afed-e2f29fac0292 req-a23f4f48-57d6-4cff-9e90-7b2cdf8f4857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "name": "network-vif-plugged", "status": "completed", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:02.204461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b8fda406-df79-477a-afed-e2f29fac0292 req-a23f4f48-57d6-4cff-9e90-7b2cdf8f4857 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.204461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b8fda406-df79-477a-afed-e2f29fac0292 req-a23f4f48-57d6-4cff-9e90-7b2cdf8f4857 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.213780 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b8fda406-df79-477a-afed-e2f29fac0292 req-a23f4f48-57d6-4cff-9e90-7b2cdf8f4857 service nova] Creating event network-vif-plugged:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h2-843861-3 Jul 19 20:50:02.221147 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b8fda406-df79-477a-afed-e2f29fac0292 req-a23f4f48-57d6-4cff-9e90-7b2cdf8f4857 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094227 Jul 19 20:50:02.221520 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3321/6748] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:02.287403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:02.287989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:02.297857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.298901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.299951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.300406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.513991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:02.523237 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8c669b0-ece5-4c14-b303-235139bd4512 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.240029 Jul 19 20:50:02.523866 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3428/6749] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:02 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:03.541988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:03.542609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:03.549128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.549740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.550393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.550847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.694046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.701733 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3655a882-7af4-4152-9e7e-f0b57b60e77c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1361 microversion: 2.1 time: 0.164877 Jul 19 20:50:03.703165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3322/6750] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:03 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:04.720153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.720791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.728010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.728465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.729250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.729691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.872298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.880436 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6178c24b-630d-464c-882f-1ea01e1fad71 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1547 microversion: 2.1 time: 0.165054 Jul 19 20:50:04.881035 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3429/6751] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:04.897344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.897888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.905590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.906062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.906847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.907300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.989198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b2ca1af3-6dd5-4516-bbf2-49be997272b9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095694 Jul 19 20:50:04.990189 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3323/6752] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:06.089228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b27bd5ef-6e5a-4de3-b8d8-f5e585fa4ecd req-89586542-5952-4cd9-8fae-55ce51761864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:06.098353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b27bd5ef-6e5a-4de3-b8d8-f5e585fa4ecd req-89586542-5952-4cd9-8fae-55ce51761864 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.098887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b27bd5ef-6e5a-4de3-b8d8-f5e585fa4ecd req-89586542-5952-4cd9-8fae-55ce51761864 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.110827 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b27bd5ef-6e5a-4de3-b8d8-f5e585fa4ecd req-89586542-5952-4cd9-8fae-55ce51761864 service nova] Creating event network-changed:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h2-843861-3 Jul 19 20:50:06.116080 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b27bd5ef-6e5a-4de3-b8d8-f5e585fa4ecd req-89586542-5952-4cd9-8fae-55ce51761864 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086359 Jul 19 20:50:06.116974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3430/6753] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:21.118422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:21.119832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:21.125179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.125810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.134262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.134731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.135709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.136200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.308477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.316828 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-11da29a6-5cc8-4d71-b107-853179d0392f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.201483 Jul 19 20:51:21.317427 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3324/6754] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:21.332814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:21.333658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=42 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:21.339160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.339840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.348638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.349212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.350091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.350622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.497988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.507469 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dc40f0a6-bcd1-4301-b0aa-7ea5443112a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.176735 Jul 19 20:51:21.508341 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3431/6755] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:21.527559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.528295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.535526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.536067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.536880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.537332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.735386 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.744529 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5597120-48e5-4022-84ee-1fa8cad4041e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.221062 Jul 19 20:51:21.745144 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3325/6756] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:21.764910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:21.766108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.774197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.774646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.776141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.776141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.816480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.823378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:51:21.831882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:51:21.832304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:51:21.832779 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:51:21.833184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:51:21.833595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:51:21.908047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea113e17-7e22-43ad-87a0-5266b45fd310 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/action" status: 202 len: 0 microversion: 2.1 time: 0.148043 Jul 19 20:51:21.908644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3432/6757] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:51:21 2022] POST /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:51:21.923878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.925430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.937066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.938021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.939461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.940347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.194940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:22.209800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-93e38f54-a144-4f11-99ad-2985016de175 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.293647 Jul 19 20:51:22.210811 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3326/6758] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:23.238412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:23.239139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:23.245752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.246235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.247277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.247934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.419117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:23.427752 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-33a01787-3e40-4a58-97d4-95033e92841c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.194920 Jul 19 20:51:23.428376 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3433/6759] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:23 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:24.457859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:24.458590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:24.466647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.467629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.468486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.468934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.686317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:24.695553 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0c23d41c-f42e-4a89-8d85-5bf2298a6599 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.243441 Jul 19 20:51:24.696232 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3327/6760] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:24 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:25.722150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:25.723153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:25.730670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.731125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.731950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.732387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.898184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:25.912084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6c61bd4-915c-43d4-b2fe-45291bb1b3a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.194279 Jul 19 20:51:25.913130 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3434/6761] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:25 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:26.940870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:26.941906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:26.949646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.950243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.952399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.952801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.142509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:27.150937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cc6e5a8-3e72-4372-97b3-52ef4ea5d596 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.215318 Jul 19 20:51:27.151564 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3328/6762] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:26 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:28.173871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:28.174961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:28.186167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.186759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.188749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.189364 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.435024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:28.444205 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05609c34-9718-45e5-98be-c52d71446ed6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1675 microversion: 2.1 time: 0.279574 Jul 19 20:51:28.444966 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3435/6763] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:28 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:29.470948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:29.471762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:29.479046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.479508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.480340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.480786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.673946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:29.688699 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-61997f4b-d36c-4e48-a288-3dac1d371cc4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.221719 Jul 19 20:51:29.689715 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3329/6764] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:29 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:30.720517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:30.724294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:30.737795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.738338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.739276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.739713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.911128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:30.924903 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c420946-5da1-4896-a95e-adca0d296aa3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.211697 Jul 19 20:51:30.925922 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3436/6765] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:30 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:31.952735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:31.953555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:31.961717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.962187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.962979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.963429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:32.127230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:32.140871 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1fb4d213-aa43-4ac6-85d2-780b3395dd4f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.192343 Jul 19 20:51:32.141889 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3330/6766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:31 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:33.167599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:33.168468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:33.177290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:33.177801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:33.178681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:33.179163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:33.353219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:33.362084 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8fc10e6-d7df-4292-a26c-6ae8186014f1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.198144 Jul 19 20:51:33.362912 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3437/6767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:33 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:34.384163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:34.385334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:34.397909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:34.398696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:34.400183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:34.400986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:34.587986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:34.600941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d3402069-1e75-4939-9434-68c928a64865 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.223624 Jul 19 20:51:34.601923 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3331/6768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:34 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:35.629165 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:35.630634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:35.638184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:35.639210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:35.640111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:35.640550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:35.799829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:35.814152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-82a2f507-cb04-4510-81a7-8c3bed5a452f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.192560 Jul 19 20:51:35.815172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3438/6769] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:35 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:36.841664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:36.842387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:36.850897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:36.851523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:36.852278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:36.852734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:37.418016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:37.427406 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a7679af3-37e0-4f22-858b-9c146f453b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.590057 Jul 19 20:51:37.428200 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3332/6770] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:36 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:38.447974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:38.448880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:38.460010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:38.460469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:38.461275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:38.461719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:38.699250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:38.709640 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b53d4cd3-353c-4fd2-9859-2be5217646d2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.267137 Jul 19 20:51:38.710486 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3439/6771] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:38 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:39.740152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:39.740806 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:39.750504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:39.750504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:39.750504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:39.750504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:39.926511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:39.940824 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-55d7f839-30b7-46db-9622-f4bd9bebeb2b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.205174 Jul 19 20:51:39.941831 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3333/6772] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:39 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:40.966809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:40.967668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:40.975225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:40.975728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:40.976579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:40.977061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:41.139926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:41.150529 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57760cb5-787c-4cd9-af71-39026b447b74 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.187736 Jul 19 20:51:41.151136 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3440/6773] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:40 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:42.180358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:42.181371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:42.193239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:42.193964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:42.195204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:42.195955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:42.392202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:42.407223 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd3e8c7d-8a56-4902-a551-e48420791600 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.233000 Jul 19 20:51:42.408352 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3334/6774] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:42 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:43.433446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:43.434418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:43.444194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:43.444648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:43.445730 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:43.446313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:43.648453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:43.657877 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8b3c94aa-c8c7-417e-8df1-879a43ad800b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.228284 Jul 19 20:51:43.658681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3441/6775] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:43 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:44.676735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:44.677352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:44.685708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:44.686183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:44.687091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:44.687523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:44.857638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:44.866145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b4378911-56c9-4cf7-b734-7374ebe14cc6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.193231 Jul 19 20:51:44.866743 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3335/6776] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:44 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:45.892869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:45.893518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:45.900840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:45.901287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:45.902069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:45.902504 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:46.081808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:46.090044 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-764a48f7-6d9e-4b0a-8e21-7a6e569fb4ea tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1680 microversion: 2.1 time: 0.201065 Jul 19 20:51:46.090637 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3442/6777] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:45 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:46.801137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "name": "network-vif-unplugged", "status": "completed", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:46.811589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:46.812188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:46.826394 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] Creating event network-vif-unplugged:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h1-843861-3 Jul 19 20:51:46.833615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] Instance a750e70b-04af-4a3e-95c2-e24500e32b00 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:51:46.847263 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-32b4d278-0581-4032-a4ae-d1adba1b69b7 req-79cbe2a3-0e01-4270-9a60-c4346e77d0f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051356 Jul 19 20:51:46.848342 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3336/6778] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:47.108901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:47.110058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:47.119243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:47.119794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:47.120669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:47.121172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:47.360739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:47.369899 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea19a391-2121-4c9e-a1ad-20cd86ffeb01 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1679 microversion: 2.1 time: 0.266940 Jul 19 20:51:47.370521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3443/6779] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:47 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:48.401696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:48.402801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:48.411455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:48.411947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:48.412752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:48.413418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:48.588400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:48.601834 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-79ee4c5c-0a09-4c81-a45c-d6129cf276a0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1677 microversion: 2.1 time: 0.205487 Jul 19 20:51:48.602879 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3337/6780] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:48 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:48.863348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:48.873077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:48.873516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:48.887416 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] Creating event network-changed:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h1-843861-3 Jul 19 20:51:48.894609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] Instance a750e70b-04af-4a3e-95c2-e24500e32b00 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:51:48.914265 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7042a94c-2ab5-4ff4-9983-7785eba17eb7 req-bd68c00a-234a-4492-ba75-2a6a78e5b6bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053980 Jul 19 20:51:48.915340 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3444/6781] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:51:49.624121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:49.625202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:49.646029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:49.646736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:49.654749 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:49.656604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:49.972484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:49.983795 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6f996da-73e7-458a-810f-2984f16e8dd0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1677 microversion: 2.1 time: 0.365997 Jul 19 20:51:49.984569 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3338/6782] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:49 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1677 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:51.012361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:51.013805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:51.021713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.021978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.022954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.023418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.207567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:51.218668 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5f9a4bd4-5d85-44ba-956b-65a3420d49c0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1674 microversion: 2.1 time: 0.210737 Jul 19 20:51:51.219563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3445/6783] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:51 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:51.241135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:51.241760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:51.244825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=31 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:51.264428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.265179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.266393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.267230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.271168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=89 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:51.345614 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b0d7a8a7-0d66-43e3-8902-98b2d4148484 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/action" status: 204 len: 0 microversion: 2.1 time: 0.108420 Jul 19 20:51:51.346366 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3339/6784] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:51:51 2022] POST /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00/action => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:51:51.355322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:51.355966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:51.359647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=35 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:51.363505 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.363970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.364748 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:51.365174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:51.368973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:51.614985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:51.624518 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-20f83a36-5210-44f2-828f-f6fc870294a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1674 microversion: 2.1 time: 0.273223 Jul 19 20:51:51.625127 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3446/6785] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:51 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:52.652746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:52.653772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:52.662676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:52.663290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:52.664329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:52.664887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:52.853644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:52.863829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2e290a17-af8d-4bc0-86f5-1a4b2740b05c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1674 microversion: 2.1 time: 0.217008 Jul 19 20:51:52.864517 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3340/6786] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:52 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:53.776795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1b26728c-0554-40fb-bf5b-c4aa5bc8964e req-9ee42197-19e7-4415-af8b-7cda15d3aa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "name": "network-vif-plugged", "status": "completed", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:53.797795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b26728c-0554-40fb-bf5b-c4aa5bc8964e req-9ee42197-19e7-4415-af8b-7cda15d3aa92 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:53.798538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1b26728c-0554-40fb-bf5b-c4aa5bc8964e req-9ee42197-19e7-4415-af8b-7cda15d3aa92 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:53.820387 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1b26728c-0554-40fb-bf5b-c4aa5bc8964e req-9ee42197-19e7-4415-af8b-7cda15d3aa92 service nova] Creating event network-vif-plugged:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h1-843861-3 Jul 19 20:51:53.829962 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1b26728c-0554-40fb-bf5b-c4aa5bc8964e req-9ee42197-19e7-4415-af8b-7cda15d3aa92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060234 Jul 19 20:51:53.830845 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3447/6787] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:51:53.887521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:53.889292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:53.901762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:53.902584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:53.904597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:53.905413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.072847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:54.084720 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7691e305-c31f-472c-a3bc-30c8dfe56cbd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.205250 Jul 19 20:51:54.085378 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3341/6788] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:53 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:54.108214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:54.109497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:54.120963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.121767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.123672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.124466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.316700 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:54.331159 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-407bbab1-e73b-41c1-a893-24a176f398f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.230718 Jul 19 20:51:54.332304 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3448/6789] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:54 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:54.357244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:54.357985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:54.365379 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.365981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.366872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.367409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.565231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:54.573875 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-402f1b43-40fb-45b1-b54d-4e2e9cd5f125 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1666 microversion: 2.1 time: 0.221024 Jul 19 20:51:54.574579 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3342/6790] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:54 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1666 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:54.591145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:54.591708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:54.600012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.600508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.601340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.601818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.633233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:51:54.737796 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-04fce8aa-0092-4662-8421-04a919c8c21e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 204 len: 0 microversion: 2.1 time: 0.150284 Jul 19 20:51:54.739796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3449/6791] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:51:54 2022] DELETE /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:51:54.751376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:54.752238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:54.760429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.761053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.762012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:54.763506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:54.934141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:54.942624 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ac6621ca-99b7-4a65-8bc6-358087c9bc26 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1672 microversion: 2.1 time: 0.196670 Jul 19 20:51:54.943480 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3343/6792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:54 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:55.963681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:55.964808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:55.973430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:55.973881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:55.974842 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:55.975209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:56.154852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:56.164343 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-247b01dc-d1e2-4a49-a79c-9316e631a9bf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1672 microversion: 2.1 time: 0.206079 Jul 19 20:51:56.164942 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3450/6793] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:55 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:57.185260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fa22cfc8-a2b2-432d-8a00-b081b01a158e req-38b929d2-afac-4207-ab09-0bcd702351e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a750e70b-04af-4a3e-95c2-e24500e32b00", "name": "network-vif-deleted", "tag": "bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:57.186525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:57.187496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:57.199408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:57.200314 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:57.201703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:57.202733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:57.222774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fa22cfc8-a2b2-432d-8a00-b081b01a158e req-38b929d2-afac-4207-ab09-0bcd702351e6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:57.223961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fa22cfc8-a2b2-432d-8a00-b081b01a158e req-38b929d2-afac-4207-ab09-0bcd702351e6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:57.250698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fa22cfc8-a2b2-432d-8a00-b081b01a158e req-38b929d2-afac-4207-ab09-0bcd702351e6 service nova] Creating event network-vif-deleted:bca8c6fc-fc13-4e97-b6f9-4b7c0573ea2e for instance a750e70b-04af-4a3e-95c2-e24500e32b00 on n-h1-843861-3 Jul 19 20:51:57.257316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fa22cfc8-a2b2-432d-8a00-b081b01a158e req-38b929d2-afac-4207-ab09-0bcd702351e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081797 Jul 19 20:51:57.258755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3344/6794] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:57.309016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:57.318437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-da6ca757-c8f1-45af-a6e1-891e7bc557fa tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 200 len: 1605 microversion: 2.1 time: 0.138681 Jul 19 20:51:57.323932 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3451/6795] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:57 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 1605 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:58.341854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:58.342605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:58.350641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:58.351196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:58.352207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:58.352983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:58.369339 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 HTTP/1.1 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a750e70b-04af-4a3e-95c2-e24500e32b00'} Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:58.371279 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9849ce8-13d2-4d27-aa3e-ad3675647724 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 404 len: 111 microversion: 2.1 time: 0.039891 Jul 19 20:51:58.380162 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3345/6796] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:58 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:58.397642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:58.397642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:58.407949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:58.408513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:58.409423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:58.409985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:58.431108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 HTTP/1.1 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a750e70b-04af-4a3e-95c2-e24500e32b00'} Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:58.433388 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb3abecb-9acc-4440-ac98-062f53cd61ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 404 len: 111 microversion: 2.1 time: 0.045988 Jul 19 20:51:58.443163 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3452/6797] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:58 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:58.522837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-240706538", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "fee9b512-4898-41be-b489-8848070db704"}], "security_groups": [{"name": "tempest-securitygroup--671971149"}], "key_name": "tempest-keypair-23138187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:58.662393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] validate_networks() for [('fee9b512-4898-41be-b489-8848070db704', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:51:59.574777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:51:59.576794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:51:59.576925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:51:59.577416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:51:59.578043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:51:59.590823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:59.592238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:59.592850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:59.593144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:59.613308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:51:59.620152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:51:59.636061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:51:59.639052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:51:59.705838 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [88d4232a-3c07-46df-aa79-c31e075f5333] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:52:00.714377 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [88d4232a-3c07-46df-aa79-c31e075f5333] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 32846. Jul 19 20:52:00.720359 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b906541-54b8-4366-8cbd-990b7e1420f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.210082 Jul 19 20:52:00.721494 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3346/6798] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:51:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:52:00.736426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-96888547-df24-43b7-9f78-05a154c2ae62 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:00.738413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-96888547-df24-43b7-9f78-05a154c2ae62 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:00.831405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-96888547-df24-43b7-9f78-05a154c2ae62 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:00.843041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-96888547-df24-43b7-9f78-05a154c2ae62 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1236 microversion: 2.1 time: 0.113176 Jul 19 20:52:00.844113 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3453/6799] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:00 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:01.872770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f819373f-0e33-4f16-8fbf-d35584abf237 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:01.873655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f819373f-0e33-4f16-8fbf-d35584abf237 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:01.933756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f819373f-0e33-4f16-8fbf-d35584abf237 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:01.942047 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f819373f-0e33-4f16-8fbf-d35584abf237 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1236 microversion: 2.1 time: 0.075259 Jul 19 20:52:01.942654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3347/6800] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:01 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:02.960647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:02.961470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:02.973278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:02.973720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:02.974796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:02.975346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:03.107273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:03.120651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a14c4a9f-473f-4ac1-adb0-e0005f2b8210 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1296 microversion: 2.1 time: 0.163440 Jul 19 20:52:03.122202 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3454/6801] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:02 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:04.140431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:04.141341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:04.152823 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:04.153282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:04.154112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:04.154677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:04.453890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:04.461829 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2abf6d33-1da9-4dff-a3f7-e89a51374b4e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.325336 Jul 19 20:52:04.462578 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3348/6802] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:04 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:04.982799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6faa301b-2d58-43ef-905f-de51c6887b8c req-2d814736-92c1-47ef-9601-ff33fe5cc530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:04.993783 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6faa301b-2d58-43ef-905f-de51c6887b8c req-2d814736-92c1-47ef-9601-ff33fe5cc530 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:04.994387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6faa301b-2d58-43ef-905f-de51c6887b8c req-2d814736-92c1-47ef-9601-ff33fe5cc530 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:05.020422 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6faa301b-2d58-43ef-905f-de51c6887b8c req-2d814736-92c1-47ef-9601-ff33fe5cc530 service nova] Creating event network-changed:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h1-843861-3 Jul 19 20:52:05.025930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6faa301b-2d58-43ef-905f-de51c6887b8c req-2d814736-92c1-47ef-9601-ff33fe5cc530 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046847 Jul 19 20:52:05.026648 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3455/6803] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:05.483876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:05.484472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:05.494658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:05.495471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:05.497529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:05.498657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:05.677691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:05.690802 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07071af5-cf68-4419-8755-640ae70f11d6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.210772 Jul 19 20:52:05.691666 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3349/6804] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:05 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:06.711478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:06.712641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:06.720603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:06.721198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:06.721901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:06.722398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:07.032187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:07.046878 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4edde208-5d25-40d8-9527-d81ceb1fea73 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.340517 Jul 19 20:52:07.048393 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3456/6805] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:06 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:08.077225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:08.077997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:08.086675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:08.087169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:08.088083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:08.088558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:08.286249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:08.300601 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ea706d4-512d-49e3-aff1-69c930828995 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.228513 Jul 19 20:52:08.301534 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3350/6806] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:08 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:09.326903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:09.327845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:09.337889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.338713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.340081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.340821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.517335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:09.526736 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3058f5a5-4bdd-4218-be57-22242b11d95f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.205061 Jul 19 20:52:09.527362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3457/6807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:09 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:10.554840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:10.555693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:10.558686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:10.566350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:10.566864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:10.567773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:10.568309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:10.757154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:10.766769 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-06d75f22-2282-469e-b427-05e1a291bdf4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.216070 Jul 19 20:52:10.767413 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3351/6808] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:10 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:11.789750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:11.790640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:11.794938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:11.801985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.802476 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.803519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.804073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.958807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-38078926-4256-452f-b20f-41fa6fa3f5f5 req-807371cb-a7f1-4489-aeb9-707e7b6945ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "name": "network-vif-plugged", "status": "completed", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:11.970092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:11.973870 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-38078926-4256-452f-b20f-41fa6fa3f5f5 req-807371cb-a7f1-4489-aeb9-707e7b6945ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.974592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-38078926-4256-452f-b20f-41fa6fa3f5f5 req-807371cb-a7f1-4489-aeb9-707e7b6945ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.988892 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-38078926-4256-452f-b20f-41fa6fa3f5f5 req-807371cb-a7f1-4489-aeb9-707e7b6945ad service nova] Creating event network-vif-plugged:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h1-843861-3 Jul 19 20:52:11.994549 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-38078926-4256-452f-b20f-41fa6fa3f5f5 req-807371cb-a7f1-4489-aeb9-707e7b6945ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039394 Jul 19 20:52:11.995500 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3352/6809] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:12.044717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:12.079467 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f395b1b8-19f5-4db9-ab30-91d1a16c72b4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.294439 Jul 19 20:52:12.080788 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3458/6810] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:11 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:13.113891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:13.114858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:13.121906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:13.122378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:13.123211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:13.123694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:13.312097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:13.321324 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aee3c749-48c7-4faa-995f-7867ae3da630 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1361 microversion: 2.1 time: 0.217582 Jul 19 20:52:13.322010 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3353/6811] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:13 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:14.343191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:14.343876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:14.351104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.351556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.352371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.352810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.558992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:14.568682 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cc8bc60-e4c3-42d7-8f59-a6062a90b1fd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1548 microversion: 2.1 time: 0.229615 Jul 19 20:52:14.569537 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3459/6812] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:14 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:14.593395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:14.593395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:14.606091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.607206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.608691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.609522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.709734 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-81fd61f6-77be-498a-a768-9b417f9044d8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126218 Jul 19 20:52:14.710371 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3354/6813] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:52:14 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:15.840976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f795389-5b1d-49c5-b186-7fc4298a24c9 req-e76af546-8c44-4e9a-8bc4-478f5b8916f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:15.850751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f795389-5b1d-49c5-b186-7fc4298a24c9 req-e76af546-8c44-4e9a-8bc4-478f5b8916f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:15.851191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f795389-5b1d-49c5-b186-7fc4298a24c9 req-e76af546-8c44-4e9a-8bc4-478f5b8916f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:15.863846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f795389-5b1d-49c5-b186-7fc4298a24c9 req-e76af546-8c44-4e9a-8bc4-478f5b8916f8 service nova] Creating event network-changed:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h1-843861-3 Jul 19 20:52:15.869217 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f795389-5b1d-49c5-b186-7fc4298a24c9 req-e76af546-8c44-4e9a-8bc4-478f5b8916f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031961 Jul 19 20:52:15.869942 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3460/6814] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:18.453640 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:52:18.454510 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:52:50.883942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:50.884740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:50.890211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b24f3f96-89d0-4879-96c3-c85975ab5867 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:50.898291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b24f3f96-89d0-4879-96c3-c85975ab5867 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.898747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b24f3f96-89d0-4879-96c3-c85975ab5867 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.923528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b24f3f96-89d0-4879-96c3-c85975ab5867 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Going to try to stop instance {{(pid=126007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:52:50.972449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b24f3f96-89d0-4879-96c3-c85975ab5867 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action" status: 202 len: 0 microversion: 2.1 time: 0.090941 Jul 19 20:52:50.973094 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3355/6815] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:52:50 2022] POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:52:50.981409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:50.982577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:50.987085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:50.987955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:50.998295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.998829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.999689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:51.000184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:51.158873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:51.168651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e991c5fc-d495-4dd8-8466-58a865f2c8b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.189995 Jul 19 20:52:51.169376 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3461/6816] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:50 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:52.195307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:52.196053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:52.204468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:52.204930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:52.205719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:52.206160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:52.362182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:52.369215 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0038bb0f-524d-4509-928c-9c6bfe2c592b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.178268 Jul 19 20:52:52.369809 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3356/6817] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:52 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:53.388522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:53.389455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:53.396104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.396550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.397320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.397750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.549143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:53.557085 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1b5d186-427c-463a-a51e-19580ced43b3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.172967 Jul 19 20:52:53.557682 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3462/6818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:53 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:54.578077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:54.578721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:54.586094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.586558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.587361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.587820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.728982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:54.737293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-124f79d1-10d9-4404-a41c-af5e745c2509 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.163275 Jul 19 20:52:54.737890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3357/6819] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:54 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:55.757198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:55.757795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:55.764916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.765363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.766137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.766568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.910661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:55.919372 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2fbbd457-d93e-403c-823c-967d8e5a0f12 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.166240 Jul 19 20:52:55.920021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3463/6820] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:55 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:56.938511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:56.939204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:56.946252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:56.946778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:56.947625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:56.948224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.088189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:57.096997 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-82f6f47e-4c3c-4ca3-a37b-ae8a3dcbbabb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.163604 Jul 19 20:52:57.097592 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3358/6821] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:56 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:58.114816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:58.115398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:58.122301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:58.122757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:58.123543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:58.124023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:58.263545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:58.271560 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7920a8b6-36b5-4cc8-a7f4-54d4f04b3d3d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.160746 Jul 19 20:52:58.272178 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3464/6822] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:58 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:59.295147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:59.296523 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:59.309904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:59.310748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:59.312279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:59.313026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:59.466489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:59.474790 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a8813b7-df0e-4919-a310-83417cdba9b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.188268 Jul 19 20:52:59.475412 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3359/6823] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:59 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:00.493876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:00.494465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:00.502284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:00.502726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:00.503508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:00.503966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:00.655030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:00.665272 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-316c8d54-c40a-4823-af78-221678fbed89 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.175738 Jul 19 20:53:00.666220 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3465/6824] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:00 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:01.684871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:01.685985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:01.694438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.694911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.695690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.696173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.837700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:01.846549 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49f003b5-44f0-4368-a142-99ce7185d198 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1654 microversion: 2.1 time: 0.166355 Jul 19 20:53:01.847142 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3360/6825] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:01 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:01.863517 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:01.864555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:01.872584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.873029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.873814 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.874249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.904998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:01.911420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:53:01.918216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:53:01.918651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:53:01.919157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:53:01.919570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:53:01.920031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:53:01.992773 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9fc4a913-91c5-440a-9ed7-a7ebac3b4ebb tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action" status: 202 len: 0 microversion: 2.1 time: 0.133184 Jul 19 20:53:01.993495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3466/6826] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:01 2022] POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:53:02.006855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:02.008075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:02.020587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:02.021408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:02.023034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:02.023909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:02.209982 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:02.219947 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dcf8b224-a1dc-44b8-8168-aeb09ccbb847 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.220725 Jul 19 20:53:02.220866 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3361/6827] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:01 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:03.239770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:03.240575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:03.249151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:03.249931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:03.250808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:03.251449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:03.398096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:03.406292 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a36bb94f-804c-42a5-b5ca-b6b50b269744 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1677 microversion: 2.1 time: 0.171931 Jul 19 20:53:03.406868 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3467/6828] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:03 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:04.423840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:04.424407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:04.431519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:04.432035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:04.433462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:04.433918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:04.577758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:04.585981 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3c10e4f0-5954-4f22-89d7-1582a8872324 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1682 microversion: 2.1 time: 0.166172 Jul 19 20:53:04.586587 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3362/6829] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:04 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:05.604209 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:05.604898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:05.611952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:05.612410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:05.613183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:05.613622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:05.753851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:05.762340 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-daa53dd3-9761-44c4-b41e-7cfbbfdebe69 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1682 microversion: 2.1 time: 0.162103 Jul 19 20:53:05.762929 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3468/6830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:05 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:06.786322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:06.786932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:06.789641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "name": "network-vif-unplugged", "status": "completed", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:06.800529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:06.800982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:06.804354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:06.807465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:06.808587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:06.809174 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:06.822623 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] Creating event network-vif-unplugged:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h2-843861-3 Jul 19 20:53:06.830623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:53:06.848904 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f7fb4eef-4c0e-46b7-8fbe-174e68a455bb req-3a488767-8b50-4f85-9c45-c2bf177537ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067301 Jul 19 20:53:06.849599 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3469/6831] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:07.497364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:07.507925 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-651a7f26-c062-4b75-83c8-2a76e6eeb645 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1681 microversion: 2.1 time: 0.729931 Jul 19 20:53:07.509303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3363/6832] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:06 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1681 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:08.527773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:08.528624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:08.536636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.537099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.537893 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.538331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.683138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:08.690887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea8d2e1a-5902-4584-9cfc-bba7d34aedf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1679 microversion: 2.1 time: 0.168061 Jul 19 20:53:08.691467 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3470/6833] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:08 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:08.863630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:08.874459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.874966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.888927 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] Creating event network-changed:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h2-843861-3 Jul 19 20:53:08.894916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:53:08.905939 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-86da4d15-4b23-4e05-8965-ece952dbbf87 req-7c8316ad-5dc0-4475-9b4c-e1558cd53625 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046068 Jul 19 20:53:08.906555 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3364/6834] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:09.708933 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:09.709562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:09.717468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:09.717916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:09.718682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:09.719114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:09.865296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:09.873013 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25f4d10c-c973-4ade-bc5d-43e0ba507399 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1679 microversion: 2.1 time: 0.167934 Jul 19 20:53:09.873602 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3471/6835] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:09 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:10.892756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:10.893473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:10.900046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:10.900514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:10.901893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:10.902345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:11.151970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:11.160303 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ca9312fe-c41c-428a-b309-83531b559f40 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1679 microversion: 2.1 time: 0.273072 Jul 19 20:53:11.160919 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3365/6836] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:10 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:12.178684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:12.179235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:12.186851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.187295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.188099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.188532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.331573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:12.339961 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df0ff53d-fa8e-4bd2-b530-ff639d14b9cd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1675 microversion: 2.1 time: 0.165310 Jul 19 20:53:12.340878 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3472/6837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:12 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:12.357232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:12.357818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:12.365259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.365732 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.366538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.366995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.434634 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7446c26d-d764-4cc1-ad86-dfead418853b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action" status: 204 len: 0 microversion: 2.1 time: 0.081042 Jul 19 20:53:12.435647 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3366/6838] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:12 2022] POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:53:12.444134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:12.444712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:12.452137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.452596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.453589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.453855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.703563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:12.712047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2dae363e-ab27-4148-a7de-53e4a678cd95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1675 microversion: 2.1 time: 0.271984 Jul 19 20:53:12.712850 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3473/6839] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:12 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:13.732239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:13.733899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:13.742069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:13.742909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:13.743961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:13.744504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:13.922801 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:13.931586 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-20736407-24b6-440e-bc88-827777e0bdc2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1675 microversion: 2.1 time: 0.205392 Jul 19 20:53:13.932210 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3367/6840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:13 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:14.950417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:14.951089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:14.958057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:14.958512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:14.959288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:14.959724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.095897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.103392 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7ffc0021-781a-400e-83ef-085906a66c5b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1654 microversion: 2.1 time: 0.157485 Jul 19 20:53:15.104089 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3474/6841] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:14 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:15.119533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:15.120194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:15.127237 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.127700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.128587 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.129030 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.266404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2f8e950b-b836-4df0-8bb2-88042c4fd051 req-27136ecf-bb16-4ad2-a3c1-979c87824540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "name": "network-vif-plugged", "status": "completed", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:15.268573 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.275914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f8e950b-b836-4df0-8bb2-88042c4fd051 req-27136ecf-bb16-4ad2-a3c1-979c87824540 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.277133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2f8e950b-b836-4df0-8bb2-88042c4fd051 req-27136ecf-bb16-4ad2-a3c1-979c87824540 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.277335 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4fb2e1f5-a7a0-44be-a4ea-49474f0dac80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1654 microversion: 2.1 time: 0.160658 Jul 19 20:53:15.279022 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3368/6842] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:15 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:15.291579 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2f8e950b-b836-4df0-8bb2-88042c4fd051 req-27136ecf-bb16-4ad2-a3c1-979c87824540 service nova] Creating event network-vif-plugged:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h2-843861-3 Jul 19 20:53:15.295484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4cd95434-31f3-43e6-8005-3952e26fa8b0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:15.297359 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2f8e950b-b836-4df0-8bb2-88042c4fd051 req-27136ecf-bb16-4ad2-a3c1-979c87824540 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034818 Jul 19 20:53:15.297980 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3475/6843] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:53:15.302561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cd95434-31f3-43e6-8005-3952e26fa8b0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.303160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4cd95434-31f3-43e6-8005-3952e26fa8b0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.326434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4cd95434-31f3-43e6-8005-3952e26fa8b0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Going to try to start instance {{(pid=126007) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:53:15.331425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:15.368908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4cd95434-31f3-43e6-8005-3952e26fa8b0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action" status: 202 len: 0 microversion: 2.1 time: 0.078094 Jul 19 20:53:15.369526 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3369/6844] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:15 2022] POST /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:53:15.379043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:15.380092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:15.388785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.389196 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.390021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.390443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.591475 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.599240 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2a7c3665-6022-4fa7-ba4c-acfec514d26f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1663 microversion: 2.1 time: 0.224480 Jul 19 20:53:15.599816 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3476/6845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:15 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1663 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:16.618360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:16.619091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:16.626266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.626737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:16.627525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.628002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:16.768597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:16.776392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-368e130e-6571-48da-ae49-97ed595b3021 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1663 microversion: 2.1 time: 0.163131 Jul 19 20:53:16.776931 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3370/6846] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:16 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:17.794511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:17.795121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:17.802107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.802555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.803308 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.803738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.808602 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:17.942384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:17.951403 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-406a55a4-75a8-4f94-afeb-df0294567375 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1667 microversion: 2.1 time: 0.161255 Jul 19 20:53:17.952265 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3477/6847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:17 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:17.968242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:17.968777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:17.976519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.977029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.977810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.978258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:18.005047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:53:18.078876 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4b3aca50-b913-492e-a487-6112ff3ee541 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 204 len: 0 microversion: 2.1 time: 0.114299 Jul 19 20:53:18.079454 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3371/6848] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:53:17 2022] DELETE /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:53:18.087833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:18.088448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:18.094818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:18.095273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:18.096071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:18.096508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:18.228124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:18.236185 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea4f7884-3b70-4dcc-a983-10397dc3869f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1673 microversion: 2.1 time: 0.152352 Jul 19 20:53:18.236762 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3478/6849] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:18 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:19.254979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:19.255762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:19.266051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:19.266527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:19.267337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:19.267792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:19.414012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:19.422426 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54d20af3-da81-413c-abb5-f40a15f89d52 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1673 microversion: 2.1 time: 0.171970 Jul 19 20:53:19.423094 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3372/6850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:19 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:20.441424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:20.442412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:20.449609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.450006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.450792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.451233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.495387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-368ef1ce-e12d-40b0-80cb-b1817228bece req-2651755c-f105-4cbb-baf9-5a5fed42b050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848cef3-7b19-4fe1-9d8f-e47895ccb585", "name": "network-vif-deleted", "tag": "699ba8c6-7863-4fa4-a7b4-3b904e56ac00"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:20.507299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-368ef1ce-e12d-40b0-80cb-b1817228bece req-2651755c-f105-4cbb-baf9-5a5fed42b050 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.508137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-368ef1ce-e12d-40b0-80cb-b1817228bece req-2651755c-f105-4cbb-baf9-5a5fed42b050 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.525051 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-368ef1ce-e12d-40b0-80cb-b1817228bece req-2651755c-f105-4cbb-baf9-5a5fed42b050 service nova] Creating event network-vif-deleted:699ba8c6-7863-4fa4-a7b4-3b904e56ac00 for instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 on n-h2-843861-3 Jul 19 20:53:20.533509 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:20.538622 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-368ef1ce-e12d-40b0-80cb-b1817228bece req-2651755c-f105-4cbb-baf9-5a5fed42b050 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046887 Jul 19 20:53:20.539250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3373/6851] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:53:20.543225 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57d8ceab-3112-4ea1-ab28-3e31ebdfe7cc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 200 len: 1606 microversion: 2.1 time: 0.105760 Jul 19 20:53:20.544271 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3479/6852] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:20 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 1606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:21.562752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:21.563493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:21.565531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:21.571203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.571661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.572473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.572921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.587205 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 HTTP/1.1 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd848cef3-7b19-4fe1-9d8f-e47895ccb585'} Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:53:21.589449 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-986605c0-66d5-45d9-80d3-992f6e092e80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 404 len: 111 microversion: 2.1 time: 0.033324 Jul 19 20:53:21.594421 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3374/6853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:21 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:53:21.607983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:21.608516 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:21.611335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=43 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:21.616879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.617352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.618116 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.618552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.632992 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 HTTP/1.1 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd848cef3-7b19-4fe1-9d8f-e47895ccb585'} Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:53:21.634644 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8f3213d-ab31-4379-86ac-b49dabe453b2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 404 len: 111 microversion: 2.1 time: 0.032856 Jul 19 20:53:21.638859 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3480/6854] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:21 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:53:21.684673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-172801595", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "fee9b512-4898-41be-b489-8848070db704"}], "security_groups": [{"name": "tempest-securitygroup--671971149"}], "key_name": "tempest-keypair-23138187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:21.792068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] validate_networks() for [('fee9b512-4898-41be-b489-8848070db704', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:53:22.186445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:53:22.186885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:53:22.187387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:53:22.187833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:53:22.188266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:53:22.197448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.197970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.199310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.199763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.217184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:53:22.223960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:53:22.236364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:53:22.238714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:53:22.290995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ddf9b42e-568c-4150-8fe0-59aa7e021700 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.610337 Jul 19 20:53:22.291660 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3375/6855] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:53:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:53:22.302122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e9fa8b1-0c4f-47ea-8d54-ed36a77f4a7f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:22.302738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e9fa8b1-0c4f-47ea-8d54-ed36a77f4a7f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:22.368080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7e9fa8b1-0c4f-47ea-8d54-ed36a77f4a7f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:22.376718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e9fa8b1-0c4f-47ea-8d54-ed36a77f4a7f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1236 microversion: 2.1 time: 0.078503 Jul 19 20:53:22.377311 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3481/6856] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:22 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:23.395442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:23.396128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:23.403994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.404472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:23.405269 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.405726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:23.503601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:23.512145 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8e33bf83-2dc5-42aa-89d3-9b57315e9bd7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1294 microversion: 2.1 time: 0.121439 Jul 19 20:53:23.512737 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3376/6857] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:23 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:24.531201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:24.531942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:24.541267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:24.542386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:24.543215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:24.543646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:24.871077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:24.880023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7958f190-2052-4fe2-96ed-b9ed912beb54 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.352844 Jul 19 20:53:24.880826 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3482/6858] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:24 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:25.105185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-322a7fb9-69ee-43ed-b37c-6d3c18fe5c9c req-bc2f87a1-02b0-4012-bba8-8b09c4cd2281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:25.128411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-322a7fb9-69ee-43ed-b37c-6d3c18fe5c9c req-bc2f87a1-02b0-4012-bba8-8b09c4cd2281 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.128885 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-322a7fb9-69ee-43ed-b37c-6d3c18fe5c9c req-bc2f87a1-02b0-4012-bba8-8b09c4cd2281 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.149335 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-322a7fb9-69ee-43ed-b37c-6d3c18fe5c9c req-bc2f87a1-02b0-4012-bba8-8b09c4cd2281 service nova] Creating event network-changed:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:53:25.154653 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-322a7fb9-69ee-43ed-b37c-6d3c18fe5c9c req-bc2f87a1-02b0-4012-bba8-8b09c4cd2281 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056327 Jul 19 20:53:25.155274 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3377/6859] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:25.898615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:25.899225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:25.906724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.907171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.907963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.908418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:26.043005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:26.050605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b2b52b84-c582-453f-8536-7c4d53a279e8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.155963 Jul 19 20:53:26.051178 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3483/6860] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:25 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:27.069361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:27.070119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:27.078433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.079050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.079887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.080349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.222050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:27.230491 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e880cbd8-7038-46b0-9b99-3e25c9df9e6d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.165442 Jul 19 20:53:27.231224 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3378/6861] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:27 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:28.249887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:28.250565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:28.258249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.258617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.259400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.259862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.397819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:28.406605 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9d4a16d0-e624-481b-88cd-36612e6c3ee7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.163023 Jul 19 20:53:28.407334 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3484/6862] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:28 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:29.429678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:29.430283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:29.437875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.438339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.439117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.439563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.571452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:29.579995 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e34d4f22-aeff-499d-a5e9-b8c341ce7edc tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.154160 Jul 19 20:53:29.580583 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3379/6863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:29 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:30.400395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-76283868-4bc8-4365-bd39-a66363d3c446 req-760ef41c-4c1e-44f9-92a1-d36a30155317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-plugged", "status": "completed", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:30.410412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-76283868-4bc8-4365-bd39-a66363d3c446 req-760ef41c-4c1e-44f9-92a1-d36a30155317 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.410825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-76283868-4bc8-4365-bd39-a66363d3c446 req-760ef41c-4c1e-44f9-92a1-d36a30155317 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.423352 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-76283868-4bc8-4365-bd39-a66363d3c446 req-760ef41c-4c1e-44f9-92a1-d36a30155317 service nova] Creating event network-vif-plugged:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:53:30.428692 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-76283868-4bc8-4365-bd39-a66363d3c446 req-760ef41c-4c1e-44f9-92a1-d36a30155317 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Jul 19 20:53:30.429385 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3485/6864] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:30.598318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:30.598948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:30.606741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.607205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.608033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.608481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.742331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:30.750665 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa659450-99ee-4257-80fb-f0894153102c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.156223 Jul 19 20:53:30.751267 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3380/6865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:30 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:31.770361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:31.771068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:31.777891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.778352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.779147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.779671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.921724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:31.929344 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f04efebf-300e-4ba9-ae44-3a413774d19e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1361 microversion: 2.1 time: 0.164192 Jul 19 20:53:31.929917 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3486/6866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:31 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:32.946876 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:32.947545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:32.951152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:32.951923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:32.958097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.958554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:32.959339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.959787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:33.217550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:33.225600 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-eeced553-099c-4d5f-aa88-4a77a8d0168a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1548 microversion: 2.1 time: 0.282671 Jul 19 20:53:33.226206 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3381/6867] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:32 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1548 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:33.243003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:33.243563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:33.246304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:33.252722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:33.253166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:33.253947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:33.254383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:33.333952 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d073d2b4-a2aa-4656-8dc4-2f84577fa5fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094847 Jul 19 20:53:33.334745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3487/6868] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:53:33 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:34.320672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-0322479d-953f-490d-8799-3daa029f6228 req-6a199e6e-0269-4d21-9f60-861f7e18833f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:34.330540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0322479d-953f-490d-8799-3daa029f6228 req-6a199e6e-0269-4d21-9f60-861f7e18833f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:34.330993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-0322479d-953f-490d-8799-3daa029f6228 req-6a199e6e-0269-4d21-9f60-861f7e18833f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:34.342387 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-0322479d-953f-490d-8799-3daa029f6228 req-6a199e6e-0269-4d21-9f60-861f7e18833f service nova] Creating event network-changed:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:53:34.347520 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-0322479d-953f-490d-8799-3daa029f6228 req-6a199e6e-0269-4d21-9f60-861f7e18833f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030624 Jul 19 20:53:34.348200 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3382/6869] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:10.222758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=17 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:10.223578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=48 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:10.228161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:10.229171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:10.236905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:10.237357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:10.238250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:10.238694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:10.272001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:10.278802 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:54:10.286066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:10.286426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:10.286901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:10.287317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:10.287732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:10.358357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69e16efa-9c82-46c8-b934-584e7ec13570 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/action" status: 202 len: 0 microversion: 2.1 time: 0.137407 Jul 19 20:54:10.363190 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3488/6870] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:54:10 2022] POST /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:10.367191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:10.368036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:10.373751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:10.374456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:10.383063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:10.383434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:10.385091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:10.385544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:10.559152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:10.567430 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14d58c02-3b23-424e-8b7c-5f393b89a9e2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1676 microversion: 2.1 time: 0.202540 Jul 19 20:54:10.568329 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3383/6871] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:10 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:11.586067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:11.586672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:11.598307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:11.598769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:11.599603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:11.600138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:11.810994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:11.824913 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ca740cd-0ea9-44d1-9579-44e068a22d31 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1676 microversion: 2.1 time: 0.242332 Jul 19 20:54:11.825883 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3489/6872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:11 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:12.844563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:12.845276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:12.852743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:12.853750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:12.854840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:12.855294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:13.011750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:13.019955 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-617200fc-05b5-4b8c-8ce8-21d8992bc135 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.179228 Jul 19 20:54:13.020568 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3384/6873] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:12 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:14.038869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:14.039419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:14.046649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:14.047095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:14.047945 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:14.048374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:14.184367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:14.192637 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f435ba7c-e737-4c36-894b-278c6468f687 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.157936 Jul 19 20:54:14.193224 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3490/6874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:14 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:15.210630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:15.211272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:15.219377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:15.219867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:15.220757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:15.221223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:15.368824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:15.378163 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d5679042-2c30-4ce9-aa69-f2b17c843a6f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.171378 Jul 19 20:54:15.378760 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3385/6875] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:15 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:16.396464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:16.397109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:16.404663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:16.405106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:16.405873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:16.406303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:16.548533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:16.556443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-022aa0c7-fe25-4189-8a6d-a7db7ab2a148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.163885 Jul 19 20:54:16.557256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3491/6876] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:16 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:17.574465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:17.575149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:17.582516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:17.582986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:17.583788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:17.584262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:17.730078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:17.739064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d359ac1-8e54-4c85-8133-5a61f1591cdd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.168457 Jul 19 20:54:17.739751 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3386/6877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:17 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:18.757889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:18.758542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:18.765571 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:18.766034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:18.766807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:18.767249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:18.905675 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:18.913283 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-477992ae-914a-40ba-82b2-0284c5881b8b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.159676 Jul 19 20:54:18.913863 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3492/6878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:18 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:19.932065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:19.932859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:19.940500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:19.940965 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:19.941777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:19.942234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:20.090786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:20.101838 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67acc355-a1c3-4a87-a0a7-1b5e41a345a9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.174302 Jul 19 20:54:20.102463 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3387/6879] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:19 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:21.118815 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:21.119428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:21.126838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:21.127558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:21.127558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:21.127558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:21.268485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:21.277134 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b342379d-8e00-4cf0-82a3-9499a8f49c4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.162335 Jul 19 20:54:21.277723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3493/6880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:21 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:22.295178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:22.295821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:22.303367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:22.303892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:22.304693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:22.305142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:22.445706 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:22.454023 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c33a5af-82a5-4321-b378-a905e9075a47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.162823 Jul 19 20:54:22.454601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3388/6881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:22 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:23.472220 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:23.472773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:23.480645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:23.481016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:23.481825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:23.482263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:23.620736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:23.632010 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af3b2e74-dd91-461a-a8b1-8ef66fa1056f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.163605 Jul 19 20:54:23.632879 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3494/6882] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:24.649544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:24.650548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:24.657810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:24.658282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:24.659077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:24.659541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:24.802784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:24.811375 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-281507f7-4d68-4ddc-8f31-8de6be877095 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.165751 Jul 19 20:54:24.811991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3389/6883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:24 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:25.829283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:25.829976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:25.837930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:25.838387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:25.839216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:25.839794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:25.987114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:25.996431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-71c9be6f-585d-4d6e-bf6f-6fb5c239b49f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.171217 Jul 19 20:54:25.997019 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3495/6884] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:25 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:27.015674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:27.016245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:27.023209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:27.023674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:27.024525 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:27.024972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:27.532315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:27.541053 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5c07208e-5fc9-44b9-9613-5a1c2a8c2298 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.528868 Jul 19 20:54:27.541666 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3390/6885] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:27 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:28.559159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:28.559775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:28.567443 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:28.568012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:28.568781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:28.569210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:28.715685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:28.723940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70b5bbf2-f466-4fec-87f2-8198e374fd80 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.169283 Jul 19 20:54:28.724520 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3496/6886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:28 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:29.740506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:29.741180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:29.748475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:29.748947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:29.749743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:29.750201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:29.885428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:29.893131 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41cca847-e5d6-4c04-930d-91297d5f98ee tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1681 microversion: 2.1 time: 0.156620 Jul 19 20:54:29.893717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3391/6887] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:29 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:30.915376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:30.917661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:30.925863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:30.926132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:30.926915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:30.927373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:30.978382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-unplugged", "status": "completed", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:30.988235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:30.988674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:31.004123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] Creating event network-vif-unplugged:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h2-843861-3 Jul 19 20:54:31.013333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:54:31.027239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-e15c62bb-be5a-4e6d-9587-c8b41ae5ccde req-049f2218-0d27-4569-95f8-234ebf396650 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122936 Jul 19 20:54:31.028061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3497/6888] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:31.208926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:31.218282 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-026eecc7-2a9a-4f82-97ed-cbd45d957dca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1680 microversion: 2.1 time: 0.310840 Jul 19 20:54:31.218894 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3392/6889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:30 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:32.242368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.243192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:32.254930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:32.255938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:32.256731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:32.257159 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:32.397892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:32.406850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-93f25dc4-e91f-4e13-86f5-2f9e614b06fe tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1678 microversion: 2.1 time: 0.168706 Jul 19 20:54:32.407510 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3498/6890] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:33.057890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:33.067246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.067246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.080517 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] Creating event network-changed:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h2-843861-3 Jul 19 20:54:33.086522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:54:33.098682 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7a3a4662-6ccd-4e36-a3ae-209b5c88c642 req-5e1bd7a9-117a-4fad-838a-e252d30cfab4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045007 Jul 19 20:54:33.099307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3393/6891] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:33.430788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.431564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:33.438871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.439415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.440309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.440745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.655403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:33.664210 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4989c50f-e229-45d5-bbc5-54a85a7c34e6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1678 microversion: 2.1 time: 0.237400 Jul 19 20:54:33.664854 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3499/6892] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:34.683846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.684990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:34.699252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:34.699720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:34.700549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:34.701011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:34.924225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:34.932591 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-691dba2f-fd33-4612-9917-e5fcccf9a81f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1678 microversion: 2.1 time: 0.254730 Jul 19 20:54:34.933217 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3394/6893] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:35.950043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:35.950653 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:35.957745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:35.958195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:35.958964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:35.959396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.098777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:36.106482 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b692d814-4fce-4ac1-bfc8-2893c32a9831 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1675 microversion: 2.1 time: 0.160341 Jul 19 20:54:36.107062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3500/6894] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:35 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:36.123661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:36.124253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:36.131514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.132016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.132795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.134058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.173232 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.173695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.174503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.174947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.197500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:36.202999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:36.312698 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be9ac67c-4137-4cc3-960e-8efb186d9e94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/action" status: 202 len: 0 microversion: 2.1 time: 0.192517 Jul 19 20:54:36.313349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3395/6895] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:54:36 2022] POST /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:36.322141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:36.322766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:36.329158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.329616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.330386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.330822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.534873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:36.543664 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d3a9e04b-f636-4c11-8534-ec0795a541f9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.226047 Jul 19 20:54:36.544279 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3501/6896] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:36 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:37.562584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:37.563310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:37.571892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:37.572371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:37.573160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:37.573615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:37.707592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:37.711218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:37.716558 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-983dee14-6e22-4f22-895c-d482d4244023 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.158505 Jul 19 20:54:37.717156 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3396/6897] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:37 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:37.756403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-plugged", "status": "completed", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:37.766019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:37.766467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:37.778715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] Creating event network-vif-plugged:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h2-843861-3 Jul 19 20:54:37.784451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:54:37.795356 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f862958a-e088-4c06-954b-9ae0f990db6d req-a8128b76-b46a-4785-bac2-5d4a8fbbed5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 Jul 19 20:54:37.796021 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3502/6898] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:38.734287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:38.735001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:38.743606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:38.744113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:38.744904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:38.745355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:38.889216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:38.897363 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-29ccaea6-d7bb-4020-b02a-223b96b0dbf3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.167082 Jul 19 20:54:38.897969 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3397/6899] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:38 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:39.647936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-unplugged", "status": "completed", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:39.656924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:39.657551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:39.670666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] Creating event network-vif-unplugged:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:54:39.676581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:54:39.689038 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-370ab0b6-8c5f-46b0-94ee-6c714bac7994 req-7ff9b9c8-37cd-42e5-bd5e-fe1dbf978390 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045983 Jul 19 20:54:39.689885 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3503/6900] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:39.918465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:39.919137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:39.926668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:39.927140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:39.928332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:39.928794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:40.167981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:40.177878 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-16dd37c4-9ca9-4657-9494-371113cf58f0 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.266527 Jul 19 20:54:40.178501 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3398/6901] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:39 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:41.196142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:41.196853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:41.198831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:41.204856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:41.205310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:41.206085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:41.206524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:41.209201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:41.345847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:41.354068 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9e3d4e4-d82d-401b-a74f-a638e0e5c4a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.163177 Jul 19 20:54:41.354644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3504/6902] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:41 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:41.706279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:41.710580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:41.716901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:41.717359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:41.730255 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] Creating event network-changed:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:54:41.735647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:54:41.746559 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c003fdda-a0c1-4675-aa16-0539f8cdf13b req-0786c869-f08f-4b47-ac0c-da50be4ee909 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044022 Jul 19 20:54:41.747360 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3399/6903] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:42.372245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:42.372960 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:42.380553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.381004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.381772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.382203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.913425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:42.924297 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4d3709a-eaa5-40f8-8d0b-c7269680f905 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1674 microversion: 2.1 time: 0.556685 Jul 19 20:54:42.924924 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3505/6904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:42 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1674 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:43.944062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:43.944784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:43.952199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:43.953061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:43.953861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:43.954315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.090107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:44.100451 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f9e77b2e-d065-40ea-91f0-00e68daadc03 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1667 microversion: 2.1 time: 0.160641 Jul 19 20:54:44.101108 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3400/6905] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:43 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:44.118682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:44.119284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:44.126174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.126817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.127572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.128031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.295114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:44.303341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-005f10da-9cd9-4ba8-9209-26e1dfbebf95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1667 microversion: 2.1 time: 0.188919 Jul 19 20:54:44.303974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3506/6906] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:44 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:44.320116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:44.320882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:44.327412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.327910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.328734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.329191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.470891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:44.479370 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b31f225-e569-4c92-8870-c36b6a4de8a2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1667 microversion: 2.1 time: 0.163291 Jul 19 20:54:44.480006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3401/6907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:44 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:44.495828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:44.496333 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:44.502686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.503133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.503935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.504368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.531596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:54:44.616780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ed5fe0d5-f56c-4803-a06a-4e9668974c6a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 204 len: 0 microversion: 2.1 time: 0.124076 Jul 19 20:54:44.617396 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3507/6908] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:54:44 2022] DELETE /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:54:44.626789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:44.628000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:44.636208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.636899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.637826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.638384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.800112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:44.812744 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fa4016b7-5e56-4761-b2e0-91aa47bf7e9a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1673 microversion: 2.1 time: 0.190790 Jul 19 20:54:44.813359 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3402/6909] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:44 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:45.831348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:45.832096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:45.843281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.843729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.844577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.844992 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.990575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:46.000582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf8c04b5-e598-444f-8a79-b5886bee9623 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1673 microversion: 2.1 time: 0.173464 Jul 19 20:54:46.001190 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3508/6910] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:45 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:46.815435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c571eb23-cf96-4227-9d0b-36937c9d38cb req-b873235c-8725-4926-a409-7e4911d88fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-plugged", "status": "completed", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:46.820618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:46.827542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c571eb23-cf96-4227-9d0b-36937c9d38cb req-b873235c-8725-4926-a409-7e4911d88fbd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.828049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c571eb23-cf96-4227-9d0b-36937c9d38cb req-b873235c-8725-4926-a409-7e4911d88fbd service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.841395 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c571eb23-cf96-4227-9d0b-36937c9d38cb req-b873235c-8725-4926-a409-7e4911d88fbd service nova] Creating event network-vif-plugged:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:54:46.846614 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c571eb23-cf96-4227-9d0b-36937c9d38cb req-b873235c-8725-4926-a409-7e4911d88fbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035818 Jul 19 20:54:46.847459 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3403/6911] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:47.022189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:47.022800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:47.031397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:47.031947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:47.032735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:47.033169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:47.255901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:47.271067 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-822b5aa0-d912-4766-956a-d89600bc469e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1673 microversion: 2.1 time: 0.252858 Jul 19 20:54:47.271668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3509/6912] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:47 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:47.706285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f5329af4-5f13-4e85-9394-67224106e484 req-c08840f7-1f30-48dc-97c2-5d20d250b7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9db217-da1a-4dcd-83e1-9c76f6af4061", "name": "network-vif-deleted", "tag": "e07ff801-6124-476c-9cb5-1bb90764e086"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:47.716697 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5329af4-5f13-4e85-9394-67224106e484 req-c08840f7-1f30-48dc-97c2-5d20d250b7fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:47.717339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f5329af4-5f13-4e85-9394-67224106e484 req-c08840f7-1f30-48dc-97c2-5d20d250b7fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:47.730514 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f5329af4-5f13-4e85-9394-67224106e484 req-c08840f7-1f30-48dc-97c2-5d20d250b7fc service nova] Creating event network-vif-deleted:e07ff801-6124-476c-9cb5-1bb90764e086 for instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 on n-h1-843861-3 Jul 19 20:54:47.736416 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f5329af4-5f13-4e85-9394-67224106e484 req-c08840f7-1f30-48dc-97c2-5d20d250b7fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035208 Jul 19 20:54:47.737057 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3404/6913] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:48.385758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:48.387355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:48.401826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.403398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.404939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.406166 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.473331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.474294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.474873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lazy-loading 'fault' on Instance uuid ea9db217-da1a-4dcd-83e1-9c76f6af4061 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:48.536307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:48.550354 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-61e16caf-8f39-4573-8078-6262c325766a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 200 len: 1326 microversion: 2.1 time: 0.261588 Jul 19 20:54:48.551691 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3510/6914] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:48 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 1326 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:49.578615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:49.579340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.586272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.586850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.587822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.588565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.609751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 HTTP/1.1 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ea9db217-da1a-4dcd-83e1-9c76f6af4061'} Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:49.611472 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ebd54474-47b7-417f-bcf6-23cd37ca2620 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 404 len: 111 microversion: 2.1 time: 0.040391 Jul 19 20:54:49.617623 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3405/6915] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:49 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:49.636597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:49.637404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.644619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.645073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.645863 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.646302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.664767 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 HTTP/1.1 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ea9db217-da1a-4dcd-83e1-9c76f6af4061'} Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:49.668093 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:49.672312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e7bcabf-1fd3-43c1-95ac-dbe71b54ea9b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 404 len: 111 microversion: 2.1 time: 0.038664 Jul 19 20:54:49.672827 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3511/6916] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:49 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:54:49.736248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1065255133", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "fee9b512-4898-41be-b489-8848070db704"}], "security_groups": [{"name": "tempest-securitygroup--671971149"}], "key_name": "tempest-keypair-23138187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:49.859387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] validate_networks() for [('fee9b512-4898-41be-b489-8848070db704', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:54:50.351213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:50.352452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:50.352632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:50.353001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:50.354144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:50.365488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.366098 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.367055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.367698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.388377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:50.394995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:50.411111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:54:50.413893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:54:50.468435 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4be85d5-3932-448d-9fdc-bde891da08ec tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736432 Jul 19 20:54:50.468435 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3406/6917] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:54:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:54:50.485208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4f71108a-09eb-42b2-8790-204345cfd478 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:50.486327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4f71108a-09eb-42b2-8790-204345cfd478 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:50.559388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4f71108a-09eb-42b2-8790-204345cfd478 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.570749 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4f71108a-09eb-42b2-8790-204345cfd478 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1237 microversion: 2.1 time: 0.090415 Jul 19 20:54:50.572081 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3512/6918] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:50 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:51.593891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.594755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.603061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.603552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.604394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.604848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.695913 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.709379 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ec656b0c-fb74-4778-8b28-7456b3d311c3 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1297 microversion: 2.1 time: 0.121317 Jul 19 20:54:51.710375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3407/6919] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:52.730663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:52.731524 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:52.739577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.740386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.741287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.741757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.051563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:53.060228 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c8512fe-9af6-4b75-9eb5-22a6f542b00c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.333558 Jul 19 20:54:53.061292 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3513/6920] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:52 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:53.682055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3889602c-7b6f-41d9-9349-59434bb9bbcb req-b68dc03d-102e-4726-86d0-a2e9003502f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:53.722075 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3889602c-7b6f-41d9-9349-59434bb9bbcb req-b68dc03d-102e-4726-86d0-a2e9003502f1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.723014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3889602c-7b6f-41d9-9349-59434bb9bbcb req-b68dc03d-102e-4726-86d0-a2e9003502f1 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.744573 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-3889602c-7b6f-41d9-9349-59434bb9bbcb req-b68dc03d-102e-4726-86d0-a2e9003502f1 service nova] Creating event network-changed:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:54:53.766494 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3889602c-7b6f-41d9-9349-59434bb9bbcb req-b68dc03d-102e-4726-86d0-a2e9003502f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092181 Jul 19 20:54:53.767159 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3408/6921] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:54.083280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:54.084590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:54.094228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.094912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.095963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.096454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.373332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.383841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f810db0-912c-4f2f-9681-397c6ab5970e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.305350 Jul 19 20:54:54.384927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3514/6922] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:54 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:55.405133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.405937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.413136 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.413667 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.414688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.415353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.582208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.590862 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2853c8a0-0e2f-46ea-8e73-7ecd7978a856 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.192165 Jul 19 20:54:55.591466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3409/6923] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:56.611181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:56.612606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:56.623269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.624145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.625076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.625699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.906125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.935006 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1c6b2531-156a-4f3a-943c-68bf2556f824 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.328476 Jul 19 20:54:56.936111 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3515/6924] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:56 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:57.954531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:57.955673 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:57.963832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.964586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.965599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.966146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:58.128162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:58.137889 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ddd8c42-e8ef-4225-8e7c-ec899f60fdc7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.187842 Jul 19 20:54:58.138566 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3410/6925] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:57 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.157922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.159075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.171496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.172313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.173719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.174503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.365255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.375262 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4d10609e-8fc6-4148-9e05-fddf501da26a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.221560 Jul 19 20:54:59.375883 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3516/6926] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.913625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a6f9ee8a-cd99-4e98-b84b-e9d956cd788c req-143caa74-80f3-4b6d-889b-f3434706126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-plugged", "status": "completed", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:59.928488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a6f9ee8a-cd99-4e98-b84b-e9d956cd788c req-143caa74-80f3-4b6d-889b-f3434706126f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.929050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a6f9ee8a-cd99-4e98-b84b-e9d956cd788c req-143caa74-80f3-4b6d-889b-f3434706126f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.943228 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a6f9ee8a-cd99-4e98-b84b-e9d956cd788c req-143caa74-80f3-4b6d-889b-f3434706126f service nova] Creating event network-vif-plugged:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:54:59.951445 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a6f9ee8a-cd99-4e98-b84b-e9d956cd788c req-143caa74-80f3-4b6d-889b-f3434706126f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043864 Jul 19 20:54:59.952526 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3411/6927] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:00.395915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.396811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.408635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.409156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.410023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.410567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.566281 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:00.597526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:00.609026 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db9c065a-86cf-420a-8c2d-2b136fe48e84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1362 microversion: 2.1 time: 0.218199 Jul 19 20:55:00.609802 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3517/6928] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:01.629114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:01.630290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:01.637997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:01.638947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:01.650830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.651947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.653544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.654207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.811615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:01.819656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f543afb7-94e1-48ae-b308-9f522498cbd2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1548 microversion: 2.1 time: 0.191813 Jul 19 20:55:01.820289 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3412/6929] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:01 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:01.839302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:01.840328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:01.847449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.847901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.848665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.849099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.948715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbd9b399-dc22-419c-ad8f-a9bfb4de2635 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114291 Jul 19 20:55:01.949388 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3518/6930] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:55:01 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:03.358762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-66fa36be-cffc-476a-b240-31fccd28e501 req-822549f3-0c30-4b7e-bb02-b9cfadf9ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:03.370129 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-66fa36be-cffc-476a-b240-31fccd28e501 req-822549f3-0c30-4b7e-bb02-b9cfadf9ef9b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.370716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-66fa36be-cffc-476a-b240-31fccd28e501 req-822549f3-0c30-4b7e-bb02-b9cfadf9ef9b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.383121 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-66fa36be-cffc-476a-b240-31fccd28e501 req-822549f3-0c30-4b7e-bb02-b9cfadf9ef9b service nova] Creating event network-changed:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:55:03.389100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-66fa36be-cffc-476a-b240-31fccd28e501 req-822549f3-0c30-4b7e-bb02-b9cfadf9ef9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035646 Jul 19 20:55:03.389834 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3413/6931] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:27.601346 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:55:27.602046 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:55:38.465815 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:55:38.466559 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:55:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:56:19.232597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:19.233358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:19.237925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:19.238531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:19.247483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:19.247957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:19.248728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:19.249162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:19.390983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:19.398881 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-78e3d37e-5020-44be-9a7d-0e0571e8dc32 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1667 microversion: 2.1 time: 0.168682 Jul 19 20:56:19.400005 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3519/6932] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:19 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:19.414629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:19.415397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=72 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:19.420452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7cf04ae-00e0-4728-aeff-3ad327acfb3f"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:19.421618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:19.429798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:19.430814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:19.431603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:19.432080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:19.720305 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-092b823f-bcaa-411c-99ed-995b479db79a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308112 Jul 19 20:56:19.720989 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3414/6933] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:56:19 2022] POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:31.510609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:31.511707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.513871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:31.514521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:31.520663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.521108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.521869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.522296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.553323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:31.559605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:56:31.566570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:31.566983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:31.567453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:31.567877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:31.568287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:31.636331 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50910108-71f0-4545-a81d-9f5aa991f96e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/action" status: 202 len: 0 microversion: 2.1 time: 0.130075 Jul 19 20:56:31.637352 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3520/6934] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:56:31 2022] POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:56:31.650183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:31.650882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:31.655753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:31.656526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.663946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.664487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.665794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.666240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.858190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:31.868294 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbe425ea-88ca-4347-9c41-799cecf05614 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.221084 Jul 19 20:56:31.871862 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3415/6935] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:31 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:32.889820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:32.890610 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:32.903001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.903442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.904255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.904686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.056482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:33.068968 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f2332aa0-869f-41d7-b88f-e0b05f8c4453 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.184036 Jul 19 20:56:33.069924 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3521/6936] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:32 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:34.099962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:34.101048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:34.110177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.110694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.111549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.112094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.290143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:34.298898 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-09127171-691b-46fc-adae-300a0648c774 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.205893 Jul 19 20:56:34.299639 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3416/6937] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:34 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:35.321963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:35.322995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:35.331062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.331665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.332594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.333131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.529070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:35.538101 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c0d2808d-6066-4e66-95f9-07d7d2c20b49 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.223598 Jul 19 20:56:35.540714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3522/6938] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:35 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:36.557838 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:36.558831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:36.567221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.567759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.568741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.569248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.753112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:36.768564 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8c6a3bc0-6fa3-4bd6-aab1-ffbfba53a736 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.214691 Jul 19 20:56:36.769539 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3417/6939] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:36 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:37.791103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.791952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.799519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.800407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.801232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.801674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.049787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:38.066215 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b24f6e5a-fd96-4958-b48c-d570496f5d25 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1722 microversion: 2.1 time: 0.280421 Jul 19 20:56:38.067691 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3523/6940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:39.085188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:39.086018 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:39.094052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.094714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.095859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.096291 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.269864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:39.283598 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ec2ac62-c0d3-45c8-bc25-b990a22cc4da tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.202597 Jul 19 20:56:39.284230 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3418/6941] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:39 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:40.316331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:40.317507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:40.330132 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.330882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.332212 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.332988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.561326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:40.575930 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-834880c6-dc8a-478d-ace2-035b9779e7b8 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.266711 Jul 19 20:56:40.576774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3524/6942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:40 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:41.600399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:41.601138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:41.610028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.610502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.611328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.611788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.770594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:41.779754 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-288042be-2282-4481-ba0c-739a01a68082 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.183643 Jul 19 20:56:41.780402 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3419/6943] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:41 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:42.798311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:42.798970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:42.811384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.811905 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.812731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.813235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.960828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:42.970478 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-678834d4-f52a-4356-a9eb-1d95f89f2e41 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.175834 Jul 19 20:56:42.971077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3525/6944] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:42 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:43.989750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:43.990481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:43.998182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.998640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.999424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.999914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:44.149638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:44.158771 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-14fef57c-9ae2-44e2-885a-d33efff95ec9 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.173063 Jul 19 20:56:44.159403 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3420/6945] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:43 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:45.178463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:45.179083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:45.187023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.187477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.188297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.188738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.340000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:45.348498 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8f275cd-cfa5-48a1-a825-49f72e04f04f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.174054 Jul 19 20:56:45.349094 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3526/6946] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:45 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:46.366892 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:46.367524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:46.378183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.378715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:46.379577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.380182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:46.530477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:46.539834 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c5968c6d-e2fa-4d9a-aadd-ca99f0c9d6c2 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.176891 Jul 19 20:56:46.540464 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3421/6947] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:46 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:47.558513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:47.559135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:47.566129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:47.566573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:47.567331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:47.567761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:47.711133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:47.719358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-75b94ba9-36bc-4902-906a-ea7c32660f9e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.165526 Jul 19 20:56:47.719988 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3527/6948] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:47 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:48.738311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:48.739089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:48.747633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.748551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.749520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.750069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.914074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:48.926832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f53e9a29-a15a-4ea5-988c-6fe61e82736d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.192664 Jul 19 20:56:48.928866 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3422/6949] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:48 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:49.945952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:49.946575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:49.953729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:49.954122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:49.954934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:49.955375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:50.092648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:50.100619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-514e5ffa-8ed0-417a-a9a0-6a0df9544c08 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.158802 Jul 19 20:56:50.101690 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3528/6950] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:49 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:51.118383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:51.119031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:51.126224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:51.126703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:51.127501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:51.127986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:51.279226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:51.287859 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e2dc382-096a-44f6-bcbb-58a81615ee33 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.173910 Jul 19 20:56:51.288457 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3423/6951] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:51 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:52.306152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:52.306732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:52.313352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.313799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:52.314570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.315000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:52.455607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:52.464143 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ee898b46-cab0-4d6e-b57c-a9ad7769aae1 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.161958 Jul 19 20:56:52.464747 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3529/6952] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:52 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:53.482747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:53.483413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:53.490657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.491120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.491962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.492411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.636848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.645143 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd528b19-7c7b-4fda-beb1-67d92b3f32b7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.166501 Jul 19 20:56:53.645726 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3424/6953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:53 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:54.662848 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:54.663512 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:54.671876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:54.672352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:54.673187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:54.673628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:54.817876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:54.826423 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-74ef50f1-2f0c-43c9-b706-deea5e619d84 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.167467 Jul 19 20:56:54.827020 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3530/6954] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:54 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:55.844818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:55.845579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:55.853021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.853582 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.854467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.855021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.998317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:56.007832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7ae476f-30a9-446d-9707-afe945040515 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.166367 Jul 19 20:56:56.008446 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3425/6955] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:55 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:57.026138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:57.026669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:57.033871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:57.034331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.035101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:57.035533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.185726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:57.194651 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3fe43b5-5bd2-4ab8-8d5f-8c9532332f94 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1727 microversion: 2.1 time: 0.173122 Jul 19 20:56:57.195261 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3531/6956] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:57 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:58.213101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:58.214323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:58.221336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:58.221803 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:58.222822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:58.223445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:58.423570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-unplugged", "status": "completed", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:58.434479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:58.435272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:58.458106 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] Creating event network-vif-unplugged:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h1-843861-3 Jul 19 20:56:58.461182 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:58.465130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:56:58.470428 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:56:58.480453 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c7674245-0d46-46a5-9e3e-3d0ecb9ef405 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1726 microversion: 2.1 time: 0.271180 Jul 19 20:56:58.482445 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3426/6957] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:58 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1726 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:59.481399 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33440. Jul 19 20:56:59.493493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-05b3474d-338c-48a9-8113-58d9843de049 req-8b849842-a55e-46cb-9423-51024d33ba77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.073899 Jul 19 20:56:59.494532 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3532/6958] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:59.499963 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:59.500593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:59.509298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:59.509756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:59.510548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:59.511002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:59.764627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:59.773619 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bfe5c005-b7c1-4e18-aa60-9b88e2867876 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1726 microversion: 2.1 time: 0.277527 Jul 19 20:56:59.774479 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3427/6959] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:59 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1726 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:00.796623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:00.797502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:00.810000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.810547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.811414 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.811868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.958098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:00.966582 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8e260fcf-6c43-4843-b07e-ebd646257c57 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.174889 Jul 19 20:57:00.976788 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3533/6960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:00 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:01.509334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:01.519196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:01.519688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:01.536361 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] Creating event network-changed:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h1-843861-3 Jul 19 20:57:01.544139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:57:01.558203 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e376ebaa-027e-4507-a2a7-6af643451df6 req-1a0f5453-6a40-45d8-a22f-ffb40d4048ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053077 Jul 19 20:57:01.558845 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3428/6961] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:01.986006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:01.987554 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:01.993331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=33 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:02.000276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:02.000850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:02.001713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:02.002148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:02.005708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:02.339155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:02.348361 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0144a599-8703-4a31-98ab-aa4977154812 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.367677 Jul 19 20:57:02.349008 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3534/6962] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:01 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:03.368877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:03.369604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:03.371718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=29 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:03.377875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.378351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.379151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.379602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.383067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=83 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:03.518549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:03.527055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4640b45c-57ba-4aa0-b802-180145e0c2cf tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.164042 Jul 19 20:57:03.527650 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3429/6963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:03 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:04.545910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:04.546535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:04.555710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.556185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:04.556959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.557399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:04.703885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:04.712618 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-21e4cb6d-934e-4be5-bf32-0623b0d66b14 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.171799 Jul 19 20:57:04.713228 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3535/6964] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:04 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:05.730168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:05.730887 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:05.738186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.738690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.739486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.739985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.886959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:05.895964 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-91da9bb4-fa3e-41e3-8387-854b87cd74ad tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.169541 Jul 19 20:57:05.896563 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3430/6965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:05 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:06.914432 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:06.915351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:06.924241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.924698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.925564 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.926100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.069755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:07.078157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02f647b9-6f7e-4c92-8fb0-73165eaf4e76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.167778 Jul 19 20:57:07.078753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3536/6966] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:06 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:07.656374 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:57:07.656942 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 20:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:57:08.095727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:08.096434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:08.103419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.103916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.104702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.105189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.243381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:08.251697 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1e839f39-b4c3-4b79-b8ad-31a7c4628d76 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.159800 Jul 19 20:57:08.252337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3431/6967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:08 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:09.270576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:09.271175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:09.279406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:09.279876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:09.280651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:09.281282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:09.425142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:09.433219 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9e92d9a-4277-4877-9747-3472c0926b20 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.166553 Jul 19 20:57:09.434290 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3537/6968] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:09 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:10.451265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:10.451918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.459330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.459789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.461252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.461704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.603324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:10.616573 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-35b4efda-5451-4d29-bcb2-af6576a65325 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.169122 Jul 19 20:57:10.617165 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3432/6969] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:10 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:11.634486 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.635133 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.642724 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.643163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.643972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.645408 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.796708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.805835 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-50798553-0400-448e-97c2-30876774891d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1724 microversion: 2.1 time: 0.175415 Jul 19 20:57:11.806817 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3538/6970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:11 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:12.824558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:12.825335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:12.832800 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.833351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.834426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.834735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.984674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:12.993475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-41a0a086-f06b-43da-ada2-6adfb3574546 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1721 microversion: 2.1 time: 0.173516 Jul 19 20:57:12.994077 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3433/6971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:12 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:13.010446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:13.011110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:13.019671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.020153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.020967 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.021625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.064976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.065427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.066223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.066654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.090763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:57:13.096470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Getting quotas for user ea1e79f002d549ae95eb8a886455b9ba and project 3504fd525a1540d2ad7c4f0069c53d49. Resources: {'cores', 'ram'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:57:13.206713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-110fb892-0b1b-45e1-aa91-db7c86984937 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/action" status: 202 len: 0 microversion: 2.1 time: 0.200052 Jul 19 20:57:13.207214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3539/6972] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:57:13 2022] POST /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:13.216639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:13.217366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:13.224479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.225049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.226083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.227333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.478729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.488064 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-043fc70c-86b3-490d-9f17-3b58e97773f7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.275508 Jul 19 20:57:13.488959 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3434/6973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:13 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:14.508753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:14.509381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:14.516185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.516638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.517423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.517923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.666361 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:14.675825 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f4b45b77-f1fc-4454-a41e-43b699bf58b5 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.172831 Jul 19 20:57:14.676441 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3540/6974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:14 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:15.546566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-plugged", "status": "completed", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:15.560740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.562023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.582856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] Creating event network-vif-plugged:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h1-843861-3 Jul 19 20:57:15.591751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:57:15.603866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-86634d5f-1e84-42e3-8e78-7720840efd6b req-055a69cc-c6b8-4aaa-9347-90e7c7e3165c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139497 Jul 19 20:57:15.604570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3435/6975] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:15.693877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:15.694547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:15.701818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.702265 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.703033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.703464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.844416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:15.853179 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c3c4c9c-7fc0-4a05-aad8-0c82924d359b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.163517 Jul 19 20:57:15.853773 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3541/6976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:15 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:16.872313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:16.873184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:16.880215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.880686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.882246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.882696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:17.037691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:17.046228 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3cfa6d59-8fc4-4ec6-b540-9b52146286f6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.179174 Jul 19 20:57:17.046815 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3436/6977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:16 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:18.066889 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:18.067953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:18.078658 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.079107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.079914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.080348 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.263013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:18.274765 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a054bf35-618d-485d-8a1b-b457a8e7d574 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.214514 Jul 19 20:57:18.275374 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3542/6978] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:18 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:19.030420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-unplugged", "status": "completed", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:19.047767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.048630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.064524 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] Creating event network-vif-unplugged:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:57:19.070489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:57:19.088872 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5ea28b9b-e91d-4dc1-83d1-b6fd3a1a634e req-3f101406-987e-4bb5-be3a-c3a777dc1831 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065984 Jul 19 20:57:19.090243 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3437/6979] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:19.303580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:19.307062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:19.334349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.335168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.336435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.337224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.603283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.614312 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0dcb1159-28fc-49f1-bca6-c978cb140d4b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.319728 Jul 19 20:57:19.627732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3543/6980] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:19 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:20.643348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:20.644612 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:20.656304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.657096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:20.658541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.659305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:20.852590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:20.861751 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a51568e0-9d9c-4103-9bba-b83bfebae914 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.226251 Jul 19 20:57:20.862623 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3438/6981] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:20 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:21.112574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:21.129466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.130266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.146481 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] Creating event network-changed:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:57:21.153532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:57:21.165339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-9fa588ea-8d0c-44e2-b550-a881d9870608 req-71a75fc8-7230-46cf-be70-68c225c40e6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059457 Jul 19 20:57:21.166313 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3544/6982] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:21.881047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:21.882811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:21.891280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.891746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.893122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.893641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.521496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.530791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1cd867f9-650e-442a-9f0b-1c4957135f95 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.654288 Jul 19 20:57:22.531720 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3439/6983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:21 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:23.550217 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:23.554874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:23.556051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:23.563598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.564081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.564876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.565343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.722141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.731063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-929123d5-eaae-410a-8ebf-2289ea05fff6 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.182938 Jul 19 20:57:23.731676 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3545/6984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:23 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:24.749391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.750221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.758925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.759483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.760509 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.761096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.972345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.984363 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2843e578-13c2-4946-ac5f-0d8f307d27ca tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.238596 Jul 19 20:57:24.985363 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3440/6985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:26.002725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:26.003500 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:26.012980 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.013465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.014249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.014687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.179067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.192816 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c0a9a18-f6cd-4439-af6e-f0897d3a1562 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.193595 Jul 19 20:57:26.193785 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3546/6986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:25 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:27.221040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.222050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.231694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.232252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.233435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.233961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.414270 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.423197 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-28bd6ce6-f2d1-449b-b9ec-2ea01c743278 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.208150 Jul 19 20:57:27.423828 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3441/6987] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:28.445794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.446641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.454871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.455418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.456322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.456806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.634184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.649351 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-95b4310c-6575-4a84-83da-2cc7623c4a58 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.208050 Jul 19 20:57:28.650342 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3547/6988] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:29.676111 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.677130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.685400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.686014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.686973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.687471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.869897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.878603 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-afc09e50-3f5f-41f8-a2c5-cfbc947ad148 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.206892 Jul 19 20:57:29.879375 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3442/6989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:30.901393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:30.902499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:30.914881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.915679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.917082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.917861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.925609 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:31.118642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.133804 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11f51333-2da0-4f99-b259-7dfc9ef23395 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.239311 Jul 19 20:57:31.134870 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3548/6990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:30 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:32.162220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:32.163547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:32.171860 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.172328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.173100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.173565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.345677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:32.355287 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73f88625-cfac-4f36-a606-637fef3ff7e7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.197934 Jul 19 20:57:32.356004 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3443/6991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:32 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:33.374697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.375583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:33.379468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:33.386096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.386538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.387331 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.387767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.573838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.584370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18beeb6a-d2cd-4283-9a50-f2b1b145502c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1720 microversion: 2.1 time: 0.214416 Jul 19 20:57:33.585058 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3549/6992] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:34.604533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.605158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.608220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=30 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:34.617335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.618166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.619594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.620428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.626013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=86 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:34.813818 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.823174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb1a6336-2b83-4398-948e-06792e1a551f tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1713 microversion: 2.1 time: 0.223413 Jul 19 20:57:34.823773 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3444/6993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1713 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:34.842673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.843285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.850681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.851128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.851922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.852352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.013080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.021729 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f0aec175-46e4-4bdb-be27-25159e22c097 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1713 microversion: 2.1 time: 0.183903 Jul 19 20:57:35.022408 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3550/6994] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1713 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:35.040744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:35.041381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:35.047961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.048426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.049240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.049688 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.205826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.216231 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-264a5b75-fae2-4d91-9f80-bd02100e30bd tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1713 microversion: 2.1 time: 0.180925 Jul 19 20:57:35.217313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3445/6995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:35 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:35.238299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:35.238892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:35.246320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.246954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.247962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.248491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.277898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:57:35.386811 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e761177-b7cd-4bec-8642-bd177b26c532 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 204 len: 0 microversion: 2.1 time: 0.152301 Jul 19 20:57:35.387665 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3551/6996] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:35 2022] DELETE /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:35.398606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:35.400177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:35.408774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.409239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.410035 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.410488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.570780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.586284 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43c41c7e-9f72-40a3-bb5f-da3264e7fe90 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1719 microversion: 2.1 time: 0.193326 Jul 19 20:57:35.587388 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3446/6997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:35 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:36.610283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:36.614194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:36.623291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.623765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.624645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.625081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.788251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:36.797535 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52594e18-0ffa-4cb3-95d7-ff1ab6d1e28e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1719 microversion: 2.1 time: 0.194053 Jul 19 20:57:36.799495 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3552/6998] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:36 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:36.868644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d8428afc-08ba-42ea-a7d1-d02d202350a2 req-aa2942a3-b66e-41a8-a389-56bd2ca896f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-plugged", "status": "completed", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:36.879100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d8428afc-08ba-42ea-a7d1-d02d202350a2 req-aa2942a3-b66e-41a8-a389-56bd2ca896f6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.879596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d8428afc-08ba-42ea-a7d1-d02d202350a2 req-aa2942a3-b66e-41a8-a389-56bd2ca896f6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.892391 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d8428afc-08ba-42ea-a7d1-d02d202350a2 req-aa2942a3-b66e-41a8-a389-56bd2ca896f6 service nova] Creating event network-vif-plugged:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:57:36.898391 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d8428afc-08ba-42ea-a7d1-d02d202350a2 req-aa2942a3-b66e-41a8-a389-56bd2ca896f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 Jul 19 20:57:36.899044 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3447/6999] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:37.820913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:37.821835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:37.831862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.832324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.833190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.833680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.177687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.187527 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18e2f444-698f-4099-8f95-9e1c7bcd566b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1719 microversion: 2.1 time: 0.373552 Jul 19 20:57:38.188176 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3553/7000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:37 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1719 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:38.669804 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-12eb875a-fad3-4a85-9394-6082a4cdcb79 req-3817e65f-3d04-4073-a245-74ecbc70ac07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46e457f-4a06-4dc1-bf79-927bf0d57ede", "name": "network-vif-deleted", "tag": "221fdeb7-d496-4204-91c0-109b287882c8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:38.679690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-12eb875a-fad3-4a85-9394-6082a4cdcb79 req-3817e65f-3d04-4073-a245-74ecbc70ac07 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.680621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-12eb875a-fad3-4a85-9394-6082a4cdcb79 req-3817e65f-3d04-4073-a245-74ecbc70ac07 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.694976 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-12eb875a-fad3-4a85-9394-6082a4cdcb79 req-3817e65f-3d04-4073-a245-74ecbc70ac07 service nova] Creating event network-vif-deleted:221fdeb7-d496-4204-91c0-109b287882c8 for instance b46e457f-4a06-4dc1-bf79-927bf0d57ede on n-h2-843861-3 Jul 19 20:57:38.703916 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-12eb875a-fad3-4a85-9394-6082a4cdcb79 req-3817e65f-3d04-4073-a245-74ecbc70ac07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040690 Jul 19 20:57:38.704768 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3448/7001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:39.212091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:39.213254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:39.227460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.228677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.230545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.231717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.345643 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:39.358754 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-85b1cf61-78d7-4c45-9ab4-cb9f1766334d tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1368 microversion: 2.1 time: 0.155017 Jul 19 20:57:39.359451 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3554/7002] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:39 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:40.388721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:40.389517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:40.396733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:40.397734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:40.398535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:40.398977 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:40.474372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.483150 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bc8d96d8-7831-4ea5-bc49-5290e55f597c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1368 microversion: 2.1 time: 0.100460 Jul 19 20:57:40.491997 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3449/7003] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:40 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:41.504596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:41.505445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:41.513598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.514045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.514822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.515255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.587659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:41.603713 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6fe149cf-3b85-493c-b48c-00f62ddfaa3a tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1368 microversion: 2.1 time: 0.103393 Jul 19 20:57:41.604841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3555/7004] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:41 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:42.627145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:42.628786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:42.641760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.642519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.643930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.644653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.752530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.763313 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7153c060-2d89-4021-8b89-63c05f811254 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1368 microversion: 2.1 time: 0.143430 Jul 19 20:57:42.763953 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3450/7005] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:42 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:43.791354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:43.792485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:43.805238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.805767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.807157 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.808020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.844402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.844850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.845300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lazy-loading 'fault' on Instance uuid b46e457f-4a06-4dc1-bf79-927bf0d57ede {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:43.911625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1e79f002d549ae95eb8a886455b9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3504fd525a1540d2ad7c4f0069c53d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.920181 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fb381d5-675a-41ba-844f-a8b86137b94e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 200 len: 1373 microversion: 2.1 time: 0.136020 Jul 19 20:57:43.920775 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3556/7006] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:43 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 1373 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:44.939376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:44.940047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:44.947468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.947970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.948768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.949249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.964982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede HTTP/1.1 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b46e457f-4a06-4dc1-bf79-927bf0d57ede'} Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:44.966698 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6ba55f6-31b4-4134-b802-a5acd26f0b47 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 404 len: 111 microversion: 2.1 time: 0.032866 Jul 19 20:57:44.974475 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3451/7007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:44 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:45.046397 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:45.047341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:45.054930 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:45.055386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:45.056193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:45.056632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:45.070940 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-volume_attachments HTTP/1.1 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': 'b46e457f-4a06-4dc1-bf79-927bf0d57ede'} Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:45.072690 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe507252-46eb-4311-8f86-e1ec596278a7 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033029 Jul 19 20:57:45.080379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3557/7008] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:57:45 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.483080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.483988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.492157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.492712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.493591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.494114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.511149 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede HTTP/1.1 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'b46e457f-4a06-4dc1-bf79-927bf0d57ede'} Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.512912 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-564ce21e-3674-40e1-abdd-4280aa30488c tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 404 len: 111 microversion: 2.1 time: 0.036218 Jul 19 20:57:48.522957 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3452/7009] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:48 2022] DELETE /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.529239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.530736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: b46e457f-4a06-4dc1-bf79-927bf0d57ede] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.541976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.542566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.543712 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.544377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.568148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede HTTP/1.1 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'b46e457f-4a06-4dc1-bf79-927bf0d57ede'} Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.571963 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance b46e457f-4a06-4dc1-bf79-927bf0d57ede could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26cbfaa2-5c75-4333-a63d-a83a4132e76e tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede" status: 404 len: 111 microversion: 2.1 time: 0.052724 Jul 19 20:57:48.584921 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3558/7010] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/b46e457f-4a06-4dc1-bf79-927bf0d57ede => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.588729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.589366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.597205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.597859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.598782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.599335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.617635 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 HTTP/1.1 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ea9db217-da1a-4dcd-83e1-9c76f6af4061'} Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.619638 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ba3bd753-6b54-473c-ab5e-2faaed75db30 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 404 len: 111 microversion: 2.1 time: 0.039707 Jul 19 20:57:48.627483 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3453/7011] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:48 2022] DELETE /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.636141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.637238 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: ea9db217-da1a-4dcd-83e1-9c76f6af4061] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.649178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.649976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.651395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.652167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.683892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 HTTP/1.1 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'ea9db217-da1a-4dcd-83e1-9c76f6af4061'} Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.686985 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance ea9db217-da1a-4dcd-83e1-9c76f6af4061 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c89f608a-7b25-49f4-b7e9-ee56a1dfb991 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061" status: 404 len: 111 microversion: 2.1 time: 0.060805 Jul 19 20:57:48.694714 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3559/7012] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/ea9db217-da1a-4dcd-83e1-9c76f6af4061 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.704493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.705396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.716988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.717781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.719609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.721595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.748337 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 HTTP/1.1 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'd848cef3-7b19-4fe1-9d8f-e47895ccb585'} Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.750863 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7b0fc53e-5f10-4088-980e-117244be64d4 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 404 len: 111 microversion: 2.1 time: 0.055725 Jul 19 20:57:48.758654 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3454/7013] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:48 2022] DELETE /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.768922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.770044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: d848cef3-7b19-4fe1-9d8f-e47895ccb585] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.781745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.783800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.785311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.786093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.812135 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 HTTP/1.1 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd848cef3-7b19-4fe1-9d8f-e47895ccb585'} Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.815343 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance d848cef3-7b19-4fe1-9d8f-e47895ccb585 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4b9bc6c9-8d6f-470a-b8d1-413662030b07 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585" status: 404 len: 111 microversion: 2.1 time: 0.056540 Jul 19 20:57:48.820990 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3560/7014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/d848cef3-7b19-4fe1-9d8f-e47895ccb585 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.832831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.833874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.845971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.846993 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.848615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.849520 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.878333 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 HTTP/1.1 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a750e70b-04af-4a3e-95c2-e24500e32b00'} Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.881886 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-502a6daf-197a-4a20-a1c5-0f0a0e74170b tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 404 len: 111 microversion: 2.1 time: 0.059012 Jul 19 20:57:48.887082 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3455/7015] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:48 2022] DELETE /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.899994 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.901105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] [instance: a750e70b-04af-4a3e-95c2-e24500e32b00] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.913185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.913935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.915369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.916203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.942168 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] HTTP exception thrown: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Request method failure captured: Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 HTTP/1.1 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xjs2MP47YPXWMoyX30k1HLINa595Hkr0mhu6dL_js834iIQjBaxKHPO2nOGhDLB4fVO4MkOlgbJPHXKONbQS-d0_aIXVMx3O6MPHk8LORH1XQDfElxtZrX8vkISqS4lFHszcpm6ZfkDCpL8MMcF4qVMzB4olUmIUjhNvDOtLaMg7Ts Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3504fd525a1540d2ad7c4f0069c53d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 3504fd525a1540d2ad7c4f0069c53d49 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServerActionsTestJSON-471421194 Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: ea1e79f002d549ae95eb8a886455b9ba Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServerActionsTestJSON-471421194-project Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'a750e70b-04af-4a3e-95c2-e24500e32b00'} Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:48.944787 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Returning 404 to user: Instance a750e70b-04af-4a3e-95c2-e24500e32b00 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-22f79474-10f0-46b4-b62d-e276439d8078 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00" status: 404 len: 111 microversion: 2.1 time: 0.055287 Jul 19 20:57:48.952449 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3561/7016] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/a750e70b-04af-4a3e-95c2-e24500e32b00 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:48.961228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d7743ea-31e9-49c5-941d-1a00cafeb609 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] Calling method '.version_select at 0x7fb88d470790>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.987381 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1d7743ea-31e9-49c5-941d-1a00cafeb609 tempest-ServerActionsTestJSON-471421194 tempest-ServerActionsTestJSON-471421194-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23138187" status: 202 len: 0 microversion: 2.1 time: 0.031577 Jul 19 20:57:48.988597 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3456/7017] 10.222.0.33 () {58 vars in 1214 bytes} [Tue Jul 19 20:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23138187 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:01.777716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:01.779841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:01.970395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1629298077", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "453aa7a3-7f08-4807-a5be-3bfcb667c8fd"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:02.075979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] validate_networks() for [('453aa7a3-7f08-4807-a5be-3bfcb667c8fd', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:03.291428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:03.292471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:03.292822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:03.293547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:03.294061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:03.308387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.309137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.310195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.310696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.336552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Getting quotas for project 8e66999cb6f84cf5abbbeedb25aa6ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:03.346210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Getting quotas for user 2cfbbe58d8e04822bbc7dde9b47fd232 and project 8e66999cb6f84cf5abbbeedb25aa6ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:03.364807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:03.368019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:03.431411 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90b00551-7073-4c0d-9b44-f04df3eaef82 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664154 Jul 19 20:58:03.433653 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3562/7018] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:58:03.445147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d686475-81f9-470d-8c77-73f130660447 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:03.446091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d686475-81f9-470d-8c77-73f130660447 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:03.452058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=43 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:03.454203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:03.587959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d686475-81f9-470d-8c77-73f130660447 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:03.619715 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d686475-81f9-470d-8c77-73f130660447 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1217 microversion: 2.1 time: 0.179808 Jul 19 20:58:03.623879 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3457/7019] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:03 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:04.656419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:04.657090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:04.667685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.668687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.670769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.670769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.765429 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.776051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f97b51ba-6dbc-41e3-a37f-7ddfe08e54d8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1269 microversion: 2.1 time: 0.127701 Jul 19 20:58:04.776767 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3563/7020] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:04 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:05.803484 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:05.804854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:05.814449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.815522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:05.816940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.817819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.459178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.474006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bef162bc-e5d0-4162-94c3-dc0780c58099 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.675649 Jul 19 20:58:06.475717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3458/7021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:05 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:07.391003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f53d9ee9-3221-44e2-a944-d016df63ee91 req-fc2f66d7-88d7-49e9-b31e-fe7d81ec8cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c64132-f974-4db1-9600-23fe15f8441e", "tag": "ced617ce-f3c4-4ba5-8481-5f5f6361f181"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:07.428324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f53d9ee9-3221-44e2-a944-d016df63ee91 req-fc2f66d7-88d7-49e9-b31e-fe7d81ec8cc0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.428977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f53d9ee9-3221-44e2-a944-d016df63ee91 req-fc2f66d7-88d7-49e9-b31e-fe7d81ec8cc0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.451678 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f53d9ee9-3221-44e2-a944-d016df63ee91 req-fc2f66d7-88d7-49e9-b31e-fe7d81ec8cc0 service nova] Creating event network-changed:ced617ce-f3c4-4ba5-8481-5f5f6361f181 for instance c3c64132-f974-4db1-9600-23fe15f8441e on n-h1-843861-3 Jul 19 20:58:07.460794 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f53d9ee9-3221-44e2-a944-d016df63ee91 req-fc2f66d7-88d7-49e9-b31e-fe7d81ec8cc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079970 Jul 19 20:58:07.462139 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3564/7022] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:07.503266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:07.511142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:07.521597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.522478 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.523712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.524276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.886407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:07.896228 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4692303e-8d90-4810-a956-23bb605d0df8 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.404220 Jul 19 20:58:07.897173 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3459/7023] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:07 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:08.918425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:08.919043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:08.926685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.927175 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.928013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.928462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.127625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:09.136222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bd0a0896-2310-4c0d-9dec-9932d9776a42 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.221911 Jul 19 20:58:09.137037 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3565/7024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:08 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:10.154486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:10.155283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:10.163914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.164376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.165175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.165626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.325212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:10.333857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-73e01830-e328-454e-9cde-5a51f428c585 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.183757 Jul 19 20:58:10.334651 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3460/7025] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:10 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:11.353424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:11.354145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:11.361737 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.362181 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.362947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.363379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.504582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.512650 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-03bf9129-0a57-49b2-b6d8-9c3b7d791d1f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.163820 Jul 19 20:58:11.513355 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3566/7026] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:11 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:12.532056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:12.532758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:12.541310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.541759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.542614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.543078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.731393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:12.739459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2edf3147-ef75-4c44-9631-3ea957aca33b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.211984 Jul 19 20:58:12.740236 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3461/7027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:12 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:13.747359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b1953aad-f296-4afa-81bd-26833f7dffec req-c8ac11f9-6800-41d5-ad2f-984ec881c3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c64132-f974-4db1-9600-23fe15f8441e", "name": "network-vif-plugged", "status": "completed", "tag": "ced617ce-f3c4-4ba5-8481-5f5f6361f181"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:13.753591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:13.754745 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:13.758274 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:13.759141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:13.762194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:13.768171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b1953aad-f296-4afa-81bd-26833f7dffec req-c8ac11f9-6800-41d5-ad2f-984ec881c3b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.769389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b1953aad-f296-4afa-81bd-26833f7dffec req-c8ac11f9-6800-41d5-ad2f-984ec881c3b3 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.772786 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.773254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.774074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.782096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.793603 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b1953aad-f296-4afa-81bd-26833f7dffec req-c8ac11f9-6800-41d5-ad2f-984ec881c3b3 service nova] Creating event network-vif-plugged:ced617ce-f3c4-4ba5-8481-5f5f6361f181 for instance c3c64132-f974-4db1-9600-23fe15f8441e on n-h1-843861-3 Jul 19 20:58:13.804041 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b1953aad-f296-4afa-81bd-26833f7dffec req-c8ac11f9-6800-41d5-ad2f-984ec881c3b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059588 Jul 19 20:58:13.804834 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3567/7028] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:14.010093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.018459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f8faf27-958a-4bba-b68c-c9275235d73f tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.265413 Jul 19 20:58:14.019071 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3462/7029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:13 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:15.036910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:15.037623 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:15.045139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.045589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.046373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.046806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.194638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.202537 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-37ea37a5-350b-402a-91b9-db8074632645 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1317 microversion: 2.1 time: 0.169854 Jul 19 20:58:15.203144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3568/7030] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:15 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:16.220789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.221430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.228960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.229420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.230213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.230661 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.388983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.397092 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-63a1ece9-f340-47b5-bb1b-5d5c4fa3b20e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.181022 Jul 19 20:58:16.397680 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3463/7031] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:16 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:16.473551 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1061802470", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "453aa7a3-7f08-4807-a5be-3bfcb667c8fd"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:16.540590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] validate_networks() for [('453aa7a3-7f08-4807-a5be-3bfcb667c8fd', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:17.001167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:17.001755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:17.002384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:17.002986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:17.003459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:17.017591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.018497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.019389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.019927 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.044547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Getting quotas for project 8e66999cb6f84cf5abbbeedb25aa6ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:17.050029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Getting quotas for user 2cfbbe58d8e04822bbc7dde9b47fd232 and project 8e66999cb6f84cf5abbbeedb25aa6ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:17.065061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:17.067560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:17.116818 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4151efdc-1537-4f44-b823-93b6e220c44a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647535 Jul 19 20:58:17.117455 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3569/7032] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:58:17.132720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b8d26a9b-4c71-4125-b71a-241c23a7b849 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:17.133357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b8d26a9b-4c71-4125-b71a-241c23a7b849 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:17.203417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b8d26a9b-4c71-4125-b71a-241c23a7b849 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.213863 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b8d26a9b-4c71-4125-b71a-241c23a7b849 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1217 microversion: 2.1 time: 0.087947 Jul 19 20:58:17.214798 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3464/7033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:17 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:18.236366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:18.237499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:18.250322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.251097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:18.252672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.253130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:18.431368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:18.449885 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5dadcdc1-2ab1-478f-9eef-9b89379a9e51 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1277 microversion: 2.1 time: 0.220429 Jul 19 20:58:18.464673 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3570/7034] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:18 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:19.477461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:19.479037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:19.489089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.490910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.492130 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.492906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.735074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:19.745749 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-95bd85ce-4354-47a2-83ed-4ea215629e00 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.272804 Jul 19 20:58:19.746349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3465/7035] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:19 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:20.197865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0109b9ff-106e-480d-ac98-5b8a795c9345 req-4197c1f4-c8d8-4ba9-837e-8e467c35fbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb05ed5-3bf5-4fcc-993d-cc4e489a0707", "tag": "7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:20.225651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0109b9ff-106e-480d-ac98-5b8a795c9345 req-4197c1f4-c8d8-4ba9-837e-8e467c35fbd2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.226244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0109b9ff-106e-480d-ac98-5b8a795c9345 req-4197c1f4-c8d8-4ba9-837e-8e467c35fbd2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.248501 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0109b9ff-106e-480d-ac98-5b8a795c9345 req-4197c1f4-c8d8-4ba9-837e-8e467c35fbd2 service nova] Creating event network-changed:7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5 for instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 on n-h2-843861-3 Jul 19 20:58:20.256126 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0109b9ff-106e-480d-ac98-5b8a795c9345 req-4197c1f4-c8d8-4ba9-837e-8e467c35fbd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062277 Jul 19 20:58:20.256766 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3571/7036] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:20.767178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:20.768097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:20.778371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.778906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.779987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.780447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.227426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:21.238417 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f1bba232-dddf-4389-bbbe-5497a4f656f3 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.477901 Jul 19 20:58:21.239199 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3466/7037] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:20 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:22.261280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:22.262015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:22.269576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.270069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.270900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.271376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.412413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:22.420051 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-be0148c6-680f-4f34-9785-de7bc88ca30d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.163183 Jul 19 20:58:22.420652 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3572/7038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:22 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:23.447986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:23.448704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:23.459561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.460067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.460871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.461323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.622006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:23.630936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-93443558-4b46-4ab7-9fb9-561e2d97b5ae tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.187351 Jul 19 20:58:23.631553 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3467/7039] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:23 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:24.649578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:24.650185 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:24.657508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.657953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.658727 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.659183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.874098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:24.884384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6652ba16-b5c4-4229-964c-99cf320a5f58 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.239119 Jul 19 20:58:24.885201 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3573/7040] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:24 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:25.904815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:25.905441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:25.913825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.914456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.915321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.915834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.054402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:26.062392 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-216ec04e-d89a-490c-ab15-72eecdefbeff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.161466 Jul 19 20:58:26.062991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3468/7041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:25 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:26.897627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-55079d5a-930e-4cd9-8fc7-f737b8637ed6 req-8da1a1d8-97c8-4720-9b79-45bbaa074712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb05ed5-3bf5-4fcc-993d-cc4e489a0707", "name": "network-vif-plugged", "status": "completed", "tag": "7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:26.911085 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55079d5a-930e-4cd9-8fc7-f737b8637ed6 req-8da1a1d8-97c8-4720-9b79-45bbaa074712 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.911913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-55079d5a-930e-4cd9-8fc7-f737b8637ed6 req-8da1a1d8-97c8-4720-9b79-45bbaa074712 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.934809 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-55079d5a-930e-4cd9-8fc7-f737b8637ed6 req-8da1a1d8-97c8-4720-9b79-45bbaa074712 service nova] Creating event network-vif-plugged:7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5 for instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 on n-h2-843861-3 Jul 19 20:58:26.944584 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-55079d5a-930e-4cd9-8fc7-f737b8637ed6 req-8da1a1d8-97c8-4720-9b79-45bbaa074712 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052343 Jul 19 20:58:26.945927 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3574/7042] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:27.083605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:27.084976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:27.098056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.098923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.100385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.101255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.211359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:27.361758 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:27.370247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10cd0bc2-eeca-4067-899e-dc8c8ddf9755 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.294194 Jul 19 20:58:27.370842 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3469/7043] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:27 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:28.389709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:28.390747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:28.397162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:28.397907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:28.405300 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.405757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.406526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.406956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.553424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:28.561459 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-99069f61-2764-46e1-ac3c-9295fde339d9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1317 microversion: 2.1 time: 0.172998 Jul 19 20:58:28.562061 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3575/7044] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:28 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:29.581640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.582417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.590832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.591290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.592134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.592586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.807364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:29.815570 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0e9a8699-6c6d-4b85-9a43-3866c50bad76 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1506 microversion: 2.1 time: 0.238973 Jul 19 20:58:29.816239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3470/7045] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:29 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:29.835325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.835949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.845480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.846400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.848027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.848816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.883164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:29.969443 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6f06eae2-37e4-4ee5-8c1a-481c963f66c5 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 204 len: 0 microversion: 2.1 time: 0.139508 Jul 19 20:58:29.969946 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3576/7046] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:29 2022] DELETE /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:58:29.979528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.980183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.986608 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.987061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.987874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.988333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:30.128166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:30.137020 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b9b7090a-76f6-4a27-bcd5-6c9132f032c7 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1512 microversion: 2.1 time: 0.162239 Jul 19 20:58:30.137623 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3471/7047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:29 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:31.155497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:31.156141 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:31.163416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.163907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.164677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.165117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.309277 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:31.316987 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc725d10-29ec-4d64-901c-ea090adfdc8c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1512 microversion: 2.1 time: 0.165903 Jul 19 20:58:31.318087 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3577/7048] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:31 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:32.314492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bd885bb8-5946-4b54-a9c1-8e3eb0ab054b req-23815a8d-e808-4a85-8666-61e50310fd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb05ed5-3bf5-4fcc-993d-cc4e489a0707", "name": "network-vif-deleted", "tag": "7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:32.335674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:32.336573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.340029 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:32.351161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd885bb8-5946-4b54-a9c1-8e3eb0ab054b req-23815a8d-e808-4a85-8666-61e50310fd80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.352526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bd885bb8-5946-4b54-a9c1-8e3eb0ab054b req-23815a8d-e808-4a85-8666-61e50310fd80 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.364754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.365527 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.366577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.367208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.371254 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bd885bb8-5946-4b54-a9c1-8e3eb0ab054b req-23815a8d-e808-4a85-8666-61e50310fd80 service nova] Creating event network-vif-deleted:7d75a9b4-a4b3-4589-8cb0-8f1b321ec4a5 for instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 on n-h2-843861-3 Jul 19 20:58:32.383358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:32.393977 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bd885bb8-5946-4b54-a9c1-8e3eb0ab054b req-23815a8d-e808-4a85-8666-61e50310fd80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083186 Jul 19 20:58:32.400137 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3472/7049] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:32.474466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:32.482491 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-69ae07fc-1ada-49d9-9238-2346d1b753b0 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 200 len: 1302 microversion: 2.1 time: 0.151660 Jul 19 20:58:32.483151 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3578/7050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:32 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:33.501199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.501839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.504833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=37 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:33.511023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.511494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.512327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.512785 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.515940 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=81 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:33.533652 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 HTTP/1.1 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'abb05ed5-3bf5-4fcc-993d-cc4e489a0707'} Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:33.535373 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 404 to user: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ea55105-dd2b-4a64-88da-a291119aee2c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 404 len: 111 microversion: 2.1 time: 0.040742 Jul 19 20:58:33.543766 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3473/7051] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:33.548666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.549319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.557305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.557750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.558536 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.558964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.707552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.716164 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-823881c3-11a6-4f05-b36d-f0a1d0c87492 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.172050 Jul 19 20:58:33.716779 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3579/7052] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:33.734299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:33.735284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: 59467ad6-6f11-48c2-bab1-30327cd59508] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.742021 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/59467ad6-6f11-48c2-bab1-30327cd59508/action HTTP/1.1 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 32 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: {"resize": {"flavorRef": "452"}} Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '59467ad6-6f11-48c2-bab1-30327cd59508', 'body': {'resize': {'flavorRef': '452'}}} Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:33.743669 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 404 to user: Instance 59467ad6-6f11-48c2-bab1-30327cd59508 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e0b33e56-d841-4c48-9d9e-1fe9714f6b87 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "POST /compute/v2.1/servers/59467ad6-6f11-48c2-bab1-30327cd59508/action" status: 404 len: 111 microversion: 2.1 time: 0.014988 Jul 19 20:58:33.748006 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3474/7053] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:33 2022] POST /compute/v2.1/servers/59467ad6-6f11-48c2-bab1-30327cd59508/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:58:33.756124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.756662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.763473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.763953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.764736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.765190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.921455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.929408 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b25148be-13a9-4687-b886-f76c0335c163 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.178067 Jul 19 20:58:33.930235 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3580/7054] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:33.948935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.949563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.956849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.957311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.958645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.959093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.193506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.202257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6ef6ff4-9977-4361-a233-7dc51c718f19 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.257273 Jul 19 20:58:34.202832 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3475/7055] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.223950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "74de1f95-dd6f-4acb-82e8-c66b9c505698"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:34.225060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.231550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.232035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.232852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.233232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.282761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.289216 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: request: POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action HTTP/1.1 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 65 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: {"resize": {"flavorRef": "74de1f95-dd6f-4acb-82e8-c66b9c505698"}} Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: exception: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c3c64132-f974-4db1-9600-23fe15f8441e', 'body': {'resize': {'flavorRef': '74de1f95-dd6f-4acb-82e8-c66b9c505698'}}} Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:58:34.292002 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 400 to user: Flavor 74de1f95-dd6f-4acb-82e8-c66b9c505698 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c08dfab8-675e-4572-bf68-aafdfedf9e7b tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action" status: 400 len: 107 microversion: 2.1 time: 0.076051 Jul 19 20:58:34.300307 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3581/7056] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:34 2022] POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action => generated 107 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:58:34.302769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.303273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.309790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.310255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.311125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.311575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.458450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.466293 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df36d3d8-895e-4b90-a0f1-543ceebff26c tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.167615 Jul 19 20:58:34.466916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3476/7057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.484907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.485528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.492762 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.493205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.493976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.494409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.643204 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.650967 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-60dec346-d532-4dd0-8591-ecbd9d7e9917 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.169880 Jul 19 20:58:34.651549 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3582/7058] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:34.667770 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6d5f9aa-160a-4961-a43f-4ccaecd0e24e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6d5f9aa-160a-4961-a43f-4ccaecd0e24e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: request: POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action HTTP/1.1 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 29 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: {"resize": {"flavorRef": ""}} Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'c3c64132-f974-4db1-9600-23fe15f8441e', 'body': {'resize': {'flavorRef': ''}}} Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi '' Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.670167 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c6d5f9aa-160a-4961-a43f-4ccaecd0e24e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c6d5f9aa-160a-4961-a43f-4ccaecd0e24e tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action" status: 400 len: 113 microversion: 2.1 time: 0.008193 Jul 19 20:58:34.674832 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3477/7059] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:34 2022] POST /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:58:34.681061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.681680 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.687895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.688355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.689127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.689562 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.843430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.852251 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-abe046ea-ec22-4891-aab0-a1ed04db402a tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1506 microversion: 2.1 time: 0.175436 Jul 19 20:58:34.852841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3583/7060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.875454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.876301 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.884457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.885183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.885994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.886419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.900982 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 HTTP/1.1 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'abb05ed5-3bf5-4fcc-993d-cc4e489a0707'} Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:34.902583 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 404 to user: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cba40f9b-b501-43cc-b26a-7768bf403fff tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 404 len: 111 microversion: 2.1 time: 0.034178 Jul 19 20:58:34.906779 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3478/7061] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:34 2022] DELETE /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:34.913448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.914069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: abb05ed5-3bf5-4fcc-993d-cc4e489a0707] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.920417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.920873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.921656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.922092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.938021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 HTTP/1.1 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'abb05ed5-3bf5-4fcc-993d-cc4e489a0707'} Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:34.939665 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 404 to user: Instance abb05ed5-3bf5-4fcc-993d-cc4e489a0707 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7cfe03a7-d4d8-4bfc-b178-e58d6ab547e1 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707" status: 404 len: 111 microversion: 2.1 time: 0.032316 Jul 19 20:58:34.944934 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3584/7062] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/abb05ed5-3bf5-4fcc-993d-cc4e489a0707 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:34.950286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.950799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.956990 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.957454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.958273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.958834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.985252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:35.075301 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2f3de3b9-337f-4a39-a9a5-b6c5b3d97af9 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 204 len: 0 microversion: 2.1 time: 0.128899 Jul 19 20:58:35.075731 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3479/7063] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:34 2022] DELETE /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:58:35.086168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:35.086798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:35.093214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.093598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.094357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.094787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.241460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:35.249988 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18c4f558-c4d5-46d6-aa33-98e9674d3668 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1512 microversion: 2.1 time: 0.169427 Jul 19 20:58:35.250589 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3585/7064] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:35 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:36.269037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:36.269754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:36.276953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.277429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.278223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.278678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.412526 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:36.420320 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c00d6576-b81f-4c6c-b34f-21d44d998a31 tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1512 microversion: 2.1 time: 0.155715 Jul 19 20:58:36.420903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3480/7065] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:36 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:37.091884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-690a9b79-11d0-4f89-8331-e48f529fb457 req-8c59fcb9-30cc-462d-8bca-f1ba05c8934f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c64132-f974-4db1-9600-23fe15f8441e", "name": "network-vif-deleted", "tag": "ced617ce-f3c4-4ba5-8481-5f5f6361f181"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:37.103287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-690a9b79-11d0-4f89-8331-e48f529fb457 req-8c59fcb9-30cc-462d-8bca-f1ba05c8934f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.103832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-690a9b79-11d0-4f89-8331-e48f529fb457 req-8c59fcb9-30cc-462d-8bca-f1ba05c8934f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.119537 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-690a9b79-11d0-4f89-8331-e48f529fb457 req-8c59fcb9-30cc-462d-8bca-f1ba05c8934f service nova] Creating event network-vif-deleted:ced617ce-f3c4-4ba5-8481-5f5f6361f181 for instance c3c64132-f974-4db1-9600-23fe15f8441e on n-h1-843861-3 Jul 19 20:58:37.126008 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-690a9b79-11d0-4f89-8331-e48f529fb457 req-8c59fcb9-30cc-462d-8bca-f1ba05c8934f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Jul 19 20:58:37.127256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3586/7066] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:37.438862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:37.439527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:37.446285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.446760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.447546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.448034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.483703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.484199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.484677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lazy-loading 'fault' on Instance uuid c3c64132-f974-4db1-9600-23fe15f8441e {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:37.530012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfbbe58d8e04822bbc7dde9b47fd232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66999cb6f84cf5abbbeedb25aa6ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:37.539398 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-080a2fe8-7774-410f-92e0-fee5b5645b0d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 200 len: 1307 microversion: 2.1 time: 0.104672 Jul 19 20:58:37.540581 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3481/7067] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:37 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:38.558767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:38.559473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] [instance: c3c64132-f974-4db1-9600-23fe15f8441e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:38.568224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.568772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.569832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.570545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.585965 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] HTTP exception thrown: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Request method failure captured: Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e HTTP/1.1 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xrZUQ1hco89FmnZPbis0JW-zp7pLFUQisy8Zlreuxcr7hMzM4otks3REjxHmOHAT7Qw2p2kq-CYRiBhNdXnE-E8v0ij3PMo25l8G1rzHNN9TM7vlnKFK9t4RAJyDGGnEWlLySCAqD5N-VHGen3cnI3N8verIa1bukSrfqBjpgFOa4k Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e66999cb6f84cf5abbbeedb25aa6ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 8e66999cb6f84cf5abbbeedb25aa6ad1 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1512018159 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 2cfbbe58d8e04822bbc7dde9b47fd232 Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-ServersNegativeTestJSON-1512018159-project Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'c3c64132-f974-4db1-9600-23fe15f8441e'} Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:38.587629 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] Returning 404 to user: Instance c3c64132-f974-4db1-9600-23fe15f8441e could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3943dd1b-f106-403a-9874-a59f2d5b8a1d tempest-ServersNegativeTestJSON-1512018159 tempest-ServersNegativeTestJSON-1512018159-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e" status: 404 len: 111 microversion: 2.1 time: 0.034596 Jul 19 20:58:38.593405 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3587/7068] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:38 2022] GET /compute/v2.1/servers/c3c64132-f974-4db1-9600-23fe15f8441e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:58.475620 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:58:58.476546 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 20:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:59:17.118255 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:17.120647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:17.358164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8d792ac-c4d9-4d8a-a36b-4246c83081a6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: .version_select at 0x7fb88cdd4550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-708661434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvxnWhNZS2DaAtHvKiPIuVa1JcqBDC9fP02qDZArQ5tdzWnbUGkT++1dUOhNtHupP4ny8rkIWeEIy0BYiuSIeNO9MXea4R1/1u4sAB3hqYhyS5fs9PjCmWT3BUh51cvfQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:17.380238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c8d792ac-c4d9-4d8a-a36b-4246c83081a6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for project d1bfbfd612224121a3182c76e47b8752. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:17.388154 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c8d792ac-c4d9-4d8a-a36b-4246c83081a6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for user 668f2211176c4f08aeeb1fee76c61746 and project d1bfbfd612224121a3182c76e47b8752. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:17.418815 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8d792ac-c4d9-4d8a-a36b-4246c83081a6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.306983 Jul 19 20:59:17.431891 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3482/7069] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:59:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:17.475045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-168944991", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-708661434", "networks": [{"uuid": "9af81ebe-4a00-4bf3-aada-139644224e87"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:17.483057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=21 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:17.484270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=45 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:17.704961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] validate_networks() for [('9af81ebe-4a00-4bf3-aada-139644224e87', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:59:18.181169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:59:18.181594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:59:18.182076 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:59:18.182525 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:59:18.182942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:59:18.198058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.198601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.199416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.199954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.228050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for project d1bfbfd612224121a3182c76e47b8752. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:18.235839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for user 668f2211176c4f08aeeb1fee76c61746 and project d1bfbfd612224121a3182c76e47b8752. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:18.250215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:59:18.252692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:59:18.304175 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-11a1529a-b89a-4fbc-9f1b-3b09e474f9e8 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834011 Jul 19 20:59:18.305006 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3588/7070] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:59:18.318085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ae4c574-ec5a-445d-a1a9-398cd881c1da tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.318946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ae4c574-ec5a-445d-a1a9-398cd881c1da tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.377747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ae4c574-ec5a-445d-a1a9-398cd881c1da tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.386850 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ae4c574-ec5a-445d-a1a9-398cd881c1da tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1261 microversion: 2.1 time: 0.075068 Jul 19 20:59:18.387444 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3483/7071] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1261 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:19.416430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:19.420818 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:19.438990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.440108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.442451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.444149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.594384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.605853 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-de2af1e5-df55-498e-b3bd-408c19449043 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1321 microversion: 2.1 time: 0.204730 Jul 19 20:59:19.606657 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3589/7072] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:19 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:20.633707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.635603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.647488 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.648459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.649496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.650415 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.890546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.899735 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70559adb-d1de-462e-b37e-c14ea213fbcb tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.276833 Jul 19 20:59:20.900591 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3484/7073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:21.292773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-53364f8d-71ac-4e8c-a27c-96ec20f09dd4 req-0050ba53-a154-4703-a020-6c2782e350e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32b1ff1-a1b3-4858-b6fd-00aa2b464369", "tag": "bd060a99-5bb0-422a-b67b-3e46fdc09da4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:21.312887 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-53364f8d-71ac-4e8c-a27c-96ec20f09dd4 req-0050ba53-a154-4703-a020-6c2782e350e6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.314318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-53364f8d-71ac-4e8c-a27c-96ec20f09dd4 req-0050ba53-a154-4703-a020-6c2782e350e6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.329381 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-53364f8d-71ac-4e8c-a27c-96ec20f09dd4 req-0050ba53-a154-4703-a020-6c2782e350e6 service nova] Creating event network-changed:bd060a99-5bb0-422a-b67b-3e46fdc09da4 for instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 on n-h2-843861-3 Jul 19 20:59:21.334787 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-53364f8d-71ac-4e8c-a27c-96ec20f09dd4 req-0050ba53-a154-4703-a020-6c2782e350e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050325 Jul 19 20:59:21.335412 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3590/7074] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:21.918177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.918849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.926534 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.927149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.928037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.928721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.066672 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.074412 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3a8c53d-dc55-4d57-a619-72ffb006c72e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.160569 Jul 19 20:59:22.074991 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3485/7075] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:23.093161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.093864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.100699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.101149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.101934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.102377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.249651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.257792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-073b98b7-83c1-4695-a662-7507828959ea tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.169471 Jul 19 20:59:23.258379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3591/7076] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:24.283202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:24.283935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:24.291552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.292047 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.292840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.293391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.603207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.611072 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-340e39ad-3339-4dbe-a94e-587d543a4046 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.332021 Jul 19 20:59:24.611736 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3486/7077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:24 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:25.628764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:25.629386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:25.636803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.637254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.638033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.638467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.781874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.789669 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9349b08-c7f0-4a4c-b269-407dca6de652 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.165063 Jul 19 20:59:25.790293 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3592/7078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:25 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:26.806796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:26.807470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:26.814422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.814900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.815692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.816177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.959434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.967163 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-85d45726-749b-4f95-8fcf-e3e69195b87f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.164404 Jul 19 20:59:26.967739 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3487/7079] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:26 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:27.194540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1baedca7-b0ce-4836-83c3-918149e90472 req-b548ae0a-94cc-43c4-953c-a1683402db2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32b1ff1-a1b3-4858-b6fd-00aa2b464369", "name": "network-vif-plugged", "status": "completed", "tag": "bd060a99-5bb0-422a-b67b-3e46fdc09da4"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:27.203858 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1baedca7-b0ce-4836-83c3-918149e90472 req-b548ae0a-94cc-43c4-953c-a1683402db2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.204317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1baedca7-b0ce-4836-83c3-918149e90472 req-b548ae0a-94cc-43c4-953c-a1683402db2a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.220178 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1baedca7-b0ce-4836-83c3-918149e90472 req-b548ae0a-94cc-43c4-953c-a1683402db2a service nova] Creating event network-vif-plugged:bd060a99-5bb0-422a-b67b-3e46fdc09da4 for instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 on n-h2-843861-3 Jul 19 20:59:27.225901 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1baedca7-b0ce-4836-83c3-918149e90472 req-b548ae0a-94cc-43c4-953c-a1683402db2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Jul 19 20:59:27.226490 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3593/7080] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:27.983906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.984458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.991928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.992403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.993198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.993653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.134657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:28.142297 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6516f1b6-ea28-4209-a426-0f21c160d0d1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1361 microversion: 2.1 time: 0.162511 Jul 19 20:59:28.142874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3488/7081] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:29.160701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.161874 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.164871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:29.165546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:29.172334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.172777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.173550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.173982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.309672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.317880 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d8b71cc-783a-403e-8e0d-7a540c6f608d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1554 microversion: 2.1 time: 0.162312 Jul 19 20:59:29.318446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3594/7082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:29.334707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.335549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.337355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:29.344088 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.344548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.345339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.345780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.487889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.495701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-92ea78cc-ea81-47b6-89f3-8fc47dda28a1 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1554 microversion: 2.1 time: 0.165526 Jul 19 20:59:29.496418 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3489/7083] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:31.183278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1dd090e-5c09-4aaa-906d-14a31b95a5e6"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:31.184382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:31.192012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.192460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.193227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.193660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.464037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d8aac759-13a6-4329-b200-f526ab4ca7ca tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283914 Jul 19 20:59:31.464679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3595/7084] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 20:59:31 2022] POST /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:43.214782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.215336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.218192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:43.219037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:43.226221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.226683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.227476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.227946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.320336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lazy-loading 'services' on Instance uuid e32b1ff1-a1b3-4858-b6fd-00aa2b464369 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:43.394521 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-680695f9-b579-41e1-8c12-8c4e1dde88c0 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments/d1dd090e-5c09-4aaa-906d-14a31b95a5e6" status: 202 len: 0 microversion: 2.1 time: 0.183057 Jul 19 20:59:43.395252 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3490/7085] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:59:43 2022] DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments/d1dd090e-5c09-4aaa-906d-14a31b95a5e6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:43.408766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.410552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.415708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:43.416778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:43.426023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.426463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.427244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.427679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.460634 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-706c477b-7636-4d60-8b5c-0b616c221448 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060137 Jul 19 20:59:43.461256 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3596/7086] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:43 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:44.474571 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:44.475586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:44.483922 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.484394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.485184 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.485630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.518126 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-feeb004c-966c-41a2-8ec9-dc3bce5dadff tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049300 Jul 19 20:59:44.518757 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3491/7087] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:44 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:45.530544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:45.531427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:45.539193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.539645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.540465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.540903 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.571794 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f519498c-ab20-4d9b-8736-14d0193d4bc4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Jul 19 20:59:45.572667 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3597/7088] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:45 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:46.587879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.589115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.596546 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.597745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.598630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.598791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.635961 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dc6be690-f73c-40f7-a169-37eaad5d15db tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Jul 19 20:59:46.636877 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3492/7089] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:47.649555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:47.650537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:47.658019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.658470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.659249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.659692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.693583 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-58badd70-b478-4f33-b9d1-c7199f19d582 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Jul 19 20:59:47.694701 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3598/7090] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:47 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:48.708317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:48.709288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:48.716907 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:48.718476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.718476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:48.718707 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.754531 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e38ec147-2815-4700-80df-13438656354e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051126 Jul 19 20:59:48.755197 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3493/7091] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:48 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:59:48.766738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:48.767409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:48.774384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:48.774812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.775581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:48.776068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.865129 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] HTTP exception thrown: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 is not attached to volume d1dd090e-5c09-4aaa-906d-14a31b95a5e6 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Request method failure captured: Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments/d1dd090e-5c09-4aaa-906d-14a31b95a5e6 HTTP/1.1 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xsfeWcFhwRPzVTvruX68B_OFijKcKJIGrSh32wfB8g3flSERaf8fScKL07IQdIBacJCIMzG6TfS91GHBB3QBQZXo_nr5GmxUoRqr_xpkcsdgouEwGvllRLAVaOtBwoFTVo_sQ01gp8UJQ3-GqPwjbaXrsvhF_KQBSJbRv-YYYboBTw Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 668f2211176c4f08aeeb1fee76c61746 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 is not attached to volume d1dd090e-5c09-4aaa-906d-14a31b95a5e6 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': 'e32b1ff1-a1b3-4858-b6fd-00aa2b464369', 'id': 'd1dd090e-5c09-4aaa-906d-14a31b95a5e6'} Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d1dd090e-5c09-4aaa-906d-14a31b95a5e6. Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 is not attached to volume d1dd090e-5c09-4aaa-906d-14a31b95a5e6 Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:48.873215 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 is not attached to volume d1dd090e-5c09-4aaa-906d-14a31b95a5e6 Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Returning 404 to user: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 is not attached to volume d1dd090e-5c09-4aaa-906d-14a31b95a5e6 {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-854ef9c0-ba62-41d0-ba32-46c223f3f3b2 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments/d1dd090e-5c09-4aaa-906d-14a31b95a5e6" status: 404 len: 154 microversion: 2.1 time: 0.113241 Jul 19 20:59:48.879164 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3599/7092] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 20:59:48 2022] DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369/os-volume_attachments/d1dd090e-5c09-4aaa-906d-14a31b95a5e6 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:52.462272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:52.462896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:52.471470 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.472090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.473543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.474413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.511380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:52.618920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1d6d85d7-2e55-4276-8e92-232316ede908 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 204 len: 0 microversion: 2.1 time: 0.160265 Jul 19 20:59:52.619943 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3494/7093] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:52 2022] DELETE /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:59:52.629741 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:52.630508 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:52.639245 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.640065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.641448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.642252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.830156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:52.840909 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-73093922-a062-4133-9c97-34e103e40b2e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1560 microversion: 2.1 time: 0.216001 Jul 19 20:59:52.841432 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3600/7094] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:52 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:53.859108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:53.859981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:53.868239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.868591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:53.869383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.869837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.010284 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:54.018234 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7ba263a-5ff9-4af2-ab6e-8c93564c2a55 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1560 microversion: 2.1 time: 0.163493 Jul 19 20:59:54.018837 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3495/7095] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:53 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:55.038069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:55.038728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:55.046233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:55.046682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:55.048011 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:55.048478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:55.142091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:55.152656 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-accb9fcf-e114-456f-9b70-5fa4318a813e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 200 len: 1518 microversion: 2.1 time: 0.119200 Jul 19 20:59:55.155848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3601/7096] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:55 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 1518 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:55.163095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-04d6f607-5608-4663-8424-af58adfe5476 req-9bfe544e-0dd8-42fc-9113-23159b7dc44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32b1ff1-a1b3-4858-b6fd-00aa2b464369", "name": "network-vif-deleted", "tag": "bd060a99-5bb0-422a-b67b-3e46fdc09da4"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:55.172083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-04d6f607-5608-4663-8424-af58adfe5476 req-9bfe544e-0dd8-42fc-9113-23159b7dc44f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:55.172799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-04d6f607-5608-4663-8424-af58adfe5476 req-9bfe544e-0dd8-42fc-9113-23159b7dc44f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:55.186086 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-04d6f607-5608-4663-8424-af58adfe5476 req-9bfe544e-0dd8-42fc-9113-23159b7dc44f service nova] Creating event network-vif-deleted:bd060a99-5bb0-422a-b67b-3e46fdc09da4 for instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 on n-h2-843861-3 Jul 19 20:59:55.192478 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-04d6f607-5608-4663-8424-af58adfe5476 req-9bfe544e-0dd8-42fc-9113-23159b7dc44f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120706 Jul 19 20:59:55.193112 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3496/7097] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:56.170413 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.171010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: e32b1ff1-a1b3-4858-b6fd-00aa2b464369] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:56.178128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.178566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.179327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.179754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.196334 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] HTTP exception thrown: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Request method failure captured: Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 HTTP/1.1 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xsfeWcFhwRPzVTvruX68B_OFijKcKJIGrSh32wfB8g3flSERaf8fScKL07IQdIBacJCIMzG6TfS91GHBB3QBQZXo_nr5GmxUoRqr_xpkcsdgouEwGvllRLAVaOtBwoFTVo_sQ01gp8UJQ3-GqPwjbaXrsvhF_KQBSJbRv-YYYboBTw Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 668f2211176c4f08aeeb1fee76c61746 Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'e32b1ff1-a1b3-4858-b6fd-00aa2b464369'} Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:56.197859 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Returning 404 to user: Instance e32b1ff1-a1b3-4858-b6fd-00aa2b464369 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-32d6a868-7f99-4ffd-88e2-9f1dd066aff3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369" status: 404 len: 111 microversion: 2.1 time: 0.032779 Jul 19 20:59:56.202435 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3602/7098] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:56 2022] GET /compute/v2.1/servers/e32b1ff1-a1b3-4858-b6fd-00aa2b464369 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:56.210194 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ae0b5bc0-0d9b-46d3-87b3-54685784259f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '.version_select at 0x7fb88db75b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.230241 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ae0b5bc0-0d9b-46d3-87b3-54685784259f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-708661434" status: 202 len: 0 microversion: 2.1 time: 0.025798 Jul 19 20:59:56.230968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3497/7099] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 19 20:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-708661434 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:59:56.248194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-846d76be-17ef-4542-ba5c-6031062fc5e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: .version_select at 0x7fb88c94cdc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1666768275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsjqv4xDdpAHIAHxY4T5d3xDXUR2DG1qR+2tJe6PPwic3YpBiZsnOqV5SYCgRMAfkFbuwlPA9aN6jog9ZvvyGjvL/X/eaCInyoL7CSw9ATJ1757ge+fAx4gX1Z8JAWfjg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:56.271254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-846d76be-17ef-4542-ba5c-6031062fc5e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for project d1bfbfd612224121a3182c76e47b8752. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:56.276931 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-846d76be-17ef-4542-ba5c-6031062fc5e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for user 668f2211176c4f08aeeb1fee76c61746 and project d1bfbfd612224121a3182c76e47b8752. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:56.303314 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-846d76be-17ef-4542-ba5c-6031062fc5e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.059239 Jul 19 20:59:56.303948 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3603/7100] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 20:59:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:56.353026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1450907669", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1666768275", "networks": [{"uuid": "9af81ebe-4a00-4bf3-aada-139644224e87"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:56.406311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] validate_networks() for [('9af81ebe-4a00-4bf3-aada-139644224e87', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:59:56.875971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:59:56.876408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:59:56.880310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:59:56.880310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:59:56.880310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:59:56.888013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.888471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.889285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.889726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.906836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for project d1bfbfd612224121a3182c76e47b8752. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:56.912401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Getting quotas for user 668f2211176c4f08aeeb1fee76c61746 and project d1bfbfd612224121a3182c76e47b8752. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:56.926070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:59:56.928538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:59:56.976623 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-44290dc8-3560-4b9d-9374-8f9ad709638f tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627537 Jul 19 20:59:56.977310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3498/7101] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 20:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:59:56.987233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4a0784ef-2cd9-44f0-92e2-6aff1ca51ce6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.988449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4a0784ef-2cd9-44f0-92e2-6aff1ca51ce6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:57.044775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4a0784ef-2cd9-44f0-92e2-6aff1ca51ce6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:57.055898 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4a0784ef-2cd9-44f0-92e2-6aff1ca51ce6 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1263 microversion: 2.1 time: 0.072196 Jul 19 20:59:57.056507 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3604/7102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:56 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:58.074361 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:58.075201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:58.084065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:58.084065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:58.084563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:58.084999 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:58.158155 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:58.168377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0f8bfa2-ebf5-4ba5-8031-f763cfa0a84e tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1323 microversion: 2.1 time: 0.098433 Jul 19 20:59:58.169885 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3499/7103] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:58 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:59.188604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:59.190080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:59.198941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:59.199358 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:59.200469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:59.201003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:59.433425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:59.445753 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ac7cf3e-5f70-4625-bf95-dff550bddee7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.260249 Jul 19 20:59:59.446820 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3605/7104] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:59 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:59.692350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-954dd35f-5df2-4251-bdfe-8c8ce4a82c11 req-8ad15fa3-cfa3-4a56-885d-36d38060ef9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2124a1d0-f856-4d28-a9c6-ebe8506f7e84", "tag": "f7e803bc-8a60-407a-94e8-4fdfe3f15569"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:59.703007 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-954dd35f-5df2-4251-bdfe-8c8ce4a82c11 req-8ad15fa3-cfa3-4a56-885d-36d38060ef9a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:59.703360 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-954dd35f-5df2-4251-bdfe-8c8ce4a82c11 req-8ad15fa3-cfa3-4a56-885d-36d38060ef9a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:59.716759 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-954dd35f-5df2-4251-bdfe-8c8ce4a82c11 req-8ad15fa3-cfa3-4a56-885d-36d38060ef9a service nova] Creating event network-changed:f7e803bc-8a60-407a-94e8-4fdfe3f15569 for instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 on n-h1-843861-3 Jul 19 20:59:59.723445 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-954dd35f-5df2-4251-bdfe-8c8ce4a82c11 req-8ad15fa3-cfa3-4a56-885d-36d38060ef9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035360 Jul 19 20:59:59.724857 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3500/7105] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:00.463240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:00.463886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:00.470938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.471395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.472782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.473224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.607104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:00.614905 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1003b26-091a-40aa-807a-d970b7a282df tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.155569 Jul 19 21:00:00.615490 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3606/7106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:00 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:01.633771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:01.634568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:01.641249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.641715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.642513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.642960 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.784058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:01.792533 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ac1febdb-33d1-4699-8e03-82ebef24ad23 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.164323 Jul 19 21:00:01.793128 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3501/7107] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:01 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:02.810606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:02.811228 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:02.818976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:02.819522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:02.820462 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:02.820899 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:02.953270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:02.961575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0832ca70-318f-4d6c-9e4d-23790cf555f7 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.155044 Jul 19 21:00:02.962150 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3607/7108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:02 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:03.978986 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:03.979655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:03.987441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:03.987946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:03.988759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:03.989213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:04.137825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:04.148035 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6f0a3277-480b-4a43-98c2-d5d9bdc80e26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.173047 Jul 19 21:00:04.148641 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3502/7109] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:03 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:04.237944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-7b4d629a-a93d-4158-b981-d3edfa5154c2 req-546b307d-b8e2-4ed7-a126-319318005406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2124a1d0-f856-4d28-a9c6-ebe8506f7e84", "name": "network-vif-plugged", "status": "completed", "tag": "f7e803bc-8a60-407a-94e8-4fdfe3f15569"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:04.247879 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7b4d629a-a93d-4158-b981-d3edfa5154c2 req-546b307d-b8e2-4ed7-a126-319318005406 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:04.248363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-7b4d629a-a93d-4158-b981-d3edfa5154c2 req-546b307d-b8e2-4ed7-a126-319318005406 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:04.269739 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-7b4d629a-a93d-4158-b981-d3edfa5154c2 req-546b307d-b8e2-4ed7-a126-319318005406 service nova] Creating event network-vif-plugged:f7e803bc-8a60-407a-94e8-4fdfe3f15569 for instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 on n-h1-843861-3 Jul 19 21:00:04.276384 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-7b4d629a-a93d-4158-b981-d3edfa5154c2 req-546b307d-b8e2-4ed7-a126-319318005406 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041684 Jul 19 21:00:04.280429 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3608/7110] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:05.166102 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:05.166740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:05.183472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:05.183957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:05.184761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:05.185210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:05.335731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:05.349820 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-105fe4e3-5126-4d9a-87cf-e86b83199d26 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1363 microversion: 2.1 time: 0.187228 Jul 19 21:00:05.350888 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3503/7111] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:05 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:06.369458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:06.370169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:06.378787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.379231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.380045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.380478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.528636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.536692 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-59642857-8d87-437e-92d4-69848d6b9c3c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1555 microversion: 2.1 time: 0.171580 Jul 19 21:00:06.537304 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3609/7112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:06 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:06.553912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:06.554583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:06.562251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.562719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.563502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.563983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.710381 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.719482 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d106b881-f8af-4e69-bdb1-4ca3cbfe8781 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1555 microversion: 2.1 time: 0.170169 Jul 19 21:00:06.720277 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3504/7113] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:06 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:08.279072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "717c40d2-4e6b-4bc9-af92-8182790a93af"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:08.280178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:08.285284 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:08.289401 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.289877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.290647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.291078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.571016 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e310f535-c685-404f-a880-a4851f7b384a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "POST /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295904 Jul 19 21:00:08.576739 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3610/7114] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 21:00:08 2022] POST /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:00:20.327935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:20.328524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:20.330605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.331974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.333204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.333866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.340517 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.340983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.341780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.342233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.427772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lazy-loading 'services' on Instance uuid 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:00:20.501628 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-525f8544-4264-4981-85b2-57b07d235c8a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments/717c40d2-4e6b-4bc9-af92-8182790a93af" status: 202 len: 0 microversion: 2.1 time: 0.177279 Jul 19 21:00:20.502243 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3505/7115] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:00:20 2022] DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments/717c40d2-4e6b-4bc9-af92-8182790a93af => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:00:20.510164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.511138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:20.516632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:20.517757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:20.527383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.527850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.528633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.529058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.566059 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6af0687a-b664-4923-8c4f-45954f82b27d tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058244 Jul 19 21:00:20.570357 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3611/7116] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:20 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:21.579926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:21.581168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:21.593359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:21.594003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:21.595149 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:21.595737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:21.629331 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6de9d8a7-dc46-435d-aa08-c88e263c0572 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054324 Jul 19 21:00:21.629949 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3506/7117] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:21 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:22.642991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:22.644283 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:22.651998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:22.652453 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:22.653239 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:22.653673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:22.688330 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-332a4466-3720-41ad-ac96-dab8a271a72a tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048872 Jul 19 21:00:22.688330 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3612/7118] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:22 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:23.699294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:23.700617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:23.708159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.708630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.709428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.709884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.741974 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-60e15aa6-5ff8-44b2-8365-f61b9216c608 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Jul 19 21:00:23.742570 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3507/7119] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:23 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:24.755669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:24.756723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:24.765040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:24.765490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:24.766736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:24.767236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:24.803964 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fd036daa-bad9-42c3-aaeb-556cdf9e8dfc tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Jul 19 21:00:24.808189 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3613/7120] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:24 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:25.816456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:25.817412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:25.824592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.825060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.825861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.826308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.858931 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c1dc4377-e310-476d-8576-c79e90b9246b tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046663 Jul 19 21:00:25.859531 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3508/7121] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:25 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:00:25.869746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:25.870391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:25.877859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.878354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.879147 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.879591 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.967597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] HTTP exception thrown: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 is not attached to volume 717c40d2-4e6b-4bc9-af92-8182790a93af Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Request method failure captured: Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: request: DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments/717c40d2-4e6b-4bc9-af92-8182790a93af HTTP/1.1 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xsfeWcFhwRPzVTvruX68B_OFijKcKJIGrSh32wfB8g3flSERaf8fScKL07IQdIBacJCIMzG6TfS91GHBB3QBQZXo_nr5GmxUoRqr_xpkcsdgouEwGvllRLAVaOtBwoFTVo_sQ01gp8UJQ3-GqPwjbaXrsvhF_KQBSJbRv-YYYboBTw Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 668f2211176c4f08aeeb1fee76c61746 Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 is not attached to volume 717c40d2-4e6b-4bc9-af92-8182790a93af Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'server_id': '2124a1d0-f856-4d28-a9c6-ebe8506f7e84', 'id': '717c40d2-4e6b-4bc9-af92-8182790a93af'} Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 717c40d2-4e6b-4bc9-af92-8182790a93af. Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 is not attached to volume 717c40d2-4e6b-4bc9-af92-8182790a93af Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:25.969258 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 is not attached to volume 717c40d2-4e6b-4bc9-af92-8182790a93af Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Returning 404 to user: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 is not attached to volume 717c40d2-4e6b-4bc9-af92-8182790a93af {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-45938c39-a07a-45b2-b969-806758ea1992 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments/717c40d2-4e6b-4bc9-af92-8182790a93af" status: 404 len: 154 microversion: 2.1 time: 0.105139 Jul 19 21:00:25.975168 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3614/7122] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:00:25 2022] DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84/os-volume_attachments/717c40d2-4e6b-4bc9-af92-8182790a93af => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:00:29.305347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:29.305930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:29.312903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:29.313369 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:29.314142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:29.314584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:29.343997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:00:29.429007 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9bae4b38-5527-449d-9b8e-0f857bf85142 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 204 len: 0 microversion: 2.1 time: 0.127237 Jul 19 21:00:29.434613 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3509/7123] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:00:29 2022] DELETE /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:00:29.440771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:29.441176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:29.449048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:29.449498 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:29.450268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:29.450709 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:29.594043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:29.602172 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f1edab5c-1101-41fa-b542-fe03835995e4 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1561 microversion: 2.1 time: 0.166179 Jul 19 21:00:29.602774 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3615/7124] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:29 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:30.620606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:30.621322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:30.628605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:30.629071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:30.629859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:30.630314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:30.764980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:30.773325 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-31b232c2-6281-4161-bfa2-390862399089 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1561 microversion: 2.1 time: 0.157191 Jul 19 21:00:30.773910 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3510/7125] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:30 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:31.791339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:31.792178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:31.800941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:31.801389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:31.802380 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:31.802826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:32.091118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-83c71db2-4057-454d-94c9-e33374fd4c38 req-0184642a-07e1-4813-b619-e9a12c1870ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2124a1d0-f856-4d28-a9c6-ebe8506f7e84", "name": "network-vif-deleted", "tag": "f7e803bc-8a60-407a-94e8-4fdfe3f15569"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:32.103778 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668f2211176c4f08aeeb1fee76c61746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bfbfd612224121a3182c76e47b8752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:32.112512 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8b312e3e-4a0c-4e99-9a3a-30cba23a361c tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 200 len: 1519 microversion: 2.1 time: 0.324957 Jul 19 21:00:32.113226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-83c71db2-4057-454d-94c9-e33374fd4c38 req-0184642a-07e1-4813-b619-e9a12c1870ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:32.113474 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3616/7126] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:31 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:32.114935 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-83c71db2-4057-454d-94c9-e33374fd4c38 req-0184642a-07e1-4813-b619-e9a12c1870ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:32.127907 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-83c71db2-4057-454d-94c9-e33374fd4c38 req-0184642a-07e1-4813-b619-e9a12c1870ea service nova] Creating event network-vif-deleted:f7e803bc-8a60-407a-94e8-4fdfe3f15569 for instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 on n-h1-843861-3 Jul 19 21:00:32.132787 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-83c71db2-4057-454d-94c9-e33374fd4c38 req-0184642a-07e1-4813-b619-e9a12c1870ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050101 Jul 19 21:00:32.133668 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3511/7127] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:33.130026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:33.130659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] [instance: 2124a1d0-f856-4d28-a9c6-ebe8506f7e84] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:33.137913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:33.138370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:33.139137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:33.139570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:33.155567 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] HTTP exception thrown: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Request method failure captured: Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 HTTP/1.1 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xsfeWcFhwRPzVTvruX68B_OFijKcKJIGrSh32wfB8g3flSERaf8fScKL07IQdIBacJCIMzG6TfS91GHBB3QBQZXo_nr5GmxUoRqr_xpkcsdgouEwGvllRLAVaOtBwoFTVo_sQ01gp8UJQ3-GqPwjbaXrsvhF_KQBSJbRv-YYYboBTw Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1bfbfd612224121a3182c76e47b8752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: d1bfbfd612224121a3182c76e47b8752 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1374187259 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 668f2211176c4f08aeeb1fee76c61746 Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestEncryptedCinderVolumes-1374187259-project Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '2124a1d0-f856-4d28-a9c6-ebe8506f7e84'} Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:33.157140 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Returning 404 to user: Instance 2124a1d0-f856-4d28-a9c6-ebe8506f7e84 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-798ce97a-baa2-4247-aa99-6e564fc164c3 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84" status: 404 len: 111 microversion: 2.1 time: 0.032990 Jul 19 21:00:33.161757 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3617/7128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:33 2022] GET /compute/v2.1/servers/2124a1d0-f856-4d28-a9c6-ebe8506f7e84 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:00:33.168914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7caf3995-7f25-45c8-97b7-7c1ed4ec9108 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] Calling method '.version_select at 0x7fb88cdd4ee0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:33.187641 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7caf3995-7f25-45c8-97b7-7c1ed4ec9108 tempest-TestEncryptedCinderVolumes-1374187259 tempest-TestEncryptedCinderVolumes-1374187259-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1666768275" status: 202 len: 0 microversion: 2.1 time: 0.023711 Jul 19 21:00:33.188214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3512/7129] 10.222.0.33 () {58 vars in 1277 bytes} [Tue Jul 19 21:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1666768275 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:01.706608 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd86cb3b-aa89-426a-ae0b-cf0670bb9a0f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: .version_select at 0x7fb88c95e5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-713144141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXaPOk1Zi/Ej50s6kakkVLweJwvtPQLlOBHR1mbAb4wr4FFiRY+St8OFtcDrGC9r+zhI/DBKu7+6qLlPyluwDzzdum5+anxgpvVNU7quF41TQlK8RpV2SQCQNMNzh811Q=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:01.710981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=14 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:01.711640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=38 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:01.725004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd86cb3b-aa89-426a-ae0b-cf0670bb9a0f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:01.730539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd86cb3b-aa89-426a-ae0b-cf0670bb9a0f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for user f593685780b64a13a7ba039633a5aeae and project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:01.755194 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd86cb3b-aa89-426a-ae0b-cf0670bb9a0f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052892 Jul 19 21:01:01.755800 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3618/7130] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:01:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:01.809483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:01.810252 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:01.815080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-368809712", "imageRef": "4405b01c-1ac0-4db3-8eef-4125f5f09a77", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-713144141", "networks": [{"uuid": "33aeea13-681c-4f42-a55d-6b622223f5f5"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:01.871589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] validate_networks() for [('33aeea13-681c-4f42-a55d-6b622223f5f5', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:01:02.258547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:01:02.258994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:01:02.259490 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:01:02.259952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:01:02.260450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:01:02.271034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:02.271508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:02.272372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:02.272829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:02.290883 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:02.297460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for user f593685780b64a13a7ba039633a5aeae and project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:02.310151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:01:02.312622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4405b01c-1ac0-4db3-8eef-4125f5f09a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:01:02.361783 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5f81090d-8f85-48cc-bc77-04216d62004b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554175 Jul 19 21:01:02.362308 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3513/7131] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:01:02.373624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f74acbd-a157-4eac-a009-3d796d03df6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:02.374311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f74acbd-a157-4eac-a009-3d796d03df6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:02.432266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f74acbd-a157-4eac-a009-3d796d03df6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:02.440415 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f74acbd-a157-4eac-a009-3d796d03df6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1257 microversion: 2.1 time: 0.070205 Jul 19 21:01:02.441006 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3619/7132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:02 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:03.461701 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:03.462298 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:03.469901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.470364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.471718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.472191 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.548434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:03.556578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7997cf53-5793-43f0-87a2-9e05c2854431 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1327 microversion: 2.1 time: 0.101557 Jul 19 21:01:03.557172 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3514/7133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:03 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:04.574866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:04.577496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:04.590686 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.591205 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.592671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.593426 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.771990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:04.781108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-89b8c35a-fdc9-46bb-bfe0-34b927e231a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.210911 Jul 19 21:01:04.781909 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3620/7134] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:04 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:05.800671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:05.801251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:05.809639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.810229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:05.811135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.811683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:05.976829 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:05.985316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b2edd00-b358-4d9f-b30d-6b61a9093f03 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.189285 Jul 19 21:01:05.987214 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3515/7135] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:05 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:07.007689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:07.008678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:07.020059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:07.020584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:07.021303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:07.021736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:07.187953 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:07.196570 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ea768734-ea1f-420f-9029-a797e8b4dc87 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.192832 Jul 19 21:01:07.197351 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3621/7136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:07 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:08.236087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:08.236704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:08.249974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:08.251233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:08.253678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:08.254855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:08.442109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:08.450377 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6ca46a29-1181-4c60-8ab2-99b1abb6f5fb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.238583 Jul 19 21:01:08.451298 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3516/7137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:08 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:09.469968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:09.471200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:09.484151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:09.484792 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:09.485699 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:09.486160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:09.672771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:09.681588 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6248139d-e621-451b-a5de-7a255e549b2f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.217582 Jul 19 21:01:09.686197 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3622/7138] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:09 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:10.706981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:10.708426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:10.715985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:10.716781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:10.717592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:10.718406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:10.868112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:10.881324 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5ee6e84c-c555-4d28-b09d-5f3dea56c520 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.179021 Jul 19 21:01:10.881931 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3517/7139] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:10 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:11.901477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:11.902088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:11.909859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:11.910301 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:11.911075 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:11.911507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:12.054230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:12.062203 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-35936b8c-2af5-4d25-9bf7-b51a71812877 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.164501 Jul 19 21:01:12.063084 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3623/7140] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:11 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:13.079352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:13.080398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:13.082942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:13.083653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:13.090632 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:13.091078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:13.091906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:13.092357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:13.232955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:13.242129 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b624d863-3801-42c3-b36e-c591dce8bfc9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.166658 Jul 19 21:01:13.242722 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3518/7141] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:13 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:14.259459 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4e1cb9d7-9334-4b59-aaa6-9477897859c2 req-5b6b2de2-e836-450e-9f0e-3a1a43d4bc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:14.260177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:14.263710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:14.269343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:14.275257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4e1cb9d7-9334-4b59-aaa6-9477897859c2 req-5b6b2de2-e836-450e-9f0e-3a1a43d4bc61 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:14.276122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4e1cb9d7-9334-4b59-aaa6-9477897859c2 req-5b6b2de2-e836-450e-9f0e-3a1a43d4bc61 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:14.285417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:14.286866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:14.288477 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:14.289760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:14.294624 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4e1cb9d7-9334-4b59-aaa6-9477897859c2 req-5b6b2de2-e836-450e-9f0e-3a1a43d4bc61 service nova] Creating event network-changed:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:01:14.309888 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4e1cb9d7-9334-4b59-aaa6-9477897859c2 req-5b6b2de2-e836-450e-9f0e-3a1a43d4bc61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055498 Jul 19 21:01:14.310847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3624/7142] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:14.546496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:14.554802 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4255d2b2-2b97-4f0e-b99d-55e9b9c96a75 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.299437 Jul 19 21:01:14.555553 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3519/7143] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:14 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:15.574590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:15.575317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:15.582558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:15.583258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:15.584406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:15.585182 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:15.726067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:15.733399 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-63134c1c-e25f-4d9c-b77d-c2b5f597a763 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.163996 Jul 19 21:01:15.733972 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3625/7144] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:15 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:16.750626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:16.751239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:16.759132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:16.759591 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:16.760399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:16.760852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:16.898677 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:16.906636 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05aec956-c4af-4a9a-b1c5-ea33eef5fa83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.159828 Jul 19 21:01:16.907252 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3520/7145] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:16 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:17.924134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:17.924758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:17.931847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:17.932305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:17.933073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:17.933513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:18.073738 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:18.082230 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fc8f56f5-9dbe-4aa5-ba6f-84f23586d2a6 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.162158 Jul 19 21:01:18.082838 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3626/7146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:17 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:19.100996 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:19.102273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:19.109556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.110058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.110847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.111341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.251614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:19.259685 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4403f686-1c61-47d2-a6f4-0822d6a9c5e7 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.162950 Jul 19 21:01:19.260309 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3521/7147] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:19 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:19.775477 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a9478bac-8193-444f-ad63-1dfb1f9deb3e req-711c7b45-9267-4cd7-8136-3eed8550d8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "name": "network-vif-plugged", "status": "completed", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:19.785260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a9478bac-8193-444f-ad63-1dfb1f9deb3e req-711c7b45-9267-4cd7-8136-3eed8550d8f9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.785736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a9478bac-8193-444f-ad63-1dfb1f9deb3e req-711c7b45-9267-4cd7-8136-3eed8550d8f9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.798167 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a9478bac-8193-444f-ad63-1dfb1f9deb3e req-711c7b45-9267-4cd7-8136-3eed8550d8f9 service nova] Creating event network-vif-plugged:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:01:19.803667 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a9478bac-8193-444f-ad63-1dfb1f9deb3e req-711c7b45-9267-4cd7-8136-3eed8550d8f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Jul 19 21:01:19.804668 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3627/7148] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:20.277494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:20.278122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:20.285967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:20.286430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:20.287204 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:20.287651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:20.430112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:20.437808 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-944b8fe9-76a5-462b-8baa-dc1db836150e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1357 microversion: 2.1 time: 0.164263 Jul 19 21:01:20.438416 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3522/7149] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:20 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:21.457984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:21.459169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:21.466908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.467304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.468124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.468563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.611469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:21.619078 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d1fb44ba-99bc-49c3-a494-0be4587d0fef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1547 microversion: 2.1 time: 0.167886 Jul 19 21:01:21.619686 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3628/7150] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:21 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:21.639923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:21.639923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:21.644638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.645107 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.645901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.646354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.789446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:21.797171 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a3e698f9-129e-43bd-b211-86f359714726 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1547 microversion: 2.1 time: 0.165140 Jul 19 21:01:21.797755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3523/7151] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:21 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:21.814351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:21.817708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:21.818464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Searching by: {'deleted': False, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257'} {{(pid=126008) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 21:01:21.823969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.824411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.825193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.825619 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.850926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.multi_cell_list [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126008) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 21:01:21.879433 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-184859f6-1676-44f8-a322-9ef3ab54b6a1 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069650 Jul 19 21:01:21.880057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3629/7152] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 21:01:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:21.890792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:21.891423 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:21.897791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.898258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.899042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:21.899492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:22.034450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:22.042338 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-030b8b80-c59e-48de-b343-a107ec03d948 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1547 microversion: 2.1 time: 0.155482 Jul 19 21:01:22.042934 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3524/7153] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:21 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:23.609736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92a624f3-e0b1-41b7-a6d3-ec7b77151f67"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:23.610807 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:23.618698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:23.619424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:23.620710 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:23.621600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:23.916715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-839cbf00-72bb-4ca8-868b-09dea05bb68f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310928 Jul 19 21:01:23.917362 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3630/7154] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 21:01:23 2022] POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:38.012303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:38.012926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:38.015040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:38.015712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=68 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:38.022137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.022599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.023393 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.023855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.171998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:38.181008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8e318453-0b1a-42f2-9124-038326a527b2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1593 microversion: 2.1 time: 0.173074 Jul 19 21:01:38.181609 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3525/7155] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:38 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:40.042651 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:40.043455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:40.044974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:40.197934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-98062ed8-1d0b-4ce1-9f07-142e99a9bf28 req-e682171a-5bf9-46cc-ad2b-3133cc302650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:40.208542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-98062ed8-1d0b-4ce1-9f07-142e99a9bf28 req-e682171a-5bf9-46cc-ad2b-3133cc302650 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.208993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-98062ed8-1d0b-4ce1-9f07-142e99a9bf28 req-e682171a-5bf9-46cc-ad2b-3133cc302650 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.222245 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-98062ed8-1d0b-4ce1-9f07-142e99a9bf28 req-e682171a-5bf9-46cc-ad2b-3133cc302650 service nova] Creating event network-changed:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:01:40.228744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-98062ed8-1d0b-4ce1-9f07-142e99a9bf28 req-e682171a-5bf9-46cc-ad2b-3133cc302650 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187148 Jul 19 21:01:40.229823 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3631/7156] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:41.178086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2008553743"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:41.178649 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:41.189812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.190592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.191705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.192659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.328807 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.security_group_api [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Adding security group 9625fef0-2946-49e7-8cfc-ff1f9011f615 to port 24468093-503d-4ce9-9ca1-4ead478dc804 Jul 19 21:01:41.956583 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3acd0479-3439-4e65-b2a4-ec287437e23a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action" status: 202 len: 0 microversion: 2.1 time: 0.783208 Jul 19 21:01:41.961377 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3526/7157] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:01:41 2022] POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:01:41.965312 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-bef5553b-f6cd-4b2c-9ed9-f564db5e9df5 req-a9ef281a-e17d-4b79-ab0a-7266d2013ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:41.968606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:41.969247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:41.976110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.976974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.980864 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bef5553b-f6cd-4b2c-9ed9-f564db5e9df5 req-a9ef281a-e17d-4b79-ab0a-7266d2013ad9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.981316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-bef5553b-f6cd-4b2c-9ed9-f564db5e9df5 req-a9ef281a-e17d-4b79-ab0a-7266d2013ad9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.983565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.984188 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:42.005666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-bef5553b-f6cd-4b2c-9ed9-f564db5e9df5 req-a9ef281a-e17d-4b79-ab0a-7266d2013ad9 service nova] Creating event network-changed:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:01:42.012239 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-bef5553b-f6cd-4b2c-9ed9-f564db5e9df5 req-a9ef281a-e17d-4b79-ab0a-7266d2013ad9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050729 Jul 19 21:01:42.013749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3632/7158] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:01:42.260807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:42.270316 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a7e49f4-d753-4017-9aa0-b5b25cb59b15 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1758 microversion: 2.1 time: 0.305553 Jul 19 21:01:42.271045 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3527/7159] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:41 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1758 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:47.615443 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:03:47.616223 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:03:47.668366 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:03:47.669072 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:04:03.329323 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:04:03.330163 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:04:03.330703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:03.331469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:03.336758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:03.337820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:03.346514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:03.346966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:03.347758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:03.348218 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:03.430068 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:04:04.341040 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34758. Jul 19 21:04:04.344527 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34760. Jul 19 21:04:04.437527 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34762. Jul 19 21:04:04.441088 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3c97f9c9-42c3-4048-a70a-6900cc2c6bbe tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action" status: 202 len: 0 microversion: 2.1 time: 1.113745 Jul 19 21:04:04.441809 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3633/7160] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:04:03 2022] POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:04:04.448665 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:04:04.449486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:04.450265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:04.454817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:04.455447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:04.467083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.467854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.469151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.469889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.855897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:04.864474 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a37c2488-2b25-4baf-a33d-4def5630b6ae tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1760 microversion: 2.1 time: 0.417956 Jul 19 21:04:04.865067 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3528/7161] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:04 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1760 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:05.883378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:05.884117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:05.892183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.892617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:05.893402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.893839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:06.054007 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:06.062407 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-eaf60308-65c7-4279-b3a5-0b8d106aa2c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1758 microversion: 2.1 time: 0.184676 Jul 19 21:04:06.062991 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3634/7162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:05 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:30.788101 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:04:30.788838 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:04:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:05:45.246435 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:05:45.247357 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:05:50.126902 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:05:50.128798 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:50.129618 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:50.135489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2008553743"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:50.136326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:50.149536 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.150014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.151189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.151647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.153704 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34804. Jul 19 21:05:50.376233 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.network.security_group_api [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Removing security group 9625fef0-2946-49e7-8cfc-ff1f9011f615 from port 24468093-503d-4ce9-9ca1-4ead478dc804 Jul 19 21:05:50.821857 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f25fc9ca-9769-4a08-a855-29abf64a53f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action" status: 202 len: 0 microversion: 2.1 time: 0.696799 Jul 19 21:05:50.822756 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3529/7163] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:05:50 2022] POST /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:05:50.830291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:50.831389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:51.021723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-b778b525-a7e1-4e66-aeed-40f30e58ef68 req-4ed3989c-7307-4798-b7a6-a2d4a678ed3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:51.035716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b778b525-a7e1-4e66-aeed-40f30e58ef68 req-4ed3989c-7307-4798-b7a6-a2d4a678ed3d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:51.036537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-b778b525-a7e1-4e66-aeed-40f30e58ef68 req-4ed3989c-7307-4798-b7a6-a2d4a678ed3d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:51.056686 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-b778b525-a7e1-4e66-aeed-40f30e58ef68 req-4ed3989c-7307-4798-b7a6-a2d4a678ed3d service nova] Creating event network-changed:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:05:51.064644 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-b778b525-a7e1-4e66-aeed-40f30e58ef68 req-4ed3989c-7307-4798-b7a6-a2d4a678ed3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237752 Jul 19 21:05:51.065846 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3635/7164] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:53.093249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-c2d88727-9b61-4a91-87c0-173d35ecd633 req-1025b0ab-4f77-40e7-9869-1bbbef1da1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:53.117506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2d88727-9b61-4a91-87c0-173d35ecd633 req-1025b0ab-4f77-40e7-9869-1bbbef1da1dc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:53.118315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-c2d88727-9b61-4a91-87c0-173d35ecd633 req-1025b0ab-4f77-40e7-9869-1bbbef1da1dc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:53.142325 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34826. Jul 19 21:05:53.146757 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-c2d88727-9b61-4a91-87c0-173d35ecd633 req-1025b0ab-4f77-40e7-9869-1bbbef1da1dc service nova] Creating event network-changed:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:05:53.160190 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-c2d88727-9b61-4a91-87c0-173d35ecd633 req-1025b0ab-4f77-40e7-9869-1bbbef1da1dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077272 Jul 19 21:05:53.161653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3530/7165] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:53.244605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:53.245234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:53.252617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:53.253074 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:53.253884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:53.254377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:53.498296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lazy-loading 'services' on Instance uuid ccc945d8-97cc-4798-ba15-5703029e039e {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:05:53.619634 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e9571701-e65c-421b-9c22-e00317f75fe3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments/92a624f3-e0b1-41b7-a6d3-ec7b77151f67" status: 202 len: 0 microversion: 2.1 time: 0.380997 Jul 19 21:05:53.621108 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3636/7166] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:05:53 2022] DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments/92a624f3-e0b1-41b7-a6d3-ec7b77151f67 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:05:53.644449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:53.653858 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:53.678350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:53.679259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:53.680759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:53.681566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:53.778192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a4436acb-7364-48d1-a2a3-79f4f92a85ef tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148382 Jul 19 21:05:53.779239 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3531/7167] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:53 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:54.800804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:54.804095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:54.816715 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:54.817531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:54.818968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:54.819744 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:54.887060 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6aab6135-ea94-44cd-abab-f204ff12a4ec tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095926 Jul 19 21:05:54.888644 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3637/7168] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:54 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:55.905767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:55.906942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:55.914127 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:55.914596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:55.915543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:55.915948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:55.952915 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ad4a06e-459c-4ae3-8a08-889b381501bf tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053138 Jul 19 21:05:55.953539 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3532/7169] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:55 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:56.968956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:56.971102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:56.989614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.991385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:56.992820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.993611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:57.058619 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f17900c9-f798-4334-83c0-712a574e3c83 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096085 Jul 19 21:05:57.059582 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3638/7170] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:56 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:58.076072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:58.077187 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:58.088142 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:58.088759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:58.089777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:58.090574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:58.151971 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f2b79357-65cc-4f29-b5d3-c04234a722e8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080779 Jul 19 21:05:58.152884 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3533/7171] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:58 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:59.166560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.168021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.177247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.178012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.178844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.179293 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.221104 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6fa4927c-cdd6-4ea3-b8b9-c4e2a417b17a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058294 Jul 19 21:05:59.222179 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3639/7172] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:59 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:05:59.236763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.237636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.245544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.246025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.247108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.247565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.337138 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] HTTP exception thrown: Instance ccc945d8-97cc-4798-ba15-5703029e039e is not attached to volume 92a624f3-e0b1-41b7-a6d3-ec7b77151f67 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Request method failure captured: Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments/92a624f3-e0b1-41b7-a6d3-ec7b77151f67 HTTP/1.1 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xt-tIM8wrIKIJ-tLWKMdRJomUsbRUDbY6sG1IvNfMR_AKUDMS0OCm16xF_SN8Q8ot-YmHAK18D9-J9sPjwYjJNJoM9wVSb8moMwgOD1COwkIpHmi_3F4iHbKbzbXaGB8Ni54_Dalo5mMLa5dHUsB4JAj25DDUlQ8MTNcU3R7GJFQR0 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: f593685780b64a13a7ba039633a5aeae Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ccc945d8-97cc-4798-ba15-5703029e039e is not attached to volume 92a624f3-e0b1-41b7-a6d3-ec7b77151f67 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': 'ccc945d8-97cc-4798-ba15-5703029e039e', 'id': '92a624f3-e0b1-41b7-a6d3-ec7b77151f67'} Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 92a624f3-e0b1-41b7-a6d3-ec7b77151f67. Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc945d8-97cc-4798-ba15-5703029e039e is not attached to volume 92a624f3-e0b1-41b7-a6d3-ec7b77151f67 Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:05:59.338978 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc945d8-97cc-4798-ba15-5703029e039e is not attached to volume 92a624f3-e0b1-41b7-a6d3-ec7b77151f67 Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Returning 404 to user: Instance ccc945d8-97cc-4798-ba15-5703029e039e is not attached to volume 92a624f3-e0b1-41b7-a6d3-ec7b77151f67 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e840c358-a913-47fe-adc1-7d798008ae79 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments/92a624f3-e0b1-41b7-a6d3-ec7b77151f67" status: 404 len: 154 microversion: 2.1 time: 0.109202 Jul 19 21:05:59.344327 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3534/7173] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:05:59 2022] DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e/os-volume_attachments/92a624f3-e0b1-41b7-a6d3-ec7b77151f67 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:03.726067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:03.726901 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:03.739020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.739817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.741136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.741913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:04.063584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:06:04.174148 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ec6a27c8-c231-4cc9-919e-a5cbd9b8e9c8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 204 len: 0 microversion: 2.1 time: 0.455172 Jul 19 21:06:04.175072 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3640/7174] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:06:03 2022] DELETE /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:06:04.186160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:04.187243 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:04.197788 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:04.198268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:04.199116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:04.199580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:04.362231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:04.370391 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6267ce43-5c87-4637-81dc-920e64d96920 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1553 microversion: 2.1 time: 0.189435 Jul 19 21:06:04.371268 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3535/7175] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:04 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:05.389867 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:05.391445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:05.399334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.400033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.400965 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.401522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.569787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:05.578115 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d4421fe-0a61-4de3-bfad-8a3d23454fdc tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1553 microversion: 2.1 time: 0.192949 Jul 19 21:06:05.579217 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3641/7176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:05 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:06.597689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:06.597689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:06.604844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.605310 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.606120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.606572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.736817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:06.747723 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-830e0463-94e6-440d-81ba-b61f95f4124e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 200 len: 1511 microversion: 2.1 time: 0.154847 Jul 19 21:06:06.748602 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3536/7177] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:06 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:06.756027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a6115281-f4da-4022-a7fb-96ab0fecf271 req-47fa6b8c-2c31-439c-90b1-9c18192416ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc945d8-97cc-4798-ba15-5703029e039e", "name": "network-vif-deleted", "tag": "24468093-503d-4ce9-9ca1-4ead478dc804"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:06.770122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a6115281-f4da-4022-a7fb-96ab0fecf271 req-47fa6b8c-2c31-439c-90b1-9c18192416ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.770725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a6115281-f4da-4022-a7fb-96ab0fecf271 req-47fa6b8c-2c31-439c-90b1-9c18192416ad service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.787048 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a6115281-f4da-4022-a7fb-96ab0fecf271 req-47fa6b8c-2c31-439c-90b1-9c18192416ad service nova] Creating event network-vif-deleted:24468093-503d-4ce9-9ca1-4ead478dc804 for instance ccc945d8-97cc-4798-ba15-5703029e039e on n-h2-843861-3 Jul 19 21:06:06.793341 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a6115281-f4da-4022-a7fb-96ab0fecf271 req-47fa6b8c-2c31-439c-90b1-9c18192416ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042693 Jul 19 21:06:06.794248 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3642/7178] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:07.768541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.769474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: ccc945d8-97cc-4798-ba15-5703029e039e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:07.777853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.778389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.780910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.780910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.810027 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] HTTP exception thrown: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Request method failure captured: Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e HTTP/1.1 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xt-tIM8wrIKIJ-tLWKMdRJomUsbRUDbY6sG1IvNfMR_AKUDMS0OCm16xF_SN8Q8ot-YmHAK18D9-J9sPjwYjJNJoM9wVSb8moMwgOD1COwkIpHmi_3F4iHbKbzbXaGB8Ni54_Dalo5mMLa5dHUsB4JAj25DDUlQ8MTNcU3R7GJFQR0 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: f593685780b64a13a7ba039633a5aeae Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'ccc945d8-97cc-4798-ba15-5703029e039e'} Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.813752 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Returning 404 to user: Instance ccc945d8-97cc-4798-ba15-5703029e039e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5dae0783-b155-4524-95ef-b161c830b6e9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e" status: 404 len: 111 microversion: 2.1 time: 0.052558 Jul 19 21:06:07.820198 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3537/7179] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:07 2022] GET /compute/v2.1/servers/ccc945d8-97cc-4798-ba15-5703029e039e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:07.837167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-831a4afe-fb39-45c5-b26e-46526d074a7e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '.version_select at 0x7fb88cecd9d0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.843294 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-831a4afe-fb39-45c5-b26e-46526d074a7e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:06:08.852532 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-831a4afe-fb39-45c5-b26e-46526d074a7e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34884. Jul 19 21:06:08.876778 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-831a4afe-fb39-45c5-b26e-46526d074a7e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-713144141" status: 202 len: 0 microversion: 2.1 time: 1.051622 Jul 19 21:06:08.877366 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3643/7180] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 21:06:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-713144141 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:06:20.577890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=18 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:20.578875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=44 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:20.584140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5cb8819e-4e3a-4e93-b79b-58578a9df301 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: .version_select at 0x7fb88dc0b0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-956120919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJ9GdhiVoVBAQF+AkfuyCttmecieyT+IhvAEPWmhAN21XIizMn5LlGaw2S/2UrbLIh6IEgsYn0dq5HqRAkL7hGY0f2pL1w26KH7vRbBrxSsxiZeiRDMaiSuIPyz83GzEw=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:20.603794 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5cb8819e-4e3a-4e93-b79b-58578a9df301 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:06:20.612128 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5cb8819e-4e3a-4e93-b79b-58578a9df301 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for user f593685780b64a13a7ba039633a5aeae and project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:06:20.647830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5cb8819e-4e3a-4e93-b79b-58578a9df301 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.071557 Jul 19 21:06:20.648760 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3538/7181] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:06:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:20.700603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:20.701704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:20.708555 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-770384888", "imageRef": "2f8fee4d-dc41-45f1-ba7a-45d0c1110e39", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-956120919", "networks": [{"uuid": "33aeea13-681c-4f42-a55d-6b622223f5f5"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:20.780252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] validate_networks() for [('33aeea13-681c-4f42-a55d-6b622223f5f5', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:06:21.388100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:06:21.388550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:06:21.389019 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:06:21.389868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:06:21.389868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:06:21.408770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:21.409280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:21.410640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:21.411409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:21.436726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:06:21.443971 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Getting quotas for user f593685780b64a13a7ba039633a5aeae and project 0802b55fc01141f2b9e2a9a04cf34257. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:06:21.466363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:06:21.469912 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2f8fee4d-dc41-45f1-ba7a-45d0c1110e39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:06:21.527595 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-112b6eed-6d15-441e-bc8d-6636460e7855 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828832 Jul 19 21:06:21.528303 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3644/7182] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:06:21.546942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-969a907d-416a-4060-9d69-2eccddd5e031 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:21.549419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-969a907d-416a-4060-9d69-2eccddd5e031 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:21.626992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-969a907d-416a-4060-9d69-2eccddd5e031 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:21.634743 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-969a907d-416a-4060-9d69-2eccddd5e031 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1257 microversion: 2.1 time: 0.095808 Jul 19 21:06:21.635698 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3539/7183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:21 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1257 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:22.663046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:22.665148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:22.676038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:22.676553 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:22.677391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:22.677865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:22.780510 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:22.792763 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8c86d089-07b0-453e-99b3-b427fe63ad9e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1309 microversion: 2.1 time: 0.138730 Jul 19 21:06:22.793440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3645/7184] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:22 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:23.818486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:23.820766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:23.858687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:23.860083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:23.861973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:23.864146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:24.113822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:24.129769 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-850d57c0-93f9-4f31-b872-48076b6206b8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1315 microversion: 2.1 time: 0.319763 Jul 19 21:06:24.130704 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3540/7185] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:23 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:25.151799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:25.153784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:25.172515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:25.173163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:25.174213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:25.179121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:25.407835 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:25.426222 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c1bb973e-a2fb-4cc8-8242-ed3c44a6b0d8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.279170 Jul 19 21:06:25.427210 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3646/7186] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:25 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:26.458625 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:26.459425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:26.469249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:26.470125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:26.471674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:26.472611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:26.722928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:26.736216 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-940be425-5b64-486d-881a-411de536227f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.284448 Jul 19 21:06:26.737068 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3541/7187] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:26 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:27.760066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:27.761460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:27.778966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:27.779784 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:27.781449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:27.782280 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:28.014914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:28.030931 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c633e065-7e1c-41fa-8048-b107efacd4dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.278736 Jul 19 21:06:28.031962 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3647/7188] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:27 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:29.060324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:29.061532 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:29.075093 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:29.075988 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:29.077997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:29.078852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:29.309605 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:29.319953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be6891d1-9875-4b0b-8ccd-cb3a1f94a3ba tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.267196 Jul 19 21:06:29.320482 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3542/7189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:29 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:30.349099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:30.349952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:30.358754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:30.359211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:30.360056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:30.360492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:30.590144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:30.614942 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-198af86a-3660-47b1-b03e-b0f0e88f9426 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.272133 Jul 19 21:06:30.616078 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3648/7190] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:30 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:31.643897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:31.652862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:31.654089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:31.668555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:31.669378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:31.671339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:31.672303 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:31.954341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:31.965980 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2702e6dc-10d0-44d8-b18b-768391f1d5f2 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.325764 Jul 19 21:06:31.971898 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3543/7191] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:31 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:32.997115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:32.998108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:33.000991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:33.001983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:33.010256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:33.010855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:33.011769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:33.012349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:33.174767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:33.182935 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2f85b8a-39e7-405c-94be-f120bb81da96 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.190349 Jul 19 21:06:33.183539 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3649/7192] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:32 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:34.210702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:34.212337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:34.229057 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:34.230410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:34.234026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:34.234487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:34.698163 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:34.709073 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d7b4c13-39d5-48b3-b2c5-b0b2f214c565 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.509530 Jul 19 21:06:34.709745 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3544/7193] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:34 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:34.761090 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-960dae49-9fc5-4bf8-b817-de5b56fede83 req-8d65f21e-990f-4654-8185-7111df426741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:34.793851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-960dae49-9fc5-4bf8-b817-de5b56fede83 req-8d65f21e-990f-4654-8185-7111df426741 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:34.795917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-960dae49-9fc5-4bf8-b817-de5b56fede83 req-8d65f21e-990f-4654-8185-7111df426741 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:34.821813 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-960dae49-9fc5-4bf8-b817-de5b56fede83 req-8d65f21e-990f-4654-8185-7111df426741 service nova] Creating event network-changed:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:06:34.833753 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-960dae49-9fc5-4bf8-b817-de5b56fede83 req-8d65f21e-990f-4654-8185-7111df426741 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082255 Jul 19 21:06:34.835424 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3650/7194] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:35.737757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:35.738762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:35.748210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:35.748846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:35.749718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:35.750275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:35.945308 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:35.955272 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3d3ce8a2-6ba8-4527-872c-0762f5800f8e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.222826 Jul 19 21:06:35.955997 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3545/7195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:35 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:36.976259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:36.978272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:36.987892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:36.988355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:36.989761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:36.990415 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:37.410939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:37.426455 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-042d8f58-05e6-463d-9894-746a0f06c3f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.455076 Jul 19 21:06:37.427086 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3651/7196] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:36 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:38.446689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:38.447580 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:38.456190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:38.456659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:38.457528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:38.457992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:38.675263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:38.689657 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ffab9f3c-9820-4d31-b866-96e77218d1ea tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.246679 Jul 19 21:06:38.690726 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3546/7197] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:38 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:39.716419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:39.717424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:39.730661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:39.731174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:39.732458 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:39.733207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:39.920349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:39.934573 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fe7717b4-b3c0-4d98-a86b-7ef3eb9f7d31 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.225923 Jul 19 21:06:39.936198 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3652/7198] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:39 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:40.498709 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-43dd220d-a8b7-4518-92fd-81f7100ea277 req-bd095323-9b42-46cd-805a-8b75c8647248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "name": "network-vif-plugged", "status": "completed", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:40.509457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-43dd220d-a8b7-4518-92fd-81f7100ea277 req-bd095323-9b42-46cd-805a-8b75c8647248 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.509917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-43dd220d-a8b7-4518-92fd-81f7100ea277 req-bd095323-9b42-46cd-805a-8b75c8647248 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.524133 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-43dd220d-a8b7-4518-92fd-81f7100ea277 req-bd095323-9b42-46cd-805a-8b75c8647248 service nova] Creating event network-vif-plugged:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:06:40.531264 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-43dd220d-a8b7-4518-92fd-81f7100ea277 req-bd095323-9b42-46cd-805a-8b75c8647248 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162785 Jul 19 21:06:40.531953 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3547/7199] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:40.961820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:40.962451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:40.970386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.970833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.971620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.972169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:41.144406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:41.153349 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a971206-3650-4f05-b66a-ffa87555a35b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1357 microversion: 2.1 time: 0.195385 Jul 19 21:06:41.154666 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3653/7200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:40 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:42.178321 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:42.179681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:42.192327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.193168 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.194657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.195542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.416731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:42.428096 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2942c985-fb01-4358-a8a7-9e43981ce85d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1546 microversion: 2.1 time: 0.260062 Jul 19 21:06:42.429815 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3548/7201] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:42 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:42.449288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:42.449962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:42.457937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.458391 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.459186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.459788 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.620539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:42.629506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7c1d2927-0205-4a69-8eea-5be227e77a0d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1546 microversion: 2.1 time: 0.184793 Jul 19 21:06:42.630092 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3654/7202] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:42 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:42.656280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:42.660835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:42.661723 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Searching by: {'deleted': False, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257'} {{(pid=126007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 21:06:42.669041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.669621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.670681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.671179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.702447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.multi_cell_list [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 21:06:42.748253 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-038d1a8d-7431-445e-9ede-c89bb4662e3e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.097280 Jul 19 21:06:42.749285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3549/7203] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 19 21:06:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:42.761546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:42.762199 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:42.769952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.770398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.771174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.771615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.968381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:42.978850 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01ad3175-1a86-4b3f-8ad1-f9416aa6e2af tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1546 microversion: 2.1 time: 0.221125 Jul 19 21:06:42.979591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3655/7204] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:42 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:45.755134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6325ac38-fd05-4522-a07b-3cbffc5427c3"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:45.756772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:45.765326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:45.765914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:45.766790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:45.767387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:46.120931 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-faf75b21-85d6-4642-b9e0-7fda241dfb37 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370607 Jul 19 21:06:46.121642 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3550/7205] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 19 21:06:45 2022] POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:58.146703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:58.147339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:58.150728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:58.151423 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=64 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:58.158605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:58.159339 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:58.160334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:58.160825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:58.319091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:58.331153 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-76d02b3f-c7dd-4755-9e93-00e195152ae3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1592 microversion: 2.1 time: 0.188210 Jul 19 21:06:58.331781 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3656/7206] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:58 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1592 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:00.905910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:00.907458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:00.909038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:01.010550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d61d5d58-730e-4b0e-8ce0-185bbdd869fb req-b91ee377-7b32-478b-8489-af8f528b3400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:01.028295 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d61d5d58-730e-4b0e-8ce0-185bbdd869fb req-b91ee377-7b32-478b-8489-af8f528b3400 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:01.029085 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d61d5d58-730e-4b0e-8ce0-185bbdd869fb req-b91ee377-7b32-478b-8489-af8f528b3400 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:01.052656 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d61d5d58-730e-4b0e-8ce0-185bbdd869fb req-b91ee377-7b32-478b-8489-af8f528b3400 service nova] Creating event network-changed:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:07:01.062217 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d61d5d58-730e-4b0e-8ce0-185bbdd869fb req-b91ee377-7b32-478b-8489-af8f528b3400 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159943 Jul 19 21:07:01.063496 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3551/7207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:02.565208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1606487233"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:02.568782 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:02.579176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:02.580005 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:02.581664 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:02.582431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:02.770260 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Adding security group cda20daa-cbc1-485e-b959-8c1e4160d63a to port f9ed8036-1b94-47d5-9bcc-567c7c5facd0 Jul 19 21:07:03.208834 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-51265dd0-fd23-4daa-a1c7-0dc3dbc3c6a3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.650831 Jul 19 21:07:03.209896 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3657/7208] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:07:02 2022] POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:07:03.233152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-0e8d7dab-25f3-452f-80ae-f4fee8b80f7c req-781c6b93-2528-4b21-ba2b-052d4334b4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:03.237866 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:03.240655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:03.258290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0e8d7dab-25f3-452f-80ae-f4fee8b80f7c req-781c6b93-2528-4b21-ba2b-052d4334b4f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:03.259036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-0e8d7dab-25f3-452f-80ae-f4fee8b80f7c req-781c6b93-2528-4b21-ba2b-052d4334b4f8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:03.259687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:03.260563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:03.262106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:03.262914 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:03.297476 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-0e8d7dab-25f3-452f-80ae-f4fee8b80f7c req-781c6b93-2528-4b21-ba2b-052d4334b4f8 service nova] Creating event network-changed:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:07:03.306715 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-0e8d7dab-25f3-452f-80ae-f4fee8b80f7c req-781c6b93-2528-4b21-ba2b-052d4334b4f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080514 Jul 19 21:07:03.309132 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3658/7209] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:03.638320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:03.660543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3ea27dac-e295-496f-9ce0-c45b44d337d3 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1757 microversion: 2.1 time: 0.441778 Jul 19 21:07:03.676009 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3552/7210] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:03 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1757 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:07.677902 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:07:07.678623 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:07:32.935393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:32.936306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=12 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:32.941479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:32.942577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:32.951083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:32.951530 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:32.952360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:32.952794 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:33.048345 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-165d8ab8-fc8e-4114-ae27-e0682397642a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.114799 Jul 19 21:07:33.049356 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3659/7211] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:07:32 2022] POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:07:33.058577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:33.059472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:33.073351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:33.074099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:33.083689 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:33.084197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:33.085002 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:33.085473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:33.390854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:33.402222 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c995cd2a-0a08-4703-9b65-027c3c08d6dd tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1749 microversion: 2.1 time: 0.344764 Jul 19 21:07:33.407061 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3553/7212] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:33 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1749 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:34.434868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:34.435656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:34.443920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.444439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.445327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.445811 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.620083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:34.630718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5c769b10-05c5-4220-94b8-2b6800f2617f tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.204377 Jul 19 21:07:34.631335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3660/7213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:34 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:35.651044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:35.651726 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:35.659422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.659917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.660721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.661169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.850058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:35.858833 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c547480d-d003-4fff-b227-da1fe8313b30 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.212752 Jul 19 21:07:35.859446 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3554/7214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:35 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:36.886062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:36.886726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:36.894777 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.895226 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:36.896064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.896497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:37.082888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:37.092585 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5e1eb802-162d-4b8a-ae53-bce43b06aec8 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.210466 Jul 19 21:07:37.093214 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3661/7215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:36 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:38.114422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:38.114879 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:38.124833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.125421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.126239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.126693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.306092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:38.315496 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fc13ecd6-3976-4693-b16d-295506dac50e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.206651 Jul 19 21:07:38.316197 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3555/7216] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:38 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:39.333496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:39.334254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:39.341946 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.342392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:39.343189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.343627 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:39.551499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:39.561157 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9851684a-ae8f-44d2-9814-12a49e37bbed tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.232082 Jul 19 21:07:39.561769 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3662/7217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:39 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:40.579586 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:40.580507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:40.590031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:40.590510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:40.591357 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:40.591918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:40.921414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:40.933303 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-011f108f-88bb-4561-ac59-23cc20314a6d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.357720 Jul 19 21:07:40.934370 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3556/7218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:40 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:41.954040 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:41.954878 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:41.965556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.966183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.967295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.967840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:42.135434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:42.144642 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1e212ff7-b186-445d-89b0-90558b1df711 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.194643 Jul 19 21:07:42.145415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3663/7219] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:41 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:43.165332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:43.166096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:43.175147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:43.175781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:43.177020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:43.177590 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:43.372735 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:43.381891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24897494-f015-480e-bd65-f546e72a2b06 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.221621 Jul 19 21:07:43.382492 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3557/7220] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:43 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:44.400111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:44.400900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:44.408540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:44.409046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:44.409883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:44.410359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:44.581395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:44.590980 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a06454e2-6c02-441c-af69-73033829381a tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.195321 Jul 19 21:07:44.591589 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3664/7221] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:44 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:45.609647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:45.610296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:45.620512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:45.621052 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:45.621890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:45.622356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:45.796201 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:45.806294 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-790dda09-7a3f-4804-9f05-fd9cf41eded0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.200793 Jul 19 21:07:45.807656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3558/7222] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:45 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:46.826136 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:46.826796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:46.834998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:46.835446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:46.836849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:46.837285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:47.008803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:47.018096 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9b8fd175-afc6-4a36-a558-22642fa3633d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.195867 Jul 19 21:07:47.018753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3665/7223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:46 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:48.041297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:48.042165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:48.051158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:48.051629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:48.052516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:48.052980 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:48.239340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:48.248599 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-49efa123-3b3c-479e-9d10-f60ce074204d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.214153 Jul 19 21:07:48.249402 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3559/7224] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:48 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:49.267537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:49.268295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:49.275976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:49.276445 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:49.277273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:49.277725 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:49.449948 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:49.458851 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a5b57bad-439e-4095-a0da-672209c18a2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.195565 Jul 19 21:07:49.459530 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3666/7225] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:49 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:50.478173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:50.478776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:50.486862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.487473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.488444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.488946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.662492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:50.671535 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-300dab39-1550-4475-9668-2193ffe3c1cb tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.197616 Jul 19 21:07:50.672525 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3560/7226] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:50 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:51.692130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:51.692826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:51.701268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:51.701720 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:51.702540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:51.702982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:52.190873 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:52.200882 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-49ba7931-367c-4712-88e1-4600ac703eab tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.513323 Jul 19 21:07:52.201511 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3667/7227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:51 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:53.222651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:53.223974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:53.232844 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:53.233398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:53.234506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:53.235134 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:53.419397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:53.432700 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-564d53a1-6956-4961-aa6f-6a75b5ba9d2b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.216775 Jul 19 21:07:53.433754 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3561/7228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:53 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:54.456801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:54.457937 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:54.471950 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:54.472759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:54.474225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:54.475001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:54.689241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:54.698261 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e0af3d37-f864-44a0-b05c-d76fcbfbb211 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1754 microversion: 2.1 time: 0.249073 Jul 19 21:07:54.699826 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3668/7229] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:54 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1754 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:55.717795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:55.718602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:55.727467 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:55.727987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:55.728805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:55.729261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:55.898696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:55.908247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c867c53-be15-4be6-b3e6-6310e86de489 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1757 microversion: 2.1 time: 0.194974 Jul 19 21:07:55.909250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3562/7230] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:55 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:39.276952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1606487233"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:39.277652 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:39.282379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=20 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:39.283471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:39.292219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:39.292998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:39.294366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:39.295150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:39.479653 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.network.security_group_api [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Removing security group cda20daa-cbc1-485e-b959-8c1e4160d63a from port f9ed8036-1b94-47d5-9bcc-567c7c5facd0 Jul 19 21:08:39.905410 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26a17ef7-87dd-490a-8653-1438f648c041 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.633679 Jul 19 21:08:39.908316 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3669/7231] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:08:39 2022] POST /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:08:39.931374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-440995b6-0a46-488a-87fc-4fb32d94fb81 req-1e6eb982-7805-495c-a04c-c8e9e7947a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:39.949967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=20 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:39.953660 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=60 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:39.976084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-440995b6-0a46-488a-87fc-4fb32d94fb81 req-1e6eb982-7805-495c-a04c-c8e9e7947a40 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:39.977992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-440995b6-0a46-488a-87fc-4fb32d94fb81 req-1e6eb982-7805-495c-a04c-c8e9e7947a40 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:40.020503 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-440995b6-0a46-488a-87fc-4fb32d94fb81 req-1e6eb982-7805-495c-a04c-c8e9e7947a40 service nova] Creating event network-changed:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:08:40.036556 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-440995b6-0a46-488a-87fc-4fb32d94fb81 req-1e6eb982-7805-495c-a04c-c8e9e7947a40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117743 Jul 19 21:08:40.037251 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3563/7232] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:41.344831 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4331266a-bed3-4a08-8ad0-84a778df2047 req-d86baee0-b0fc-4053-be4c-a9c5e584c1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:41.353118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:41.354030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:41.354746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4331266a-bed3-4a08-8ad0-84a778df2047 req-d86baee0-b0fc-4053-be4c-a9c5e584c1de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.355206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4331266a-bed3-4a08-8ad0-84a778df2047 req-d86baee0-b0fc-4053-be4c-a9c5e584c1de service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.369235 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4331266a-bed3-4a08-8ad0-84a778df2047 req-d86baee0-b0fc-4053-be4c-a9c5e584c1de service nova] Creating event network-changed:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:08:41.370028 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.371144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.375055 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4331266a-bed3-4a08-8ad0-84a778df2047 req-d86baee0-b0fc-4053-be4c-a9c5e584c1de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035640 Jul 19 21:08:41.375537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.376799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.380013 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3564/7233] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:08:41.512420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lazy-loading 'services' on Instance uuid 3391ad33-3087-48e2-a8a7-2a80464c2f9f {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:08:41.599685 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-787a4aef-7624-4328-8e7c-2acdc3dc0ad9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments/6325ac38-fd05-4522-a07b-3cbffc5427c3" status: 202 len: 0 microversion: 2.1 time: 0.260324 Jul 19 21:08:41.600399 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3670/7234] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:08:41 2022] DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments/6325ac38-fd05-4522-a07b-3cbffc5427c3 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:08:41.621442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:41.625238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:41.642643 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.644012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.647013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.648609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.718716 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6d165edd-3db2-4f54-b9d1-9c08225b7158 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108442 Jul 19 21:08:41.720718 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3565/7235] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:41 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:42.742127 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:42.744832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:42.760735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.762022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.763579 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.764755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.820894 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5a5758ba-6de3-4375-b3bc-7e7c9a2803b0 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088587 Jul 19 21:08:42.822760 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3671/7236] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:42 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:43.836891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:43.838339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:43.847681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:43.848328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:43.849572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:43.850137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:43.901937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ad57add0-f2f0-430b-852b-26341de7c111 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069879 Jul 19 21:08:43.902903 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3566/7237] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:43 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:44.915956 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:44.917256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:44.926578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:44.927299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:44.928309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:44.928890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:44.966741 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5b00f861-14b5-4e5b-a1cb-6cc729da998d tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055057 Jul 19 21:08:44.967618 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3672/7238] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:44 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:08:45.986878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:45.989441 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:46.003179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:46.004653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:46.006209 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:46.007070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:46.081247 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c71b69ae-5a17-4f3f-8c9e-e7249e6f8308 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102211 Jul 19 21:08:46.086062 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3567/7239] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:45 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:47.094385 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:47.095356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:47.103396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:47.103877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:47.104702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:47.105148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:47.141419 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-30c400c7-1a48-4223-bd15-36675556f007 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051452 Jul 19 21:08:47.142524 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3673/7240] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 19 21:08:47 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:08:47.153330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:47.154159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:47.162422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:47.162905 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:47.163725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:47.164218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:47.263272 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] HTTP exception thrown: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f is not attached to volume 6325ac38-fd05-4522-a07b-3cbffc5427c3 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Request method failure captured: Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: request: DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments/6325ac38-fd05-4522-a07b-3cbffc5427c3 HTTP/1.1 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1xt-tIM8wrIKIJ-tLWKMdRJomUsbRUDbY6sG1IvNfMR_AKUDMS0OCm16xF_SN8Q8ot-YmHAK18D9-J9sPjwYjJNJoM9wVSb8moMwgOD1COwkIpHmi_3F4iHbKbzbXaGB8Ni54_Dalo5mMLa5dHUsB4JAj25DDUlQ8MTNcU3R7GJFQR0 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: f593685780b64a13a7ba039633a5aeae Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f is not attached to volume 6325ac38-fd05-4522-a07b-3cbffc5427c3 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'server_id': '3391ad33-3087-48e2-a8a7-2a80464c2f9f', 'id': '6325ac38-fd05-4522-a07b-3cbffc5427c3'} Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6325ac38-fd05-4522-a07b-3cbffc5427c3. Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f is not attached to volume 6325ac38-fd05-4522-a07b-3cbffc5427c3 Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:08:47.266588 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f is not attached to volume 6325ac38-fd05-4522-a07b-3cbffc5427c3 Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Returning 404 to user: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f is not attached to volume 6325ac38-fd05-4522-a07b-3cbffc5427c3 {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5e885604-2011-4f3f-97e8-8d14beded950 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments/6325ac38-fd05-4522-a07b-3cbffc5427c3" status: 404 len: 154 microversion: 2.1 time: 0.119914 Jul 19 21:08:47.275543 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3568/7241] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 19 21:08:47 2022] DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f/os-volume_attachments/6325ac38-fd05-4522-a07b-3cbffc5427c3 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:08:47.626923 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:08:47.627421 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:08:50.603989 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:50.604631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:50.614538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:50.615149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:50.616420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:50.616969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:50.654698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:08:50.783386 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fffebbd-f044-40e4-a68a-bdacb035376b tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 204 len: 0 microversion: 2.1 time: 0.182609 Jul 19 21:08:50.785353 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3674/7242] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:08:50 2022] DELETE /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:08:50.799294 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:50.802023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:50.811577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:50.812096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:50.813138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:50.813678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:51.053708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:51.067063 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-60015691-0f9e-44c2-b78e-61b12a6955f4 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1552 microversion: 2.1 time: 0.274190 Jul 19 21:08:51.067983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3569/7243] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:50 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1552 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:52.089582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:52.090384 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:52.099082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:52.099539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:52.100378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:52.100828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:52.262378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:52.273132 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e3e6536d-b3d1-449f-97ed-2ab03967480e tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1552 microversion: 2.1 time: 0.190073 Jul 19 21:08:52.273974 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3675/7244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:52 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1552 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:53.296621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:53.298834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:53.312431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:53.313292 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:53.314774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:53.315648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:53.463223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-492b2654-e5e3-4494-8707-f7540fe8b897 req-a474cd22-7d3e-41f7-bbe7-6a7089902e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391ad33-3087-48e2-a8a7-2a80464c2f9f", "name": "network-vif-deleted", "tag": "f9ed8036-1b94-47d5-9bcc-567c7c5facd0"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:53.481569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-492b2654-e5e3-4494-8707-f7540fe8b897 req-a474cd22-7d3e-41f7-bbe7-6a7089902e9c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:53.482696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-492b2654-e5e3-4494-8707-f7540fe8b897 req-a474cd22-7d3e-41f7-bbe7-6a7089902e9c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:53.485544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f593685780b64a13a7ba039633a5aeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0802b55fc01141f2b9e2a9a04cf34257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:53.505278 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-492b2654-e5e3-4494-8707-f7540fe8b897 req-a474cd22-7d3e-41f7-bbe7-6a7089902e9c service nova] Creating event network-vif-deleted:f9ed8036-1b94-47d5-9bcc-567c7c5facd0 for instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f on n-h1-843861-3 Jul 19 21:08:53.509940 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cc58f34e-31dc-427a-a262-f0eeb87ed834 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 200 len: 1510 microversion: 2.1 time: 0.220989 Jul 19 21:08:53.514470 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-492b2654-e5e3-4494-8707-f7540fe8b897 req-a474cd22-7d3e-41f7-bbe7-6a7089902e9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059864 Jul 19 21:08:53.515563 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3676/7245] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:53.521832 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3570/7246] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:53 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:54.534482 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:54.535822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] [instance: 3391ad33-3087-48e2-a8a7-2a80464c2f9f] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:54.543068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:54.543560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:54.544422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:54.544871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:54.560943 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] HTTP exception thrown: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Request method failure captured: Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f HTTP/1.1 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1xt-tIM8wrIKIJ-tLWKMdRJomUsbRUDbY6sG1IvNfMR_AKUDMS0OCm16xF_SN8Q8ot-YmHAK18D9-J9sPjwYjJNJoM9wVSb8moMwgOD1COwkIpHmi_3F4iHbKbzbXaGB8Ni54_Dalo5mMLa5dHUsB4JAj25DDUlQ8MTNcU3R7GJFQR0 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0802b55fc01141f2b9e2a9a04cf34257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 0802b55fc01141f2b9e2a9a04cf34257 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314848803 Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: f593685780b64a13a7ba039633a5aeae Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestMinimumBasicScenario-314848803-project Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '3391ad33-3087-48e2-a8a7-2a80464c2f9f'} Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:08:54.562698 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Returning 404 to user: Instance 3391ad33-3087-48e2-a8a7-2a80464c2f9f could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5359ecb4-16b2-4c7b-b8e1-7083e68b92d9 tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f" status: 404 len: 111 microversion: 2.1 time: 0.035318 Jul 19 21:08:54.567951 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3677/7247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:54 2022] GET /compute/v2.1/servers/3391ad33-3087-48e2-a8a7-2a80464c2f9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:08:54.575353 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54d3d1bf-041d-4166-8203-b40ded6ac47c tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] Calling method '.version_select at 0x7fb88d46d4c0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:54.601410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54d3d1bf-041d-4166-8203-b40ded6ac47c tempest-TestMinimumBasicScenario-314848803 tempest-TestMinimumBasicScenario-314848803-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956120919" status: 202 len: 0 microversion: 2.1 time: 0.030092 Jul 19 21:08:54.602170 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3571/7248] 10.222.0.33 () {58 vars in 1268 bytes} [Tue Jul 19 21:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956120919 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:09:06.740998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:06.741827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:06.992542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cd8613da-baa5-4881-a26f-09aed103641e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: .version_select at 0x7fb88d152f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1826143151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSpvV1k3wXV7naSNcBlARyzX9QWHqarFTdno1UcCXHb/EOBsa6qJ5zbl5GIIs8SgV9d5GGF3bFfy5kGYeLMUYVrMcoLQqpPIU3dJTtAHJoBxr3hYpV4dgHUUldKbXkJZA=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:07.020139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd8613da-baa5-4881-a26f-09aed103641e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:09:07.026330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-cd8613da-baa5-4881-a26f-09aed103641e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:09:07.060253 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cd8613da-baa5-4881-a26f-09aed103641e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.324980 Jul 19 21:09:07.061621 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3678/7249] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:09:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:09:15.494551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-993294552", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "5dffe968-776e-4386-88b3-318223b2cbe6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1826143151", "security_groups": [{"name": "tempest-secgroup-smoke-1985249662"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:15.510022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=40 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:15.511968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:15.851185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] validate_networks() for [('5dffe968-776e-4386-88b3-318223b2cbe6', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:09:16.467950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:09:16.468744 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:09:16.469607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:09:16.470407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:09:16.471211 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:09:16.488727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:16.489228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:16.490406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:16.491055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:16.525910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:09:16.537059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:09:16.559861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:09:16.563241 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:09:16.641013 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0fd1541d-9a25-49b5-a630-6bd85425875c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.155280 Jul 19 21:09:16.642890 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3572/7250] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:09:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:09:16.660050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cacb818a-2020-4825-b24c-c66cfcfa180b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:16.661427 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cacb818a-2020-4825-b24c-c66cfcfa180b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:16.760017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cacb818a-2020-4825-b24c-c66cfcfa180b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:16.773843 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cacb818a-2020-4825-b24c-c66cfcfa180b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1266 microversion: 2.1 time: 0.123253 Jul 19 21:09:16.774903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3679/7251] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:16 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:09:17.804670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3dce5296-5da8-4b6d-96d4-126a1a8ef22a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:17.805302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3dce5296-5da8-4b6d-96d4-126a1a8ef22a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:17.935487 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3dce5296-5da8-4b6d-96d4-126a1a8ef22a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:17.944371 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3dce5296-5da8-4b6d-96d4-126a1a8ef22a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1266 microversion: 2.1 time: 0.148045 Jul 19 21:09:17.945633 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3573/7252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:17 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:18.974359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2d369be6-c4ef-4e0d-ac7a-bc25fbb51e69 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:18.974990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2d369be6-c4ef-4e0d-ac7a-bc25fbb51e69 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:19.045291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2d369be6-c4ef-4e0d-ac7a-bc25fbb51e69 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:19.054632 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2d369be6-c4ef-4e0d-ac7a-bc25fbb51e69 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1266 microversion: 2.1 time: 0.085115 Jul 19 21:09:19.055241 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3680/7253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:18 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:20.072220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8f104013-8927-4ea0-b69c-921423c32887 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:20.072849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8f104013-8927-4ea0-b69c-921423c32887 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:20.131382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8f104013-8927-4ea0-b69c-921423c32887 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:20.140066 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8f104013-8927-4ea0-b69c-921423c32887 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1266 microversion: 2.1 time: 0.071187 Jul 19 21:09:20.140798 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3574/7254] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:20 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:21.159353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:21.160213 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:21.170543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:21.171107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:21.172254 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:21.173049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:21.260197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:21.270367 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c2def303-aba8-4d2d-a6f1-9c7e30d8b277 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1270 microversion: 2.1 time: 0.115774 Jul 19 21:09:21.271048 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3681/7255] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:21 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:22.290067 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:22.290702 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:22.299703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:22.300406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:22.301341 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:22.301911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:22.416724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:22.426422 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-904bdc4e-f229-4af2-bf30-77f692755e0a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1326 microversion: 2.1 time: 0.140198 Jul 19 21:09:22.436601 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3575/7256] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:22 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:23.445958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:23.448290 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:23.457616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:23.458490 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:23.460357 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:23.461356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:23.725073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:23.734078 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0c21687e-fac8-4f3d-9332-fa04e4ab3aaf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.293691 Jul 19 21:09:23.735005 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3682/7257] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:23 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:24.155995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7590565a-dfce-4b96-ba96-75fba9c2ed46 req-03b4e54a-26a4-4112-8d39-47589bff5925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61c09e-36f2-4339-b984-8c1bf86f1eac", "tag": "9a95fc1e-177d-4a44-9cff-3c66bb3cacc8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:24.174330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7590565a-dfce-4b96-ba96-75fba9c2ed46 req-03b4e54a-26a4-4112-8d39-47589bff5925 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:24.174802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7590565a-dfce-4b96-ba96-75fba9c2ed46 req-03b4e54a-26a4-4112-8d39-47589bff5925 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:24.196983 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7590565a-dfce-4b96-ba96-75fba9c2ed46 req-03b4e54a-26a4-4112-8d39-47589bff5925 service nova] Creating event network-changed:9a95fc1e-177d-4a44-9cff-3c66bb3cacc8 for instance fe61c09e-36f2-4339-b984-8c1bf86f1eac on n-h2-843861-3 Jul 19 21:09:24.202909 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7590565a-dfce-4b96-ba96-75fba9c2ed46 req-03b4e54a-26a4-4112-8d39-47589bff5925 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052654 Jul 19 21:09:24.203542 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3576/7258] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:24.754008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:24.754683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:24.762546 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:24.763008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:24.763826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:24.764299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:24.929215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:24.937493 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7270296f-4e4f-47ef-a27e-58757d2858d1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.188504 Jul 19 21:09:24.938110 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3683/7259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:24 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:09:25.956991 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:25.957755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:25.965158 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:25.965867 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:25.966579 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:25.966868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:26.127468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:26.136174 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-75300d22-6866-46b2-861b-bd27d47a93af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.184788 Jul 19 21:09:26.136851 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3577/7260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:25 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:27.155920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:27.161944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:27.165866 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:27.166273 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:27.167439 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:27.167947 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:27.428268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:27.443055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3744986c-6b0f-4aa8-8697-5d9882ad2f74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.291937 Jul 19 21:09:27.444187 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3684/7261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:27 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:09:28.465849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:28.467092 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:28.471074 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:28.484065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:28.484938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:28.486483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:28.487938 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:28.660417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:28.674842 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3f6ea1e0-e088-4222-acdd-4d4d10f86577 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.216673 Jul 19 21:09:28.675948 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3578/7262] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:28 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:29.696775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:29.697597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:29.700232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=8 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:29.706812 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:29.707268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:29.708406 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:29.708849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:29.883198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:29.897876 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b86798c1-08a3-4b46-a502-6c7e166fa017 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.204810 Jul 19 21:09:29.898966 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3685/7263] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:29 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:09:30.120223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-decc2196-5b89-4858-8c05-315f1935fcb9 req-9698ef31-dd67-41bc-a306-7e0893caa9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe61c09e-36f2-4339-b984-8c1bf86f1eac", "name": "network-vif-plugged", "status": "completed", "tag": "9a95fc1e-177d-4a44-9cff-3c66bb3cacc8"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:30.131983 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-decc2196-5b89-4858-8c05-315f1935fcb9 req-9698ef31-dd67-41bc-a306-7e0893caa9ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:30.132504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-decc2196-5b89-4858-8c05-315f1935fcb9 req-9698ef31-dd67-41bc-a306-7e0893caa9ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:30.136872 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=10 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:30.157206 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-decc2196-5b89-4858-8c05-315f1935fcb9 req-9698ef31-dd67-41bc-a306-7e0893caa9ea service nova] Creating event network-vif-plugged:9a95fc1e-177d-4a44-9cff-3c66bb3cacc8 for instance fe61c09e-36f2-4339-b984-8c1bf86f1eac on n-h2-843861-3 Jul 19 21:09:30.166658 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-decc2196-5b89-4858-8c05-315f1935fcb9 req-9698ef31-dd67-41bc-a306-7e0893caa9ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049873 Jul 19 21:09:30.167666 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3579/7264] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:30.799077 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:09:30.799954 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:09:30.924134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:30.924881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:30.932511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:30.932966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:30.933760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:30.934203 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:31.087824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:31.096847 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2085866b-7f83-45f7-8192-742d7da2334b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1392 microversion: 2.1 time: 0.177487 Jul 19 21:09:31.097648 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3686/7265] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:30 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:32.116861 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:32.117606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:32.124815 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:32.125325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:32.126659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:32.127115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:32.292053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:32.300847 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-683aaeca-e186-43be-a6da-19de8b9ccace tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1563 microversion: 2.1 time: 0.189647 Jul 19 21:09:32.301466 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3580/7266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:32 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:32.319790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:32.320451 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:32.328532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:32.330243 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:32.331096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:32.331577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:32.513589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:32.522100 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b70582af-4d98-4c52-90fc-9316cfdd6e3a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1563 microversion: 2.1 time: 0.206257 Jul 19 21:09:32.522706 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3687/7267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:32 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1563 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:34.548177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:34.548916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:34.557039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:34.557751 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:34.558693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:34.559215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:34.559635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-5bbd39fe-631b-4e28-9306-1c20aacd9aca req-45d16b9c-3337-4b2f-a6c2-aa6afd77e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61c09e-36f2-4339-b984-8c1bf86f1eac", "tag": "9a95fc1e-177d-4a44-9cff-3c66bb3cacc8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:34.575219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5bbd39fe-631b-4e28-9306-1c20aacd9aca req-45d16b9c-3337-4b2f-a6c2-aa6afd77e8c4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:34.576064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-5bbd39fe-631b-4e28-9306-1c20aacd9aca req-45d16b9c-3337-4b2f-a6c2-aa6afd77e8c4 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:34.599064 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-5bbd39fe-631b-4e28-9306-1c20aacd9aca req-45d16b9c-3337-4b2f-a6c2-aa6afd77e8c4 service nova] Creating event network-changed:9a95fc1e-177d-4a44-9cff-3c66bb3cacc8 for instance fe61c09e-36f2-4339-b984-8c1bf86f1eac on n-h2-843861-3 Jul 19 21:09:34.608891 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-5bbd39fe-631b-4e28-9306-1c20aacd9aca req-45d16b9c-3337-4b2f-a6c2-aa6afd77e8c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056294 Jul 19 21:09:34.610247 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3688/7268] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:34.773659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:34.791341 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a68ed0ed-1b3e-42cb-af22-4ddd4e00d7e9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1563 microversion: 2.1 time: 0.247670 Jul 19 21:09:34.792504 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3581/7269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:34 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:10.189291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:10.190594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=44 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:10.196351 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:10.197617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:10.208291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:10.208973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:10.209908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:10.211188 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:10.291539 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7d6220c9-8190-4c13-83fd-01280119bd87 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action" status: 200 len: 24569 microversion: 2.1 time: 0.104832 Jul 19 21:10:10.292180 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3689/7270] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:10 2022] POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action => generated 24569 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:10:49.085440 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:49.086373 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:49.092293 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:49.092909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:49.102631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:49.103480 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:49.105118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:49.105992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:49.195399 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58f5ac5c-8261-41ea-8353-fe0815868ae6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action" status: 202 len: 0 microversion: 2.1 time: 0.112228 Jul 19 21:10:49.196393 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3582/7271] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:49 2022] POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:10:49.207589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:49.208566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:49.213010 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:49.214083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:49.222306 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:49.222773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:49.223590 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:49.224065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:49.388234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:49.396950 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8b649a06-f54a-4c85-9e2b-1d05548a23a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1686 microversion: 2.1 time: 0.194034 Jul 19 21:10:49.397734 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3690/7272] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:49 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1686 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:10:50.415606 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:10:50.420364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:50.421229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:50.428475 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:50.429242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:50.430329 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:50.430968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:50.600556 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:50.611087 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-87910f04-3da7-4bc6-81b3-d3832b82453b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1666 microversion: 2.1 time: 0.197435 Jul 19 21:10:50.611708 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3583/7273] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:50 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1666 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:51.719072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:51.720070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:51.728207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.728702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:51.729582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.730083 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:51.802988 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a94d8bc3-ebb6-4899-a82f-1bf883d4cbae tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action" status: 200 len: 32640 microversion: 2.1 time: 0.087996 Jul 19 21:10:51.804063 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3691/7274] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:51 2022] POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action => generated 32640 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:10:51.821382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:51.822349 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:51.840955 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.841422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:51.842225 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.842682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:51.846940 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 35588. Jul 19 21:10:51.928332 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2696558c-aed2-42ff-b049-61ec94da2292 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action" status: 202 len: 0 microversion: 2.1 time: 0.114455 Jul 19 21:10:51.929173 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3584/7275] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:51 2022] POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:10:51.941322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:51.942043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:51.954044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.955515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:51.956241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:51.957129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:52.214164 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:52.227219 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00bd105a-798c-48a7-a742-41e4a1cf0d74 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1673 microversion: 2.1 time: 0.290201 Jul 19 21:10:52.228115 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3692/7276] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:51 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:10:53.253404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:53.254140 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:53.262593 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:53.263072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:53.263941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:53.264408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:53.431118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:53.441276 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd4f58b2-03e6-46f1-b4d3-e82327ce461d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1681 microversion: 2.1 time: 0.193762 Jul 19 21:10:53.442036 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3585/7277] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:53 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:10:53.555189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:53.556206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:53.565259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:53.566753 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:53.568528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:53.569593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:53.639009 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6b83ee9a-9ba7-40dd-8051-3072dbe8c663 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action" status: 200 len: 38420 microversion: 2.1 time: 0.088207 Jul 19 21:10:53.639715 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3693/7278] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:53 2022] POST /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac/action => generated 38420 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:10:54.926375 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-6e5e7b81-73d4-4259-8ff2-95fe19f1d21c req-856bc257-ef43-44e8-aac9-74fc591974dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61c09e-36f2-4339-b984-8c1bf86f1eac", "tag": "9a95fc1e-177d-4a44-9cff-3c66bb3cacc8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:54.931917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:54.933765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:54.938095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6e5e7b81-73d4-4259-8ff2-95fe19f1d21c req-856bc257-ef43-44e8-aac9-74fc591974dc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:54.938547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-6e5e7b81-73d4-4259-8ff2-95fe19f1d21c req-856bc257-ef43-44e8-aac9-74fc591974dc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:54.943416 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:54.944458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:54.946193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:54.947278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:54.953764 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-6e5e7b81-73d4-4259-8ff2-95fe19f1d21c req-856bc257-ef43-44e8-aac9-74fc591974dc service nova] Creating event network-changed:9a95fc1e-177d-4a44-9cff-3c66bb3cacc8 for instance fe61c09e-36f2-4339-b984-8c1bf86f1eac on n-h2-843861-3 Jul 19 21:10:54.959963 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-6e5e7b81-73d4-4259-8ff2-95fe19f1d21c req-856bc257-ef43-44e8-aac9-74fc591974dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037963 Jul 19 21:10:54.964050 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3694/7279] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:54.985065 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:10:55.126717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e2bd1078-65ad-4ad2-b7a5-6896efbe48e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 204 len: 0 microversion: 2.1 time: 0.204606 Jul 19 21:10:55.128720 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3586/7280] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:10:54 2022] DELETE /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:10:55.152983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:55.154316 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:55.168906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:55.169969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:55.171192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:55.172045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:55.893775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:55.904235 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-24ef42b7-9beb-49a0-b083-0044f08e6074 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1687 microversion: 2.1 time: 0.767722 Jul 19 21:10:55.904863 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3695/7281] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:55 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1687 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:10:56.923674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:56.924465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:56.931953 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:56.932424 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:56.933752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:56.934221 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:57.318594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:57.328134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6569fa26-afb6-4d74-aaa1-c74cbb45679d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 200 len: 1687 microversion: 2.1 time: 0.408794 Jul 19 21:10:57.328752 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3587/7282] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:56 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 1687 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:57.627759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c5353da7-2b6e-48c1-be4b-02af8a492fe5 req-e6693994-d90e-44e6-9798-59bb31ce45b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe61c09e-36f2-4339-b984-8c1bf86f1eac", "name": "network-vif-deleted", "tag": "9a95fc1e-177d-4a44-9cff-3c66bb3cacc8"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:57.646369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c5353da7-2b6e-48c1-be4b-02af8a492fe5 req-e6693994-d90e-44e6-9798-59bb31ce45b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:57.647190 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c5353da7-2b6e-48c1-be4b-02af8a492fe5 req-e6693994-d90e-44e6-9798-59bb31ce45b6 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:57.665782 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c5353da7-2b6e-48c1-be4b-02af8a492fe5 req-e6693994-d90e-44e6-9798-59bb31ce45b6 service nova] Creating event network-vif-deleted:9a95fc1e-177d-4a44-9cff-3c66bb3cacc8 for instance fe61c09e-36f2-4339-b984-8c1bf86f1eac on n-h2-843861-3 Jul 19 21:10:57.672879 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c5353da7-2b6e-48c1-be4b-02af8a492fe5 req-e6693994-d90e-44e6-9798-59bb31ce45b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052674 Jul 19 21:10:57.673732 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3696/7283] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:58.346575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:58.347242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: fe61c09e-36f2-4339-b984-8c1bf86f1eac] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:58.355596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:58.356086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:58.356890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:58.357343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:58.372866 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] HTTP exception thrown: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Request method failure captured: Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac HTTP/1.1 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1x1xeEidRTPE2l36GiZgrOxF5u67pT6s7RoGpkDCY9Po1D-tAeXQUJomAJue_jmaMCEQbTZeivXMtUBjn61oTAqznziOk1lBXC8WHAYaX9H2YbQWYABwQB0obUXK2ZVJnqvvCsP4E-bEsi9D8BO9SlIdkeVIRGS0fA9PpafvabPWyQQ Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5e33d2517ed1482eaf37b4fb734be853 Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'fe61c09e-36f2-4339-b984-8c1bf86f1eac'} Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:58.374604 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Returning 404 to user: Instance fe61c09e-36f2-4339-b984-8c1bf86f1eac could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd551686-f991-439c-af9d-a1f1fc97a6e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac" status: 404 len: 111 microversion: 2.1 time: 0.033571 Jul 19 21:10:58.381614 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3588/7284] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:58 2022] GET /compute/v2.1/servers/fe61c09e-36f2-4339-b984-8c1bf86f1eac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:11:02.195882 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41295212-4e5a-4547-9be9-74a63d2789a7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '.version_select at 0x7fb88d6424c0>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:02.251235 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41295212-4e5a-4547-9be9-74a63d2789a7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826143151" status: 202 len: 0 microversion: 2.1 time: 0.063617 Jul 19 21:11:02.251796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3697/7285] 10.222.0.33 () {58 vars in 1283 bytes} [Tue Jul 19 21:11:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826143151 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:11:02.292597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8d44a9e5-6d64-4901-90a3-3569dd72dc6b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: .version_select at 0x7fb88ccabe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2113229730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDblV8nZWbPL04fqo+u/6r3mPajaamOtusXtC4hyvjxGbMn9ZaBAqvgoLjzJkc0zmCKBziFUsP+zljy07nHxTsOQuatoThNYcyEYYHkYsPiDoFJtj6GGKFDaoEQ3rpd0tA=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:02.327425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8d44a9e5-6d64-4901-90a3-3569dd72dc6b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:11:02.341589 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-8d44a9e5-6d64-4901-90a3-3569dd72dc6b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:11:02.390591 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8d44a9e5-6d64-4901-90a3-3569dd72dc6b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.105990 Jul 19 21:11:02.391679 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3589/7286] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:11:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:09.474816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2117287428", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "31e43515-b0d2-4062-83de-80d500f7363e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2113229730", "security_groups": [{"name": "tempest-secgroup-smoke-558358586"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:09.487518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=30 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:09.616275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] validate_networks() for [('31e43515-b0d2-4062-83de-80d500f7363e', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:11:10.240941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:11:10.241370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:11:10.241856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:11:10.242285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:11:10.242702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:11:10.261156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:10.261624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:10.262548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:10.262996 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:10.284988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:11:10.293168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:11:10.310313 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:11:10.316145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:11:10.391113 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8a236410-38cb-446e-8562-576c5ddea3bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.920707 Jul 19 21:11:10.393359 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3698/7287] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:11:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:11:10.410183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-92d8dfa1-580f-4933-a892-f381008066fe tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:10.411313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-92d8dfa1-580f-4933-a892-f381008066fe tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:10.424765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:10.579133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-92d8dfa1-580f-4933-a892-f381008066fe tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:10.602778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-92d8dfa1-580f-4933-a892-f381008066fe tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1267 microversion: 2.1 time: 0.200361 Jul 19 21:11:10.610455 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3590/7288] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:10 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:11.641152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:11.642605 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:11.653318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.653691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.654840 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.655485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.742021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:11.751575 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf620e68-8ccf-4f9e-9b0b-22bbad0a2104 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1319 microversion: 2.1 time: 0.116704 Jul 19 21:11:11.763158 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3699/7289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:11 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:12.777046 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:12.778164 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:12.798712 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:12.799555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:12.801095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:12.801989 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:13.256042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:13.268830 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8be8a3f1-f3f4-4e41-be6e-3553554e305c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1325 microversion: 2.1 time: 0.500566 Jul 19 21:11:13.270294 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3591/7290] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:12 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:14.303857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:14.308518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:14.334638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:14.335539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:14.343206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:14.345069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:14.727494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:14.738031 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c7e16773-781a-4fb4-81d1-c4d0a133ab21 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.442440 Jul 19 21:11:14.747110 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3700/7291] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:14 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:15.018219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-d59f12cf-4364-46a9-a101-d35ad0cb9e1d req-5b2c201f-42ba-4a41-82ed-4d462f46d2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5018e99-b814-4228-b6b7-e2ae75af0251", "tag": "78dbc09d-7324-4b4e-986f-90e600f1e050"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:15.035031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d59f12cf-4364-46a9-a101-d35ad0cb9e1d req-5b2c201f-42ba-4a41-82ed-4d462f46d2b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:15.035718 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-d59f12cf-4364-46a9-a101-d35ad0cb9e1d req-5b2c201f-42ba-4a41-82ed-4d462f46d2b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:15.058058 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-d59f12cf-4364-46a9-a101-d35ad0cb9e1d req-5b2c201f-42ba-4a41-82ed-4d462f46d2b8 service nova] Creating event network-changed:78dbc09d-7324-4b4e-986f-90e600f1e050 for instance f5018e99-b814-4228-b6b7-e2ae75af0251 on n-h1-843861-3 Jul 19 21:11:15.065544 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-d59f12cf-4364-46a9-a101-d35ad0cb9e1d req-5b2c201f-42ba-4a41-82ed-4d462f46d2b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190360 Jul 19 21:11:15.066549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3592/7292] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:15.757468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:15.758275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:15.768163 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:15.768911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:15.770638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:15.771210 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:15.947138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:15.956129 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6515944-58b7-4964-8fd7-7dd9c9e23e3c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.202770 Jul 19 21:11:15.956799 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3701/7293] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:15 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:16.976877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:16.977756 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:16.985917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:16.986387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:16.987384 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:16.987890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:17.144750 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:17.153286 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-baea67d7-7e42-44c7-9a37-66a512c379ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.181887 Jul 19 21:11:17.153967 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3593/7294] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:16 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:18.173909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:18.174526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:18.182082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:18.182528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:18.183317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:18.183752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:18.352582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:18.360978 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4e40f96b-55f2-425e-84f6-ae9fa9614c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.192371 Jul 19 21:11:18.361581 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3702/7295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:18 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:19.383791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:19.384539 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:19.387848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:19.393763 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:19.394233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:19.395061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:19.395522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:19.615435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:19.629232 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-82ca6825-7a29-4bbc-ac8e-177404ad46cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.249333 Jul 19 21:11:19.630870 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3594/7296] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:19 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:20.652264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:20.652837 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:20.656009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:20.656659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:20.657496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:20.663633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:20.664195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:20.665603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:20.665772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:20.824469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:20.833145 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9e43c053-a0fb-4117-9986-03a91ccc7f58 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.185484 Jul 19 21:11:20.833753 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3703/7297] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:20 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:21.655845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-2e42f096-f805-4c09-bac4-18995892cef2 req-d82cb72c-93ee-4997-bd78-d063cac237be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5018e99-b814-4228-b6b7-e2ae75af0251", "name": "network-vif-plugged", "status": "completed", "tag": "78dbc09d-7324-4b4e-986f-90e600f1e050"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:21.663476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:21.678656 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2e42f096-f805-4c09-bac4-18995892cef2 req-d82cb72c-93ee-4997-bd78-d063cac237be service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:21.679616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-2e42f096-f805-4c09-bac4-18995892cef2 req-d82cb72c-93ee-4997-bd78-d063cac237be service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:21.697481 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-2e42f096-f805-4c09-bac4-18995892cef2 req-d82cb72c-93ee-4997-bd78-d063cac237be service nova] Creating event network-vif-plugged:78dbc09d-7324-4b4e-986f-90e600f1e050 for instance f5018e99-b814-4228-b6b7-e2ae75af0251 on n-h1-843861-3 Jul 19 21:11:21.706920 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-2e42f096-f805-4c09-bac4-18995892cef2 req-d82cb72c-93ee-4997-bd78-d063cac237be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057100 Jul 19 21:11:21.707738 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3595/7298] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:11:21.852310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:21.852929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:21.863200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:21.864021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:21.865121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:21.865669 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:22.062713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:22.079118 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-fa86cd7f-a9e4-4637-87ef-071cde81aff3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.231082 Jul 19 21:11:22.080257 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3704/7299] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:21 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:23.110034 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:23.111356 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:23.126183 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:23.127048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:23.128564 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:23.129397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:23.366118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:23.375678 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ef1b2e1-05c2-4b48-a12d-9af2694261d9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1392 microversion: 2.1 time: 0.274206 Jul 19 21:11:23.376478 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3596/7300] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:23 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:24.405232 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:24.406043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:24.414369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.414827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.416262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.416721 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.617035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:24.628204 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-29a355e8-f4a0-42ba-9e4c-563ccc9367e2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1564 microversion: 2.1 time: 0.227675 Jul 19 21:11:24.629029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3705/7301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:24 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1564 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:24.651236 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:24.652442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:24.666461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.667224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.668717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.669551 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.868103 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:24.883289 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-afa3ec8b-27c0-45b1-9448-5d57f8cbe66d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1564 microversion: 2.1 time: 0.239981 Jul 19 21:11:24.884470 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3597/7302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:24 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:27.667572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:27.668422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:27.676315 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-8e112207-3c06-4148-b0c6-6a00a380cbd4 req-e743ccf6-6e5f-47c2-a57e-f059333b10ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5018e99-b814-4228-b6b7-e2ae75af0251", "tag": "78dbc09d-7324-4b4e-986f-90e600f1e050"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:27.677319 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:27.677502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:27.678247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:27.678687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:27.698148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8e112207-3c06-4148-b0c6-6a00a380cbd4 req-e743ccf6-6e5f-47c2-a57e-f059333b10ca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:27.700854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-8e112207-3c06-4148-b0c6-6a00a380cbd4 req-e743ccf6-6e5f-47c2-a57e-f059333b10ca service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:27.726439 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-8e112207-3c06-4148-b0c6-6a00a380cbd4 req-e743ccf6-6e5f-47c2-a57e-f059333b10ca service nova] Creating event network-changed:78dbc09d-7324-4b4e-986f-90e600f1e050 for instance f5018e99-b814-4228-b6b7-e2ae75af0251 on n-h1-843861-3 Jul 19 21:11:27.738204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-8e112207-3c06-4148-b0c6-6a00a380cbd4 req-e743ccf6-6e5f-47c2-a57e-f059333b10ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072809 Jul 19 21:11:27.738204 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3598/7303] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:11:27.986170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:28.001522 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-00d17890-5c6b-4c14-a6f6-bdec09522f84 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1564 microversion: 2.1 time: 0.342000 Jul 19 21:11:28.002919 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3706/7304] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:27 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1564 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:51.443210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:51.444251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=36 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:51.449832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:51.451240 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:51.459931 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:51.460560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:51.461231 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:51.461714 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:51.534033 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65f9a84a-e006-4698-97a1-9ef5c117b73f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action" status: 200 len: 24558 microversion: 2.1 time: 0.092193 Jul 19 21:11:51.535122 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3599/7305] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:11:51 2022] POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action => generated 24558 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:12:02.572543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:02.573787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:02.577082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:02.578193 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=50 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:02.587153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:02.587599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:02.588446 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:02.588885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:02.695666 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9a243b7b-8bfa-4837-9051-bd3dec640328 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action" status: 202 len: 0 microversion: 2.1 time: 0.126303 Jul 19 21:12:02.696997 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3707/7306] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:12:02 2022] POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:12:02.711743 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:02.714757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:02.720927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:02.722398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:02.734299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:02.735161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:02.736694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:02.737535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:03.150550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:03.158988 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4c707274-ed84-4746-a162-4c050289226a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1675 microversion: 2.1 time: 0.455705 Jul 19 21:12:03.159495 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3600/7307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:02 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1675 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:04.189222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:04.190023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:04.200892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:04.201353 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:04.202162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:04.202620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:04.400272 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:04.409339 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d394e08e-d4b3-44d9-a884-5ed1812ce45d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.232226 Jul 19 21:12:04.409961 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3708/7308] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:04 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:05.431997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:05.432852 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:05.442094 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:05.442808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:05.443842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:05.444514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:05.672854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:05.682141 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d707d2ab-2ce4-404f-b331-dcdb5733353b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.255438 Jul 19 21:12:05.682635 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3601/7309] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:05 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:06.702701 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:06.703572 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:06.710773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:06.711350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:06.712270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:06.712750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:06.920452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:06.935553 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf8145f2-a141-4bc9-8e09-ee01b2f61cdd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.238055 Jul 19 21:12:06.936712 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3709/7310] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:06 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:07.690505 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:12:07.691265 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:12:07.956491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:07.957214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:07.966601 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.967203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.968173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.968741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:08.162063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:08.177557 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d65dccc-e713-4936-9eed-657ac79400c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.225513 Jul 19 21:12:08.178755 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3602/7311] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:07 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:09.198378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:09.199176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:09.209096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:09.209603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.210951 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:09.211441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.401666 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:09.411218 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c8c7a5be-b43c-455c-ad38-d62b015ef14a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.217292 Jul 19 21:12:09.412135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3710/7312] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:09 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:10.432850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:10.433698 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:10.443911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.444461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:10.445348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.446042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:10.643025 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:10.654039 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-be4412e1-b852-44e2-a27b-ec5d903b4f91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.226148 Jul 19 21:12:10.654833 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3603/7313] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:10 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:11.679466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:11.680703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:11.693630 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:11.694438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.696060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:11.696890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.925275 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:11.935023 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7bbfd7c6-bdcf-43f8-92a5-76e6695a9df2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.264035 Jul 19 21:12:11.935848 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3711/7314] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:11 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:12.962338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:12.963607 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:12.972275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:12.972836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:12.973810 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:12.974570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:13.218195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:13.232475 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5478cd7f-22f7-4ffb-929d-8c1b2bf46ee4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.274434 Jul 19 21:12:13.233893 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3604/7315] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:12 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:14.255268 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:14.256317 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:14.265006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:14.265464 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:14.266393 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:14.267121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:14.514216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:14.528370 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7fa84d49-1ac8-4d17-af38-1ada4911f13c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.280172 Jul 19 21:12:14.529384 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3712/7316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:14 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:15.551323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:15.551974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:15.559437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:15.559936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:15.560757 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:15.561216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:15.783406 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:15.792970 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-26f45375-0886-4e1e-9d0f-609508533958 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.245664 Jul 19 21:12:15.793653 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3605/7317] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:15 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:16.812484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:16.813356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:16.821628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:16.822148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:16.823072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:16.823556 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:16.984754 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:16.993552 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f20f3775-905a-4bef-822a-e0553e260b51 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.185236 Jul 19 21:12:16.994172 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3713/7318] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:16 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:18.019426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:18.020396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:18.028676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:18.029138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:18.029950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:18.030412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:18.244317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:18.252605 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-661d8664-c05a-4ccd-91d5-a14c8780d215 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.238158 Jul 19 21:12:18.253205 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3606/7319] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:18 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:19.272378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:19.273246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:19.282531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:19.283187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:19.284142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:19.284692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:19.464844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:19.480198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-595b4e75-edcf-4889-9a2a-ba217149222a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1680 microversion: 2.1 time: 0.213240 Jul 19 21:12:19.481735 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3714/7320] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:19 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:20.506954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:20.507575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:20.515037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:20.515506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:20.517372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:20.517372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:20.674397 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:20.683260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ac1c89b-e16b-4528-9c0b-28f9da470d18 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1683 microversion: 2.1 time: 0.180364 Jul 19 21:12:20.683886 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3607/7321] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:20 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:46.900214 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:46.901176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:46.904072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=16 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:46.904984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:46.912987 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:46.913436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:46.914225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:46.914655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:46.982431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b3a16bd3-8f07-40a2-8749-1330f9c8a7c3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action" status: 200 len: 69322 microversion: 2.1 time: 0.086144 Jul 19 21:12:46.983313 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3715/7322] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:12:46 2022] POST /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251/action => generated 69322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:12:54.737166 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:54.738199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:54.743400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f955d479-2732-45b6-b420-4dea6afa50ed req-67dc7f5b-ad1a-44b3-9aee-5fb54ddca28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5018e99-b814-4228-b6b7-e2ae75af0251", "tag": "78dbc09d-7324-4b4e-986f-90e600f1e050"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:54.745317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:54.746427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=48 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:54.748664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:54.749239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:54.750916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:54.751443 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:54.756356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f955d479-2732-45b6-b420-4dea6afa50ed req-67dc7f5b-ad1a-44b3-9aee-5fb54ddca28b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:54.756958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f955d479-2732-45b6-b420-4dea6afa50ed req-67dc7f5b-ad1a-44b3-9aee-5fb54ddca28b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:54.776152 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f955d479-2732-45b6-b420-4dea6afa50ed req-67dc7f5b-ad1a-44b3-9aee-5fb54ddca28b service nova] Creating event network-changed:78dbc09d-7324-4b4e-986f-90e600f1e050 for instance f5018e99-b814-4228-b6b7-e2ae75af0251 on n-h1-843861-3 Jul 19 21:12:54.782817 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f955d479-2732-45b6-b420-4dea6afa50ed req-67dc7f5b-ad1a-44b3-9aee-5fb54ddca28b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046817 Jul 19 21:12:54.783953 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3716/7323] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:54.794141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:12:54.925573 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-77b7a5a9-5e3a-456a-8ac5-26224cf20204 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 204 len: 0 microversion: 2.1 time: 0.195615 Jul 19 21:12:54.926873 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3608/7324] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:12:54 2022] DELETE /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:12:54.944059 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:54.945386 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:54.964641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:54.965470 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:54.967231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:54.968061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:55.187592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:55.196396 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9cfed25c-8a13-445c-8655-491835a6fde9 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1689 microversion: 2.1 time: 0.262098 Jul 19 21:12:55.197379 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3717/7325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:54 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:56.223302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:56.224926 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:56.239994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.240827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.242354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.243202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.538915 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:56.550155 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0d6906a2-e7fa-43e0-8803-1ceb4a73f189 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1689 microversion: 2.1 time: 0.335452 Jul 19 21:12:56.550898 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3609/7326] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:56 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1689 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:57.272970 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f835a616-2f54-4daa-8748-ab43b825a66a req-3ea9f2ab-959c-4a3d-961b-6fc36a0e62fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5018e99-b814-4228-b6b7-e2ae75af0251", "name": "network-vif-deleted", "tag": "78dbc09d-7324-4b4e-986f-90e600f1e050"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:57.283461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f835a616-2f54-4daa-8748-ab43b825a66a req-3ea9f2ab-959c-4a3d-961b-6fc36a0e62fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.284051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f835a616-2f54-4daa-8748-ab43b825a66a req-3ea9f2ab-959c-4a3d-961b-6fc36a0e62fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:57.297981 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f835a616-2f54-4daa-8748-ab43b825a66a req-3ea9f2ab-959c-4a3d-961b-6fc36a0e62fc service nova] Creating event network-vif-deleted:78dbc09d-7324-4b4e-986f-90e600f1e050 for instance f5018e99-b814-4228-b6b7-e2ae75af0251 on n-h1-843861-3 Jul 19 21:12:57.304282 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f835a616-2f54-4daa-8748-ab43b825a66a req-3ea9f2ab-959c-4a3d-961b-6fc36a0e62fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035801 Jul 19 21:12:57.304925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3718/7327] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:12:57.575100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:57.575941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:57.584592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.585059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:57.586006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.586328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:57.627376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.627850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:57.628516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lazy-loading 'fault' on Instance uuid f5018e99-b814-4228-b6b7-e2ae75af0251 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:12:57.696399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:57.706959 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2a5666d7-0a76-40b3-adfb-4073629a22c0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 200 len: 1357 microversion: 2.1 time: 0.135825 Jul 19 21:12:57.708029 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3610/7328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:57 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 1357 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:58.732335 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:58.733287 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: f5018e99-b814-4228-b6b7-e2ae75af0251] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:58.741137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:58.741649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:58.742506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:58.742983 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:58.761432 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] HTTP exception thrown: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Request method failure captured: Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 HTTP/1.1 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1x1xeEidRTPE2l36GiZgrOxF5u67pT6s7RoGpkDCY9Po1D-tAeXQUJomAJue_jmaMCEQbTZeivXMtUBjn61oTAqznziOk1lBXC8WHAYaX9H2YbQWYABwQB0obUXK2ZVJnqvvCsP4E-bEsi9D8BO9SlIdkeVIRGS0fA9PpafvabPWyQQ Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5e33d2517ed1482eaf37b4fb734be853 Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'f5018e99-b814-4228-b6b7-e2ae75af0251'} Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:12:58.763224 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Returning 404 to user: Instance f5018e99-b814-4228-b6b7-e2ae75af0251 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-05197ea1-d2ac-4504-8f9c-d2a610c44793 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251" status: 404 len: 111 microversion: 2.1 time: 0.038278 Jul 19 21:12:58.769659 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3719/7329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:58 2022] GET /compute/v2.1/servers/f5018e99-b814-4228-b6b7-e2ae75af0251 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:13:03.600012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4961db07-89b4-48e5-a2f4-456645473454 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '.version_select at 0x7fb88d4581f0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:03.630126 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4961db07-89b4-48e5-a2f4-456645473454 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2113229730" status: 202 len: 0 microversion: 2.1 time: 0.034146 Jul 19 21:13:03.631213 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3611/7330] 10.222.0.33 () {58 vars in 1283 bytes} [Tue Jul 19 21:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2113229730 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:13:03.674747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07e30855-e613-401d-9607-7fb7548ec11b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: .version_select at 0x7fb88cf9aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-39739283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQgNkpu0YhyDUgPt+JY7xn7MjUbeh2XMdpPEnNCOAmOy9YO2hdDttaGor+5xCcC6/imI8UGxy1PwWEXA04BymPfHwHqgZG9igK0IuRKdBZq9ZJ3swAXCFaaLMipo5gF2g=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:03.694598 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-07e30855-e613-401d-9607-7fb7548ec11b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:13:03.702091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-07e30855-e613-401d-9607-7fb7548ec11b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:13:03.737123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07e30855-e613-401d-9607-7fb7548ec11b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.070076 Jul 19 21:13:03.737967 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3720/7331] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:13:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:12.066817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:12.073055 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-191735367", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "cd572220-05ec-45a2-a2e6-8bd17f6c0957"}], "key_name": "tempest-TestNetworkAdvancedServerOps-39739283", "security_groups": [{"name": "tempest-secgroup-smoke-987978836"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:12.349500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] validate_networks() for [('cd572220-05ec-45a2-a2e6-8bd17f6c0957', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:13:12.993981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:13:12.995755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:13:12.997064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:13:12.997669 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:13:12.998362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:13:13.017041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.018086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.020053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.020772 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.051177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:13:13.058167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:13:13.076417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:13:13.079271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:13:13.141043 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ff91864a-13f1-4d42-8f60-b9be4a81d570 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.076477 Jul 19 21:13:13.142118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3612/7332] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:13:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:13:13.156117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=16 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:13.161925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1a02d3c3-db4f-4ad7-a91e-f459a1d034a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:13.166929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1a02d3c3-db4f-4ad7-a91e-f459a1d034a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:13.320233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1a02d3c3-db4f-4ad7-a91e-f459a1d034a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:13.336576 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1a02d3c3-db4f-4ad7-a91e-f459a1d034a2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1264 microversion: 2.1 time: 0.182663 Jul 19 21:13:13.354397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3721/7333] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:13 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:14.368713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:14.371115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:14.385338 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:14.386374 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:14.388418 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:14.389276 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:14.518340 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:14.545880 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fbbcb4f4-b64a-4874-acdb-5413d0456f98 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1316 microversion: 2.1 time: 0.184837 Jul 19 21:13:14.548376 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3613/7334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:14 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:15.582586 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:15.585249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:15.599747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:15.600580 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:15.601964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:15.603323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:15.848140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:15.864702 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-087cca92-0ce0-495c-94ff-ce7bd2a3f684 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.295979 Jul 19 21:13:15.865446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3722/7335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:15 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:16.906019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:16.909159 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:16.924109 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:16.927250 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:16.930148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:16.931375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.211235 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-20254fe7-6d54-4902-8021-b9353931bc54 req-39290d31-3557-45bb-abc9-f701b43de674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:17.234405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:17.241296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:17.254911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-20254fe7-6d54-4902-8021-b9353931bc54 req-39290d31-3557-45bb-abc9-f701b43de674 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:17.255508 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-090f38ec-cf7c-40f7-a1af-a0fc297c2c45 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.356844 Jul 19 21:13:17.256321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-20254fe7-6d54-4902-8021-b9353931bc54 req-39290d31-3557-45bb-abc9-f701b43de674 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.261112 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3614/7336] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:16 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:17.288751 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-20254fe7-6d54-4902-8021-b9353931bc54 req-39290d31-3557-45bb-abc9-f701b43de674 service nova] Creating event network-changed:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h2-843861-3 Jul 19 21:13:17.298320 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-20254fe7-6d54-4902-8021-b9353931bc54 req-39290d31-3557-45bb-abc9-f701b43de674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230432 Jul 19 21:13:17.300059 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3723/7337] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:13:18.282302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:18.283500 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:18.296787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.297600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.299099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.299984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.505780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:18.517048 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c16e11e6-d96d-408b-8204-72efe9ed24dd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.242313 Jul 19 21:13:18.518055 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3615/7338] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:18 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:19.538902 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:19.539626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:19.546852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:19.547328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:19.548197 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:19.548659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:19.728584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:19.738533 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-52bfda7e-0378-4311-a734-177d302ce911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.205644 Jul 19 21:13:19.739171 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3724/7339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:19 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:20.758332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:20.759100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:20.768407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:20.768936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:20.769896 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:20.770389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:20.971401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:20.981518 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b2f27f4-a1a9-486b-a71d-2de97dc0c9ea tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.228431 Jul 19 21:13:20.982518 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3616/7340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:20 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:13:22.003050 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:22.004493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:22.015976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:22.016824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:22.018311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:22.019109 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:22.253559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:22.268248 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e92c0e0a-bfa3-4f18-8fea-801cd402f675 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.270499 Jul 19 21:13:22.269440 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3725/7341] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:21 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:23.290820 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:23.291492 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:23.295402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:23.296613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:23.300840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:23.301362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:23.302200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:23.302663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:23.423288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:23.509190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:23.520642 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67d7ac54-2cf0-491f-a93e-951509edec19 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.234722 Jul 19 21:13:23.523954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3617/7342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:23 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:23.545859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-1db4d456-2840-4d02-bb29-ce57ed307432 req-5cadd68b-38c7-4a3b-a4cb-5bb1e23b20ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "name": "network-vif-plugged", "status": "completed", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:23.555096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1db4d456-2840-4d02-bb29-ce57ed307432 req-5cadd68b-38c7-4a3b-a4cb-5bb1e23b20ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:23.555543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-1db4d456-2840-4d02-bb29-ce57ed307432 req-5cadd68b-38c7-4a3b-a4cb-5bb1e23b20ea service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:23.568776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-1db4d456-2840-4d02-bb29-ce57ed307432 req-5cadd68b-38c7-4a3b-a4cb-5bb1e23b20ea service nova] Creating event network-vif-plugged:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h2-843861-3 Jul 19 21:13:23.574518 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-1db4d456-2840-4d02-bb29-ce57ed307432 req-5cadd68b-38c7-4a3b-a4cb-5bb1e23b20ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161909 Jul 19 21:13:23.575154 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3726/7343] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:13:24.538826 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:24.539691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:24.548727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:24.549540 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:24.551558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:24.552143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:24.743355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:24.754192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-160f142e-50c1-498f-a9a9-2b9db2698764 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1389 microversion: 2.1 time: 0.219326 Jul 19 21:13:24.755432 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3618/7344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:24 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:13:25.775637 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:25.776655 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:25.785303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:25.786062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:25.787359 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:25.787857 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:25.973888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:25.985758 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-62ad4850-b042-4f3c-a73a-52f3018b80e1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1560 microversion: 2.1 time: 0.214535 Jul 19 21:13:25.986923 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3727/7345] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:25 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:26.017439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:26.019217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:26.022654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:26.033422 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:26.034254 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:26.035727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:26.036570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:26.271738 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:26.282210 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8825bc8a-9719-4750-8c0e-3e28596a8deb tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1560 microversion: 2.1 time: 0.273864 Jul 19 21:13:26.283209 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3619/7346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:26 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1560 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:28.656096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:28.664383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-fc1e3965-ac3b-4794-802e-3aec58925b48 req-a6044fd7-c8ef-482c-9898-3de18cf21d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:28.672973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:28.683031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:28.683717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:28.684578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fc1e3965-ac3b-4794-802e-3aec58925b48 req-a6044fd7-c8ef-482c-9898-3de18cf21d9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:28.684979 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:28.685410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-fc1e3965-ac3b-4794-802e-3aec58925b48 req-a6044fd7-c8ef-482c-9898-3de18cf21d9e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:28.685739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:28.712265 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-fc1e3965-ac3b-4794-802e-3aec58925b48 req-a6044fd7-c8ef-482c-9898-3de18cf21d9e service nova] Creating event network-changed:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h2-843861-3 Jul 19 21:13:28.721274 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-fc1e3965-ac3b-4794-802e-3aec58925b48 req-a6044fd7-c8ef-482c-9898-3de18cf21d9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062003 Jul 19 21:13:28.727617 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3620/7347] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:28.899450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:28.912244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c087ce8b-9167-403e-b125-9275dc54b8e5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1560 microversion: 2.1 time: 0.262869 Jul 19 21:13:28.912861 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3728/7348] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:28 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:01.341059 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:01.341875 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=46 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:01.347238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:14:01.348382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:01.356594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:01.357071 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:01.357899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:01.358355 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:01.426539 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d42ddb70-9527-4ee8-b593-1fb4925bf2a4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action" status: 200 len: 24565 microversion: 2.1 time: 0.087286 Jul 19 21:14:01.427368 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3621/7349] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:14:01 2022] POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:14:40.528368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=11 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:40.529043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:40.581152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:14:40.582145 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:40.588383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:40.588829 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:40.589594 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:40.590026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:40.702805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:40.710740 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Old instance type m1.heat2, new instance type m1.heat {{(pid=126008) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 21:14:40.717545 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:14:40.717966 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:14:40.718438 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:14:40.718849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:14:40.719282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:14:40.783865 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d479a4be-1b1f-422c-8d97-13f0ed4f3fb2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action" status: 202 len: 0 microversion: 2.1 time: 0.257231 Jul 19 21:14:40.784926 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3729/7350] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:14:40 2022] POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:14:40.795385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:40.795778 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:40.798428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:40.799256 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:40.806548 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:40.807068 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:40.807994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:40.808491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:41.001544 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:41.012306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a6e88204-b34f-4f9d-a38b-06f066878eee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1688 microversion: 2.1 time: 0.221625 Jul 19 21:14:41.013025 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3622/7351] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:40 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:14:42.033330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:42.033955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:42.042412 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:42.042898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:42.043631 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:42.044120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:42.185242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:42.193880 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-558740af-1c5d-4a6f-88f9-bd6f76e0462d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1688 microversion: 2.1 time: 0.164746 Jul 19 21:14:42.194484 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3730/7352] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:42 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:43.211198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:43.212447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:43.221446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.221766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:43.222428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.222937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:43.358429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:43.366701 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-df4e7eea-3350-4638-9827-ed26e330d157 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.159556 Jul 19 21:14:43.367285 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3623/7353] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:43 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:44.385444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:44.386072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:44.394008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:44.394455 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.396100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:44.396100 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.541080 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:44.550048 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f243841c-49d7-4d8b-82ef-f10d1c34f3a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.168799 Jul 19 21:14:44.550667 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3731/7354] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:44 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:45.568112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:45.568737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:45.575752 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:45.576247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:45.577026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:45.577506 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:45.716962 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:45.724604 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-aff6c52a-d25f-4407-9d4f-7abe7e69f113 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.160559 Jul 19 21:14:45.725169 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3624/7355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:45 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:46.742654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:46.743278 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:46.750256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:46.750697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:46.751461 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:46.751925 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:46.891310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:46.899108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a37c6f9c-c705-4e6a-82fd-fc236b1141cd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.160942 Jul 19 21:14:46.899840 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3732/7356] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:46 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:47.917299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:47.918081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:47.925848 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:47.926314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:47.927190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:47.927638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:48.071797 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:48.079629 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6199f6fa-2536-4ec9-b137-a6f8d8cb5556 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.166285 Jul 19 21:14:48.080254 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3625/7357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:47 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:49.097816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:49.098487 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:49.107123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:49.107600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:49.108454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:49.108890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:49.273976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:49.282792 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e4a2bd18-d638-42af-8230-97865d6f2ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.188833 Jul 19 21:14:49.283428 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3733/7358] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:49 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:50.304663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:50.305323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:50.312793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:50.313262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:50.314051 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:50.314501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:50.457137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:50.465489 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80c743f2-659f-46cb-bb42-923dc6ac1648 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.165234 Jul 19 21:14:50.466072 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3626/7359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:50 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:51.483895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:51.484538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:51.491886 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:51.492332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:51.493093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:51.493534 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:51.628728 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:51.639018 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a77adcf0-4aff-46f1-b43a-cb510e636257 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.159361 Jul 19 21:14:51.639593 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3734/7360] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:51 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:52.656843 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:52.657464 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:52.664549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:52.665009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:52.665790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:52.666238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:52.798970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:52.806720 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd831dcb-eb92-424a-9ca6-3f21b450d5e4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.153877 Jul 19 21:14:52.807403 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3627/7361] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:52 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:53.824935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:53.825541 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:53.832642 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:53.833102 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:53.833862 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:53.834291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:53.978095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:53.986024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-438b75dc-0b85-49c2-8810-7a6d56c898bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.165358 Jul 19 21:14:53.986599 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3735/7362] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:53 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:55.003476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:55.004118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:55.011289 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:55.011683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:55.012494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:55.012944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:55.147426 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:55.155134 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f1a85f9-8ff2-4885-b4f9-eada1031f248 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.155560 Jul 19 21:14:55.155720 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3628/7363] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:54 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:56.172674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:56.173285 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:56.180374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:56.180817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:56.181575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:56.182004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:56.318920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:56.326772 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-02a753db-6583-44a7-83aa-d80ba903f33f tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.158113 Jul 19 21:14:56.327346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3736/7364] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:56 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:57.344603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:57.345449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:57.352651 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:57.353143 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:57.353951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:57.354395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:57.488547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:57.497739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7541de2d-345a-4cae-803f-6b210d30ef5b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.156142 Jul 19 21:14:57.497739 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3629/7365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:57 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:58.515266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:58.515841 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:58.523428 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:58.523918 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:58.524688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:58.525120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:58.661360 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:58.676873 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cf8e3f7f-b01c-4347-b737-ff50ace378ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.165824 Jul 19 21:14:58.677464 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3737/7366] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:58 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:59.700494 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:59.701358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:59.708784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:59.709249 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:59.710038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:59.710483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:59.864626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:59.871989 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dd0cbff3-cbe7-4a3c-9c06-e10ebf0610b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1693 microversion: 2.1 time: 0.175308 Jul 19 21:14:59.872591 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3630/7367] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:59 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:00.589693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "name": "network-vif-unplugged", "status": "completed", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:00.600844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:00.601294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:00.615507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] Creating event network-vif-unplugged:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h1-843861-3 Jul 19 21:15:00.622198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] Instance a9f00d4e-4612-4654-901d-ede63662c79e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 21:15:00.640669 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-c8391b5f-4a09-4cd6-9930-2c04344e3804 req-de8b7c33-515d-410a-84b9-819b67880f5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054602 Jul 19 21:15:00.641823 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3738/7368] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:15:00.893522 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:00.894309 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:00.902330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:00.905884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:00.905884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:00.905884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:01.356821 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:01.366409 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0f706f84-2d54-4e65-8baf-7093aa024487 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1692 microversion: 2.1 time: 0.476732 Jul 19 21:15:01.367270 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3631/7369] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:00 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1692 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:02.387211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:02.387997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:02.395726 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.396211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.397288 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.397729 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.561236 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:02.569123 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-25bcc3d1-b618-4fea-8d23-027545de3c9b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1690 microversion: 2.1 time: 0.186772 Jul 19 21:15:02.569723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3739/7370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:02 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:02.662062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:02.672501 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.672959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.686011 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] Creating event network-changed:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h1-843861-3 Jul 19 21:15:02.692013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] Instance a9f00d4e-4612-4654-901d-ede63662c79e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 21:15:02.703631 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5e796634-fdc0-4ed5-97a3-a3053d508889 req-62bff3bf-0534-4dea-88ad-e1035c997187 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046054 Jul 19 21:15:02.704349 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3632/7371] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:03.587107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:03.587755 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:03.594895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:03.596099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:03.596099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:03.597395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:03.808704 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:03.816426 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9fa4489-d46b-4506-84cf-ff61d5e15d4d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1690 microversion: 2.1 time: 0.233241 Jul 19 21:15:03.817521 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3740/7372] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:03 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:04.836599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:04.837401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:04.843924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:04.844398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:04.845190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:04.845640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.001431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:05.010890 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c92a703a-ca50-4e7d-b609-1b9e35e1b226 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1687 microversion: 2.1 time: 0.179448 Jul 19 21:15:05.012037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3633/7373] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:04 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:05.031065 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:05.031647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:05.039246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.039694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.040522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.040962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.108639 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b1eb26f3-17d4-4429-b74d-7df27a599356 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action" status: 204 len: 0 microversion: 2.1 time: 0.082153 Jul 19 21:15:05.109674 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3741/7374] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:15:05 2022] POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:15:05.119629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:05.120954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:05.128446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.129036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.130179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.131376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.313268 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:05.321948 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8572c5b1-1701-452a-a378-e08159cce0e6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1687 microversion: 2.1 time: 0.207728 Jul 19 21:15:05.322578 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3634/7375] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:05 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:05.340654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:05.341374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:05.351146 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.351853 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.353240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:05.354008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:05.562434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:05.576884 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7cbc42f8-f8bd-4467-9304-b157604f68d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1687 microversion: 2.1 time: 0.240413 Jul 19 21:15:05.577987 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3742/7376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:05 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1687 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:06.605391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:06.606452 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:06.618195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:06.618782 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:06.619658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:06.620316 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:06.690985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "name": "network-vif-plugged", "status": "completed", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:06.705435 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:06.706825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:06.724692 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] Creating event network-vif-plugged:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h1-843861-3 Jul 19 21:15:06.732892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:06.735103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] Instance a9f00d4e-4612-4654-901d-ede63662c79e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843861-3', 'n-h2-843861-3'} {{(pid=126008) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 21:15:06.753077 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a363ecc5-49df-4472-8478-f553aa1529be req-895edadb-cd64-49e2-aef2-63caca4272ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067960 Jul 19 21:15:06.754985 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3743/7377] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:15:06.829087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:06.842403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-54bb8418-098b-4949-81e8-fc9da7586a86 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1687 microversion: 2.1 time: 0.241773 Jul 19 21:15:06.843489 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3635/7378] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:06 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1687 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:07.867233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:07.867959 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:07.874798 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:07.875247 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:07.876035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:07.876638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:08.030299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:08.045275 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-edcf1a9b-d98e-40c1-94c1-b9857b08c597 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1679 microversion: 2.1 time: 0.182337 Jul 19 21:15:08.046757 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3744/7379] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:07 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:30.246642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:30.247594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:30.250167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=28 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:30.250863 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=82 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:30.257541 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:30.258014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:30.258809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:30.259264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:30.314004 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-413780f8-3242-44b5-9601-a65d23242ecc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action" status: 200 len: 24581 microversion: 2.1 time: 0.071121 Jul 19 21:15:30.314655 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3636/7380] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:15:30 2022] POST /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e/action => generated 24581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:15:37.654444 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:37.655167 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:37.656671 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f9a61344-60af-4508-82f6-126284d6f9bc req-57f6da5b-5fc2-4bb9-9cf9-a074a48881b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:37.657685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=36 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:37.658691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=7 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:37.666068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.667130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.667266 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f9a61344-60af-4508-82f6-126284d6f9bc req-57f6da5b-5fc2-4bb9-9cf9-a074a48881b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.667381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.667469 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f9a61344-60af-4508-82f6-126284d6f9bc req-57f6da5b-5fc2-4bb9-9cf9-a074a48881b8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.667909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.680953 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f9a61344-60af-4508-82f6-126284d6f9bc req-57f6da5b-5fc2-4bb9-9cf9-a074a48881b8 service nova] Creating event network-changed:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h1-843861-3 Jul 19 21:15:37.686732 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f9a61344-60af-4508-82f6-126284d6f9bc req-57f6da5b-5fc2-4bb9-9cf9-a074a48881b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Jul 19 21:15:37.687577 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3637/7381] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:15:37.697056 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:15:37.791303 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-cc8d19f1-0f62-4aea-9632-7d7c09527f14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 204 len: 0 microversion: 2.1 time: 0.141009 Jul 19 21:15:37.792347 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3745/7382] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:15:37 2022] DELETE /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:15:37.804575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:37.805767 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:37.814433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.815060 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.818535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.818535 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.983165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:37.991560 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32154134-0b23-4cdb-b9da-8c2bd69b1e8e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1685 microversion: 2.1 time: 0.193869 Jul 19 21:15:37.992415 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3638/7383] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:37 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:38.505168 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:15:38.505398 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:15:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:15:39.010929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:39.011622 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:39.022667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:39.023112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:39.023936 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:39.024367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:39.244031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:39.259357 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ff8e5fa9-61e7-4252-a794-d8cc9737cd5a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1685 microversion: 2.1 time: 0.252173 Jul 19 21:15:39.259357 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3746/7384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:39 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1685 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:40.006930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5d402d7a-6db6-4aa0-9afd-5c9f591f4f03 req-350337cf-425a-4cfa-b78d-fea731669e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00d4e-4612-4654-901d-ede63662c79e", "name": "network-vif-deleted", "tag": "a6b1d9ef-a366-4acc-9292-fd390694c057"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:40.016272 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d402d7a-6db6-4aa0-9afd-5c9f591f4f03 req-350337cf-425a-4cfa-b78d-fea731669e84 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:40.016720 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5d402d7a-6db6-4aa0-9afd-5c9f591f4f03 req-350337cf-425a-4cfa-b78d-fea731669e84 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:40.031397 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5d402d7a-6db6-4aa0-9afd-5c9f591f4f03 req-350337cf-425a-4cfa-b78d-fea731669e84 service nova] Creating event network-vif-deleted:a6b1d9ef-a366-4acc-9292-fd390694c057 for instance a9f00d4e-4612-4654-901d-ede63662c79e on n-h1-843861-3 Jul 19 21:15:40.036660 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5d402d7a-6db6-4aa0-9afd-5c9f591f4f03 req-350337cf-425a-4cfa-b78d-fea731669e84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034069 Jul 19 21:15:40.037566 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3639/7385] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:40.276194 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:40.276926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:40.284565 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:40.285013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:40.285790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:40.286215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:40.322688 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:40.323137 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:40.323589 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lazy-loading 'fault' on Instance uuid a9f00d4e-4612-4654-901d-ede63662c79e {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:15:40.366822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:40.374986 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ccaa061f-da9b-43d4-bf83-f5d49fc5da55 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 200 len: 1354 microversion: 2.1 time: 0.102769 Jul 19 21:15:40.375761 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3747/7386] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:40 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 1354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:41.395210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:41.395952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: a9f00d4e-4612-4654-901d-ede63662c79e] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:41.402805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:41.403259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:41.404063 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:41.404510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:41.422369 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] HTTP exception thrown: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Request method failure captured: Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e HTTP/1.1 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1x1xeEidRTPE2l36GiZgrOxF5u67pT6s7RoGpkDCY9Po1D-tAeXQUJomAJue_jmaMCEQbTZeivXMtUBjn61oTAqznziOk1lBXC8WHAYaX9H2YbQWYABwQB0obUXK2ZVJnqvvCsP4E-bEsi9D8BO9SlIdkeVIRGS0fA9PpafvabPWyQQ Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5e33d2517ed1482eaf37b4fb734be853 Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a9f00d4e-4612-4654-901d-ede63662c79e'} Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:15:41.427895 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Returning 404 to user: Instance a9f00d4e-4612-4654-901d-ede63662c79e could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a0de0b02-2cce-494f-b84f-d89bae5db37c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e" status: 404 len: 111 microversion: 2.1 time: 0.040093 Jul 19 21:15:41.432683 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3640/7387] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:41 2022] GET /compute/v2.1/servers/a9f00d4e-4612-4654-901d-ede63662c79e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:15:44.896219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b9adba6d-882a-48bf-a7f2-93b67f33ec14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '.version_select at 0x7fb88d152b80>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:44.931984 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b9adba6d-882a-48bf-a7f2-93b67f33ec14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-39739283" status: 202 len: 0 microversion: 2.1 time: 0.040066 Jul 19 21:15:44.932842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3748/7388] 10.222.0.33 () {58 vars in 1277 bytes} [Tue Jul 19 21:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-39739283 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:15:44.959235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1e61e09c-840c-4a91-9f72-b291565f0736 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: .version_select at 0x7fb892f4ed30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1233921313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHsakjDkxQUf3uXQWgYCEGLWPjo5zIHdY5cruPsAijkr2M+h6dtqGLIa3AdhYnd2hvZxSJhIX2futcCQmKs/CfLmOfrbL/KFdiib0dc10Wuab/V4+1BBdTAYxqRyX+YVQ=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:44.975165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-1e61e09c-840c-4a91-9f72-b291565f0736 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:15:44.986056 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-1e61e09c-840c-4a91-9f72-b291565f0736 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:15:45.012500 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1e61e09c-840c-4a91-9f72-b291565f0736 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057209 Jul 19 21:15:45.013305 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3641/7389] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:15:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:50.934154 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:50.945526 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-625448407", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "a87f8bdf-f968-4be4-b1d3-1114f6174b06"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1233921313", "security_groups": [{"name": "tempest-secgroup-smoke-2031822875"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:51.088934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] validate_networks() for [('a87f8bdf-f968-4be4-b1d3-1114f6174b06', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:15:51.585988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:15:51.586734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:15:51.587452 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:15:51.588107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:15:51.588734 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:15:51.599177 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:51.600103 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:51.601499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:51.602117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:51.631369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:15:51.638760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:15:51.653683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:15:51.656023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:15:51.703346 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0b21b0f6-2528-4227-9a0c-eed12bbd53fc tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770829 Jul 19 21:15:51.704363 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3749/7390] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:15:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:15:51.713383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=16 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:51.718114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f6f1efc4-e07b-4ed2-88e6-6c74aea2a042 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:51.719153 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f6f1efc4-e07b-4ed2-88e6-6c74aea2a042 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:51.788368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f6f1efc4-e07b-4ed2-88e6-6c74aea2a042 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:51.795676 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f6f1efc4-e07b-4ed2-88e6-6c74aea2a042 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1266 microversion: 2.1 time: 0.084432 Jul 19 21:15:51.796787 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3642/7391] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:51 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:52.813346 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-482b40c5-22d6-4427-8b7f-51a88465b9ac tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:52.813961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-482b40c5-22d6-4427-8b7f-51a88465b9ac tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:52.938559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-482b40c5-22d6-4427-8b7f-51a88465b9ac tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:52.948358 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-482b40c5-22d6-4427-8b7f-51a88465b9ac tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1266 microversion: 2.1 time: 0.139149 Jul 19 21:15:52.948950 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3750/7392] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:52 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:53.971401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67d03a60-3fa2-41eb-af7f-03a30b5326b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:53.972766 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67d03a60-3fa2-41eb-af7f-03a30b5326b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:54.032792 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67d03a60-3fa2-41eb-af7f-03a30b5326b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:54.041251 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67d03a60-3fa2-41eb-af7f-03a30b5326b0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1266 microversion: 2.1 time: 0.078526 Jul 19 21:15:54.041859 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3643/7393] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:53 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:55.058974 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1963e0f0-843d-4ab2-86b6-444eb33c5192 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:55.059588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1963e0f0-843d-4ab2-86b6-444eb33c5192 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:55.115647 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1963e0f0-843d-4ab2-86b6-444eb33c5192 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:55.123108 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1963e0f0-843d-4ab2-86b6-444eb33c5192 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1266 microversion: 2.1 time: 0.068082 Jul 19 21:15:55.123962 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3751/7394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:55 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:56.140642 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:56.141265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:56.148354 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:56.148807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:56.149583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:56.150028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:56.211889 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:56.220163 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9eb99b8e-d723-4c4c-ac16-0bea92054ee6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1270 microversion: 2.1 time: 0.083529 Jul 19 21:15:56.220767 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3644/7395] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:56 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:57.242138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:57.242844 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:57.251126 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:57.251573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:57.252387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:57.252805 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:57.328997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:57.338922 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-190118ac-607b-4ff9-8053-2ff7206c28c2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1324 microversion: 2.1 time: 0.103527 Jul 19 21:15:57.339587 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3752/7396] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:57 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1324 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:58.361973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:58.363267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:58.372877 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:58.373345 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:58.374144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:58.374596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:58.486186 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-74f99625-65f7-4dec-a261-ce6e88887cf9 req-85537239-34b8-48be-a567-2f39cf82a325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eccec7c8-1bba-4ee5-924b-881d12169248", "tag": "b4969dbd-5c03-4418-81be-02cfe83d74fc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:58.501540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-74f99625-65f7-4dec-a261-ce6e88887cf9 req-85537239-34b8-48be-a567-2f39cf82a325 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:58.501991 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-74f99625-65f7-4dec-a261-ce6e88887cf9 req-85537239-34b8-48be-a567-2f39cf82a325 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:58.515047 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-74f99625-65f7-4dec-a261-ce6e88887cf9 req-85537239-34b8-48be-a567-2f39cf82a325 service nova] Creating event network-changed:b4969dbd-5c03-4418-81be-02cfe83d74fc for instance eccec7c8-1bba-4ee5-924b-881d12169248 on n-h1-843861-3 Jul 19 21:15:58.521780 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-74f99625-65f7-4dec-a261-ce6e88887cf9 req-85537239-34b8-48be-a567-2f39cf82a325 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039072 Jul 19 21:15:58.522454 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3753/7397] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:58.677346 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:58.688891 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b43b15e-5b89-4dd2-af31-d8948931718e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.334256 Jul 19 21:15:58.689520 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3645/7398] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:58 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:59.708067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:59.708768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:59.715234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:59.715667 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:59.716454 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:59.716880 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:59.954240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:59.963171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3bf5e00c-1f7a-463c-a47d-2f737ebe0184 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.260247 Jul 19 21:15:59.963914 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3754/7399] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:59 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:00.982460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:00.983847 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:00.986968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:00.995696 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:00.996196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:00.997147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:00.997626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:01.162462 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:01.170423 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-415f7925-dd5d-4f38-97fc-130151bc8bb8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.194408 Jul 19 21:16:01.171031 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3646/7400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:00 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:02.188928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:02.189539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:02.192719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:02.198665 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:02.199113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:02.199913 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:02.200363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:02.349396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:02.357626 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a6c82253-ec7b-4e64-87a9-5a4dbda9d044 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.173048 Jul 19 21:16:02.358229 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3755/7401] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:02 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:03.088577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-7e760f37-c8b5-4f2f-b0b5-160e940b5e81 req-c782de5a-278d-49f1-96ca-cc4ae9cf6fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eccec7c8-1bba-4ee5-924b-881d12169248", "name": "network-vif-plugged", "status": "completed", "tag": "b4969dbd-5c03-4418-81be-02cfe83d74fc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:03.100121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7e760f37-c8b5-4f2f-b0b5-160e940b5e81 req-c782de5a-278d-49f1-96ca-cc4ae9cf6fd8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:03.100716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-7e760f37-c8b5-4f2f-b0b5-160e940b5e81 req-c782de5a-278d-49f1-96ca-cc4ae9cf6fd8 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:03.114443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-7e760f37-c8b5-4f2f-b0b5-160e940b5e81 req-c782de5a-278d-49f1-96ca-cc4ae9cf6fd8 service nova] Creating event network-vif-plugged:b4969dbd-5c03-4418-81be-02cfe83d74fc for instance eccec7c8-1bba-4ee5-924b-881d12169248 on n-h1-843861-3 Jul 19 21:16:03.120297 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-7e760f37-c8b5-4f2f-b0b5-160e940b5e81 req-c782de5a-278d-49f1-96ca-cc4ae9cf6fd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038080 Jul 19 21:16:03.121118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3647/7402] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:03.376262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:03.377087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:03.385550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:03.385998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:03.386790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:03.387225 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:03.716499 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:03.729095 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f8a81711-9acc-4bf2-9086-7d4b328f98af tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.356442 Jul 19 21:16:03.729745 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3756/7403] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:03 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:04.745409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=8 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:04.750769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:04.751491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:04.759076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:04.759543 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:04.760447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:04.760918 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:04.933550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:04.944902 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-024cdc68-b246-4528-a882-476c5c8eb05c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1392 microversion: 2.1 time: 0.200360 Jul 19 21:16:04.945549 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3648/7404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:04 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:05.963036 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:05.963716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:05.965924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:05.971820 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:05.972282 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:05.973093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:05.973533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:06.119797 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:06.128454 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8e7c59c-6ead-4f34-a6d6-49d2691dcac6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1565 microversion: 2.1 time: 0.169486 Jul 19 21:16:06.129122 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3757/7405] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:05 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:06.146190 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:06.146824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:06.154213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:06.154675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:06.155482 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:06.155950 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:06.312199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:06.320731 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-854c478b-11d9-4723-a575-f594ec20c661 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1565 microversion: 2.1 time: 0.178874 Jul 19 21:16:06.321342 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3649/7406] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:06 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:08.938850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:08.939766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:08.940891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-a3b741dd-624d-401a-a417-ee845f33458c req-a796e087-97ed-4247-97cb-50529a7ad01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eccec7c8-1bba-4ee5-924b-881d12169248", "tag": "b4969dbd-5c03-4418-81be-02cfe83d74fc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:08.945961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:08.948532 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:08.949000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:08.949796 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:08.950422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:08.960837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a3b741dd-624d-401a-a417-ee845f33458c req-a796e087-97ed-4247-97cb-50529a7ad01a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:08.961683 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-a3b741dd-624d-401a-a417-ee845f33458c req-a796e087-97ed-4247-97cb-50529a7ad01a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:08.985291 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-a3b741dd-624d-401a-a417-ee845f33458c req-a796e087-97ed-4247-97cb-50529a7ad01a service nova] Creating event network-changed:b4969dbd-5c03-4418-81be-02cfe83d74fc for instance eccec7c8-1bba-4ee5-924b-881d12169248 on n-h1-843861-3 Jul 19 21:16:08.995177 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-a3b741dd-624d-401a-a417-ee845f33458c req-a796e087-97ed-4247-97cb-50529a7ad01a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058670 Jul 19 21:16:08.996328 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3650/7407] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:09.233079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:09.245539 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2454cae4-4234-4ad3-9fc6-9a33faad63ab tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1565 microversion: 2.1 time: 0.311924 Jul 19 21:16:09.246547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3758/7408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:08 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1565 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:16:30.574259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:30.575081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:30.580125 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:30.581455 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:30.590062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:30.590527 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:30.591332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:30.591780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:30.649006 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bdbba82f-fb05-4a55-ab6e-add2be658d91 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action" status: 200 len: 24572 microversion: 2.1 time: 0.076430 Jul 19 21:16:30.649695 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3651/7409] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:16:30 2022] POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action => generated 24572 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 21:16:41.706533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a12b995e-40ec-4f97-962b-eaf87b55fcf6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:41.708865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:41.709523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=40 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:41.715469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a12b995e-40ec-4f97-962b-eaf87b55fcf6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:41.715942 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a12b995e-40ec-4f97-962b-eaf87b55fcf6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:41.740047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a12b995e-40ec-4f97-962b-eaf87b55fcf6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Going to try to stop instance {{(pid=126008) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 21:16:41.789507 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a12b995e-40ec-4f97-962b-eaf87b55fcf6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action" status: 202 len: 0 microversion: 2.1 time: 0.087469 Jul 19 21:16:41.790346 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3759/7410] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:16:41 2022] POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:16:41.801898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:41.802969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:41.806599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:41.807404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:41.816078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:41.816078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:41.816733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:41.817029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:41.988521 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:41.996443 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6c62845a-b2ab-4020-b306-a1618f2e4c5d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.201144 Jul 19 21:16:41.997032 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3652/7411] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:41 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:43.014845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:43.015558 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:43.023791 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:43.024269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:43.025246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:43.025583 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:43.168070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:43.176246 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f34050cd-de98-4dcd-80b5-9315d01c6179 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.165802 Jul 19 21:16:43.176841 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3760/7412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:43 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:44.199010 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:44.199691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:44.207908 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:44.208376 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:44.209179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:44.209629 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:44.397318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:44.407257 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a52eb1ab-e713-47fb-a0d3-88093f9a1180 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.212476 Jul 19 21:16:44.407929 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3653/7413] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:44 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:45.429150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:45.430012 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:45.439407 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:45.439972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:45.440765 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:45.441198 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:45.586096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:45.593748 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-42946120-669a-41ee-b785-5ad94012b7bd tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.171230 Jul 19 21:16:45.594330 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3761/7414] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:45 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:46.612275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:46.612912 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:46.621371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:46.621909 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:46.622705 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:46.623179 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:46.765080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:46.773992 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cd4a7787-4c4b-4c29-a480-b1a365a73623 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.165689 Jul 19 21:16:46.774585 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3654/7415] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:46 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:47.794420 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:47.795561 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:47.802906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:47.803366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:47.804189 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:47.804632 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:47.972355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:47.980480 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18d18af1-2c81-4207-88a3-3fbc4e4919d3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.191421 Jul 19 21:16:47.981064 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3762/7416] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:47 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:48.998512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:48.999118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:49.006181 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:49.006647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:49.007430 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:49.007903 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:49.146644 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:49.154259 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7054107-c5eb-4aeb-a425-bf75b4098b14 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.159671 Jul 19 21:16:49.154841 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3655/7417] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:48 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:50.172092 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:50.172733 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:50.180599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:50.181051 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:50.181823 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:50.182257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:50.323376 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:50.331924 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2d3d741-fd72-45e8-bf85-54f4482414ee tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.163723 Jul 19 21:16:50.332520 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3763/7418] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:50 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:51.350733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:51.351613 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:51.359001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:51.359466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:51.360391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:51.360746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:51.497805 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:51.506490 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-43ffe7b5-017f-4aab-bc59-217ffd278fc4 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.160342 Jul 19 21:16:51.507300 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3656/7419] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:51 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:52.525052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:52.525611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:52.533084 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:52.533538 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:52.534329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:52.534749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:52.698943 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:52.708114 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-638fe499-0b54-4d6c-925b-c9198a15f66b tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.187009 Jul 19 21:16:52.708713 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3764/7420] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:52 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:53.737747 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:53.739023 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:53.746934 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:53.747407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:53.748239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:53.748700 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:53.922442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:53.931403 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1e8dca6d-8139-4481-8516-a5e0041180bf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.197825 Jul 19 21:16:53.932027 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3657/7421] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:53 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:16:54.949053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:54.949674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:54.957595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:54.958043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:54.958825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:54.959258 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:55.104917 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:55.113007 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a4858ed0-1e83-4297-a046-7a77ccab4ae8 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.167746 Jul 19 21:16:55.113697 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3765/7422] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:54 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:56.130742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:56.131395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:56.138594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:56.139050 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:56.139862 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:56.140323 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:56.312078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:56.320288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83d98dca-325a-4a81-884a-a48129c15a72 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1694 microversion: 2.1 time: 0.193345 Jul 19 21:16:56.320895 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3658/7423] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:56 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:57.338471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:57.339124 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:57.347659 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:57.348292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:57.349223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:57.349716 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:57.503719 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:57.512198 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f6ea96fd-5d44-4590-b7d6-90a517f98972 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1671 microversion: 2.1 time: 0.177550 Jul 19 21:16:57.512815 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3766/7424] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:57 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:16:58.613795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:58.614765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:58.622911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.623395 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.624234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.624681 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.694047 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d118969d-e107-4030-a9a3-1c64d3ff0c12 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action" status: 200 len: 38426 microversion: 2.1 time: 0.083930 Jul 19 21:16:58.694939 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3659/7425] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:16:58 2022] POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action => generated 38426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 21:16:58.711252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70ef2f26-243c-45c5-994a-014569c248c6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:58.722328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70ef2f26-243c-45c5-994a-014569c248c6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.722760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70ef2f26-243c-45c5-994a-014569c248c6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.757089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70ef2f26-243c-45c5-994a-014569c248c6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Going to try to start instance {{(pid=126008) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 21:16:58.819228 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70ef2f26-243c-45c5-994a-014569c248c6 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action" status: 202 len: 0 microversion: 2.1 time: 0.113703 Jul 19 21:16:58.820595 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3767/7426] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:16:58 2022] POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:16:58.831664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:58.832425 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:58.847719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.848886 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.851078 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.852275 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:59.112230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:59.121164 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d54751b2-6c16-4121-bb2a-46087fba339e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1680 microversion: 2.1 time: 0.295684 Jul 19 21:16:59.122131 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3660/7427] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:58 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:17:00.141485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:00.142334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:00.148981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:00.149441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:00.150231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:00.150673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:00.340345 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:00.348954 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-80a1d903-91e5-4599-bada-ab44eefe7ae3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1684 microversion: 2.1 time: 0.212544 Jul 19 21:17:00.349557 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3768/7428] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:00 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1684 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:17:24.543755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:24.544636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:24.547230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=18 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:24.547933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=52 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:24.555177 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:24.555711 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:24.556439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:24.556881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:24.612485 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8dd2a80c-1087-41e8-a7ab-35c087876d63 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action" status: 200 len: 62986 microversion: 2.1 time: 0.072597 Jul 19 21:17:24.613179 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3661/7429] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:17:24 2022] POST /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248/action => generated 62986 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:17:31.892624 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:31.893340 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:31.895929 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=20 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:31.897404 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:31.908678 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:31.909162 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:31.910192 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:31.910849 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:31.939456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:17:31.978203 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-6b1f87df-8c6d-4580-98f1-fb4de94a3cd3 req-e5dbd8ef-2422-4b11-aaf7-f339474a403d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eccec7c8-1bba-4ee5-924b-881d12169248", "tag": "b4969dbd-5c03-4418-81be-02cfe83d74fc"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:31.988413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6b1f87df-8c6d-4580-98f1-fb4de94a3cd3 req-e5dbd8ef-2422-4b11-aaf7-f339474a403d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:31.988904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-6b1f87df-8c6d-4580-98f1-fb4de94a3cd3 req-e5dbd8ef-2422-4b11-aaf7-f339474a403d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:32.000459 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-6b1f87df-8c6d-4580-98f1-fb4de94a3cd3 req-e5dbd8ef-2422-4b11-aaf7-f339474a403d service nova] Creating event network-changed:b4969dbd-5c03-4418-81be-02cfe83d74fc for instance eccec7c8-1bba-4ee5-924b-881d12169248 on n-h1-843861-3 Jul 19 21:17:32.007074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-6b1f87df-8c6d-4580-98f1-fb4de94a3cd3 req-e5dbd8ef-2422-4b11-aaf7-f339474a403d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114951 Jul 19 21:17:32.007971 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3662/7430] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:17:32.035027 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-605d414e-26ba-4fb5-9841-408912250447 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 204 len: 0 microversion: 2.1 time: 0.146275 Jul 19 21:17:32.035951 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3769/7431] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:17:31 2022] DELETE /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:17:32.045721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:32.046634 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:32.054570 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:32.055199 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:32.056144 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:32.056703 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:32.201631 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:32.209527 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-a5c95ff0-99df-47fb-9fd0-78f47f450ed3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1690 microversion: 2.1 time: 0.168430 Jul 19 21:17:32.210157 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3663/7432] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:32 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:33.229892 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:33.230607 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:33.238221 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:33.238677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:33.239465 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:33.239940 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:33.387160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:33.395400 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a1b0cc43-efa7-45c8-a2cb-db3478dbab2e tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1690 microversion: 2.1 time: 0.170600 Jul 19 21:17:33.396077 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3770/7433] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:33 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:34.415344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:34.415985 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:34.422933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:34.423401 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:34.424217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:34.424662 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:34.646133 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:34.654843 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-12774457-06b3-4928-a26e-031251124bc0 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 200 len: 1690 microversion: 2.1 time: 0.244126 Jul 19 21:17:34.655439 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3664/7434] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:34 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 1690 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:34.803547 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-8145cb71-41d1-465d-8518-0b5760cab811 req-2862a70a-2a07-44ab-ba64-fdee0e513d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eccec7c8-1bba-4ee5-924b-881d12169248", "name": "network-vif-deleted", "tag": "b4969dbd-5c03-4418-81be-02cfe83d74fc"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:34.814691 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8145cb71-41d1-465d-8518-0b5760cab811 req-2862a70a-2a07-44ab-ba64-fdee0e513d2c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:34.815140 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-8145cb71-41d1-465d-8518-0b5760cab811 req-2862a70a-2a07-44ab-ba64-fdee0e513d2c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:34.828331 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-8145cb71-41d1-465d-8518-0b5760cab811 req-2862a70a-2a07-44ab-ba64-fdee0e513d2c service nova] Creating event network-vif-deleted:b4969dbd-5c03-4418-81be-02cfe83d74fc for instance eccec7c8-1bba-4ee5-924b-881d12169248 on n-h1-843861-3 Jul 19 21:17:34.833927 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-8145cb71-41d1-465d-8518-0b5760cab811 req-2862a70a-2a07-44ab-ba64-fdee0e513d2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Jul 19 21:17:34.835368 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3771/7435] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:35.674012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:35.674646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: eccec7c8-1bba-4ee5-924b-881d12169248] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:35.683031 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:35.683504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:35.684350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:35.684841 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:35.699932 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] HTTP exception thrown: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Request method failure captured: Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 HTTP/1.1 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1x1xeEidRTPE2l36GiZgrOxF5u67pT6s7RoGpkDCY9Po1D-tAeXQUJomAJue_jmaMCEQbTZeivXMtUBjn61oTAqznziOk1lBXC8WHAYaX9H2YbQWYABwQB0obUXK2ZVJnqvvCsP4E-bEsi9D8BO9SlIdkeVIRGS0fA9PpafvabPWyQQ Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 5e33d2517ed1482eaf37b4fb734be853 Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'eccec7c8-1bba-4ee5-924b-881d12169248'} Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:17:35.701617 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Returning 404 to user: Instance eccec7c8-1bba-4ee5-924b-881d12169248 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b9f5859-f9fc-44a3-8b13-9968aceeb355 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248" status: 404 len: 111 microversion: 2.1 time: 0.033194 Jul 19 21:17:35.711100 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3665/7436] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:35 2022] GET /compute/v2.1/servers/eccec7c8-1bba-4ee5-924b-881d12169248 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:17:38.997336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-48421faa-0b9b-436d-a3b4-39fd4a32c7b2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '.version_select at 0x7fb88cd8a700>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:39.018661 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-48421faa-0b9b-436d-a3b4-39fd4a32c7b2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1233921313" status: 202 len: 0 microversion: 2.1 time: 0.025620 Jul 19 21:17:39.019276 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3772/7437] 10.222.0.33 () {58 vars in 1283 bytes} [Tue Jul 19 21:17:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1233921313 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:17:39.053653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c743cd60-e8a9-4818-b3f2-0ce4a34f93e7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: .version_select at 0x7fb88dde0040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1274802773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmNepof1ORp4PKOahqP2qraHofvPKCFYRseikXek9J+0+zMlA6849ExJSIujVeQlOhpOovD6fv+Ab8Ve1szdUy2f4dafZv5R5J8mps2M6C2bUKmfVarP7IHxTSf7JLCxw=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:39.071447 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c743cd60-e8a9-4818-b3f2-0ce4a34f93e7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:17:39.077332 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-c743cd60-e8a9-4818-b3f2-0ce4a34f93e7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:17:39.116596 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c743cd60-e8a9-4818-b3f2-0ce4a34f93e7 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.067119 Jul 19 21:17:39.123122 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3666/7438] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:17:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:45.002939 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:45.017222 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-605898287", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "networks": [{"uuid": "cc58b2e3-6078-44e1-b3f8-7db8746338c6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1274802773", "security_groups": [{"name": "tempest-secgroup-smoke-1277179933"}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:45.171772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] validate_networks() for [('cc58b2e3-6078-44e1-b3f8-7db8746338c6', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:17:45.620817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:17:45.621155 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:17:45.621629 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:17:45.622033 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:17:45.622447 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:17:45.632303 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:45.632749 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:45.633539 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:45.633968 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:45.652224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:17:45.661904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Getting quotas for user 5e33d2517ed1482eaf37b4fb734be853 and project 6eb7cb95a71b4c68ac897018200bf901. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:17:45.681327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:17:45.683723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:17:45.741597 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d089f7f-388e-46a4-adef-491494cce036 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740217 Jul 19 21:17:45.742528 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3773/7439] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:17:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:17:45.758330 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=20 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:45.762491 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ea71ca84-a3d0-4e89-ad74-401cbea4e694 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:45.763126 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ea71ca84-a3d0-4e89-ad74-401cbea4e694 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:45.833717 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ea71ca84-a3d0-4e89-ad74-401cbea4e694 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:45.840767 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ea71ca84-a3d0-4e89-ad74-401cbea4e694 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1266 microversion: 2.1 time: 0.091614 Jul 19 21:17:45.842352 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3667/7440] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:45 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:46.866596 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:46.867776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:46.887231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:46.890118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:46.893310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:46.893771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:47.004355 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:47.016842 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-5ef76ec9-2372-4d3b-937a-719f6a80e308 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1324 microversion: 2.1 time: 0.156974 Jul 19 21:17:47.032520 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3774/7441] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:46 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:48.040616 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:48.042761 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:48.051602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:48.052173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:48.053555 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:48.054282 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:48.317216 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:48.326456 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c8cbc582-c610-4c36-80d6-3d273b77d701 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.289776 Jul 19 21:17:48.327727 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3668/7442] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:48 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:48.562367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-d2893da9-5f8b-4bda-90fe-9dd5f5b0f0b6 req-fb46042f-52e9-40f3-8000-f73084028192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a367fa-8e1a-4d6f-8333-b477bfdd71c6", "tag": "6458282a-fea7-473a-8b0f-ea3adfdc0772"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:48.580466 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d2893da9-5f8b-4bda-90fe-9dd5f5b0f0b6 req-fb46042f-52e9-40f3-8000-f73084028192 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:48.581195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-d2893da9-5f8b-4bda-90fe-9dd5f5b0f0b6 req-fb46042f-52e9-40f3-8000-f73084028192 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:48.607335 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-d2893da9-5f8b-4bda-90fe-9dd5f5b0f0b6 req-fb46042f-52e9-40f3-8000-f73084028192 service nova] Creating event network-changed:6458282a-fea7-473a-8b0f-ea3adfdc0772 for instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 on n-h1-843861-3 Jul 19 21:17:48.617021 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-d2893da9-5f8b-4bda-90fe-9dd5f5b0f0b6 req-fb46042f-52e9-40f3-8000-f73084028192 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062444 Jul 19 21:17:48.618316 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3775/7443] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:49.344708 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:49.345380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:49.353822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:49.354394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:49.355113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:49.355682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:49.494948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:49.502673 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9f35a4ca-dc45-4dcb-af6f-e4491764b674 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.162019 Jul 19 21:17:49.503250 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3669/7444] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:49 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:50.521489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:50.522149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:50.530424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:50.530870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:50.531626 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:50.532093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:50.763006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:50.771171 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e6bbf237-cd32-4ce8-bd90-91f65594f475 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.254265 Jul 19 21:17:50.771847 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3776/7445] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:50 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:51.789627 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:51.790278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:51.797391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:51.797846 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:51.798638 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:51.799086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:51.947350 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:51.955908 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-24ac4bf5-635d-49dc-af50-50ab94014911 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.170671 Jul 19 21:17:51.956621 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3670/7446] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:51 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:52.973985 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:52.974604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:52.982548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:52.982998 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:52.983769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:52.984269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:53.133673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:53.141957 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a09a8f38-6677-4bb6-89ae-80e6141a248c tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.171876 Jul 19 21:17:53.142547 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3777/7447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:52 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:53.637431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-ee16fb1b-963f-46f8-85d1-baf66b3075b4 req-4ecba4c2-8d7d-429c-92a8-cd2294cf52d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a367fa-8e1a-4d6f-8333-b477bfdd71c6", "name": "network-vif-plugged", "status": "completed", "tag": "6458282a-fea7-473a-8b0f-ea3adfdc0772"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:53.646888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ee16fb1b-963f-46f8-85d1-baf66b3075b4 req-4ecba4c2-8d7d-429c-92a8-cd2294cf52d9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:53.648019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-ee16fb1b-963f-46f8-85d1-baf66b3075b4 req-4ecba4c2-8d7d-429c-92a8-cd2294cf52d9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:53.660104 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-ee16fb1b-963f-46f8-85d1-baf66b3075b4 req-4ecba4c2-8d7d-429c-92a8-cd2294cf52d9 service nova] Creating event network-vif-plugged:6458282a-fea7-473a-8b0f-ea3adfdc0772 for instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 on n-h1-843861-3 Jul 19 21:17:53.665593 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-ee16fb1b-963f-46f8-85d1-baf66b3075b4 req-4ecba4c2-8d7d-429c-92a8-cd2294cf52d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Jul 19 21:17:53.666225 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3671/7448] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:54.160809 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:54.161431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:54.168603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:54.169054 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:54.169826 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:54.170261 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:54.311518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:54.319281 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-763572eb-c73c-40d7-87e2-84686143a610 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1392 microversion: 2.1 time: 0.163325 Jul 19 21:17:54.319889 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3778/7449] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:54 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:55.337981 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:55.338693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:55.340722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:55.346680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:55.346897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:55.347611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:55.348090 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:55.487692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:55.495884 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1b324bfc-9e27-486c-bb45-c028b46bbf6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1565 microversion: 2.1 time: 0.163025 Jul 19 21:17:55.496467 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3672/7450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:55 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:55.513144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:55.513771 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:55.521593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:55.522067 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:55.522822 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:55.523255 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:55.642195 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:55.657043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:55.665475 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-36ded4f0-7393-443f-8529-b7c89f216526 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1565 microversion: 2.1 time: 0.156343 Jul 19 21:17:55.666062 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3779/7451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:55 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:57.481633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:57.482713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:57.482986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-ecb36b47-0b48-4bfa-ab1b-d569e2eb7512 req-c87766cc-f684-4ff9-8ffa-4774e358fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a367fa-8e1a-4d6f-8333-b477bfdd71c6", "tag": "6458282a-fea7-473a-8b0f-ea3adfdc0772"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:57.486663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:57.487032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:57.495442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:57.495768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ecb36b47-0b48-4bfa-ab1b-d569e2eb7512 req-c87766cc-f684-4ff9-8ffa-4774e358fa06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:57.496200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:57.496552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-ecb36b47-0b48-4bfa-ab1b-d569e2eb7512 req-c87766cc-f684-4ff9-8ffa-4774e358fa06 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:57.497336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:57.498219 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:57.510262 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-ecb36b47-0b48-4bfa-ab1b-d569e2eb7512 req-c87766cc-f684-4ff9-8ffa-4774e358fa06 service nova] Creating event network-changed:6458282a-fea7-473a-8b0f-ea3adfdc0772 for instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 on n-h1-843861-3 Jul 19 21:17:57.516116 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-ecb36b47-0b48-4bfa-ab1b-d569e2eb7512 req-c87766cc-f684-4ff9-8ffa-4774e358fa06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037193 Jul 19 21:17:57.517159 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3780/7452] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:57.769596 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:57.784309 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5b915ec5-5d36-402f-9dd6-294485f8f4de tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1565 microversion: 2.1 time: 0.308183 Jul 19 21:17:57.786287 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3673/7453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:57 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1565 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:21.105417 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:21.106130 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:21.108673 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:21.109635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=36 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:21.119636 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:21.120134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:21.120957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:21.121392 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:21.183779 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-70238c78-cd8a-4476-8c97-b471c98a6ad1 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action" status: 200 len: 24566 microversion: 2.1 time: 0.084002 Jul 19 21:18:21.184650 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3781/7454] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:21 2022] POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action => generated 24566 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:18:32.309438 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:32.310213 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:32.312359 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:32.313151 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=32 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:32.320054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.320575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:32.321409 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.321865 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:32.349227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lazy-loading 'flavor' on Instance uuid 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:18:32.436186 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-30fa560e-0f15-4083-866b-2044b738f969 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action" status: 202 len: 0 microversion: 2.1 time: 0.131764 Jul 19 21:18:32.440099 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3674/7455] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:32 2022] POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:18:32.446941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:32.447877 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:32.452058 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:32.452897 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=4 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:32.460296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.461369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:32.462543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.462885 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:32.630735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:32.641833 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f67bac57-851e-452c-bd7b-01fa6a4deb6d tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1691 microversion: 2.1 time: 0.199437 Jul 19 21:18:32.642759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3782/7456] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:32 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:33.663584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:33.664431 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:33.672081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:33.672558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:33.673366 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:33.673824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:33.838230 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:33.848204 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-67f9c2f9-f734-4402-8bc3-ad7255c00455 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1674 microversion: 2.1 time: 0.189906 Jul 19 21:18:33.849410 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3675/7457] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:33 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:34.955628 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:34.956612 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:34.964257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:34.964703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:34.965469 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:34.965900 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:35.023533 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-8ac85cc5-f00f-4b08-b09e-6e63270c31d5 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action" status: 200 len: 38373 microversion: 2.1 time: 0.070743 Jul 19 21:18:35.024334 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3783/7458] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:34 2022] POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action => generated 38373 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:18:35.043904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:35.044970 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:35.051138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:35.051595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:35.052410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:35.052842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:35.134348 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e7b492c9-2f15-4d41-8821-7e62bede51a3 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action" status: 202 len: 0 microversion: 2.1 time: 0.099164 Jul 19 21:18:35.134348 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3676/7459] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:35 2022] POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:18:35.144324 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:35.145409 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:35.157685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:35.158327 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:35.159549 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:35.160522 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:35.438825 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:35.446701 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a2d967d0-2bac-4dc1-915f-7fc206e6aabf tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1680 microversion: 2.1 time: 0.307251 Jul 19 21:18:35.447903 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3784/7460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:35 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1680 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:36.469377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:36.470147 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:36.478904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:36.479285 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:36.480287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:36.481106 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:36.672417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:36.686279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-dba08e25-c390-4115-9b4d-88e2ebbaa531 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1680 microversion: 2.1 time: 0.222609 Jul 19 21:18:36.687187 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3677/7461] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:36 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:37.706731 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:37.707387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:37.714735 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:37.715184 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:37.716001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:37.716436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:37.868224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:37.876187 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a07be0c6-d9a1-40a9-86bf-8668ba49f9f2 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1683 microversion: 2.1 time: 0.173309 Jul 19 21:18:37.876658 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3785/7462] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:37 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:37.983946 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:37.986160 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:37.995410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:37.995951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:37.997045 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:37.997508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:38.044917 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6e5be48f-7632-4e19-9a26-da0a81f1c715 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action" status: 200 len: 38373 microversion: 2.1 time: 0.066112 Jul 19 21:18:38.045573 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3678/7463] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:37 2022] POST /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6/action => generated 38373 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:18:39.431617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:39.432171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:39.436261 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-44906607-d348-431d-bc88-e6a07cd84227 req-351ac72f-39c2-489d-977c-b494a7f21c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a367fa-8e1a-4d6f-8333-b477bfdd71c6", "tag": "6458282a-fea7-473a-8b0f-ea3adfdc0772"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:39.439396 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:39.439916 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:39.441053 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:39.441223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:39.446396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-44906607-d348-431d-bc88-e6a07cd84227 req-351ac72f-39c2-489d-977c-b494a7f21c20 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:39.446992 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-44906607-d348-431d-bc88-e6a07cd84227 req-351ac72f-39c2-489d-977c-b494a7f21c20 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:39.459648 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-44906607-d348-431d-bc88-e6a07cd84227 req-351ac72f-39c2-489d-977c-b494a7f21c20 service nova] Creating event network-changed:6458282a-fea7-473a-8b0f-ea3adfdc0772 for instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 on n-h1-843861-3 Jul 19 21:18:39.464911 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-44906607-d348-431d-bc88-e6a07cd84227 req-351ac72f-39c2-489d-977c-b494a7f21c20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033258 Jul 19 21:18:39.465954 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3679/7464] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:18:39.468399 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:18:39.573846 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3a95d6d9-b8eb-4d9d-9f4f-d0c693628102 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 204 len: 0 microversion: 2.1 time: 0.146060 Jul 19 21:18:39.575339 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3786/7465] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:18:39 2022] DELETE /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:18:39.588561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:39.589834 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:39.597390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:39.598112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:39.598784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:39.599655 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:39.773259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:39.782713 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee1a3abc-2fba-4d20-aca3-2a71fec2e630 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1689 microversion: 2.1 time: 0.199361 Jul 19 21:18:39.783762 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3680/7466] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:39 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:40.801227 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:40.801855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:40.809563 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:40.810023 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:40.810832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:40.811251 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:40.953395 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:40.961154 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9d42870-bad1-4d77-ac9d-bbbea3689a28 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1689 microversion: 2.1 time: 0.164303 Jul 19 21:18:40.961741 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3787/7467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:40 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:41.979157 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:41.979842 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:41.987318 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:41.987888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:41.988685 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:41.989139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:41.999521 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a8cda5f9-df40-4dac-8112-c22f5bba94d4 req-c6c05643-4b61-4885-8c83-1f9d36395cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a367fa-8e1a-4d6f-8333-b477bfdd71c6", "name": "network-vif-deleted", "tag": "6458282a-fea7-473a-8b0f-ea3adfdc0772"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:42.010231 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a8cda5f9-df40-4dac-8112-c22f5bba94d4 req-c6c05643-4b61-4885-8c83-1f9d36395cf7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:42.010681 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a8cda5f9-df40-4dac-8112-c22f5bba94d4 req-c6c05643-4b61-4885-8c83-1f9d36395cf7 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:42.022787 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a8cda5f9-df40-4dac-8112-c22f5bba94d4 req-c6c05643-4b61-4885-8c83-1f9d36395cf7 service nova] Creating event network-vif-deleted:6458282a-fea7-473a-8b0f-ea3adfdc0772 for instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 on n-h1-843861-3 Jul 19 21:18:42.032798 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a8cda5f9-df40-4dac-8112-c22f5bba94d4 req-c6c05643-4b61-4885-8c83-1f9d36395cf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037072 Jul 19 21:18:42.033972 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3788/7468] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:18:42.059331 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e33d2517ed1482eaf37b4fb734be853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb7cb95a71b4c68ac897018200bf901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:42.068481 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0ac294d7-0232-4a6c-91cc-fa62df9d5028 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 200 len: 1503 microversion: 2.1 time: 0.093633 Jul 19 21:18:42.069453 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3681/7469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:41 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 1503 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:43.089973 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:43.090698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] [instance: 41a367fa-8e1a-4d6f-8333-b477bfdd71c6] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:43.097747 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:43.098320 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:43.099123 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:43.099569 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:43.118602 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] HTTP exception thrown: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Request method failure captured: Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 HTTP/1.1 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1x1xeEidRTPE2l36GiZgrOxF5u67pT6s7RoGpkDCY9Po1D-tAeXQUJomAJue_jmaMCEQbTZeivXMtUBjn61oTAqznziOk1lBXC8WHAYaX9H2YbQWYABwQB0obUXK2ZVJnqvvCsP4E-bEsi9D8BO9SlIdkeVIRGS0fA9PpafvabPWyQQ Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6eb7cb95a71b4c68ac897018200bf901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: 6eb7cb95a71b4c68ac897018200bf901 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103005821 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 5e33d2517ed1482eaf37b4fb734be853 Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103005821-project Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '41a367fa-8e1a-4d6f-8333-b477bfdd71c6'} Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:18:43.120354 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Returning 404 to user: Instance 41a367fa-8e1a-4d6f-8333-b477bfdd71c6 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a0fadedc-dbb6-4d30-96d3-a53ad2ef8199 tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6" status: 404 len: 111 microversion: 2.1 time: 0.038047 Jul 19 21:18:43.125938 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3789/7470] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:43 2022] GET /compute/v2.1/servers/41a367fa-8e1a-4d6f-8333-b477bfdd71c6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:18:46.747682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0bb83f52-17b9-4681-a757-5a5987af363a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] Calling method '.version_select at 0x7fb88cc3cd30>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:46.768467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0bb83f52-17b9-4681-a757-5a5987af363a tempest-TestNetworkAdvancedServerOps-103005821 tempest-TestNetworkAdvancedServerOps-103005821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1274802773" status: 202 len: 0 microversion: 2.1 time: 0.024726 Jul 19 21:18:46.768852 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3682/7471] 10.222.0.33 () {58 vars in 1283 bytes} [Tue Jul 19 21:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1274802773 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:18:47.706594 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:18:47.707098 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:18:58.872714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:58.873578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:59.067089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-716467c9-f374-4bf5-ad1d-a469a33cf7cf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'create', calling method: .version_select at 0x7fb893038160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1426675775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCqOC70Hkn2/pbGV21OiME/H1i95bWoTzSiVdQP+3DrXmdqvA96uNj8puoUqOfUrw6eUp4MIm0eYfhIPwkzMOwk33Yu71ydBsCloX5S0/nOFPbyAp6Iq8rhT3fY6R2HLw=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:59.084928 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-716467c9-f374-4bf5-ad1d-a469a33cf7cf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:18:59.090828 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-716467c9-f374-4bf5-ad1d-a469a33cf7cf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for user b6d59d30c26144df94f2bfdbe401defe and project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:18:59.121055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-716467c9-f374-4bf5-ad1d-a469a33cf7cf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.256335 Jul 19 21:18:59.121822 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3790/7472] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:18:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:19:00.295897 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:00.297456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:00.302849 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1098844506", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1426675775", "security_groups": [{"name": "tempest-secgroup-smoke-1087155150"}], "networks": [{"uuid": "c033e6a1-c876-4f6d-a497-2927f22cb0ec"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:00.452984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] validate_networks() for [('c033e6a1-c876-4f6d-a497-2927f22cb0ec', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:19:00.987263 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:19:00.987699 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:19:00.988387 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:19:00.988812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:19:00.989234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:19:00.999146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:00.999524 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:01.000413 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:01.000854 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:01.023663 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:19:01.029399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for user b6d59d30c26144df94f2bfdbe401defe and project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:19:01.041921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:19:01.044253 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:19:01.093489 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-58671614-7275-4e66-80dd-8b10136355c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799165 Jul 19 21:19:01.094142 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3683/7473] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:19:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:19:01.105906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9ced7439-6326-42f2-b1d5-9aaa25931829 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:01.106827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9ced7439-6326-42f2-b1d5-9aaa25931829 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:01.164672 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9ced7439-6326-42f2-b1d5-9aaa25931829 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:01.171918 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9ced7439-6326-42f2-b1d5-9aaa25931829 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1247 microversion: 2.1 time: 0.071091 Jul 19 21:19:01.172535 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3791/7474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:01 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:02.192807 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:02.193481 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:02.203226 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:02.203768 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:02.204604 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:02.205058 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:02.369348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:02.385144 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-406dcd4c-4a0d-40ef-9df5-65a38c6a4325 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1307 microversion: 2.1 time: 0.198072 Jul 19 21:19:02.386555 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3684/7475] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:02 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:19:03.418838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:03.420099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:03.448422 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:03.450160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:03.450671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:03.451480 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:03.679460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:03.690197 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d49d242b-b884-46af-a1db-81dd278a3ba4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.279778 Jul 19 21:19:03.690925 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3792/7476] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:03 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:04.456635 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bb23e8fa-749b-44d2-ba81-f5a4eddc7e67 req-35d831cb-cb84-4927-8487-a1c936dd7771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:04.475828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bb23e8fa-749b-44d2-ba81-f5a4eddc7e67 req-35d831cb-cb84-4927-8487-a1c936dd7771 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:04.480328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bb23e8fa-749b-44d2-ba81-f5a4eddc7e67 req-35d831cb-cb84-4927-8487-a1c936dd7771 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:04.512499 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bb23e8fa-749b-44d2-ba81-f5a4eddc7e67 req-35d831cb-cb84-4927-8487-a1c936dd7771 service nova] Creating event network-changed:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h2-843861-3 Jul 19 21:19:04.519755 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bb23e8fa-749b-44d2-ba81-f5a4eddc7e67 req-35d831cb-cb84-4927-8487-a1c936dd7771 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206579 Jul 19 21:19:04.521200 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3685/7477] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:19:04.713089 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:04.713801 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:04.725713 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:04.726171 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:04.727237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:04.727714 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:04.949550 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:04.958033 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-9745044d-9498-4118-9dc3-58545a527ca5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.253826 Jul 19 21:19:04.958641 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3793/7478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:04 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:05.977278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:05.978020 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:05.984434 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:05.984899 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:05.985675 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:05.986122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:06.122930 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:06.130511 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-13d7c85b-51ff-4971-82ae-04b62c69bd5e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.158637 Jul 19 21:19:06.131717 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3686/7479] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:05 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:07.148981 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:07.150017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:07.158997 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:07.159582 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:07.160938 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:07.161674 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:07.316668 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:07.325353 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6979434f-52b9-4922-b333-3c949148a438 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.181008 Jul 19 21:19:07.325963 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3794/7480] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:07 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:08.345755 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:08.346382 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:08.353653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:08.354193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:08.355000 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:08.355502 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:08.494258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:08.502000 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7d357210-ae5b-4f64-adae-60b39d91a246 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.160146 Jul 19 21:19:08.502586 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3687/7481] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:08 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:19:09.519795 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:09.520410 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:09.527625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:09.528122 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:09.528904 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:09.529342 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:09.664329 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:09.672069 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d29a06e1-bd94-48e9-875a-9a2b296c9ba6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.157261 Jul 19 21:19:09.672679 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3795/7482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:09 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:10.689465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:10.690173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:10.698563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:10.698933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:10.699739 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:10.700224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:10.838734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:10.846240 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c55a7ff8-d81f-4f7a-ac58-b63ea229e19b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.161036 Jul 19 21:19:10.846854 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3688/7483] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:10 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:19:11.004870 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f6b73b40-5c28-47b5-9d44-0b6093106d61 req-48db30fa-776a-4499-923b-3edc80896a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "name": "network-vif-plugged", "status": "completed", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:11.019015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f6b73b40-5c28-47b5-9d44-0b6093106d61 req-48db30fa-776a-4499-923b-3edc80896a24 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:11.019015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f6b73b40-5c28-47b5-9d44-0b6093106d61 req-48db30fa-776a-4499-923b-3edc80896a24 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:11.030810 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f6b73b40-5c28-47b5-9d44-0b6093106d61 req-48db30fa-776a-4499-923b-3edc80896a24 service nova] Creating event network-vif-plugged:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h2-843861-3 Jul 19 21:19:11.036063 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f6b73b40-5c28-47b5-9d44-0b6093106d61 req-48db30fa-776a-4499-923b-3edc80896a24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114306 Jul 19 21:19:11.036706 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3796/7484] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:19:11.863296 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:11.863966 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:11.867006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:11.867435 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:11.875297 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:11.875773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:11.876633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:11.877086 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:12.033945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:12.044864 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8397abf1-4e7c-4467-8cfb-6e67881e5247 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1373 microversion: 2.1 time: 0.184765 Jul 19 21:19:12.045691 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3689/7485] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:11 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:13.063910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:13.064633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:13.066768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:13.073625 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:13.074434 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:13.075552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:13.076069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:13.247969 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:13.258380 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6a6a0552-d51c-443f-9568-1bfe30355717 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1557 microversion: 2.1 time: 0.198860 Jul 19 21:19:13.258988 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3797/7486] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:13 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:13.275299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:13.276210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:13.283456 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:13.283947 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:13.284779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:13.285210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:13.428375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:13.438279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e8b58515-8f71-43d0-946e-84026be423d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1557 microversion: 2.1 time: 0.167513 Jul 19 21:19:13.438886 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3690/7487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:13 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:15.969160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-99f91f17-aa4e-4483-a9e0-afcf8608309a req-e4bc63dd-a13e-49a4-81aa-e9c8cb0ed27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:15.979436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-99f91f17-aa4e-4483-a9e0-afcf8608309a req-e4bc63dd-a13e-49a4-81aa-e9c8cb0ed27c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:15.979914 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-99f91f17-aa4e-4483-a9e0-afcf8608309a req-e4bc63dd-a13e-49a4-81aa-e9c8cb0ed27c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:15.992803 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-99f91f17-aa4e-4483-a9e0-afcf8608309a req-e4bc63dd-a13e-49a4-81aa-e9c8cb0ed27c service nova] Creating event network-changed:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h2-843861-3 Jul 19 21:19:15.997799 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-99f91f17-aa4e-4483-a9e0-afcf8608309a req-e4bc63dd-a13e-49a4-81aa-e9c8cb0ed27c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Jul 19 21:19:15.998407 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3798/7488] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:41.108965 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:21:41.110138 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:21:41.110742 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:41.111507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=40 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:41.115658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:41.116234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:41.123948 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:41.124414 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:41.125200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:41.125657 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:41.150062 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.objects.instance [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lazy-loading 'flavor' on Instance uuid 03280d30-b046-43e1-aa79-51f6e458f3d2 {{(pid=126007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:21:41.553595 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-05a96538-c5dc-43af-8cf3-c6d17f72bcd6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.446165 Jul 19 21:21:41.554280 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3691/7489] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:21:41 2022] POST /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:21:41.562764 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:21:41.564048 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:21:41.564787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:41.565599 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:41.571471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:41.572430 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:41.582615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:41.583150 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:41.584026 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:41.584535 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:41.786906 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:41.794744 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-44de384a-fd21-4db4-b97b-b6a5167d6e0a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.234161 Jul 19 21:21:41.795335 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3799/7490] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:41 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:42.815855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:42.816584 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:42.826454 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:42.826919 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:42.827721 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:42.828197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:42.835798 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36728. Jul 19 21:21:42.836584 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36726. Jul 19 21:21:42.984799 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:42.993179 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8fcd8bbd-68cc-4e34-a6a1-fcaefdf96287 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.183282 Jul 19 21:21:42.993788 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3692/7491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:42 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:44.014108 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:44.014888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:44.027650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:44.028138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:44.028924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:44.029366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:44.033616 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36732. Jul 19 21:21:44.034344 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36734. Jul 19 21:21:44.178230 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:44.188506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d9b691b8-3542-415c-9943-4fbdcf9dd5c9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.179623 Jul 19 21:21:44.189104 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3800/7492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:44 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:45.206486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:45.207247 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:45.214737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:45.215713 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:45.216561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:45.217012 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:45.375906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:45.383376 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9701d18e-3d65-45eb-a5d7-bbb7379e9461 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.181099 Jul 19 21:21:45.383969 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3693/7493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:45 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:46.400641 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:46.401266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:46.408817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:46.409264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:46.410045 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:46.410473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:46.566106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:46.574059 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-21205052-9107-4241-952d-16aed6b8af4b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.177279 Jul 19 21:21:46.574723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3801/7494] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:46 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:47.591822 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:47.592465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:47.599694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:47.600458 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:47.601239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:47.601687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:47.739223 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:47.747534 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8007c316-2146-4f17-bb73-118ecf164e6e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.159687 Jul 19 21:21:47.748164 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3694/7495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:47 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:48.765334 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:48.765895 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:48.773800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:48.774249 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:48.775020 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:48.775442 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:49.218400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:49.228628 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4613cba7-a7c9-46f4-9dab-7dc304720e62 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.467550 Jul 19 21:21:49.229284 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3802/7496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:48 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:50.246169 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:50.246827 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:50.254516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:50.254987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:50.255777 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:50.256260 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:50.396224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:50.403779 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-241ebd3d-2919-42a3-8f59-04d3d22cdad8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.161516 Jul 19 21:21:50.404389 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3695/7497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:50 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:51.421768 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:51.422368 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:51.429338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:51.429786 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:51.430552 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:51.430984 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:51.572888 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:51.589772 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-dbd23afe-dbe1-4994-b648-c6e3560263cc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.172437 Jul 19 21:21:51.590406 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3803/7498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:51 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:52.608845 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:52.609497 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:52.616731 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:52.617189 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:52.617951 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:52.618398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:52.757037 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:52.765082 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-0b176838-b96b-4162-bf2b-2fdb1e1158b4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.160384 Jul 19 21:21:52.765693 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3696/7499] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:52 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:53.782808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:53.783363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:53.791138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:53.791588 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:53.792403 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:53.792868 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:53.933170 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:53.941487 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0e30cd55-ddb6-4968-a335-05ff5c4dab5f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1703 microversion: 2.1 time: 0.162775 Jul 19 21:21:53.942082 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3804/7500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:53 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1703 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:54.958620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:54.959311 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:54.966824 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:54.967299 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:54.968138 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:54.968597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:55.120113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:55.129434 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fd958b7f-58ee-4775-b0b7-e5d4a42728be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1703 microversion: 2.1 time: 0.174606 Jul 19 21:21:55.130028 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3697/7501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:54 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1703 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:56.147015 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:56.147761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:56.155834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:56.156289 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:56.157078 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:56.157514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:56.299158 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:56.307136 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-413708fd-0b88-49aa-a2e9-c39f1da132fc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1703 microversion: 2.1 time: 0.164455 Jul 19 21:21:56.307743 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3805/7502] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:56 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1703 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:57.324504 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:57.325139 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:57.332465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:57.332933 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:57.333781 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:57.334516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:57.486119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:57.494831 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-901e9771-3d6e-45a8-b59c-ccc612fe9731 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1703 microversion: 2.1 time: 0.174294 Jul 19 21:21:57.495428 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3698/7503] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:57 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1703 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:57.769172 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-71f3e067-c661-4354-bd1a-4bc5cd00af8d req-a134e787-0c0d-482c-bac0-51d1795c9430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "name": "network-vif-plugged", "status": "completed", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:57.782566 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-71f3e067-c661-4354-bd1a-4bc5cd00af8d req-a134e787-0c0d-482c-bac0-51d1795c9430 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:57.783022 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-71f3e067-c661-4354-bd1a-4bc5cd00af8d req-a134e787-0c0d-482c-bac0-51d1795c9430 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:57.799324 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-71f3e067-c661-4354-bd1a-4bc5cd00af8d req-a134e787-0c0d-482c-bac0-51d1795c9430 service nova] Creating event network-vif-plugged:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h2-843861-3 Jul 19 21:21:57.805870 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-71f3e067-c661-4354-bd1a-4bc5cd00af8d req-a134e787-0c0d-482c-bac0-51d1795c9430 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040763 Jul 19 21:21:57.807633 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3806/7504] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:58.512585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:58.513334 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:58.520648 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:58.521463 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:58.522552 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:58.522971 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:58.680832 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:58.690049 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-cf43cfc2-fbad-44c2-a24b-9a1cb8fc5849 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.181312 Jul 19 21:21:58.701617 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3699/7505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:58 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:59.710436 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:59.711135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:59.718043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:59.718577 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:59.719418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:59.720025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:59.893770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:59.904892 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-57babe8c-a57d-440d-ad5a-b3b4b1412a51 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.199530 Jul 19 21:21:59.905934 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3807/7506] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:59 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:00.923457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:00.924217 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:00.936890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:00.938115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:00.939208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:00.939733 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:01.091958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:01.102167 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-56ecdfd3-d8a8-4d15-bfc6-2a343913a28a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.183480 Jul 19 21:22:01.113223 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3700/7507] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:00 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:02.121274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:02.122871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:02.130676 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:02.131224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:02.132114 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:02.132932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:02.293307 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:02.301611 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3a4eec5-4b5b-4e9a-82aa-fd1f859c4848 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.184283 Jul 19 21:22:02.302397 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3808/7508] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:02 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:22:03.318825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:03.320287 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:03.327893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:03.328693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:03.329449 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:03.330029 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:03.493547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:03.501721 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-83f6c101-68a3-4ae9-a75e-324eb3c7438e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.186809 Jul 19 21:22:03.507941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3701/7509] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:03 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:04.521061 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:04.522295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:04.532467 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:04.533483 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:04.534494 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:04.535121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:04.689489 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:04.697832 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7f61ae65-e4d4-4e90-be65-dbe466c7f127 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.183081 Jul 19 21:22:04.698430 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3809/7510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:04 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:05.715286 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:05.716165 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:05.724868 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:05.725693 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:05.726600 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:05.727192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:05.897690 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:05.912103 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4de4cca5-3667-44f3-affd-2360fb500b27 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.200799 Jul 19 21:22:05.913072 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3702/7511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:05 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:06.930528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:06.931250 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:06.939202 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:06.939759 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:06.940635 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:06.941144 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:07.098495 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:07.107173 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-18e0ad5d-ee15-41e0-9ecf-66fd0a46589c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1698 microversion: 2.1 time: 0.180571 Jul 19 21:22:07.112427 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3810/7512] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:06 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:07.717014 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:22:07.717631 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:22:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:22:08.126437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:08.127224 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:08.135836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:08.137313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:08.138377 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:08.138893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:08.287245 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:08.296288 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f7eb6edf-5447-47b1-b5ca-f084218b5b60 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1680 microversion: 2.1 time: 0.174079 Jul 19 21:22:08.296874 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3703/7513] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:08 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:09.314774 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:09.315419 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:09.322548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:09.323006 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:09.323776 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:09.324908 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:09.467962 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:09.476506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c581e07d-5189-4dfb-a697-3b9b0f21355d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1680 microversion: 2.1 time: 0.165511 Jul 19 21:22:09.477026 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3811/7514] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:09 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:10.493921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:10.494550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:10.502017 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.502483 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.503264 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.503716 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.637399 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:10.645349 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9c2f170b-d613-4de5-aca5-df57818b6f91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1683 microversion: 2.1 time: 0.155274 Jul 19 21:22:10.645941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3704/7515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:10 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:22:10.662743 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:22:10.663299 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:10.670496 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.670958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.671758 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.672233 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.811823 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f57e0f5a-94cd-4c4c-ada4-badb9001ec45 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.153198 Jul 19 21:22:10.812471 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3812/7516] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:22:10 2022] POST /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:22:10.820725 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:10.821352 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:10.827351 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.827830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.828628 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:10.829120 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:10.850473 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:22:10.978575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:10.987219 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-698ea12c-49e5-4aba-a37b-48244b34da10 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1631 microversion: 2.1 time: 0.170428 Jul 19 21:22:10.987961 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3705/7517] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:10 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1631 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:11.841955 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-23c59b6f-dec2-487e-8843-8d396dbce8ae req-12bb51dd-f52e-4953-996a-807517cbb6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "name": "network-vif-unplugged", "status": "completed", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:22:11.845648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=31 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:22:11.852909 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23c59b6f-dec2-487e-8843-8d396dbce8ae req-12bb51dd-f52e-4953-996a-807517cbb6af service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:11.853615 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-23c59b6f-dec2-487e-8843-8d396dbce8ae req-12bb51dd-f52e-4953-996a-807517cbb6af service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:11.864111 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:22:11.866814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-23c59b6f-dec2-487e-8843-8d396dbce8ae req-12bb51dd-f52e-4953-996a-807517cbb6af service nova] Creating event network-vif-unplugged:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h1-843861-3 Jul 19 21:22:11.875089 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-23c59b6f-dec2-487e-8843-8d396dbce8ae req-12bb51dd-f52e-4953-996a-807517cbb6af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038164 Jul 19 21:22:11.875704 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3813/7518] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:22:12.006658 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:12.007339 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:12.010081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=31 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:22:12.017614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:12.018372 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:12.019327 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:12.019780 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:12.200575 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:12.208778 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-956e35a0-9f3d-4468-bcaa-7b24c11d5f7c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.205936 Jul 19 21:22:12.209569 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3706/7519] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:12 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:13.061568 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-4de4bcf2-4f56-4915-a6ad-c7c0be23e127 req-97ce16cd-2004-4004-8d5b-4081209de502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:22:13.074831 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4de4bcf2-4f56-4915-a6ad-c7c0be23e127 req-97ce16cd-2004-4004-8d5b-4081209de502 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:13.075274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-4de4bcf2-4f56-4915-a6ad-c7c0be23e127 req-97ce16cd-2004-4004-8d5b-4081209de502 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:13.089820 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-4de4bcf2-4f56-4915-a6ad-c7c0be23e127 req-97ce16cd-2004-4004-8d5b-4081209de502 service nova] Creating event network-changed:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h1-843861-3 Jul 19 21:22:13.097055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-4de4bcf2-4f56-4915-a6ad-c7c0be23e127 req-97ce16cd-2004-4004-8d5b-4081209de502 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043200 Jul 19 21:22:13.097693 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3814/7520] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:22:13.227304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:13.227969 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:13.234695 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:13.235167 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:13.236001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:13.236466 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:13.446083 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:13.454791 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ccbbbacf-2e05-4b76-903e-938a66203d74 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.231634 Jul 19 21:22:13.455411 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3707/7521] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:13 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:14.474149 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:14.476001 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:14.483890 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:14.484838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:14.485910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:14.486450 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:14.640082 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:14.648015 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-04ece00e-5415-44f0-a9f5-0f8d4d96da91 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.179545 Jul 19 21:22:14.648853 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3815/7522] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:14 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:15.666900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:15.668262 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:15.679371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:15.680044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:15.680902 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:15.681389 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:15.841528 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:15.853846 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7f5b517b-326d-4402-8144-6e944f9edda1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.190704 Jul 19 21:22:15.857750 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3708/7523] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:15 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:22:16.873460 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:16.874128 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:16.881682 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:16.882433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:16.883441 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:16.883910 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:17.050578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:17.059827 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-26badf75-ac0b-43a3-8f7e-ca6b101f53dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.190828 Jul 19 21:22:17.060807 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3816/7524] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:16 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:18.077994 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:18.078928 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:18.087499 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:18.088141 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:18.088967 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:18.089429 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:18.285385 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:18.294613 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b3c2560e-d44c-448a-a3e3-861a3b55ebdd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.221859 Jul 19 21:22:18.317502 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3709/7525] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:18 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:18.518151 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:22:18.519150 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:22:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:22:19.329356 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:19.329986 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:19.337389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:19.337838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:19.338620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:19.339055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:19.488135 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:19.496883 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-db253ff1-97ac-4683-9973-9354e732bba0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.171560 Jul 19 21:22:19.499131 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3817/7526] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:19 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:20.515533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:20.516122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:20.523602 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:20.524087 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:20.524878 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:20.525320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:20.668367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:20.676588 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-61b34f8b-a362-46b5-bbca-debac984ad30 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.165413 Jul 19 21:22:20.683869 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3710/7527] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:20 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:21.694692 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:21.695519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:21.707350 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:21.708069 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:21.709367 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:21.720002 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:21.871463 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:21.879349 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-666bce8c-faba-4fb6-a218-03b3d64a74c7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.188843 Jul 19 21:22:21.880041 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3818/7528] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:21 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:22.897664 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:22.898317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:22.906507 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:22.906975 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:22.907754 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:22.908238 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:23.067614 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:23.075910 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9a4e50f6-57cd-4a49-a8aa-887e8abe6aae tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.182236 Jul 19 21:22:23.076516 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3711/7529] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:22 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:24.095511 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:24.096332 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:24.104847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:24.105881 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:24.106687 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:24.107112 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:24.250252 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:24.258650 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e033743c-0f47-4890-8acd-2f456708e89c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.168968 Jul 19 21:22:24.259274 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3819/7530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:24 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:25.278038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:25.278647 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:25.285817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:25.286280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:25.287064 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:25.287508 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:25.441347 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:25.449937 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-68e47578-d3e4-4fde-ac5f-c585d6f5b2ec tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.175867 Jul 19 21:22:25.450542 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3712/7531] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:25 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:26.467142 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:26.467752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:26.475106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:26.475519 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:26.476325 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:26.476761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:26.611775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:26.619440 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-279e466d-4728-4d70-a5c9-c698e7b505bc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.156250 Jul 19 21:22:26.620057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3820/7532] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:26 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:26.868097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-efbb6940-89be-4a36-a7f0-ecabc91b0995 req-4ad03695-564e-453d-8dfe-4a0bff47f1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "name": "network-vif-plugged", "status": "completed", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:22:26.878791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-efbb6940-89be-4a36-a7f0-ecabc91b0995 req-4ad03695-564e-453d-8dfe-4a0bff47f1aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:26.879248 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-efbb6940-89be-4a36-a7f0-ecabc91b0995 req-4ad03695-564e-453d-8dfe-4a0bff47f1aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:26.891449 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-efbb6940-89be-4a36-a7f0-ecabc91b0995 req-4ad03695-564e-453d-8dfe-4a0bff47f1aa service nova] Creating event network-vif-plugged:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h1-843861-3 Jul 19 21:22:26.896681 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-efbb6940-89be-4a36-a7f0-ecabc91b0995 req-4ad03695-564e-453d-8dfe-4a0bff47f1aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Jul 19 21:22:26.897374 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3713/7533] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:22:27.638160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:27.638787 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:27.646256 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:27.646708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:27.647484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:27.647954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:27.782049 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:27.790037 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-df7679ba-b42e-49b8-aca6-cf7f09a9f2b6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1689 microversion: 2.1 time: 0.156289 Jul 19 21:22:27.790621 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3821/7534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:27 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:22:28.808855 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:22:28.809574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:22:28.815973 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:28.816437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:28.817214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:22:28.817691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:22:28.955061 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:22:28.962742 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c42af463-1069-4084-9245-56d703d1047b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1676 microversion: 2.1 time: 0.159711 Jul 19 21:22:28.963324 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3714/7535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:22:28 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:23:43.406034 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=17 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:23:43.406790 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=45 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:23:43.411456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:43.411890 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-b0f1d99b-7ecf-4370-9f0e-c314912f4b22 req-3a89e2f1-41bf-4181-b06e-2b9982c7072e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:23:43.412330 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:23:43.416271 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=17 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:23:43.417215 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=52 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:23:43.423313 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b0f1d99b-7ecf-4370-9f0e-c314912f4b22 req-3a89e2f1-41bf-4181-b06e-2b9982c7072e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:43.423771 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-b0f1d99b-7ecf-4370-9f0e-c314912f4b22 req-3a89e2f1-41bf-4181-b06e-2b9982c7072e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:43.432437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:43.433013 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:43.434060 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:43.435168 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:43.435303 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-b0f1d99b-7ecf-4370-9f0e-c314912f4b22 req-3a89e2f1-41bf-4181-b06e-2b9982c7072e service nova] Creating event network-changed:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h1-843861-3 Jul 19 21:23:43.441041 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-b0f1d99b-7ecf-4370-9f0e-c314912f4b22 req-3a89e2f1-41bf-4181-b06e-2b9982c7072e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034550 Jul 19 21:23:43.442005 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3715/7536] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:23:43.463503 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:23:43.543506 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f04e82c8-e9f7-4913-bcdf-78e4e72a026e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 204 len: 0 microversion: 2.1 time: 0.139135 Jul 19 21:23:43.544135 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3822/7537] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:23:43 2022] DELETE /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:23:43.553033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:43.553748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:23:43.560910 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:43.561371 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:43.562646 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:43.563112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:43.714906 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:23:43.722620 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-663915a2-b73b-47df-bcda-bee90774b15e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.173809 Jul 19 21:23:43.723303 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3716/7538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:23:43 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:23:44.741390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:44.742097 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:23:44.748543 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:44.748990 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:44.749756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:44.750179 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:44.964876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:23:44.973440 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-821d7bf2-de48-4d89-86f1-55a1928308db tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1682 microversion: 2.1 time: 0.236299 Jul 19 21:23:44.974030 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3823/7539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:23:44 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:23:45.710439 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-bbf840c1-e5b2-474c-97a1-bcbb37c30011 req-f3f396fc-01b5-4784-a676-d908e844bd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03280d30-b046-43e1-aa79-51f6e458f3d2", "name": "network-vif-deleted", "tag": "ef0eafec-e2ae-447e-a90c-bc3554780a96"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:23:45.719421 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bbf840c1-e5b2-474c-97a1-bcbb37c30011 req-f3f396fc-01b5-4784-a676-d908e844bd0b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:45.719921 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-bbf840c1-e5b2-474c-97a1-bcbb37c30011 req-f3f396fc-01b5-4784-a676-d908e844bd0b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:45.732355 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-bbf840c1-e5b2-474c-97a1-bcbb37c30011 req-f3f396fc-01b5-4784-a676-d908e844bd0b service nova] Creating event network-vif-deleted:ef0eafec-e2ae-447e-a90c-bc3554780a96 for instance 03280d30-b046-43e1-aa79-51f6e458f3d2 on n-h1-843861-3 Jul 19 21:23:45.737647 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-bbf840c1-e5b2-474c-97a1-bcbb37c30011 req-f3f396fc-01b5-4784-a676-d908e844bd0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090988 Jul 19 21:23:45.738268 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3717/7540] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:23:45.990860 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:45.991433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:23:45.999125 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:45.999468 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:46.000425 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:46.001101 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:46.043833 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:46.044311 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:46.044723 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lazy-loading 'fault' on Instance uuid 03280d30-b046-43e1-aa79-51f6e458f3d2 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:23:46.090847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:23:46.099991 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a96e63aa-3f5f-482e-99fd-77d6dd8ce144 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 200 len: 1337 microversion: 2.1 time: 0.112929 Jul 19 21:23:46.100474 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3824/7541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:23:45 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:23:47.118900 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:47.119621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: 03280d30-b046-43e1-aa79-51f6e458f3d2] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:23:47.126101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:47.126574 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:47.127367 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:23:47.127833 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:23:47.141341 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] HTTP exception thrown: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Request method failure captured: Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 HTTP/1.1 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1x-9GWHvqDQQ1SmquXrKlo90d_UgJbjL_TWHUulGtaCBM8sbffF0Q8lo9VrsQRttqlRxH8vBt5o9MwYojFm0vLzSXz1S5hb95gNAR5P0NfyAir-0CjVbV6TfgyJ2N8CkVnYU-sUIqmFj1ys0GYbwdrUJnbmUFfcMWn9qfFCNyPdwpQw Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: c645dda219114dfeb2ae7ee96d46b3f0 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestShelveInstance-1284980786 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestShelveInstance-1284980786 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: c645dda219114dfeb2ae7ee96d46b3f0 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestShelveInstance-1284980786 Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestShelveInstance-1284980786-project Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: b6d59d30c26144df94f2bfdbe401defe Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestShelveInstance-1284980786-project Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': '03280d30-b046-43e1-aa79-51f6e458f3d2'} Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:23:47.142998 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Returning 404 to user: Instance 03280d30-b046-43e1-aa79-51f6e458f3d2 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ee73fed8-a8dd-4002-9b6f-226130e4d90c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jul 19 21:23:47.147941 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3718/7542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:23:47 2022] GET /compute/v2.1/servers/03280d30-b046-43e1-aa79-51f6e458f3d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:23:47.320381 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-07486515-7f51-4bb2-aebc-73f9c799e7e9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '.version_select at 0x7fb88d5cb280>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:23:47.356039 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-07486515-7f51-4bb2-aebc-73f9c799e7e9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1426675775" status: 202 len: 0 microversion: 2.1 time: 0.039438 Jul 19 21:23:47.357339 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3825/7543] 10.222.0.33 () {58 vars in 1253 bytes} [Tue Jul 19 21:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1426675775 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:23:47.383036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'create', calling method: .version_select at 0x7fb88c1420d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-73636697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAEnn4ap0XnpHsfWITRiV9roI2EK+zb8Dkke9THjyWnbjJRHz6oGCgMIQHqre5zVHZ3n2jfho1cPjNgKoU6Ww5qjC+cwuz640T3EFnniJRTTBKG9bPGobsBeScBuSG+Nw=="}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:23:47.397606 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:23:47.403563 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for user b6d59d30c26144df94f2bfdbe401defe and project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'key_pairs'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:23:47.417719 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [dbf8f886-7624-4691-b268-89030d3eedc0] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:23:48.425475 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [dbf8f886-7624-4691-b268-89030d3eedc0] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37014. Jul 19 21:23:48.442832 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-39a23e12-5abe-48ab-bec0-79926d11152c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 1.063895 Jul 19 21:23:48.443636 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3719/7544] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:23:47 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:24:06.063047 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:06.064237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:06.068911 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-569534869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-73636697", "security_groups": [{"name": "tempest-secgroup-smoke-1867557791"}], "networks": [{"uuid": "c033e6a1-c876-4f6d-a497-2927f22cb0ec"}], "block_device_mapping_v2": [{"uuid": "8fda2ab0-df20-4d1a-9852-95e3859045a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:24:06.200304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.network.neutron [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] validate_networks() for [('c033e6a1-c876-4f6d-a497-2927f22cb0ec', None, None, None, None, None)] {{(pid=126008) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:24:06.629803 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Flavor limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:24:06.630274 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Image limits 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:24:06.630799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Flavor pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:24:06.631257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Image pref 0:0:0 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:24:06.632216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.virt.hardware [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126008) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:24:06.641751 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:06.642200 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:06.643003 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:06.643440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:06.665310 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:24:06.671292 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Getting quotas for user b6d59d30c26144df94f2bfdbe401defe and project c645dda219114dfeb2ae7ee96d46b3f0. Resources: {'cores', 'ram', 'instances'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:24:06.738246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Going to run 1 instances... {{(pid=126008) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:24:06.740448 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fda2ab0-df20-4d1a-9852-95e3859045a4',volume_size=None,volume_type=None)] {{(pid=126008) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:24:06.888814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-44b01f41-7961-4a0d-b697-42601e6b9807 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.827384 Jul 19 21:24:06.889452 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3826/7545] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:24:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:24:06.898096 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=12 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:06.899402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:06.900193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:06.905549 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bff4e456-cdab-4760-90e1-528bba458f53 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:06.906283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bff4e456-cdab-4760-90e1-528bba458f53 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:06.968016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bff4e456-cdab-4760-90e1-528bba458f53 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:06.975374 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bff4e456-cdab-4760-90e1-528bba458f53 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1086 microversion: 2.1 time: 0.079095 Jul 19 21:24:06.975992 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3720/7546] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:06 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1086 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:07.995773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-275c980d-f5b8-4132-b03f-5ae80ff624be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:07.996689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-275c980d-f5b8-4132-b03f-5ae80ff624be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:08.059492 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-275c980d-f5b8-4132-b03f-5ae80ff624be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:08.068822 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-275c980d-f5b8-4132-b03f-5ae80ff624be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1086 microversion: 2.1 time: 0.077974 Jul 19 21:24:08.069418 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3827/7547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:07 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1086 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:09.086623 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f0d2caff-2d42-40c0-ba7b-e9d97ff613b2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:09.087265 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f0d2caff-2d42-40c0-ba7b-e9d97ff613b2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:09.163972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f0d2caff-2d42-40c0-ba7b-e9d97ff613b2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:09.172774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f0d2caff-2d42-40c0-ba7b-e9d97ff613b2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1086 microversion: 2.1 time: 0.090141 Jul 19 21:24:09.173491 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3721/7548] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:09 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1086 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:10.193457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ffb06ebb-739b-442e-b818-ec1941d11d0f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:10.194079 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ffb06ebb-739b-442e-b818-ec1941d11d0f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:10.254854 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ffb06ebb-739b-442e-b818-ec1941d11d0f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:10.261646 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ffb06ebb-739b-442e-b818-ec1941d11d0f tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1086 microversion: 2.1 time: 0.072123 Jul 19 21:24:10.262229 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3828/7549] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:10 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:11.278740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:11.279370 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:11.286654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:11.287121 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:11.287958 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:11.288412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:11.353692 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:11.361880 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d274b389-87a6-4720-8496-ab5b2e307a40 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1136 microversion: 2.1 time: 0.087026 Jul 19 21:24:11.362468 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3722/7550] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:11 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:12.379057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:12.379697 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:12.388614 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:12.389374 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:12.390369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:12.391121 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:12.472559 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:12.485223 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d9daf83-1753-4bff-9970-220acea0303a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1202 microversion: 2.1 time: 0.110301 Jul 19 21:24:12.486825 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3829/7551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:12 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:13.504326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:13.505568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:13.513687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:13.514531 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:13.515510 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:13.516162 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:13.679741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:13.689554 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3b7e7332-bcdb-41d9-a527-46f000c6ae0c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1270 microversion: 2.1 time: 0.189633 Jul 19 21:24:13.700572 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3723/7552] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:13 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:13.999031 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-48247071-8b5e-47db-93a3-424d83b83a49 req-c4cac6d3-30bc-4e78-8311-2d36e3fb95df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:24:14.010382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-48247071-8b5e-47db-93a3-424d83b83a49 req-c4cac6d3-30bc-4e78-8311-2d36e3fb95df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:14.010856 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-48247071-8b5e-47db-93a3-424d83b83a49 req-c4cac6d3-30bc-4e78-8311-2d36e3fb95df service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:14.027513 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-48247071-8b5e-47db-93a3-424d83b83a49 req-c4cac6d3-30bc-4e78-8311-2d36e3fb95df service nova] Creating event network-changed:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h2-843861-3 Jul 19 21:24:14.035053 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-48247071-8b5e-47db-93a3-424d83b83a49 req-c4cac6d3-30bc-4e78-8311-2d36e3fb95df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124159 Jul 19 21:24:14.035681 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3830/7553] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:24:14.707790 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:14.708888 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:14.717302 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:14.718145 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:14.719343 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:14.719939 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:14.870850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:14.887008 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c81828ca-7d7b-4e06-b1a6-1e2cd9a3162c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1270 microversion: 2.1 time: 0.183388 Jul 19 21:24:14.887632 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3724/7554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:14 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:15.917982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:15.919304 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:15.931694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:15.931694 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:15.932153 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:15.932601 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:16.119291 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:16.127594 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-863c0ecd-4ac1-4e5d-a1ef-93c329b9d4e4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1270 microversion: 2.1 time: 0.219219 Jul 19 21:24:16.138057 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3831/7555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:15 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:17.146314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:17.146945 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:17.155044 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:17.155578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:17.156560 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:17.157070 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:17.329459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:17.337762 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-8a1d9506-8279-42ec-997f-805657661d2d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1270 microversion: 2.1 time: 0.195502 Jul 19 21:24:17.338366 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3725/7556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:17 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:18.355322 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:18.356064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:18.358088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:18.364411 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:18.364859 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:18.365617 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:18.366072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:18.500732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:18.508382 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d676782a-db5f-4942-8f2d-2cf3221a1599 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.157485 Jul 19 21:24:18.508972 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3832/7557] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:18 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:19.526324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:19.526893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:19.529622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=4 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:19.535383 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:19.535871 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:19.536666 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:19.537122 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:19.678476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:19.686033 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9e01aef-4083-4dd5-b827-45386b98b6f2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.164292 Jul 19 21:24:19.686676 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3726/7558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:19 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:20.704604 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:20.705321 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:20.708104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=10 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:24:20.714606 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:20.715152 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:20.716120 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:20.716584 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:20.863234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:20.871490 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-225adf38-78e6-441e-a7ad-5094169219da tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.170836 Jul 19 21:24:20.872134 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3833/7559] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:20 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:21.888410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:21.888959 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:21.896036 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:21.896503 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:21.897280 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:21.897728 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:22.045378 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:22.053290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-479a254b-a6e2-4d39-a2b3-a61bf337ad9a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.168817 Jul 19 21:24:22.053875 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3727/7560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:21 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:23.071018 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:23.071645 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:23.079216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:23.079993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:23.080924 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:23.081433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:23.218062 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:23.232024 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f9aff576-839e-4423-ac0b-1140212582dc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.164871 Jul 19 21:24:23.232606 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3834/7561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:23 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:24.249218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:24.249746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:24.256741 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:24.257198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:24.258003 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:24.258471 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:24.398597 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:24.406308 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-03265686-2dd7-4a99-8125-055d174b21f1 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.161083 Jul 19 21:24:24.406883 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3728/7562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:24 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:25.425264 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:25.426119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:25.436161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:25.436611 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:25.437387 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:25.437816 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:25.603262 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:25.611190 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ba242398-ae6a-4964-9ed3-24550c789ef2 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.191086 Jul 19 21:24:25.611796 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3835/7563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:25 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:26.637694 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:26.638314 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:26.645290 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:26.645748 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:26.646513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:26.646961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:26.782835 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:26.791774 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-4af6f7fb-91ed-42dd-9253-a8c6a0cee3d8 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.157901 Jul 19 21:24:26.792404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3729/7564] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:26 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:27.809294 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:27.810057 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:27.819201 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:27.820024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:27.821257 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:27.821851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:27.983708 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:27.994814 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-1df6e4cf-a456-4bbb-b50a-49a9fc6c9305 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.189703 Jul 19 21:24:27.995415 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3836/7565] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:27 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:29.020898 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:29.022013 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:29.028917 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:29.029344 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:29.030152 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:29.030611 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:29.190365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:29.202192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-3760ff70-fbe4-4a33-a9cb-a1674f8b5545 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.184882 Jul 19 21:24:29.203242 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3730/7566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:29 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:30.221088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:30.221706 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:30.230634 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:30.231096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:30.231949 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:30.232418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:30.389169 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:30.397887 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b7755a5a-1404-484b-935f-d7e8fc44c5ed tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.180872 Jul 19 21:24:30.401359 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3837/7567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:30 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:24:30.582008 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-4a1a1bd6-9219-46f9-a6d3-a32964fe7fb1 req-bad3ae3d-a994-4a58-a5b8-9a8cca1d326e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "name": "network-vif-plugged", "status": "completed", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:24:30.591405 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4a1a1bd6-9219-46f9-a6d3-a32964fe7fb1 req-bad3ae3d-a994-4a58-a5b8-9a8cca1d326e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:30.591954 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-4a1a1bd6-9219-46f9-a6d3-a32964fe7fb1 req-bad3ae3d-a994-4a58-a5b8-9a8cca1d326e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:30.605304 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-4a1a1bd6-9219-46f9-a6d3-a32964fe7fb1 req-bad3ae3d-a994-4a58-a5b8-9a8cca1d326e service nova] Creating event network-vif-plugged:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h2-843861-3 Jul 19 21:24:30.611065 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-4a1a1bd6-9219-46f9-a6d3-a32964fe7fb1 req-bad3ae3d-a994-4a58-a5b8-9a8cca1d326e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108851 Jul 19 21:24:30.611337 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3731/7568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:24:31.414836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:31.415433 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:31.423215 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:31.423660 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:31.424581 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:31.425087 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:31.578847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:31.591227 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c58c3b82-0a40-44fb-9b15-0069495fc26e tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1258 microversion: 2.1 time: 0.180052 Jul 19 21:24:31.592139 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3838/7569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:31 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:32.613533 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:32.614322 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:32.623364 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:32.623911 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:32.630011 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:32.630476 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:32.814178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:32.824229 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6b81b75c-c90a-4594-a11d-91914b5964a5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1441 microversion: 2.1 time: 0.216938 Jul 19 21:24:32.824916 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3732/7570] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:32 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1441 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:32.855670 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:24:32.856567 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:24:32.869183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:32.870954 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:32.873309 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:32.874253 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:33.080471 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:24:33.090073 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41daba81-9630-475b-85b1-1f40ce74a62d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1441 microversion: 2.1 time: 0.241999 Jul 19 21:24:33.090816 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3839/7571] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:24:32 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1441 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:24:35.258722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-10f4e821-2b65-4945-8a7d-3ad1a3d81efe req-eb738790-81ca-4b5f-bff6-24369f77cf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:24:35.269040 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-10f4e821-2b65-4945-8a7d-3ad1a3d81efe req-eb738790-81ca-4b5f-bff6-24369f77cf26 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:24:35.269516 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-10f4e821-2b65-4945-8a7d-3ad1a3d81efe req-eb738790-81ca-4b5f-bff6-24369f77cf26 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:24:35.282389 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-10f4e821-2b65-4945-8a7d-3ad1a3d81efe req-eb738790-81ca-4b5f-bff6-24369f77cf26 service nova] Creating event network-changed:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h2-843861-3 Jul 19 21:24:35.289074 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-10f4e821-2b65-4945-8a7d-3ad1a3d81efe req-eb738790-81ca-4b5f-bff6-24369f77cf26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034301 Jul 19 21:24:35.289709 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3733/7572] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:25:27.725721 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:25:27.726489 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:26:33.050920 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:26:33.051570 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=64 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:26:33.055661 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:26:33.056216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:33.063326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:33.063773 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:33.064574 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:33.065009 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:33.090234 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.objects.instance [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lazy-loading 'flavor' on Instance uuid d4d7b6c0-4266-45fd-91c6-6f075595b5d1 {{(pid=126008) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:26:33.164606 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d6c4cdc4-8151-401c-be2a-afaa2f95bcaf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1/action" status: 202 len: 0 microversion: 2.1 time: 0.115707 Jul 19 21:26:33.165216 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3840/7573] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:26:33 2022] POST /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:26:33.172047 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 21:26:33.173153 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 21:26:33.174021 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=32 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:26:33.174796 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=64 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:26:33.179641 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:33.180450 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:33.187937 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:33.188407 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:33.189192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:33.189640 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:33.332793 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:33.340718 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2d82c705-4ea6-4b3f-8b4b-cc77c6ed141b tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.170706 Jul 19 21:26:33.341311 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3734/7574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:33 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:34.361224 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:34.362035 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:34.371378 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:34.372129 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:34.373017 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:34.373502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:34.580077 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:34.589702 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-bb07bb25-4476-4ea6-8aa8-d8499f9f6d34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.234028 Jul 19 21:26:34.590333 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3841/7575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:34 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:26:35.607116 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:35.607882 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:35.619118 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:35.619578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:35.620391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:35.620836 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:35.624980 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37294. Jul 19 21:26:35.628786 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37292. Jul 19 21:26:35.772787 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:35.782106 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-2b20160f-afae-4ede-bfbd-272d5856c7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.178872 Jul 19 21:26:35.782753 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3735/7576] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:35 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:26:36.800091 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:36.800656 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:36.807616 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:36.808098 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:36.808861 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:36.809296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:36.948354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:36.956187 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-452ab1ca-89e2-4cd4-b07d-f0d825cceac4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.160122 Jul 19 21:26:36.956819 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3842/7577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:36 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:37.976234 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:37.976884 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:37.983077 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:37.983542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:37.984368 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:37.984814 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:38.126704 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:38.135078 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f89c47b1-08a4-4b6c-bb57-1029e60c15bd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.164464 Jul 19 21:26:38.135656 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3736/7578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:37 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:39.153223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:39.153839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:39.161578 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:39.162027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:39.162817 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:39.163244 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:39.304684 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:39.312437 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6ed504af-e55f-4245-8e68-f5d2cc90e949 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.163203 Jul 19 21:26:39.313029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3843/7579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:39 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:40.329538 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:40.330283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:40.337619 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:40.338089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:40.339039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:40.339489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:40.486202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:40.494827 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-32992930-a212-4965-8e47-800825f79ebd tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.169168 Jul 19 21:26:40.495422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3737/7580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:40 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:41.512223 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:41.512763 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:41.519843 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:41.520295 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:41.521066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:41.521497 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:41.663982 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:41.671833 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d81dd5f-5b88-4b30-b4e6-a571dd750029 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.163799 Jul 19 21:26:41.672404 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3844/7581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:41 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:42.690016 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:42.690802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:42.698333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:42.698784 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:42.699566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:42.700053 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:42.942119 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:42.952384 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-7cba86b6-3aa1-46df-875e-e5d04795d07a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.265270 Jul 19 21:26:42.952384 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3738/7582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:42 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:43.971573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:43.972662 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:43.980603 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:43.981055 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:43.981836 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:43.982269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:44.184070 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:44.191776 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a86db310-7efe-471c-a14c-447b1ecab7d9 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.225730 Jul 19 21:26:44.192393 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3845/7583] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:43 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:45.210923 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:45.211620 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:45.221419 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:45.222173 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:45.223420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:45.224404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:45.368976 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:45.377822 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-edb4e668-c335-48ab-9b2e-58f79c1c2d24 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.172030 Jul 19 21:26:45.378422 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3739/7584] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:45 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:46.396402 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:46.397021 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:46.404593 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:46.405046 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:46.405830 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:46.406266 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:46.581104 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:46.590196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c18d0b2c-c1f2-4103-8009-a8e0467d1762 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.197691 Jul 19 21:26:46.590842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3846/7585] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:46 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:47.610324 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:47.611687 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:47.620904 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.621375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:47.622198 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.622652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:47.781585 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:47.789752 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7529cdf-56aa-4d79-94db-0c0d6bcc5e31 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1566 microversion: 2.1 time: 0.184129 Jul 19 21:26:47.790404 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3740/7586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:47 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:47.808151 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:26:47.808770 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:47.815095 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.815548 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:47.816926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.817354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:47.902622 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f93d8808-e74b-4196-9663-939cc8c0e6d6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "POST /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1/action" status: 202 len: 0 microversion: 2.1 time: 0.099421 Jul 19 21:26:47.903533 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3847/7587] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:26:47 2022] POST /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:26:47.915554 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:47.916403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:47.924927 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.926115 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:47.928097 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:47.928828 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:48.103542 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:48.112739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-865451c3-c9c2-46a0-a9f6-520aa6baf0ab tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1574 microversion: 2.1 time: 0.202704 Jul 19 21:26:48.113416 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3741/7588] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:47 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:49.137600 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:49.139390 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:49.148328 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:49.148781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:49.149557 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:49.149995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:49.173180 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-3e5a654c-d601-4163-a3c0-b8ab6edd5e0b req-1c7bc007-22d0-4ff9-83bb-da6c3e6a43c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "name": "network-vif-unplugged", "status": "completed", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:26:49.203789 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3e5a654c-d601-4163-a3c0-b8ab6edd5e0b req-1c7bc007-22d0-4ff9-83bb-da6c3e6a43c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:49.204239 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-3e5a654c-d601-4163-a3c0-b8ab6edd5e0b req-1c7bc007-22d0-4ff9-83bb-da6c3e6a43c0 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:49.233729 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.compute.server_external_events [req-3e5a654c-d601-4163-a3c0-b8ab6edd5e0b req-1c7bc007-22d0-4ff9-83bb-da6c3e6a43c0 service nova] Unable to find a host for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1. Dropping event network-vif-unplugged {{(pid=126007) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 21:26:49.234661 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-3e5a654c-d601-4163-a3c0-b8ab6edd5e0b req-1c7bc007-22d0-4ff9-83bb-da6c3e6a43c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065879 Jul 19 21:26:49.235278 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3742/7589] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 21:26:49.335595 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:49.343718 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-38d2ca13-ce28-4561-bbe2-0132f3460dff tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1514 microversion: 2.1 time: 0.215086 Jul 19 21:26:49.354749 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3848/7590] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:49 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:50.362961 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:50.363578 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:50.374736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:50.375049 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:50.375952 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:50.376599 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:50.516082 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:50.523781 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-834f3576-c006-4f20-866a-91bea2e2bbd7 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1514 microversion: 2.1 time: 0.164979 Jul 19 21:26:50.524392 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3743/7591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:50 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:51.542211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:51.543093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:51.550689 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:51.551024 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:51.551819 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:51.552270 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:51.698944 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:51.709723 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ccfdd925-52ba-4d61-bab8-212f98b64231 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1516 microversion: 2.1 time: 0.170455 Jul 19 21:26:51.709723 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3849/7592] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:51 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:52.726670 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:52.727432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:52.734753 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:52.735258 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:52.736042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:52.736485 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:52.897404 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:52.905821 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1007a351-6eb7-4501-bf58-6e5000247290 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1516 microversion: 2.1 time: 0.183299 Jul 19 21:26:52.906419 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3744/7593] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:52 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:53.923106 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:53.923761 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:53.931260 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:53.931781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:53.932514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:53.932957 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:54.081038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:54.090028 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-90c680b6-d3e2-4e22-b546-3ee18c3ede0d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1516 microversion: 2.1 time: 0.170854 Jul 19 21:26:54.090692 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3850/7594] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:53 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:55.108396 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:55.109043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:55.116197 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:55.116653 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:55.117427 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:55.117869 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:55.275402 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:55.283736 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5de47f8c-f265-4184-bfdd-4b66ab12fe34 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1516 microversion: 2.1 time: 0.180625 Jul 19 21:26:55.293878 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3745/7595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:55 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:56.302279 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:56.303086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:56.310958 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:56.311416 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:56.312263 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:56.312705 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:56.466977 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:56.475355 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-2f857df5-be73-419e-961f-5d098c2f9032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1516 microversion: 2.1 time: 0.177345 Jul 19 21:26:56.475894 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3851/7596] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:56 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:57.492680 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:57.493358 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:57.503072 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:57.503568 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:57.504603 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:57.505235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:58.025489 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:58.033712 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-457f9bb5-a077-4198-82c0-6a515c1fd5be tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.544767 Jul 19 21:26:58.034307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3746/7597] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:57 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:26:58.188845 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-dd5ec949-dbac-44f6-a180-2e6ab55ee678 req-f5451c7e-e1ed-4a0b-9da0-80575c847d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:26:58.208349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd5ec949-dbac-44f6-a180-2e6ab55ee678 req-f5451c7e-e1ed-4a0b-9da0-80575c847d1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:58.208799 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-dd5ec949-dbac-44f6-a180-2e6ab55ee678 req-f5451c7e-e1ed-4a0b-9da0-80575c847d1a service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:58.221105 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-dd5ec949-dbac-44f6-a180-2e6ab55ee678 req-f5451c7e-e1ed-4a0b-9da0-80575c847d1a service nova] Creating event network-changed:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h1-843861-3 Jul 19 21:26:58.241151 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-dd5ec949-dbac-44f6-a180-2e6ab55ee678 req-f5451c7e-e1ed-4a0b-9da0-80575c847d1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055727 Jul 19 21:26:58.242410 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3852/7598] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:26:59.050864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:26:59.051442 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:26:59.058380 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:59.058840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:59.059615 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:26:59.060095 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:26:59.245390 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:26:59.254279 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-65144b17-71a2-4911-abfa-cd5186aec636 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.206728 Jul 19 21:26:59.255158 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3747/7599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:26:59 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:00.275479 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:00.276207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:00.282544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:00.282995 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:00.283752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:00.284208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:00.420398 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:00.429330 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-4ad2a657-a411-4978-a65e-e9ff67905803 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.158869 Jul 19 21:27:00.430029 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3853/7600] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:00 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:01.446545 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:01.447242 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:01.454283 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:01.454745 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:01.455530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:01.456014 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:01.601214 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:01.609717 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-569c2da3-897c-4e9a-be3b-dc4dec8aa98c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.166984 Jul 19 21:27:01.610313 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3748/7601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:01 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:02.626961 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:02.627633 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:02.635237 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:02.635685 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:02.636485 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:02.636921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:02.641086 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:27:02.774540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:02.783307 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-0fdbb2fb-08ad-463d-bf34-ff054c137bcc tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.160319 Jul 19 21:27:02.783917 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3854/7602] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:02 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:03.804812 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:03.805445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:03.808206 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=31 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:27:03.813679 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:03.814146 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:03.814936 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:03.815388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:03.818891 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=87 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:27:03.979304 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:03.987107 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c7d68c36-963b-4060-a402-d28161e786df tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.186300 Jul 19 21:27:03.988238 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3749/7603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:03 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:05.005537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:05.006207 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:05.008976 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=33 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:27:05.015081 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:05.015529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:05.016336 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:05.016766 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:05.155620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:05.163545 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-47d7b575-1215-432a-8334-a232f9bdf31a tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.161908 Jul 19 21:27:05.164165 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3855/7604] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:05 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:06.181621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:06.182246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:06.188859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:06.189328 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:06.190117 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:06.190566 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:06.342048 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:06.350723 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b89347ba-66bb-4b3e-9262-dfe57933c032 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.173123 Jul 19 21:27:06.351310 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3750/7605] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:06 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:07.368810 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:07.369418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:07.377240 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:07.377832 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:07.378677 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:07.379148 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:07.529187 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:07.537381 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-01394b3c-ebc3-42dd-9683-5b4a6947b1fa tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.173176 Jul 19 21:27:07.537978 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3856/7606] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:07 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:08.436198 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:27:08.436772 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:27:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:27:08.555185 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:08.555853 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:08.563259 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:08.563722 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:08.564537 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:08.564997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:08.715412 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:08.724478 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-e9099a3e-0c27-4f81-8139-9c0d0462dff0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.173307 Jul 19 21:27:08.725111 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3751/7607] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:08 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:09.743037 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:09.743638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:09.750663 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:09.751115 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:09.751907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:09.752349 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:09.904752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:09.912589 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a3ac9ec8-9a3e-4e8b-a2c1-560785d4ecb6 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.174165 Jul 19 21:27:09.913178 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3857/7608] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:09 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:10.367326 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "name": "network-vif-plugged", "status": "completed", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:27:10.376610 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:10.377006 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:10.389353 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] Creating event network-vif-plugged:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h1-843861-3 Jul 19 21:27:10.392991 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] [dcf7bfa8-84ae-439b-8021-8b40c3995389] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:27:10.930473 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:10.931096 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:10.938847 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:10.939296 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:10.940107 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:10.940544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:11.080891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:11.090032 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d50ab58c-cbeb-4b56-8d69-e1849f95a7e0 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.162981 Jul 19 21:27:11.090353 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3858/7609] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:10 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:27:11.399587 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] [dcf7bfa8-84ae-439b-8021-8b40c3995389] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37388. Jul 19 21:27:11.402921 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-75a57e76-a74b-45b7-8422-8fe4c67adf57 req-b5e537e6-fa94-457f-affe-9b336af69e10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039595 Jul 19 21:27:11.403613 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3752/7610] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:27:12.110683 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:12.111315 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:12.118377 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:12.118824 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:12.119575 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:12.120030 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:12.268354 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:12.276676 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-635d2804-852c-4e36-8b86-652da67c4ee4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1572 microversion: 2.1 time: 0.170071 Jul 19 21:27:12.277288 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3859/7611] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:12 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:27:13.295984 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:27:13.296691 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:27:13.303581 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:13.304069 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:13.304839 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:27:13.305279 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:27:13.444932 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:27:13.452719 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-52636117-f0f3-4678-9398-b6e16c7f0ddf tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1559 microversion: 2.1 time: 0.161815 Jul 19 21:27:13.453307 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3753/7612] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:27:13 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:27.544573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=9 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:27.546000 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:27.546461 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=9 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:27.547420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=25 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:27.551068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:27.551518 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:27.552746 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-438c7d69-ad98-4ca1-9881-a82d8caf3a5f req-62c67f39-a899-498d-9051-0902a4bec55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:28:27.559073 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:27.559529 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:27.560370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:27.560806 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:27.562825 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-438c7d69-ad98-4ca1-9881-a82d8caf3a5f req-62c67f39-a899-498d-9051-0902a4bec55c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:27.563273 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-438c7d69-ad98-4ca1-9881-a82d8caf3a5f req-62c67f39-a899-498d-9051-0902a4bec55c service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:27.576260 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-438c7d69-ad98-4ca1-9881-a82d8caf3a5f req-62c67f39-a899-498d-9051-0902a4bec55c service nova] Creating event network-changed:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h1-843861-3 Jul 19 21:28:27.581800 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-438c7d69-ad98-4ca1-9881-a82d8caf3a5f req-62c67f39-a899-498d-9051-0902a4bec55c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037195 Jul 19 21:28:27.582841 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3754/7613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:28:27.588242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:28:27.688958 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ca65a1db-4004-41a0-90c8-db8df841e827 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 204 len: 0 microversion: 2.1 time: 0.146661 Jul 19 21:28:27.693012 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3860/7614] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:28:27 2022] DELETE /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:28:27.699033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:27.699759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:27.706715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:27.707512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:27.708621 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:27.709460 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:27.873229 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:27.881797 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-af3ba864-45d6-4104-9918-699d6233209d tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.186973 Jul 19 21:28:27.882522 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3755/7615] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:27 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:28:28.899491 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:28.900363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:28.907760 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:28.908246 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:28.909094 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:28.909474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:29.544138 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:29.552629 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b8f90a02-a0db-40f2-8162-3e7f139540c4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1565 microversion: 2.1 time: 0.657578 Jul 19 21:28:29.553219 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3861/7616] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:28 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1565 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:29.924391 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-f7fcb0ef-8a7b-4dd2-9f6b-3c102711e556 req-8f9b48ad-bbee-41e6-8438-59dbb9316dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7b6c0-4266-45fd-91c6-6f075595b5d1", "name": "network-vif-deleted", "tag": "f3a70453-45f8-4591-9c9e-885dc22d2037"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:28:29.934161 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f7fcb0ef-8a7b-4dd2-9f6b-3c102711e556 req-8f9b48ad-bbee-41e6-8438-59dbb9316dc9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:29.934715 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-f7fcb0ef-8a7b-4dd2-9f6b-3c102711e556 req-8f9b48ad-bbee-41e6-8438-59dbb9316dc9 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:29.946851 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-f7fcb0ef-8a7b-4dd2-9f6b-3c102711e556 req-8f9b48ad-bbee-41e6-8438-59dbb9316dc9 service nova] Creating event network-vif-deleted:f3a70453-45f8-4591-9c9e-885dc22d2037 for instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 on n-h1-843861-3 Jul 19 21:28:29.953396 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-f7fcb0ef-8a7b-4dd2-9f6b-3c102711e556 req-8f9b48ad-bbee-41e6-8438-59dbb9316dc9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Jul 19 21:28:29.954008 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3756/7617] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:28:30.571118 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:30.571850 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:30.580702 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:30.581160 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:30.581934 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:30.582379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:30.660865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:30.669192 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-b97362fd-63a1-4218-ada2-f85cc8c95448 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1217 microversion: 2.1 time: 0.101996 Jul 19 21:28:30.669791 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3862/7618] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:30 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:31.692041 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:31.692765 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:31.701099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:31.701553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:31.702348 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:31.702791 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:31.786944 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:31.797440 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-899db6e7-3cdc-406e-a6f2-fe32e5ce0669 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1217 microversion: 2.1 time: 0.112367 Jul 19 21:28:31.798040 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3757/7619] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:31 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:32.820352 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:32.821472 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:32.840248 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:32.840648 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:32.841736 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:32.842481 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:32.922449 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:32.931153 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2c136f4-443c-4333-b437-b26b162747fb tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1217 microversion: 2.1 time: 0.117582 Jul 19 21:28:32.931978 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3863/7620] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:32 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:28:33.947773 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:33.948472 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:33.955403 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:33.955864 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:33.956633 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:33.957076 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:34.030468 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d59d30c26144df94f2bfdbe401defe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645dda219114dfeb2ae7ee96d46b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:34.040856 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d7de8a38-1448-4f23-a82b-4c666f4a87a4 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 200 len: 1217 microversion: 2.1 time: 0.096860 Jul 19 21:28:34.041757 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3758/7621] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:33 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:35.058907 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:35.059507 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] [instance: d4d7b6c0-4266-45fd-91c6-6f075595b5d1] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:35.068044 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:35.068523 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:35.069305 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:35.069739 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:35.085444 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] HTTP exception thrown: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Request method failure captured: Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 HTTP/1.1 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1x-9GWHvqDQQ1SmquXrKlo90d_UgJbjL_TWHUulGtaCBM8sbffF0Q8lo9VrsQRttqlRxH8vBt5o9MwYojFm0vLzSXz1S5hb95gNAR5P0NfyAir-0CjVbV6TfgyJ2N8CkVnYU-sUIqmFj1ys0GYbwdrUJnbmUFfcMWn9qfFCNyPdwpQw Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: c645dda219114dfeb2ae7ee96d46b3f0 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestShelveInstance-1284980786 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c645dda219114dfeb2ae7ee96d46b3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestShelveInstance-1284980786 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: c645dda219114dfeb2ae7ee96d46b3f0 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestShelveInstance-1284980786 Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestShelveInstance-1284980786-project Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: b6d59d30c26144df94f2bfdbe401defe Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestShelveInstance-1284980786-project Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': 'd4d7b6c0-4266-45fd-91c6-6f075595b5d1'} Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:28:35.087156 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Returning 404 to user: Instance d4d7b6c0-4266-45fd-91c6-6f075595b5d1 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-7e764c40-8b95-4396-a895-9fcbd7470c1c tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1" status: 404 len: 111 microversion: 2.1 time: 0.034276 Jul 19 21:28:35.091915 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3864/7622] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:35 2022] GET /compute/v2.1/servers/d4d7b6c0-4266-45fd-91c6-6f075595b5d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:28:35.279362 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-adedc257-4ef0-4edf-a4f3-bfdd6d9315d5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] Calling method '.version_select at 0x7fb88c0c4b80>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:35.320169 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-adedc257-4ef0-4edf-a4f3-bfdd6d9315d5 tempest-TestShelveInstance-1284980786 tempest-TestShelveInstance-1284980786-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-73636697" status: 202 len: 0 microversion: 2.1 time: 0.047269 Jul 19 21:28:35.326032 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3759/7623] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 19 21:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-73636697 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:28:47.735276 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:28:47.737302 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:28:55.082383 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:55.083839 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:55.351341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Action: 'create', calling method: .version_select at 0x7fb88cd443a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1087832071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILaqQBmFqKjxE3A5eUgzrghu5pXS+0byeMjaeYZnHZNL2VYgRdwnA1GceymAb3uBfoQr/21/XRwrtVUag5lWG5gVoPKRwCJrD9FwiZ5XQBnMRCF+0Cjv67ylLdqmQYFHg=="}} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:28:55.386191 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for project bc08c48159654200894f652941e1655a. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:28:55.398531 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.quota [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for user 4504eb825af64eb0b418708314168b28 and project bc08c48159654200894f652941e1655a. Resources: {'key_pairs'} {{(pid=126008) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:28:55.416917 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:28:56.427216 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [4bf43e27-be71-40b2-965c-b0ff3e7f19be] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37552. Jul 19 21:28:56.447500 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-20a0c56a-22f9-4562-92a8-844ac33d4458 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.370799 Jul 19 21:28:56.448166 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3865/7624] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 19 21:28:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:28:57.627592 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=22 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:57.628561 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:28:57.633850 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-999851220", "imageRef": "7cf63fb3-07fd-4965-a7a1-a7c160992046", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1087832071", "security_groups": [{"name": "tempest-secgroup-smoke-1488304799"}], "networks": [{"uuid": "6812f037-41d3-4da0-9611-3e04730ef7bd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:28:57.765335 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] validate_networks() for [('6812f037-41d3-4da0-9611-3e04730ef7bd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:28:58.328428 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:28:58.329411 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:28:58.329974 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:28:58.330336 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:28:58.330811 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:28:58.345979 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:58.348924 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:58.350465 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:58.351228 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:58.378026 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for project bc08c48159654200894f652941e1655a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:28:58.386808 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for user 4504eb825af64eb0b418708314168b28 and project bc08c48159654200894f652941e1655a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:28:58.402682 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:28:58.405246 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cf63fb3-07fd-4965-a7a1-a7c160992046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:28:58.458467 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bb0bb9c4-3e06-4af7-9ec9-05655b7e7636 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832983 Jul 19 21:28:58.465407 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3760/7625] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:28:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:28:58.472302 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-465acdfd-c7cd-4dd8-8b71-3f1db33f76a8 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:58.473855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-465acdfd-c7cd-4dd8-8b71-3f1db33f76a8 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:58.550898 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-465acdfd-c7cd-4dd8-8b71-3f1db33f76a8 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:58.558929 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-465acdfd-c7cd-4dd8-8b71-3f1db33f76a8 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1248 microversion: 2.1 time: 0.092035 Jul 19 21:28:58.559531 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3866/7626] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:58 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:28:59.579737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:28:59.580474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:28:59.588674 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:59.589137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:59.590112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:28:59.590737 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:28:59.663325 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:28:59.673184 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-c151dbe4-ade0-4b68-b6f4-415673f6940d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1300 microversion: 2.1 time: 0.098915 Jul 19 21:28:59.673791 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3761/7627] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:28:59 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:00.695506 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:00.696174 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:00.704048 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:00.704513 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:00.705537 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:00.709679 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:01.291921 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:01.300211 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-41b0e45b-b0e7-4a40-a7a7-5a298814f455 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.608779 Jul 19 21:29:01.300812 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3867/7628] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:00 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:29:01.920636 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-e11a4163-0fbd-4c81-b534-d07a6123f2cc req-96de5df8-2590-4962-a323-65a123afcd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:29:01.930110 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e11a4163-0fbd-4c81-b534-d07a6123f2cc req-96de5df8-2590-4962-a323-65a123afcd25 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:01.930678 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-e11a4163-0fbd-4c81-b534-d07a6123f2cc req-96de5df8-2590-4962-a323-65a123afcd25 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:01.952090 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-e11a4163-0fbd-4c81-b534-d07a6123f2cc req-96de5df8-2590-4962-a323-65a123afcd25 service nova] Creating event network-changed:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:29:01.959794 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-e11a4163-0fbd-4c81-b534-d07a6123f2cc req-96de5df8-2590-4962-a323-65a123afcd25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132268 Jul 19 21:29:01.960450 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3762/7629] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:29:02.327646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:02.328297 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:02.335756 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:02.336474 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:02.337369 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:02.338043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:02.480978 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:02.489244 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-54f1f1bc-0572-499b-bf0f-18db10092293 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.167236 Jul 19 21:29:02.489820 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3868/7630] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:02 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:03.508192 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:03.509089 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:03.516949 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:03.517417 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:03.518220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:03.518676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:03.759388 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:03.770237 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5d6fb3cd-ecd4-4d16-a24e-cee5f5f2cf64 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.266024 Jul 19 21:29:03.771541 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3763/7631] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:03 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:04.788341 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:04.788972 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:04.797259 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:04.797698 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:04.798478 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:04.798932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:04.982211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:04.991617 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-34925d10-7434-4589-ad45-42c6ece2d07c tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.207288 Jul 19 21:29:04.992262 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3869/7632] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:04 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:29:06.009769 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:06.010375 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:06.017639 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:06.018101 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:06.018880 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:06.019320 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:06.184529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:06.197404 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-07cdca78-6e39-43d0-b947-0c080ff6de8d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.191374 Jul 19 21:29:06.198302 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3764/7633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:06 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:06.868852 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-13656763-d89e-40ef-85a1-9d31474d0e0a req-3782f5db-6354-4cdb-a0fa-40fad5c501e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "name": "network-vif-plugged", "status": "completed", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:29:06.881838 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-13656763-d89e-40ef-85a1-9d31474d0e0a req-3782f5db-6354-4cdb-a0fa-40fad5c501e2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:06.882750 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-13656763-d89e-40ef-85a1-9d31474d0e0a req-3782f5db-6354-4cdb-a0fa-40fad5c501e2 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:06.898407 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-13656763-d89e-40ef-85a1-9d31474d0e0a req-3782f5db-6354-4cdb-a0fa-40fad5c501e2 service nova] Creating event network-vif-plugged:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:29:06.903926 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-13656763-d89e-40ef-85a1-9d31474d0e0a req-3782f5db-6354-4cdb-a0fa-40fad5c501e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041171 Jul 19 21:29:06.904973 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3870/7634] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:29:07.218617 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:07.220091 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:07.229559 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:07.230039 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:07.230840 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:07.231288 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:07.379105 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:07.389518 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6497b8e7-61bf-4de5-b1f1-fca3c1b16f4b tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1374 microversion: 2.1 time: 0.173987 Jul 19 21:29:07.393471 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3765/7635] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:07 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:29:08.408440 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:08.409052 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:08.415775 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:08.416269 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:08.417043 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:08.417544 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:08.558326 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=6 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:29:08.562064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:08.570201 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-356dfdec-fcc6-4eed-b469-d21bf8ef2bcb tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1559 microversion: 2.1 time: 0.167490 Jul 19 21:29:08.570797 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3871/7636] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:08 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:08.587038 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:29:08.587659 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:29:08.590553 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:29:08.591365 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:29:08.598220 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:08.598942 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:08.599719 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:08.600186 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:08.739137 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:29:08.747365 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5287e7b7-9165-4786-9146-63af33be2897 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1559 microversion: 2.1 time: 0.164156 Jul 19 21:29:08.747983 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3766/7637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:29:08 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:29:10.502176 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-a3fa3cca-2459-4cad-b07d-d1c415bb53e9 req-7aef9606-118d-4c74-8d24-1959690af592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:29:10.512323 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a3fa3cca-2459-4cad-b07d-d1c415bb53e9 req-7aef9606-118d-4c74-8d24-1959690af592 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:29:10.512767 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-a3fa3cca-2459-4cad-b07d-d1c415bb53e9 req-7aef9606-118d-4c74-8d24-1959690af592 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:29:10.525055 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-a3fa3cca-2459-4cad-b07d-d1c415bb53e9 req-7aef9606-118d-4c74-8d24-1959690af592 service nova] Creating event network-changed:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:29:10.530431 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-a3fa3cca-2459-4cad-b07d-d1c415bb53e9 req-7aef9606-118d-4c74-8d24-1959690af592 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032088 Jul 19 21:29:10.531289 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3872/7638] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:29:30.826237 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:29:30.827039 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:29:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:31:08.305080 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:31:08.305991 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:31:08.306448 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:08.307300 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=34 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:08.311626 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1304836175"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:08.312734 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:08.320319 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:08.320775 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:08.322108 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:08.322550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:08.597513 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-fb9bed66-af8c-44f6-93b8-75e1ddd7a8a3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "POST /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509/action" status: 202 len: 0 microversion: 2.1 time: 0.294220 Jul 19 21:31:08.598160 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3767/7639] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:31:08 2022] POST /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 21:31:13.610260 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:31:13.611572 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:31:13.612576 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:13.613620 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=28 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:13.703533 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-f975f1eb-6f99-4b07-a0f2-7e033ba94a92 req-3a76fc97-1e00-4ddf-a81c-cde8175b346d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "name": "network-vif-plugged", "status": "completed", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:13.728804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f975f1eb-6f99-4b07-a0f2-7e033ba94a92 req-3a76fc97-1e00-4ddf-a81c-cde8175b346d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:13.728804 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-f975f1eb-6f99-4b07-a0f2-7e033ba94a92 req-3a76fc97-1e00-4ddf-a81c-cde8175b346d service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:13.760424 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-f975f1eb-6f99-4b07-a0f2-7e033ba94a92 req-3a76fc97-1e00-4ddf-a81c-cde8175b346d service nova] Creating event network-vif-plugged:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:31:13.769196 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-f975f1eb-6f99-4b07-a0f2-7e033ba94a92 req-3a76fc97-1e00-4ddf-a81c-cde8175b346d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160907 Jul 19 21:31:13.770801 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3873/7640] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:31:22.241740 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:22.243595 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:22.251233 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1277853386", "imageRef": "a866acc0-ef32-4ecb-9282-70fbd715b24e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1087832071", "security_groups": [{"name": "tempest-secgroup-smoke-1488304799"}], "networks": [{"uuid": "6812f037-41d3-4da0-9611-3e04730ef7bd"}]}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:22.294200 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37808. Jul 19 21:31:22.294957 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37810. Jul 19 21:31:22.394251 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.network.neutron [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] validate_networks() for [('6812f037-41d3-4da0-9611-3e04730ef7bd', None, None, None, None, None)] {{(pid=126007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:31:22.784727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Flavor limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:31:22.785212 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Image limits 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:31:22.785764 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Flavor pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:31:22.786493 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Image pref 0:0:0 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:31:22.787033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.virt.hardware [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:31:22.797444 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:22.797920 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:22.798730 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:22.799178 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:22.817205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for project bc08c48159654200894f652941e1655a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:31:22.822654 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.quota [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Getting quotas for user 4504eb825af64eb0b418708314168b28 and project bc08c48159654200894f652941e1655a. Resources: {'cores', 'ram', 'instances'} {{(pid=126007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:31:22.837080 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Going to run 1 instances... {{(pid=126007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:31:22.839583 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a866acc0-ef32-4ecb-9282-70fbd715b24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:31:22.886669 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-5eea162f-10cc-4176-9215-3098447ba6e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650044 Jul 19 21:31:22.887322 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3768/7641] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 19 21:31:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:31:22.899834 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-250f6550-a264-4535-839b-253f599a8a1d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:22.904781 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-250f6550-a264-4535-839b-253f599a8a1d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:22.924563 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [deb7a733-e098-4faa-ab26-8f31de5ca6cd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37824. Jul 19 21:31:22.927784 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] [1cb62ba4-0da8-4ae9-be93-a9652e7c91b8] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37822. Jul 19 21:31:22.975528 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-250f6550-a264-4535-839b-253f599a8a1d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:22.983784 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-250f6550-a264-4535-839b-253f599a8a1d tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1249 microversion: 2.1 time: 0.089916 Jul 19 21:31:22.984398 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3874/7642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:22 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:24.002148 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:24.003459 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:24.010193 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:24.010652 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:24.011420 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:24.011894 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:24.080496 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:24.088306 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-f16238b7-3dea-4d47-8ea1-77347000d252 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1301 microversion: 2.1 time: 0.090730 Jul 19 21:31:24.088844 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3769/7643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:23 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:25.107063 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:25.107800 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:25.109769 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:25.123286 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:25.124064 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:25.125093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:25.125696 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:25.384208 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:25.394760 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-3d681502-c222-42f1-afe4-311c33f94c46 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.291572 Jul 19 21:31:25.407770 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3875/7644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:25 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:25.647995 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-074ea1be-a98f-4297-815a-1860dceabfbd req-209288da-efa0-40d6-a9c3-6b309e033d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "name": "network-vif-unplugged", "status": "completed", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:25.661066 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-074ea1be-a98f-4297-815a-1860dceabfbd req-209288da-efa0-40d6-a9c3-6b309e033d9b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:25.661676 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-074ea1be-a98f-4297-815a-1860dceabfbd req-209288da-efa0-40d6-a9c3-6b309e033d9b service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:25.676848 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-074ea1be-a98f-4297-815a-1860dceabfbd req-209288da-efa0-40d6-a9c3-6b309e033d9b service nova] Creating event network-vif-unplugged:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:31:25.692029 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-074ea1be-a98f-4297-815a-1860dceabfbd req-209288da-efa0-40d6-a9c3-6b309e033d9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040761 Jul 19 21:31:25.693217 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3770/7645] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:31:26.414016 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:26.415646 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:26.423585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:26.424066 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:26.425644 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:26.426093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:26.587785 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:26.595559 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f87d428a-7644-45b5-afc9-725941df7071 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.185744 Jul 19 21:31:26.596248 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3876/7646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:26 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:27.619132 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:27.620054 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:27.626433 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:27.626968 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:27.627759 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:27.628227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:27.778135 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:27.786093 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-ec1a6706-bc41-4680-b5de-0746f4411e30 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.173719 Jul 19 21:31:27.786680 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3771/7647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:27 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:28.803540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:28.804638 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:28.812703 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:28.813161 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:28.814004 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:28.814597 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:28.967318 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:28.975935 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-af201560-6f95-4b17-829b-944284d35afa tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.176295 Jul 19 21:31:28.986483 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3877/7648] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:28 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:29.994202 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:29.994819 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:30.002175 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:30.002645 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:30.003445 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:30.003925 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:30.156594 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:30.166772 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-d88e0262-5d98-4ace-9fc9-e5d582bb37c7 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.176650 Jul 19 21:31:30.168050 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3772/7649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:29 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:31.185363 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:31.186025 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:31.193693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:31.194139 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:31.194923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:31.195370 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:31.375592 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:31.384459 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f7b51f16-55c8-49d7-91d5-75afab578557 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.202909 Jul 19 21:31:31.392343 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3878/7650] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:31 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:31:32.402009 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:32.402668 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:32.409837 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:32.410305 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:32.411084 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:32.411530 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:32.553519 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:32.561739 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-483d3fd0-0038-456b-82dd-794959001662 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.163630 Jul 19 21:31:32.562315 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3773/7651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:32 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:33.579922 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:33.580573 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:33.583366 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell0:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:33.589219 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:33.589671 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:33.590457 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:33.590891 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:33.734742 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:33.742210 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-d2b95e3c-585b-4441-a128-bb27d8d4590f tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.166760 Jul 19 21:31:33.742842 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3879/7652] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:33 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:34.760001 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:34.760577 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:34.762686 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:34.763394 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell0:SELECT=6 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:34.771196 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:34.771665 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:34.772514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:34.772964 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:34.919437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:34.927692 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-1ced14a4-4a5c-4bed-9217-e485860770e6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.171766 Jul 19 21:31:34.928311 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3774/7653] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:34 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:35.945865 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:35.947242 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:35.954418 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:35.954869 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:35.955640 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:35.956099 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:36.103993 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:36.114720 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-902479c0-7238-48a9-9f7d-07cffba768a5 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.172658 Jul 19 21:31:36.117143 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3880/7654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:35 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:37.003398 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-177e107d-9f42-4b49-ad98-4d0f847e1a70 req-43956e61-57e3-40af-9805-685873701825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:37.012400 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-177e107d-9f42-4b49-ad98-4d0f847e1a70 req-43956e61-57e3-40af-9805-685873701825 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:37.012857 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-177e107d-9f42-4b49-ad98-4d0f847e1a70 req-43956e61-57e3-40af-9805-685873701825 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:37.024386 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-177e107d-9f42-4b49-ad98-4d0f847e1a70 req-43956e61-57e3-40af-9805-685873701825 service nova] Creating event network-changed:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:31:37.030561 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-177e107d-9f42-4b49-ad98-4d0f847e1a70 req-43956e61-57e3-40af-9805-685873701825 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115572 Jul 19 21:31:37.031150 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3775/7655] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:31:37.137134 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:37.137871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:37.144964 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:37.145515 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:37.146373 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:37.146884 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:37.296722 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:37.305097 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-695f402d-1116-4aef-aaa0-3a97993aa297 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.171944 Jul 19 21:31:37.306321 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3881/7656] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:37 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:31:38.324208 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:38.325113 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:38.332873 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:38.333333 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:38.334114 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:38.334558 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:38.479317 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:38.487148 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-b7bdd237-125a-472c-8ede-2c01b9233ce1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.168157 Jul 19 21:31:38.487740 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3776/7657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:38 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:39.506071 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:39.506746 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:39.514560 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:39.515008 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:39.515789 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:39.516437 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:39.671117 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:39.678998 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-e94a6ab8-3fca-4629-bd0e-e175518a4df6 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.176990 Jul 19 21:31:39.679600 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3882/7658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:39 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:40.697227 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:40.697893 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:40.705776 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:40.706235 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:40.707043 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:40.707486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:40.860486 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:40.868578 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-44986e88-c40f-404a-aa3a-79c8952c4683 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.175380 Jul 19 21:31:40.869387 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3777/7659] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:40 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:41.886827 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:41.887456 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:41.894732 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:41.895183 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:41.895988 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:41.896424 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:42.036926 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:42.044920 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-6d7984fb-af94-4322-852d-55304bac0d10 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.162783 Jul 19 21:31:42.045512 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3883/7660] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:41 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:42.722817 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-1a9225b6-4f69-41c1-a5c0-9d205803dd5d req-81d41bb0-74c9-42d0-8e55-af35987ca73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "name": "network-vif-plugged", "status": "completed", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:42.732457 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a9225b6-4f69-41c1-a5c0-9d205803dd5d req-81d41bb0-74c9-42d0-8e55-af35987ca73f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:42.732957 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-1a9225b6-4f69-41c1-a5c0-9d205803dd5d req-81d41bb0-74c9-42d0-8e55-af35987ca73f service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:42.746748 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-1a9225b6-4f69-41c1-a5c0-9d205803dd5d req-81d41bb0-74c9-42d0-8e55-af35987ca73f service nova] Creating event network-vif-plugged:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:31:42.752208 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-1a9225b6-4f69-41c1-a5c0-9d205803dd5d req-81d41bb0-74c9-42d0-8e55-af35987ca73f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 Jul 19 21:31:42.753037 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3778/7661] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:31:43.062267 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:43.063110 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:43.071382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:43.072119 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:43.072935 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:43.073650 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:43.268211 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:43.275841 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-f8afb5cf-0f8b-4bb9-8db4-4f3c95de683e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.217443 Jul 19 21:31:43.276446 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3884/7662] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:43 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:44.295724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:44.296479 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:44.303112 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:44.303630 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:44.305432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:44.305432 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:44.511278 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:44.519192 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9729b315-9243-4303-97bb-41c1d03ffce3 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1375 microversion: 2.1 time: 0.230047 Jul 19 21:31:44.519801 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3779/7663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:44 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1375 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:45.536488 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:45.537032 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:45.539851 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=27 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:31:45.545371 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:45.545876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:45.546649 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:45.547093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:45.685113 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:45.693284 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-97abfaa8-200c-48e6-91c5-4912168b73fc tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1559 microversion: 2.1 time: 0.160813 Jul 19 21:31:45.693864 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3885/7664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:45 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:45.710572 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:31:45.711200 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:31:45.719267 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:45.719474 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:45.720307 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:45.720762 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:45.858609 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:31:45.866125 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-9ba56078-4dd0-421a-b69c-4b30541f3c1a tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1559 microversion: 2.1 time: 0.159415 Jul 19 21:31:45.866700 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3780/7665] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:31:45 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:31:47.582389 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-2ea72e53-7855-4531-9df4-c12f5bdde519 req-77eb65a5-aa0f-4f59-8f32-7e36b2033b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:31:47.593143 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2ea72e53-7855-4531-9df4-c12f5bdde519 req-77eb65a5-aa0f-4f59-8f32-7e36b2033b25 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:31:47.593876 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-2ea72e53-7855-4531-9df4-c12f5bdde519 req-77eb65a5-aa0f-4f59-8f32-7e36b2033b25 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:31:47.606620 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-2ea72e53-7855-4531-9df4-c12f5bdde519 req-77eb65a5-aa0f-4f59-8f32-7e36b2033b25 service nova] Creating event network-changed:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:31:47.612294 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-2ea72e53-7855-4531-9df4-c12f5bdde519 req-77eb65a5-aa0f-4f59-8f32-7e36b2033b25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035420 Jul 19 21:31:47.613301 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3886/7666] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:32:50.836496 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:32:50.837247 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:33:47.749475 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:33:47.750412 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:33:48.449709 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:33:48.449997 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:33:58.537230 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:33:58.537946 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:33:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:34:00.840622 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:00.841408 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=62 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:00.897529 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1013660257"}} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:00.898774 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:00.906028 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:00.906637 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:00.907901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:00.907901 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:01.225455 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-80ed8ab2-70ab-48cd-968e-ea5a8537c6ef tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "POST /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02/action" status: 202 len: 0 microversion: 2.1 time: 0.387139 Jul 19 21:34:01.226116 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3781/7667] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 19 21:34:00 2022] POST /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 21:34:09.470038 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=3 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:09.470821 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=68 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:09.475105 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "name": "network-vif-plugged", "status": "completed", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:09.485088 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:09.485618 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:09.497805 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] Creating event network-vif-plugged:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:34:09.500735 n-d-843861-3 devstack@n-api.service[126008]: ERROR oslo.messaging._drivers.impl_rabbit [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:34:10.508288 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] [b4216cf8-f5c6-4ebb-89c9-a74b235b28a0] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 38042. Jul 19 21:34:10.512226 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-81384bb7-ffb1-4d94-bfe2-cfc0bc4aa0e3 req-be7ef6fd-fbd3-4903-84c1-faf3ca4120aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044502 Jul 19 21:34:10.512844 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3887/7668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:34:22.407706 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:34:22.411027 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_api:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:22.411764 n-d-843861-3 devstack@n-api.service[126008]: DEBUG dbcounter [-] [126008] Writing DB stats nova_cell1:SELECT=2 {{(pid=126008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:22.414130 n-d-843861-3 devstack@n-api.service[126007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:34:22.414795 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_api:SELECT=2 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:22.415987 n-d-843861-3 devstack@n-api.service[126007]: DEBUG dbcounter [-] [126007] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:34:22.429727 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:22.430337 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:22.442099 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:22.442565 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:22.443547 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:22.444019 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:22.472916 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Going to try to terminate instance {{(pid=126007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:34:22.480206 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [req-08c378e2-6233-4673-b64c-a418e70b1cae req-c944374e-5b79-4a74-bf02-4b85e898f1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:22.489502 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08c378e2-6233-4673-b64c-a418e70b1cae req-c944374e-5b79-4a74-bf02-4b85e898f1fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:22.490072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [req-08c378e2-6233-4673-b64c-a418e70b1cae req-c944374e-5b79-4a74-bf02-4b85e898f1fc service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:22.502110 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.compute.server_external_events [req-08c378e2-6233-4673-b64c-a418e70b1cae req-c944374e-5b79-4a74-bf02-4b85e898f1fc service nova] Creating event network-changed:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:34:22.507708 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [req-08c378e2-6233-4673-b64c-a418e70b1cae req-c944374e-5b79-4a74-bf02-4b85e898f1fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098275 Jul 19 21:34:22.508759 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3888/7669] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:34:22.575722 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-993828b0-a03c-4af2-8f2c-3bdec53f0750 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 204 len: 0 microversion: 2.1 time: 0.167963 Jul 19 21:34:22.580118 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3782/7670] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:34:22 2022] DELETE /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:34:22.586072 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:22.586772 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:22.594388 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:22.595178 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:22.596717 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:22.600216 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:22.774855 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:34:22.782873 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-a81b8921-b72e-47fd-9dfb-c00c026dbd00 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1684 microversion: 2.1 time: 0.201299 Jul 19 21:34:22.783643 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3889/7671] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:22 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1684 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:34:23.802244 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:23.802874 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:23.812736 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:23.813205 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:23.813997 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:23.814446 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:23.821863 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b5e3203-af8e-4306-8ab8-db2a3776b42d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 38190. Jul 19 21:34:23.823220 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56ce3e5-5e89-4fe4-a5b0-41a54e34808b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 38192. Jul 19 21:34:23.971802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:34:23.980298 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-6a48bd17-8b1c-4c6e-a720-9430a5f88615 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1684 microversion: 2.1 time: 0.182294 Jul 19 21:34:23.980900 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3783/7672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:23 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:34:24.999654 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:25.000400 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:25.006752 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:25.007131 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:25.007941 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:25.008382 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:25.036022 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-55670954-782d-4671-bd33-5a17308bcdb4 req-eaf0e2a6-5e95-4ff6-8ab0-da392f8fb830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a627fea9-ee4a-464e-ade8-75f32da45a02", "name": "network-vif-deleted", "tag": "71c05648-a048-45cb-9f3d-8e96fc89268f"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:25.047410 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-55670954-782d-4671-bd33-5a17308bcdb4 req-eaf0e2a6-5e95-4ff6-8ab0-da392f8fb830 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:25.048042 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-55670954-782d-4671-bd33-5a17308bcdb4 req-eaf0e2a6-5e95-4ff6-8ab0-da392f8fb830 service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:25.061410 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-55670954-782d-4671-bd33-5a17308bcdb4 req-eaf0e2a6-5e95-4ff6-8ab0-da392f8fb830 service nova] Creating event network-vif-deleted:71c05648-a048-45cb-9f3d-8e96fc89268f for instance a627fea9-ee4a-464e-ade8-75f32da45a02 on n-h2-843861-3 Jul 19 21:34:25.066526 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-55670954-782d-4671-bd33-5a17308bcdb4 req-eaf0e2a6-5e95-4ff6-8ab0-da392f8fb830 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 Jul 19 21:34:25.067151 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3784/7673] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:34:25.079241 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:34:25.087019 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-39a122af-361f-430d-9ea2-16ad367139fe tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 200 len: 1497 microversion: 2.1 time: 0.091841 Jul 19 21:34:25.087591 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3890/7674] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:24 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 1497 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:34:26.106511 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:26.107210 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: a627fea9-ee4a-464e-ade8-75f32da45a02] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:26.113513 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:26.113972 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:26.114802 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:26.115392 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:26.129936 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.wsgi [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] HTTP exception thrown: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Request method failure captured: Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: request: GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 HTTP/1.1 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Accept: application/json Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Accept-Encoding: identity Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Connection: close Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Content-Length: 0 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Content-Type: application/json Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Host: 10.222.0.33 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: Openstack-System-Scope: None Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: User-Agent: python-urllib3/1.26.9 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Auth-Token: gAAAAABi1yIRKZ4B7RSu6WU52NwVNR4-i7O0nrlH4L4mQ4bztGH5pGMxLz3vGqjwd5z1MyT0WiKJtLLFEEqewpOBI6FFIfEuFXgBfoA5WyU965C73ZlwCd0VYl2IE2zWi9uxFGqFKN7KKtYEdeTYRPzioGZhx1ZGF9IxcRnARsQnK9-wdOrU2XQ Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Id: None Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Domain-Name: None Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Identity-Status: Confirmed Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Is-Admin-Project: True Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Id: default Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Domain-Name: Default Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Id: bc08c48159654200894f652941e1655a Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Project-Name: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Role: reader,member Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Roles: reader,member Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc08c48159654200894f652941e1655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc08c48159654200894f652941e1655a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc08c48159654200894f652941e1655a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc08c48159654200894f652941e1655a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Id: bc08c48159654200894f652941e1655a Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-Tenant-Name: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-User: tempest-TestSnapshotPattern-1954985217-project Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Id: default Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-User-Domain-Name: Default Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-User-Id: 4504eb825af64eb0b418708314168b28 Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: X-User-Name: tempest-TestSnapshotPattern-1954985217-project Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: method: > Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: exception: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: action_args: {'id': 'a627fea9-ee4a-464e-ade8-75f32da45a02'} Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:34:26.132830 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: ERROR nova.api.openstack.wsgi Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Returning 404 to user: Instance a627fea9-ee4a-464e-ade8-75f32da45a02 could not be found. {{(pid=126007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-10e89bd9-93c6-4a3b-8e60-c383fb37f1e4 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02" status: 404 len: 111 microversion: 2.1 time: 0.032282 Jul 19 21:34:26.139081 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3785/7675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:26 2022] GET /compute/v2.1/servers/a627fea9-ee4a-464e-ade8-75f32da45a02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:34:27.588952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:27.589693 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:27.591207 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-60ee2673-4e55-41fa-8c2c-be2b0ee92c6b req-9594df82-0eb6-4480-8fe6-64ed6bfe563e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:27.596883 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:27.597338 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:27.598585 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:27.598952 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:27.601779 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-60ee2673-4e55-41fa-8c2c-be2b0ee92c6b req-9594df82-0eb6-4480-8fe6-64ed6bfe563e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:27.603859 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-60ee2673-4e55-41fa-8c2c-be2b0ee92c6b req-9594df82-0eb6-4480-8fe6-64ed6bfe563e service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:27.615763 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-60ee2673-4e55-41fa-8c2c-be2b0ee92c6b req-9594df82-0eb6-4480-8fe6-64ed6bfe563e service nova] Creating event network-changed:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:34:27.622290 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-60ee2673-4e55-41fa-8c2c-be2b0ee92c6b req-9594df82-0eb6-4480-8fe6-64ed6bfe563e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Jul 19 21:34:27.623272 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3786/7676] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:34:27.629808 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Going to try to terminate instance {{(pid=126008) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:34:27.732872 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-c035226f-12ff-4bcd-87df-122ddcadc5b1 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 204 len: 0 microversion: 2.1 time: 0.147658 Jul 19 21:34:27.735981 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3891/7677] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 19 21:34:27 2022] DELETE /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:34:27.749033 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:27.751512 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.compute.api [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:27.760550 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:27.761437 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:27.762881 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:27.763514 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:27.938724 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.policy [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:34:27.947319 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-bab571f7-04c2-4344-b54e-f3652268b03e tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1682 microversion: 2.1 time: 0.205631 Jul 19 21:34:27.947968 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3787/7678] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:27 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:34:28.967540 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:28.968542 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:28.976932 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:28.977493 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:28.978431 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:28.978871 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:29.047379 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.policy [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4504eb825af64eb0b418708314168b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08c48159654200894f652941e1655a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126008) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:34:29.056131 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-ddda4b1d-36f5-4217-9a3b-25ba2d7aa250 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 200 len: 1497 microversion: 2.1 time: 0.093469 Jul 19 21:34:29.057144 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3892/7679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:28 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 1497 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:34:29.637809 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [req-5f15a389-c6e6-4099-84c3-f3052ae850c9 req-59281fbe-21a1-4fc2-a8ba-bb97b6700afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43388585-5a0f-4638-93af-7f242dc88509", "name": "network-vif-deleted", "tag": "be36b43c-c258-4e9a-b36a-11de489b5bf2"}]} {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:34:29.646760 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5f15a389-c6e6-4099-84c3-f3052ae850c9 req-59281fbe-21a1-4fc2-a8ba-bb97b6700afb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:29.647218 n-d-843861-3 devstack@n-api.service[126007]: DEBUG oslo_concurrency.lockutils [req-5f15a389-c6e6-4099-84c3-f3052ae850c9 req-59281fbe-21a1-4fc2-a8ba-bb97b6700afb service nova] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:29.658270 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.compute.server_external_events [req-5f15a389-c6e6-4099-84c3-f3052ae850c9 req-59281fbe-21a1-4fc2-a8ba-bb97b6700afb service nova] Creating event network-vif-deleted:be36b43c-c258-4e9a-b36a-11de489b5bf2 for instance 43388585-5a0f-4638-93af-7f242dc88509 on n-h1-843861-3 Jul 19 21:34:29.663078 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [req-5f15a389-c6e6-4099-84c3-f3052ae850c9 req-59281fbe-21a1-4fc2-a8ba-bb97b6700afb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 Jul 19 21:34:29.663675 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3788/7680] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 19 21:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:34:30.073484 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '>' {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:30.074093 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.compute.api [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] [instance: 43388585-5a0f-4638-93af-7f242dc88509] Fetching instance by UUID {{(pid=126008) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:34:30.081068 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:30.081514 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:30.082276 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:34:30.082707 n-d-843861-3 devstack@n-api.service[126008]: DEBUG oslo_concurrency.lockutils [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Lock "9f376e7e-4b8b-4ae3-95bf-5479c477f44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:34:30.096299 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.wsgi [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] HTTP exception thrown: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Request method failure captured: Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: request: GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 HTTP/1.1 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Accept: application/json Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Accept-Encoding: identity Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Connection: close Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Content-Length: 0 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Content-Type: application/json Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Host: 10.222.0.33 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: Openstack-System-Scope: None Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: User-Agent: python-urllib3/1.26.9 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Auth-Token: gAAAAABi1yIRKZ4B7RSu6WU52NwVNR4-i7O0nrlH4L4mQ4bztGH5pGMxLz3vGqjwd5z1MyT0WiKJtLLFEEqewpOBI6FFIfEuFXgBfoA5WyU965C73ZlwCd0VYl2IE2zWi9uxFGqFKN7KKtYEdeTYRPzioGZhx1ZGF9IxcRnARsQnK9-wdOrU2XQ Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Id: None Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Domain-Name: None Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Identity-Status: Confirmed Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Is-Admin-Project: True Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Id: default Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Domain-Name: Default Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Id: bc08c48159654200894f652941e1655a Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Project-Name: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Role: reader,member Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Roles: reader,member Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc08c48159654200894f652941e1655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc08c48159654200894f652941e1655a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc08c48159654200894f652941e1655a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc08c48159654200894f652941e1655a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Id: bc08c48159654200894f652941e1655a Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-Tenant-Name: tempest-TestSnapshotPattern-1954985217 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-User: tempest-TestSnapshotPattern-1954985217-project Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Id: default Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-User-Domain-Name: Default Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-User-Id: 4504eb825af64eb0b418708314168b28 Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: X-User-Name: tempest-TestSnapshotPattern-1954985217-project Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: method: > Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: exception: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: action_args: {'id': '43388585-5a0f-4638-93af-7f242dc88509'} Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: {{(pid=126008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:34:30.097923 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: ERROR nova.api.openstack.wsgi Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: DEBUG nova.api.openstack.wsgi [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Returning 404 to user: Instance 43388585-5a0f-4638-93af-7f242dc88509 could not be found. {{(pid=126008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: INFO nova.api.openstack.requestlog [None req-978473c0-082d-4ee8-b1f4-fb9624b2bc41 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jul 19 21:34:30.103298 n-d-843861-3 devstack@n-api.service[126008]: [pid: 126008|app: 0|req: 3893/7681] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 19 21:34:30 2022] GET /compute/v2.1/servers/43388585-5a0f-4638-93af-7f242dc88509 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:34:30.269195 n-d-843861-3 devstack@n-api.service[126007]: DEBUG nova.api.openstack.wsgi [None req-70975189-26ea-4c74-bbb5-5edc284cb772 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] Calling method '.version_select at 0x7fb88c0955e0>' {{(pid=126007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:34:30.293299 n-d-843861-3 devstack@n-api.service[126007]: INFO nova.api.openstack.requestlog [None req-70975189-26ea-4c74-bbb5-5edc284cb772 tempest-TestSnapshotPattern-1954985217 tempest-TestSnapshotPattern-1954985217-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1087832071" status: 202 len: 0 microversion: 2.1 time: 0.027876 Jul 19 21:34:30.293866 n-d-843861-3 devstack@n-api.service[126007]: [pid: 126007|app: 0|req: 3789/7682] 10.222.0.33 () {58 vars in 1256 bytes} [Tue Jul 19 21:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1087832071 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:36:10.847072 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:36:10.847780 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:36:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:37:07.760876 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:37:07.761511 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:37:08.459451 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:37:08.459692 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:37:18.546987 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:37:18.547609 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:37:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:37:25.285797 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:37:25.286411 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:37:36.381285 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:37:36.381861 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:37:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:39:30.857046 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:39:30.858271 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:39:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:40:27.769322 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:40:27.769995 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:40:28.468632 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:40:28.468938 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:40:38.555835 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:40:38.556444 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:40:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:40:45.294589 n-d-843861-3 devstack@n-api.service[126007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:40:45.295149 n-d-843861-3 devstack@n-api.service[126007]: Tue Jul 19 21:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:40:56.394010 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:40:56.394655 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:40:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:42:50.866206 n-d-843861-3 devstack@n-api.service[126008]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:42:50.866960 n-d-843861-3 devstack@n-api.service[126008]: Tue Jul 19 21:42:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!